What problem does it solve?
X/Twitter blocks most automated access behind login walls, paid APIs, and internal GraphQL endpoints, making it hard to gather auditable public post data for voice-of-customer research. This Skill collects visible posts through the user's own logged-in Chrome session and normalizes them into a consistent, auditable JSONL dataset.
Core Features & Use Cases
- Deterministic Query Planning: Builds a validated request plan from a TSV of queries with language, round, row cap, and sort mode, generating encoded X search URLs.
- Visible-DOM Collection: Extracts post text, Tweet IDs, canonical URLs, timestamps, author handles, and engagement labels using a fixed selector contract, with scroll-loop checkpointing and per-query source packages.
- Normalization and Audit: Merges per-query packages, deduplicates by Tweet ID, parses engagement metrics, matches keywords, and emits a summary with missing-data and failure counts.
- Use Case: A researcher running multilingual VOC analysis prepares queries in English and Japanese, collects up to 250 posts per query from the Latest tab, and receives a deduplicated JSONL corpus plus an audit summary for downstream reporting.
Quick Start
Use bggg-data-x to search X in my logged-in Chrome for these keyword queries and save the collected posts as normalized JSONL with an audit summary.