twitter-x-scraping

What problem does it solve?

This Skill eliminates the barrier of requiring a paid Twitter API key to collect public X/Twitter timeline and list data, making social media data accessible for research, analysis, and development use cases without incurring high API costs.

Core Features & Use Cases

• No-API Scraping: Collects public tweets from X profiles and lists via open-source Nitter mirrors, no official API credentials required.
• Anti-Bot Resilience: Automatically falls back from plain HTTP requests to headed Playwright browser sessions when encountering anti-bot challenges, with exponential backoff retries for rate-limited responses.
• Efficient Pagination: Uses cursor-based pagination with date-bound stopping to avoid unnecessary fetches, and automatically skips pinned posts to ensure accurate date cutoffs.
• Use Case: A market researcher can use this Skill to gather all public tweets from a competitor's account over a 6-month period to analyze product sentiment and feature mentions.

Quick Start

Use the twitter-x-scraping skill to collect all public tweets from the X list with ID 1585430245762441216 published between April 1 and April 15, 2026, and save the parsed results to a local JSON file.