twitter-crawler

Crawl tweets from a specified user into Markdown and JSON files.

76|6|Updated Mar 12, 2026
One-click install
npx skills add https://github.com/bozhouDev/bozhou-skills --skill twitter-crawler-bozhoudev
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: twitter-crawler
Source: https://github.com/bozhouDev/bozhou-skills/tree/main/twitter-crawler
Command: npx skills add https://github.com/bozhouDev/bozhou-skills --skill twitter-crawler-bozhoudev

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires tweety, pyyaml, and includes scripts (resource) components.

What problem does it solve?

Automates collecting a Twitter user's tweets and exporting them to Markdown (and optional JSON) for easy archiving and analysis.

Core Features & Use Cases

  • Fetch tweets for a given user and output Markdown reports.
  • Support pagination, per-user limits, and selectable fields (text, time, likes, retweets, replies, views, media).
  • Output options include Markdown files and optional JSON exports for data pipelines.

Quick Start

Run python3 scripts/fetch_tweets.py <username> to generate a Markdown file containing the user's tweets.

Frequently Asked Questions about twitter-crawler

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I crawl tweets from a specific Twitter user into Markdown?

To crawl tweets into Markdown, run python3 scripts/fetch_tweets.py with the target username. This fetches the user's tweets and automatically generates a Markdown file for easy archiving and analysis.

Can I export Twitter data to JSON instead of Markdown?

Yes, you can export Twitter data to JSON. The crawler supports optional JSON exports alongside Markdown files, allowing you to feed the collected tweet data directly into downstream data pipelines.

What tweet fields can I select when crawling a user's timeline?

When crawling a user's timeline, you can select specific tweet fields including text, time, likes, retweets, replies, views, and media. This configurable selection helps tailor the Markdown and JSON outputs to your needs.

Does the Twitter crawler support pagination and limits for large accounts?

Yes, the Twitter crawler supports configurable limits and pagination. This allows you to control the volume of tweets fetched from large accounts and manage rate limiting during data collection workflows.

Do I need an auth_token to crawl tweets with tweety?

You can use an auth_token to crawl tweets with tweety, and the script includes a fallback to the trend-crawler config. This mechanism helps maintain authentication for lightweight social data collection.