skills.rest
wulaosiji
wulaosijiCOMMUNITY
Explore all skills by this author →
WebsiteGitHub

twitter-scraper

Scrapes Twitter user timelines and metadata into structured JSON.

28|13|Updated Feb 27, 2026
Search Tags:#automation#social media#data collection#twitter#scraper#x
One-click install
npx skills add https://github.com/wulaosiji/skills --skill twitter-scraper-wulaosiji
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: twitter-scraper
Source: https://github.com/wulaosiji/skills/tree/main/twitter-scraper
Command: npx skills add https://github.com/wulaosiji/skills --skill twitter-scraper-wulaosiji

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes scripts (resource) and references (resource) components.

What problem does it solve?

This Skill automates the process of scraping public tweets from Twitter/X, overcoming the limitations of direct API access or manual browsing.

Core Features & Use Cases

  • Scrape User Tweets: Fetch the latest tweets from any public Twitter/X account.
  • Batch Scraping: Efficiently gather tweets from multiple users simultaneously.
  • Data Formatting: Output tweets in a structured JSON format, suitable for analysis or reporting.
  • Use Case: A market researcher needs to track public sentiment around a new product launch by monitoring tweets from key influencers and the company's official account. This Skill can gather all relevant tweets for analysis.

Quick Start

Use the twitter-scraper skill to get the latest 10 tweets from the user 'openai'.

Frequently Asked Questions about twitter-scraper

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I scrape public tweets from Twitter/X profiles for market research?▼

To scrape public tweets from Twitter/X profiles, you can use browser automation to fetch user timelines and engagement data, outputting structured JSON for analysis. This automates data collection without direct API access.

Can I batch scrape multiple Twitter accounts simultaneously?▼

Yes, you can batch scrape multiple Twitter accounts simultaneously. The Skill supports fetching individual user timelines and batch processing, efficiently gathering public tweets from several users at once into structured JSON.

Does scraping Twitter via browser emulation require API access?▼

Scraping Twitter via browser emulation does not require direct API access. It interacts with web pages through xcancel.com to parse dynamic content, overcoming API limitations and manual browsing restrictions to fetch public tweets.

What format is the scraped Twitter data outputted in?▼

The scraped Twitter data is outputted in structured JSON format. This makes the collected tweets and associated engagement data suitable for downstream analysis, reporting, or integration into other data processing pipelines.

What is the best way to track public sentiment on Twitter without an API key?▼

The best way to track public sentiment on Twitter without an API key is using browser automation to scrape public timelines. This gathers relevant tweets from key influencers and official accounts into structured JSON for analysis.

Are there limitations when scraping tweets from private Twitter/X accounts?▼

Yes, a key limitation is that this approach only scrapes public tweets from Twitter/X profiles. It relies on accessing public timelines via browser emulation and cannot fetch data from private or protected accounts.

Related Skills

Explore More Marketing & Sales Skills→
haiweiliuhaiweiliu

Proxy Management

Configure PyProxy proxies with sticky or random IP modes for Playwright scraping.

Community
Intermediate
RheasilviaRheasilvia

polymarket

Retrieve real-time Polymarket prices, orderbooks, and historical trends via REST APIs.

Community
Intermediate
gitroomhqgitroomhq
402

postiz-cli

Create, schedule, and post social media content via the Postiz API.

Official
Advanced
luis2404123luis2404123

social-media-scraper

Scrapes social media profiles, posts, engagement metrics, follower data and hashtags from major platforms using browser automation and residential proxies.

Community
Advanced