skills.rest
aj47
aj47COMMUNITY
Explore all skills by this author →
Website𝕏@techfrenAJGitHub

x-twitter-scraper

Scrape X/Twitter profiles and feed tabs via CDP-connected Chrome.

1|Updated Dec 24, 2025
Search Tags:#automation#twitter#cdp#tweet#web-scraping#scrape#x
One-click install
npx skills add https://github.com/aj47/agent-skills --skill x-twitter-scraper
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: x-twitter-scraper
Source: https://github.com/aj47/agent-skills/tree/main/x-twitter-scraper
Command: npx skills add https://github.com/aj47/agent-skills --skill x-twitter-scraper

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Scrapes X/Twitter content from profiles and feed tabs to collect tweets and metadata.

Core Features & Use Cases

  • CDP-connected scraping against a logged-in Chrome session
  • Supports Following and For You tabs as well as individual profiles
  • Exports structured data fields such as user, text, time, and link for downstream analysis

Quick Start

Open a logged-in Chrome session and run the agent-browser workflow to navigate to the target profile or feed and start scraping.

Frequently Asked Questions about x-twitter-scraper

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I scrape tweets from a specific Twitter profile?▼

To scrape tweets from a Twitter profile, the Skill uses a connected Chrome session via CDP to navigate the target page and extract structured data like user, text, time, and link. You need a logged-in Chrome session running on port 9222.

Can I scrape content from the Twitter Following and For You feeds?▼

Yes, you can scrape Twitter feed content from both the Following and For You tabs. The Skill uses agent-browser commands to extract tweets and metadata from these feed tabs alongside individual profile scraping.

Do I need a CDP connection to scrape Twitter content?▼

Yes, scraping Twitter content requires a CDP-connected Chrome session on port 9222. This approach ensures the agent-browser commands can interact with your logged-in session to navigate and extract data reliably.

What data fields do I get when scraping X tweets?▼

Scraping X tweets exports structured data fields including the user, tweet text, timestamp, and link. This structured output allows you to directly collect tweets and metadata for downstream analysis.

How does web scraping a logged-in Chrome session work for Twitter?▼

Web scraping a logged-in Chrome session works by connecting to Chrome via the CDP protocol on port 9222. The agent-browser workflow then navigates to the target Twitter profile or feed to extract and output structured tweet data.

What is the best way to automate tweet harvesting from X profiles?▼

The best way to automate tweet harvesting from X profiles is using an agent-browser workflow against a CDP-connected Chrome session. This method extracts structured tweet data directly from your logged-in browser environment.

Related Skills

Explore More Content & Communication Skills→
GraffiohGraffioh

web-browser

Automate Chrome browser interactions via the Chrome DevTools Protocol.

Community
Advanced
42atom42atom

twitter-media

Extract tweet text, author, and media from Twitter/X URLs via fxTwitter API.

Community
Intermediate
Arno37Arno37

agent-browser

Automate browser navigation, element interaction, and data extraction via commands.

Community
Advanced
BirdywenBirdywen
1

browser-scripting

Execute cross-tab JavaScript to control browser tabs and extract page data.

Community
Basic