skills.rest
nirholas
nirholasCOMMUNITY
Explore all skills by this author →
Website𝕏@nichxbtGitHub

twitter-scraping

Scrape X/Twitter profiles, followers, tweets, and media without API access.

443|88|Updated Feb 18, 2024
Search Tags:#automation#twitter#puppeteer#scraping#data-extraction#web-scraping#csv-json
One-click install
npx skills add https://github.com/nirholas/XActions --skill twitter-scraping
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: twitter-scraping
Source: https://github.com/nirholas/XActions/tree/main/skills/twitter-scraping
Command: npx skills add https://github.com/nirholas/XActions --skill twitter-scraping

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes references (resource) components.

What problem does it solve?

Scrapes X/Twitter data without API access, enabling researchers and developers to collect profiles, followers, tweets, media, and more for analysis.

Core Features & Use Cases

  • Node.js Scraper API: Programmatic access to scraping functions via xactions library to retrieve profile data, followers, following, tweets, and more. Use cases include collecting data for analytics, archiving public content, and building datasets.
  • Browser Console Scripts: Standalone IIFEs to run in DevTools for quick ad-hoc scraping without npm or Node setup.
  • MCP Scraping Tools: Expose scraping capabilities as MCP tools for AI agents.

Quick Start

Install xactions, authenticate via loginWithCookie, and run scrapeProfile(page, 'username') to fetch profile data.

Frequently Asked Questions about twitter-scraping

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I scrape Twitter data without API access?▼

This skill enables Twitter scraping without API access by using Node.js, Puppeteer, and browser-console scripts to collect profiles, followers, and tweets. It provides a programmatic scraper API and standalone DevTools scripts for data extraction.

Can I scrape Twitter followers and tweets using Puppeteer?▼

Yes, you can scrape Twitter followers and tweets using Puppeteer. The Node.js scraper API utilizes the xactions library to programmatically retrieve profile data, followers, following lists, and tweet histories for dataset building.

What is the best way to extract Twitter data to CSV or JSON for analytics?▼

The best way to extract Twitter data to CSV or JSON is using a Node.js scraping API to collect profiles and tweets. This approach allows you to build structured datasets for analytics, archiving, or programmatic data collection.

Do I need Node.js to run web scraping scripts for Twitter?▼

No, you do not need Node.js to run web scraping scripts for Twitter. The skill includes standalone browser console scripts (IIFEs) that run directly in DevTools for quick, ad-hoc scraping without requiring any npm or Node setup.

How do I authenticate a Puppeteer Twitter scraper to access private profile data?▼

You authenticate a Puppeteer Twitter scraper by using the loginWithCookie function provided by the xactions library. This allows your scraping script to securely access profile data, followers, and tweets as a logged-in user.

Can I expose Twitter scraping capabilities as MCP tools for AI agents?▼

Yes, you can expose Twitter scraping capabilities as MCP tools for AI agents. The skill includes MCP tooling support with a frontmatter-driven metadata structure, enabling AI agents to programmatically utilize scraping functions.

Related Skills

Explore More Software Engineering Skills→
johnlindquistjohnlindquist
24

chrome

Automate browser interactions for web testing and data extraction with Puppeteer or Playwright.

Community
Advanced
eddmanneddmann
2

twitter

Fetch X/Twitter timelines and bookmarks via Playwright with session cookies.

Community
Intermediate
nirholasnirholas
443

xactions-cli

Scrape X/Twitter data and generate MCP server configurations via Node.js CLI.

Community
Intermediate
luis2404123luis2404123

social-media-scraper

Scrapes social media profiles, posts, engagement metrics, follower data and hashtags from major platforms using browser automation and residential proxies.

Community
Advanced