Skills
.Work. You
Rest

autocli-web-scraping

Official

Scrape 55+ sites in one blazing-fast CLI.

Data & Analytics#browser automation#web scraping#json output#cli automation#social media data#adapter generation#multi-site data collection
AuthorAradotso
Version1.0.0
Installs0

System Documentation

What problem does it solve?

You need quick, repeatable access to trending and structured data across many websites, but manual browsing and custom scraping scripts are slow, brittle, and hard to maintain.

Core Features & Use Cases

  • One-command web data fetching: Pull information from 55+ supported sites (Twitter/X, Reddit, YouTube, Bilibili, Zhihu, Xiaohongshu, and more) using a single Rust-based CLI.
  • Public APIs and browser automation: Use fast public commands without a browser for supported sites, and enable extension-based browser commands when the content requires an authenticated session.
  • AI-powered adapter generation: Generate and share custom site adapters with autocli.ai for scraping new or hard-to-access pages via declarative YAML pipelines.
  • Multi-format outputs: Emit results as table, JSON, YAML, CSV, or Markdown to integrate with downstream tooling.

Quick Start

Run autocli twitter trending to fetch current Twitter/X trending topics from the supported dataset.

Dependency Matrix

Required Modules

None required

Components

Standard package

💻 Claude Code Installation

Recommended: Let Claude install automatically. Simply copy and paste the text below to Claude Code.

Please help me install this Skill:
Name: autocli-web-scraping
Download link: https://github.com/Aradotso/devtools-skills/archive/main.zip#autocli-web-scraping

Please download this .zip file, extract it, and install it in the .claude/skills/ directory.
View Source Repository

Agent Skills Search Helper

Install a tiny helper to your Agent, search and equip skill from 471,000+ vetted skills library on demand.