Skills
.Work. You
Rest

scraping-websites

Community

Effortlessly scrape sites, crawl docs, and extract web data.

Data & Analytics#firecrawl#web scraping#web data#javascript rendering#site crawling#url mapping#structured data extraction
Authorroach88
Version1.0.0
Installs0

System Documentation

What problem does it solve?

This Skill eliminates the manual effort of collecting web content from static and JavaScript-rendered sites, and extracting structured data from web pages without writing custom scraping code.

Core Features & Use Cases

  • Full Site Crawling & Single-Page Scraping: Collect content from entire websites or individual URLs, with support for JavaScript-rendered pages.
  • URL Mapping & Structured Extraction: Discover all pages on a site via sitemap generation, and extract targeted structured data using LLM-powered schemas.
  • Use Case: For example, you can crawl a product documentation site to build a local searchable knowledge base, or extract product pricing and details from an e-commerce store's pages into structured JSON for analysis.

Quick Start

Use the scraping-websites skill to crawl the public API documentation at https://docs.example.com, limit the crawl to 50 pages, and save all main content to a local JSON file.

Dependency Matrix

Required Modules

None required

Components

Standard package

💻 Claude Code Installation

Recommended: Let Claude install automatically. Simply copy and paste the text below to Claude Code.

Please help me install this Skill:
Name: scraping-websites
Download link: https://github.com/roach88/claude-config/archive/main.zip#scraping-websites

Please download this .zip file, extract it, and install it in the .claude/skills/ directory.
View Source Repository

Agent Skills Search Helper

Install a tiny helper to your Agent, search and equip skill from 536,000+ vetted skills library on demand.