web-scraping-pro

Community

Scrape protected sites with smart fallbacks

AuthorZedit42
Version1.0.0
Installs0

System Documentation

What problem does it solve?

This Skill helps you extract content from websites that block normal requests or rely heavily on JavaScript, so you can retrieve usable page data instead of errors or empty HTML.

Core Features & Use Cases

  • Protected-site scraping: Handles Cloudflare and other bot protections with fallback scraping methods.
  • JavaScript-rendered pages: Captures content from modern single-page apps and dynamic sites.
  • Structured extraction: Pulls clean markdown, HTML, text, tables, lists, or selector-targeted content for research and automation workflows.

Quick Start

Use the web-scraping-pro skill to fetch a blocked or dynamic URL, starting with Jina Reader and falling back to Crawl4AI when needed.

Dependency Matrix

Required Modules

crawl4ai

Components

scripts

💻 Claude Code Installation

Recommended: Let Claude install automatically. Simply copy and paste the text below to Claude Code.

Please help me install this Skill:
Name: web-scraping-pro
Download link: https://github.com/Zedit42/clawdbot-skills/archive/main.zip#web-scraping-pro

Please download this .zip file, extract it, and install it in the .claude/skills/ directory.
View Source Repository

Agent Skills Search Helper

Install a tiny helper to your Agent, search and equip skill from 537,000+ vetted skills library on demand.