scrapling

Fetch static and JavaScript-rendered pages with anti-bot methods and CSS/XPath extraction.

4|Updated May 18, 2026

Search Tags:#data extraction #web scraping #cloudflare bypass #stealth browser #python cli #spider crawling

Ready to run

npx skills add https://github.com/ZardLi1115/zedclaw --skill scrapling-zardli1115

💬 Prompt for ChatGPT / Claude Chat▼

Please help me install this Agent Skill.
Skill: scrapling
Source: https://github.com/ZardLi1115/zedclaw/tree/main/optional-skills/research/scrapling
Command: npx skills add https://github.com/ZardLi1115/zedclaw --skill scrapling-zardli1115

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

This Skill solves the problem of retrieving web content from sites that use dynamic rendering and anti-bot protections, without getting blocked or missing JavaScript-loaded data.

Core Features & Use Cases

HTTP and API scraping: Fetch static HTML or JSON endpoints quickly and extract fields via CSS/XPath.
Dynamic JS-rendered scraping: Use a real browser flow for SPAs and pages that require JavaScript execution.
Stealth and anti-bot/Cloudflare handling: Apply stealth headers and Cloudflare/bot challenge solving for protected pages, plus spider-style crawling across multiple links.

Quick Start

Install Scrapping with browser capabilities and then run an extraction command to save the scraped output to a file for a target URL.

Frequently Asked Questions about scrapling

High-intent search queries and answers about installing and using this skill.

FAQPage Schema

How do I scrape JavaScript-rendered pages without getting blocked?▼

To scrape JavaScript-rendered pages without blocks, use a stealth browser method that executes dynamic JS while applying anti-bot aware headers. This retrieves fully loaded content from single-page applications without triggering detection.

Can I bypass Cloudflare challenges during web scraping?▼

Yes, you can bypass Cloudflare challenges during web scraping by applying stealth headers and bot challenge solving. This allows protected-site scraping by fetching content that typically blocks automated requests.

How do I extract data using CSS and XPath from fetched HTML?▼

You can extract data using CSS and XPath by fetching static HTML or JSON endpoints and targeting specific fields. This works for single-page extraction and API POST retrieval to capture structured data.

What is the best way to crawl multiple pages in a research workflow?▼

The best way to crawl multiple pages in research workflows is using spider-style crawling across links. This multi-page crawl workflow retrieves connected content and outputs the scraped data in multiple formats.

Does this web scraping tool offer both a command line and Python interface?▼

Yes, this web scraping tool satisfies the need for both CLI and Python interfaces. You can run extraction commands directly from the command line or integrate the fetching logic into Python automation scripts.

When should I use a dynamic fetcher instead of a static HTTP request for scraping?▼

Use a dynamic fetcher instead of static HTTP requests when scraping SPAs or pages requiring JavaScript execution. Static HTTP is faster for simple HTML, but dynamic fetchers capture JavaScript-loaded data using real browser flows.