scrapling

Fetch and structure web data with anti-bot bypass strategies.

2|Updated Apr 25, 2026

Search Tags:#python #cli #cloudflare #web-scraping #browser-automation #spider #anti-bot

Ready to run

npx skills add https://github.com/AlexiosBluffMara/mercury --skill scrapling-alexiosbluffmara

💬 Prompt for ChatGPT / Claude Chat▼

Please help me install this Agent Skill.
Skill: scrapling
Source: https://github.com/AlexiosBluffMara/mercury/tree/main/optional-skills/research/scrapling
Command: npx skills add https://github.com/AlexiosBluffMara/mercury --skill scrapling-alexiosbluffmara

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Scrapling provides a web scraping framework that combines anti-bot bypass, stealth browser automation, and a spider framework to fetch and organize data from diverse sites.

Core Features & Use Cases

HTTP, Dynamic JS rendering, and Stealth fetching strategies for data extraction
Built-in spider framework for multi-page crawling and link following
CLI and Python API for flexible integration into automation pipelines
Bypass Cloudflare-like protections with configurable fetchers and robust error handling
Outputs data in structured formats suitable for downstream analytics and storage

Quick Start

Install Scrapling and run a fetch against a target URL to extract data and save it locally.

Frequently Asked Questions about scrapling

High-intent search queries and answers about installing and using this skill.

FAQPage Schema

How do I scrape data from a Cloudflare-protected website?▼

To scrape data from a Cloudflare-protected website, you use stealth fetching strategies that bypass anti-bot measures. The framework automates browser interactions to retrieve and structure content from protected pages without being blocked.

What's the best way to extract content from JavaScript-rendered web pages?▼

Extracting content from JavaScript-rendered web pages requires dynamic fetching strategies. The tool executes JavaScript via browser automation to load page content fully, then parses the resulting HTML for structured data extraction.

Can I crawl multiple pages and follow links using a spider framework in Python?▼

Yes, you can crawl multiple pages and follow links using a built-in spider framework in Python. It orchestrates multi-page crawling, processes targets sequentially, and exports consolidated data into structured formats for storage.

How do I integrate web scraping into an automation pipeline using a CLI?▼

You integrate web scraping into an automation pipeline using the provided CLI or Python API. You configure fetchers against target URLs, execute data extraction, and export structured results directly to downstream systems.

Does this web scraping tool work on both static HTML and dynamic content?▼

Yes, this web scraping tool works on both static HTML and dynamic content. It offers configurable HTTP, dynamic JS rendering, and stealth fetching strategies to extract data from diverse sites effectively.

Why does my web scraper fail with anti-bot blocks on dynamic pages?▼

Web scrapers fail with anti-bot blocks on dynamic pages due to missing stealth configurations. Using a fetching strategy that mimics human browser automation bypasses these protections and handles errors robustly during extraction.