scrapling

Name: scrapling
Availability: InStock
Author: plaidmustache

Fetch and crawl website data using HTTP, Dynamic, and Stealth modes.

Updated May 4, 2026

Search Tags:#python #cloudflare #web-scraping #browser-automation #spider #stealth

Ready to run

npx skills add https://github.com/Plaidmustache/hermes-nulab --skill scrapling-plaidmustache

💬 Prompt for ChatGPT / Claude Chat▼

Please help me install this Agent Skill.
Skill: scrapling
Source: https://github.com/Plaidmustache/hermes-nulab/tree/main/optional-skills/research/scrapling
Command: npx skills add https://github.com/Plaidmustache/hermes-nulab --skill scrapling-plaidmustache

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Scrapling provides a unified framework to extract data from websites while handling anti-bot measures and multi-page crawling.

Core Features & Use Cases

HTTP, dynamic JS, and stealth fetching strategies for flexible data retrieval.
Spider framework for multi-page crawling with link following.
Cloudflare bypass and stealth browser automation to access protected sites.
Python and CLI interfaces for easy integration into data pipelines.

Quick Start

Install Scrapling and run a simple spider against your target to start extracting data.

Frequently Asked Questions about scrapling

High-intent search queries and answers about installing and using this skill.

FAQPage Schema

How do I scrape data from a website protected by Cloudflare anti-bot measures?▼

To scrape data from Cloudflare-protected sites, use stealth browser automation to bypass anti-bot checks and extract content. This approach fetches JS-rendered pages by mimicking human browsing behavior, accessing protected sites without triggering blocks.

Can I crawl multiple pages and follow links automatically with Python?▼

Yes, you can crawl multiple pages and follow links automatically using a spider framework in Python. It handles multi-page crawling by fetching data across linked pages, extracting content and URLs through HTTP or dynamic modes for comprehensive data collection.

What is the best way to extract content from JavaScript-rendered web pages?▼

The best way to extract content from JavaScript-rendered pages is using dynamic fetching strategies. This executes JS on the target page, retrieving dynamically loaded content that static HTTP requests miss, ensuring accurate data extraction from modern web applications.

Does web scraping with stealth browser automation require specific Python versions?▼

Yes, stealth web scraping requires Python 3.10 or higher. You also need the Scrapling package installed with its browser extensions to run the CLI or Python APIs for fetching data and bypassing anti-bot protections.

When should I use HTTP mode versus stealth mode for fetching web data?▼

Use HTTP mode for static HTML pages where speed is critical, and switch to stealth mode when facing anti-bot protections or needing to render JavaScript. Stealth fetching mimics browser behavior to access protected sites, while HTTP fetches raw content directly.

Why does my spider framework fail to extract data from protected sites?▼

Spider frameworks fail to extract data from protected sites when anti-bot measures block standard HTTP requests. Switching to stealth browser automation bypasses these protections by rendering pages in a controlled browser environment, successfully retrieving the blocked content.