scrapling

Bypass anti-bot protections and crawl multi-page sites via CLI and Python.

Updated Aug 23, 2026

Search Tags:#python #cli #web-scraping #browser-automation #spider #scraping-framework #cloudflare-bypass

Ready to run

npx skills add https://github.com/objval/hermes-agent --skill scrapling-objval

💬 Prompt for ChatGPT / Claude Chat▼

Please help me install this Agent Skill.
Skill: scrapling
Source: https://github.com/objval/hermes-agent/tree/main/optional-skills/research/scrapling
Command: npx skills add https://github.com/objval/hermes-agent --skill scrapling-objval

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Web scraping often hits anti-bot barriers, handles dynamic JS-rendered pages, and requires building robust crawlers across multiple pages. Scrapling unifies HTTP, dynamic rendering, and stealth capabilities into a single framework with a CLI and Python API.

Core Features & Use Cases

HTTP, Dynamic, and Stealth Fetchers: Fetch static pages, render JS apps, and bypass bot protections.
Spider Framework: Build and run multi-page crawlers with link following.
CLI + Python API: Orchestrate scrapes from the command line or embed in Python scripts.

Quick Start

Install Scrapling and run scrapling to fetch data from a target site.

Frequently Asked Questions about scrapling

High-intent search queries and answers about installing and using this skill.

FAQPage Schema

How do I bypass Cloudflare anti-bot protection when web scraping?▼

Bypassing Cloudflare anti-bot protection during web scraping requires a stealth fetcher to render dynamic pages while mimicking legitimate traffic. This framework provides built-in stealth capabilities to fetch data from protected sites.

What is the best way to scrape JavaScript-rendered web pages with Python?▼

Scraping JavaScript-rendered web pages with Python requires a dynamic fetcher to execute scripts and extract loaded HTML. This framework supports dynamic rendering to capture content generated by JS applications.

How do I build a multi-page spider crawler in Python?▼

Building a multi-page spider crawler in Python involves using a framework that supports link following to navigate pages automatically. This tool provides a dedicated spider framework to orchestrate crawls and extract data sequentially.

Can I run web scraping tasks from the command line?▼

Running web scraping tasks from the command line is supported via the CLI, allowing you to orchestrate fetches and execute spider crawls directly without writing Python scripts. It handles HTTP, dynamic, and stealth fetches.

Do I need Python installed to use this web scraping framework?▼

You need Python installed to use this web scraping framework, as it provides both a Python API for embedding in scripts and a CLI for command-line execution. The package requires a Python environment to function.