skills.rest
matlee0409
matlee0409COMMUNITY
Explore all skills by this author →
GitHub

scrapling

Extract data from websites using HTTP, JS rendering, and stealth modes.

Updated Aug 23, 2026
Search Tags:#python#data-extraction#web-scraping#browser-automation#spider#cloudflare-bypass
One-click install
npx skills add https://github.com/matlee0409/cronus --skill scrapling-matlee0409
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: scrapling
Source: https://github.com/matlee0409/cronus/tree/main/optional-skills/research/scrapling
Command: npx skills add https://github.com/matlee0409/cronus --skill scrapling-matlee0409

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Web scraping is often blocked by Cloudflare, dynamic content, and anti-bot defenses. Scrapling provides a unified framework to fetch data using HTTP, dynamic JS rendering, stealth modes, and a spider you can script for multi-page crawls.

Core Features & Use Cases

  • Three fetching strategies: HTTP, dynamic JS rendering, and stealth/bypass for protected sites.
  • Spider framework for multi-page crawling and data extraction.
  • CLI and Python library for integration into data pipelines and research workflows.
  • Useful for research, competitive intelligence, and automated data collection at scale.

Quick Start

Install Scrapling and run a simple spider to fetch and extract data from a target website.

Frequently Asked Questions about scrapling

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I scrape data from a website protected by Cloudflare and anti-bot defenses?▼

Web scraping Cloudflare-protected sites requires stealth fetching strategies to bypass anti-bot defenses. This framework provides dedicated stealth modes and dynamic JS rendering to retrieve data from protected targets automatically.

What is the best way to crawl JavaScript-rendered web pages at scale?▼

Crawling JS-rendered pages requires dynamic content rendering to load page data. This tool applies a spider framework and dynamic JS rendering to extract data from diverse sites across large-scale automated crawls.

Can I integrate web scraping into my existing Python data pipelines?▼

Python web scraping integration is supported through a dedicated Python library and CLI. You can script multi-page crawls and fetch data using HTTP or stealth modes directly within research workflows and automated data pipelines.

Does this scraping tool support both simple HTTP requests and dynamic browser automation?▼

HTTP requests and dynamic browser automation are both supported fetching strategies. You can choose standard HTTP fetching, dynamic JS rendering, or stealth bypass modes depending on the target site's complexity and defenses.

How do I extract data from multiple pages using a web spider script?▼

Multi-page data extraction is handled through the built-in spider framework. You script the spider to navigate and extract data across multiple pages, enabling automated data collection and competitive intelligence gathering.

When should I use stealth mode over dynamic JS rendering for web scraping?▼

Stealth mode web scraping is necessary when sites have active anti-bot defenses like Cloudflare protection. Dynamic JS rendering is sufficient for loading JavaScript-generated content on sites without aggressive bot detection.

Related Skills

Explore More Data & Analytics Skills→
nicoarbelaeznicoarbelaez

python-executor

Execute Python code in a sandboxed environment with pre-installed libraries.

Community
Intermediate
xberg-ioxberg-io
26

extracting-metadata

Extract titles, descriptions, language, and Open Graph tags from HTML documents.

Official
Intermediate
PlaidmustachePlaidmustache

scrapling

Fetch and crawl website data using HTTP, Dynamic, and Stealth modes.

Community
Intermediate
superfhpsuperfhp

scrapling

Extract website data using HTTP requests, stealth browser automation, and spider crawling.

Community
Intermediate