skills.rest
Z43L
Z43LCOMMUNITY
Explore all skills by this author →
GitHub

scrapling

Extract web content from static, dynamic, and Cloudflare-protected pages.

Updated May 5, 2026
Search Tags:#web scraping#javascript rendering#css selectors#cloudflare bypass#stealth browsing#spider crawling
One-click install
npx skills add https://github.com/Z43L/zeus-agent --skill scrapling-z43l
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: scrapling
Source: https://github.com/Z43L/zeus-agent/tree/main/optional-skills/research/scrapling
Command: npx skills add https://github.com/Z43L/zeus-agent --skill scrapling-z43l

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Scrapling helps you reliably retrieve and extract content from websites that are difficult to access due to JavaScript rendering, anti-bot protections, and multi-page navigation needs.

Core Features & Use Cases

  • HTTP and API extraction: Fetch static pages quickly using HTTP strategies and extract content with CSS/XPath selectors.
  • Dynamic JS rendering: Load and extract data from SPAs and pages that require a real browser environment.
  • Stealth and Cloudflare bypass: Use stealth browser automation options to access Cloudflare-protected or heavily fingerprinted sites.
  • Spider crawling: Follow links and crawl multiple pages while extracting structured results across a site.

Quick Start

Use the scrapling skill to extract a Cloudflare-protected page into an output.html file from the URL you provide.

Frequently Asked Questions about scrapling

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I scrape data from a website that uses Cloudflare anti-bot protection?▼

To scrape a Cloudflare-protected website, you need stealth browser automation to bypass anti-bot fingerprinting. This skill uses stealth fetching strategies to access and extract content from heavily protected pages without being blocked.

What's the best way to extract content from JavaScript-rendered single page applications?▼

Extracting content from JavaScript-rendered SPAs requires a dynamic fetching strategy that loads pages in a real browser environment. This approach executes the page's scripts to render the full DOM before applying CSS or XPath selectors for data extraction.

Can I crawl multiple pages across a site and extract structured results?▼

Yes, you can crawl multiple pages across a site using spider crawling strategies. This method follows links across pages, navigates multi-page structures, and extracts structured data using CSS or XPath selectors into file-extension-driven output formats.

Do I need to configure different fetching methods for static HTML versus dynamic pages?▼

Yes, you must select the correct fetch strategy based on the target page. Use HTTP fetching for static HTML, dynamic rendering for JavaScript-heavy SPAs, stealth automation for anti-bot protections, or spider crawling for multi-page navigation.

How does CSS and XPath selector-based extraction work for web scraping?▼

Selector-based extraction targets specific HTML elements using CSS or XPath queries to isolate structured data. After fetching the page content via the appropriate HTTP or browser-based strategy, selectors pinpoint the exact nodes to extract.

Related Skills

Explore More Data & Analytics Skills→
wsbaserwsbaser

wsbaser:xcss-selectors

Construct XCSS selectors from HTML markup and CSS/XPath for UnionInit attributes.

Community
Intermediate
jluo41jluo41

haipipe-data-1-source

Convert CSV, XML, Parquet, and JSON files into standardized SourceSet assets.

Community
Advanced
zeenie-aizeenie-ai
356

proxy-config-skill

Configure residential proxy providers and execute geo-targeted proxied HTTP requests.

Community
Intermediate
davidgfolchdavidgfolch
5

scrapling-official

Scrape and crawl websites with Scrapling, bypassing anti-bot protections like Cloudflare Turnstile.

Community
Advanced