skills.rest
richardnguyen0715
richardnguyen0715COMMUNITY
Explore all skills by this author →
GitHub

scrapling

Scrape static and JavaScript-rendered web content with stealth and Cloudflare bypass.

Updated May 11, 2026
Search Tags:#browser automation#web scraping#crawling#stealth#cloudflare bypass
One-click install
npx skills add https://github.com/richardnguyen0715/keep-it-real --skill scrapling-richardnguyen0715
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: scrapling
Source: https://github.com/richardnguyen0715/keep-it-real/tree/main/refer-projects/hermes-agent/optional-skills/research/scrapling
Command: npx skills add https://github.com/richardnguyen0715/keep-it-real --skill scrapling-richardnguyen0715

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires scrapling[all], and includes scripts (resource) and assets (resource) components.

What problem does it solve?

This Skill streamlines the process of web scraping, enabling users to extract data from websites quickly and with reduced risk of detection.

Core Features & Use Cases

  • Web Scraping: Fetch content from websites using HTTP, dynamic JavaScript, and stealth modes.
  • Stealthy Browsing: Bypass bot detection and Cloudflare protection.
  • Crawling: Systematically navigate and scrape multiple pages.
  • Use Case: Automatically gather data from e-commerce websites for price comparison or product analysis.

Quick Start

Run the 'scrapling extract' command to fetch content from a webpage.

Frequently Asked Questions about scrapling

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I scrape JavaScript-rendered web content without getting blocked?▼

To scrape JavaScript-rendered web content stealthily, you need browser automation that mimics human behavior to bypass bot detection. This Skill uses stealthy browser automation and Cloudflare bypass techniques to extract dynamic content while reducing the risk of being blocked.

What is the best way to bypass Cloudflare protection when crawling websites?▼

Bypassing Cloudflare protection during website crawling is best achieved through stealthy browser automation. This Skill implements specialized cloudflare bypass techniques alongside HTTP fetching to systematically navigate and scrape multiple pages without triggering anti-bot blocks.

Can I use Python to automate web scraping for large e-commerce sites?▼

Yes, you can use Python to automate web scraping for large e-commerce sites. This Skill requires Python for script execution and utilizes browser automation libraries to systematically crawl websites, making it ideal for gathering product data or price comparisons at scale.

Does stealth web scraping work on both static and dynamic pages?▼

Stealth web scraping works effectively on both static and dynamic pages. This Skill performs data retrieval using a combination of standard HTTP fetching for static content and stealthy browser automation for JavaScript-rendered content, ensuring comprehensive scraping coverage.

Why does my web scraper fail when fetching data from protected websites?▼

Web scrapers fail on protected websites due to anti-bot measures like Cloudflare detecting automated HTTP requests. This Skill resolves this by employing stealthy browser automation techniques that mask scraping behavior, allowing you to fetch content without triggering bot detection blocks.

Related Skills

Explore More Data & Analytics Skills→
jason660519jason660519

scrapling

Fetch HTTP pages, automate stealth browsers, bypass Cloudflare, and crawl spiders via CLI or Python.

Community
Intermediate
AgentPMTAgentPMT

file-to-json-parsing

Parse CSV, HTML, JSON, ICS, spreadsheets, PDFs, and RTF into structured JSON.

Official
Intermediate
luis2404123luis2404123

proxy-rotation

Rotate IP addresses per request or sticky session for web scraping.

Community
Intermediate
vm0-aivm0-ai
76

scrapeninja

Extract data from anti-bot-protected websites via a scraping API.

Official
Intermediate