skills.rest
AnandaAnugrahHandyanto
AnandaAnugrahHandyantoCOMMUNITY
Explore all skills by this author →
GitHub

scrapling

Fetch web content via HTTP, dynamic JS, and stealth modes.

Updated Jun 19, 2026
Search Tags:#cli#cloudflare#web-scraping#browser-automation#spider#stealth#scrapling
One-click install
npx skills add https://github.com/AnandaAnugrahHandyanto/savarez_agent --skill scrapling-anandaanugrahhandyanto
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: scrapling
Source: https://github.com/AnandaAnugrahHandyanto/savarez_agent/tree/main/optional-skills/research/scrapling
Command: npx skills add https://github.com/AnandaAnugrahHandyanto/savarez_agent --skill scrapling-anandaanugrahhandyanto

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Scrapling addresses the complexity of scraping websites that deploy anti-bot protections and dynamic JavaScript content, enabling reliable data collection through a unified framework.

Core Features & Use Cases

  • HTTP fetching for static pages and APIs
  • Dynamic JavaScript rendering and browser automation
  • Stealth mode to bypass Cloudflare and bot detection
  • Spider framework for multi-page crawling
  • Command-line interface and Python integrations for automation

Quick Start

Install Scrapling and run scrapling install to set up the environment and begin extracting data from a target site.

Frequently Asked Questions about scrapling

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I scrape websites that use Cloudflare and anti-bot protection?▼

To bypass Cloudflare and anti-bot protection during web scraping, you need a stealth fetching strategy. This approach mimics human browser behavior to evade bot detection while reliably extracting dynamic JavaScript content.

What's the best way to crawl multiple pages with JavaScript-rendered content?▼

The best way to crawl multiple pages with JavaScript-rendered content is using a Spider framework. It handles dynamic JS rendering and automates multi-page crawling to systematically extract data across target sites.

Can I handle both static HTTP requests and dynamic browser automation in one framework?▼

Yes, a unified web scraping framework can handle both static HTTP requests and dynamic browser automation. It supports HTTP fetching for static pages alongside dynamic JS rendering for interactive content.

How do I set up a Python web scraping environment via command line?▼

To set up a Python web scraping environment via command line, install the framework and run its install command. This configures the necessary browser automation dependencies so you can begin automating data extraction immediately.

Does browser automation work for crawling APIs or only for dynamic web pages?▼

Browser automation is not required for APIs. You can use standard HTTP fetching for static pages and APIs, reserving dynamic JS rendering and stealth modes exclusively for JavaScript-heavy or protected web pages.

Related Skills

Explore More Software Engineering Skills→
Chris-Chai-MinjaeChris-Chai-Minjae

scrapling

Automate web scraping with HTTP fetching, stealth browser automation, and spider crawling.

Community
Advanced
xberg-ioxberg-io
26

extracting-tables

Extract HTML tables and convert them to Markdown and structured JSON.

Official
Intermediate
afel6afel6

scrapling

Extract structured data from complex websites via HTTP fetching and stealth scraping.

Community
Intermediate
Z43LZ43L

scrapling

Extract web content from static, dynamic, and Cloudflare-protected pages.

Community
Advanced