skills.rest
founderphantom
founderphantomCOMMUNITY
Explore all skills by this author →
GitHub

scrapling

Automate web scraping with HTTP, JS rendering, and stealth fetching.

Updated Apr 1, 2026
Search Tags:#automation#cli#web-scraping#crawl#stealth#dynamic-js#spider-framework
One-click install
npx skills add https://github.com/founderphantom/zola-agent --skill scrapling-founderphantom
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: scrapling
Source: https://github.com/founderphantom/zola-agent/tree/main/optional-skills/research/scrapling
Command: npx skills add https://github.com/founderphantom/zola-agent --skill scrapling-founderphantom

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Scrapling provides a comprehensive framework for efficient web scraping, stealth automation, and multi-page crawling, enabling reliable data collection across dynamic sites.

Core Features & Use Cases

  • HTTP, dynamic JS rendering, and stealth fetching options for resilient scraping.
  • Spider framework for multi-page crawling and link following.
  • Command-line interface and Python integrations for quick automation in research and development.

Quick Start

Install Scrapling, configure a simple fetch, and run a crawl to extract data from a target site.

Frequently Asked Questions about scrapling

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I scrape data from JavaScript-rendered sites?▼

Scraping JavaScript-rendered sites requires a framework supporting dynamic JS rendering to execute scripts and extract loaded HTML. This ensures you capture dynamically loaded content during your web scraping operations.

Can I crawl multiple pages and follow links automatically?▼

Yes, you can crawl multiple pages using a spider framework that follows links automatically. This enables systematic multi-page crawling to collect data across target website sections efficiently.

What is the best way to bypass anti-bot protections during web scraping?▼

Bypassing anti-bot protections involves using stealth fetching options designed to mimic human behavior and avoid detection. This ensures reliable data collection from sites with strict anti-scraping measures.

Does this web scraping framework support command-line automation?▼

Yes, the framework supports a command-line interface for quick automation alongside Python integrations. This allows executing web scraping tasks and crawls directly from the terminal for research and development.

How do I structure my scraping project with optional scripts and assets?▼

You structure a scraping project by defining YAML frontmatter with name and description in your SKILL.md file. You can then organize on-demand resources using optional scripts, references, and assets directories.

Related Skills

Explore More Software Engineering Skills→
AesopScottAesopScott
1

foundation

Set up MAPS project foundations with directories, memory, and environment configuration.

Community
Advanced
xberg-ioxberg-io
26

extracting-metadata

Extract titles, descriptions, language, and Open Graph tags from HTML documents.

Official
Intermediate
samuelmukotisamuelmukoti

scrapling

Automates web data collection via CLI and Python scripts with HTTP fetching, rendering, anti-bot bypass, and spider crawling.

Community
Intermediate
SignmanalSignmanal
1

scrapling

Extract web content protected by anti-bot systems via Python and CLI.

Community
Intermediate