skills.rest
akillness
akillnessCOMMUNITY
Explore all skills by this author →
Website𝕏@akillness0308GitHub

scrapling

Orchestrate web scraping across static, dynamic, and protected targets.

40|9|Updated Jan 4, 2026
Search Tags:#mcp#web-scraping#fetchers#spiders#scrapling#adaptive-scraping
One-click install
npx skills add https://github.com/akillness/oh-my-skills --skill scrapling-akillness
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: scrapling
Source: https://github.com/akillness/oh-my-skills/tree/main/.agent-skills/scrapling
Command: npx skills add https://github.com/akillness/oh-my-skills --skill scrapling-akillness

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes scripts (resource) and references (resource) components.

What problem does it solve?

Scrapling automates robust, multi-path web scraping orchestration across static fetchers, dynamic rendering, and MCP workflows, reducing manual setup and maintenance.

Core Features & Use Cases

  • Adaptive scraping with element fingerprint save and relocation for brittle pages
  • Support for Fetcher, DynamicFetcher, and StealthyFetcher paths to handle static, JavaScript-rendered, and protected targets
  • CLI extraction and MCP server integration to empower agent workflows
  • Spider-based crawling for large-scale data collection with checkpointing and session management

Quick Start

Install Scrapling with the recommended extras and run a sample extraction using the CLI to see results.

Frequently Asked Questions about scrapling

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I scrape dynamic JavaScript-rendered pages that break with standard fetchers?▼

Web scraping dynamic SPAs requires a DynamicFetcher path with browser rendering to execute JavaScript. Scrapling orchestrates this by escalating from static fetchers to dynamic rendering, automating robust HTML extraction from JavaScript-rendered targets.

What is adaptive web scraping and when do I need element relocation?▼

Adaptive web scraping saves element fingerprints to relocate selectors when page layouts shift. You need it for brittle pages where structural changes break traditional selectors, ensuring reliable data extraction without constant manual selector maintenance.

Can I use a web scraping spider to crawl large-scale sites with session management?▼

Spider-based crawling supports large-scale data collection with checkpointing and session management. This allows you to orchestrate extensive web scraping workflows that resume after interruptions and maintain authenticated states across multiple pages.

Does this web scraping tool support CLI extraction and MCP server integration?▼

The web scraping orchestration supports both CLI extraction and MCP server integration. This empowers agent workflows by allowing automated data collection to be triggered directly from command-line interfaces or through MCP tooling environments.

What is the best way to scrape protected targets that block automated requests?▼

Scraping protected targets requires a StealthyFetcher path to bypass anti-bot detection. This approach uses stealth browser rendering within your web scraping orchestration to reliably extract HTML content from heavily protected sites.

Why does my web scraping workflow fail when switching between static and dynamic fetchers?▼

Web scraping workflows fail without explicit fetcher escalation rules. Scrapling enforces structured transitions between static, dynamic, and stealthy fetchers, ensuring the correct rendering path is applied to each specific target type.

Related Skills

Explore More Software Engineering Skills→
tabgabtabgab

opp-repl-installation

Install opp_repl from PyPI or source with optional extras and environment setup.

Community
Advanced
patricio0312revpatricio0312rev
5

doc-to-vector-dataset-generator

Convert documents into chunked JSONL datasets for embeddings.

Community
Advanced
jason660519jason660519

scrapling

Fetch HTTP pages, automate stealth browsers, bypass Cloudflare, and crawl spiders via CLI or Python.

Community
Intermediate
DaddyElonMusk69DaddyElonMusk69

scrapling

Scrape JavaScript-rendered and Cloudflare-protected web pages via CLI or Python.

Community
Advanced