skills.rest
raghavbadhwar
raghavbadhwarCOMMUNITY
Explore all skills by this author →
GitHub

scrapling

Extract public web content using static, browser-rendered, or authorized stealth fetches.

Updated Aug 9, 2026
Search Tags:#data extraction#web scraping#browser rendering#crawling#anti-bot#scrapling#stealth fetch
One-click install
npx skills add https://github.com/raghavbadhwar/rstack --skill scrapling-raghavbadhwar
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: scrapling
Source: https://github.com/raghavbadhwar/rstack/tree/main/scrapling
Command: npx skills add https://github.com/raghavbadhwar/rstack --skill scrapling-raghavbadhwar

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve? Fetching web content often fails against JavaScript-heavy pages or bot-protected sites, and naive scraping produces raw HTML that is unusable for AI consumption. This Skill provides bounded public-web extraction through Scrapling with escalation between fetch strategies and sanitizes every CLI result for AI use. ## Core Features & Use Cases - Tiered fetch strategies: Choose static fetches for simple pages, browser-rendered fetches for JavaScript-driven content, or authorized stealth fetches for anti-bot protected pages. - Escalation on failure: Escalates to a stronger fetch mode only after a concrete failure, keeping extraction bounded and deliberate. - AI-ready output: Sanitizes every CLI result so extracted content is clean and consumable by an AI agent. - Use Case: You need to pull article text from a site that renders content client-side. Invoke the skill to attempt a static fetch, escalate to browser rendering when the static result is empty, and receive sanitized text ready for summarization. ## Quick Start Ask the agent to scrape a specific public URL with Scrapling and return the sanitized page content, escalating to browser rendering if the static fetch fails.

Frequently Asked Questions about scrapling

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I scrape a JavaScript-rendered website with an AI agent?▼

Use the browser-rendered fetch mode, which loads the page in a real browser so client-side JavaScript executes before extraction. The skill escalates to this mode automatically after a static fetch concretely fails.

What is the difference between static and browser-rendered web fetching?▼

Static fetching downloads raw HTML without executing scripts, which is fast but misses JavaScript-rendered content. Browser-rendered fetching runs the page in a browser engine, capturing the fully rendered DOM at higher cost.

Can Scrapling handle sites with anti-bot protection?▼

Yes, the skill supports an authorized stealth fetch mode for pages protected by anti-bot measures. It is used only as an escalation after other fetch modes fail and is intended for authorized extraction.

When does the skill escalate from static to stealth fetching?▼

Escalation happens only after a concrete failure of the lighter fetch mode, not preemptively. This keeps extraction bounded and avoids unnecessary heavyweight browser or stealth requests.

Is scraped output safe to feed directly into an AI model?▼

Yes, every CLI result is sanitized for AI consumption before being returned. This reduces the risk of raw page markup or embedded content polluting the agent's context.

Related Skills

Explore More Software Engineering Skills→
Memento-TeamsMemento-Teams
1.5k

web-search

Search the web via Tavily API and fetch URLs as Markdown.

Community
Intermediate
bogwarebogware
3

web-research

Decompose research questions into subtopics and synthesize cited web findings.

Official
Advanced
Lev-itLev-it

agent-reach

Route internet research requests across 13 platforms and automate search and data extraction.

Official
Advanced
Jack5316Jack5316

agent-news

Fetch, parse, and summarize news from RSS, Atom, and JSON APIs.

Community
Intermediate