skills.rest
hack-ink
hack-inkOFFICIAL
Explore all skills by this author →
WebsiteGitHub

scrapling

Escalate from lightweight fetches to dynamic or stealth browser fetchers.

Updated Aug 23, 2026
Search Tags:#automation#web-scraping#anti-bot#dynamic-fetch#scrapling#browser-fetch#stealth-fetch
One-click install
npx skills add https://github.com/hack-ink/codexlab --skill scrapling-hack-ink
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: scrapling
Source: https://github.com/hack-ink/codexlab/tree/main/.codex/skills/scrapling
Command: npx skills add https://github.com/hack-ink/codexlab --skill scrapling-hack-ink

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes references (resource) components.

What problem does it solve?

Browser-backed scraping with Scrapling for pages that lightweight system-level fetches cannot retrieve. Use when system curl, built-in web fetch, or web search is blocked, interstitialed, or stripped by JavaScript or anti-bot protection, then escalate with Scrapling dynamic or stealth fetchers.

Core Features & Use Cases

  • Escalation path from lightweight fetch to dynamic or stealth browser fetchers.
  • Private runtime isolation and per-skill venv setup to avoid repo contamination.
  • Use Case: Access data from JS-heavy sites or paywalls when standard fetch fails.

Quick Start

Install Scrapling in a private runtime under the skill root and run scrapling fetch commands to retrieve the target page.

Frequently Asked Questions about scrapling

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I scrape web pages when standard fetch is blocked by anti-bot protection?▼

Scraping JS-heavy sites involves escalating from standard fetch to dynamic or stealth browser fetchers. This tool handles that escalation automatically, rendering heavy JavaScript to access blocked content when standard web requests fail.

When should I use stealth fetch instead of a built-in web fetch?▼

Use stealth fetch when built-in web fetch fails due to anti-bot measures or JavaScript stripping. It is applied specifically to access pages protected by anti-bot systems or heavy JavaScript that block lightweight requests.

Does web scraping with browser fetchers require a specific Python environment setup?▼

Browser-backed scraping requires a dedicated Python virtual environment. This skill establishes a private runtime under the SCRAPLING_HOME directory to isolate dependencies and avoid repository contamination during dynamic fetch operations.

What is the best way to access data from paywalls or JS-heavy sites when system curl fails?▼

The best way to access data when system curl fails is using an escalation path from lightweight fetch to dynamic or stealth browser fetchers. This retrieves data from JS-heavy sites or paywalls that block standard requests.

Why does my lightweight fetch return stripped content from interstitial pages?▼

Lightweight fetch returns stripped content because interstitial pages or anti-bot protection block system-level requests. Escalating to a browser-backed stealth fetch bypasses these protections to retrieve the full page content.

Related Skills

Explore More Software Engineering Skills→
mdmagnuson-creatormdmagnuson-creator

browser-debugging

Automate structured browser debugging escalation when tests pass but features fail.

Community
Advanced
PlaidmustachePlaidmustache

scrapling

Fetch and crawl website data using HTTP, Dynamic, and Stealth modes.

Community
Intermediate
JKhyroJKhyro

scrapling

Extract web page content from static, dynamic, and protected sites.

Community
Advanced
tedtv1007-ctrltedtv1007-ctrl

cloudflare-crawl

Fetch rendered HTML from dynamic websites via the Cloudflare Browser Rendering API.

Community
Intermediate