skills.rest
davpatel605-beep
davpatel605-beepCOMMUNITY
Explore all skills by this author →
GitHub

scrapling

Extracts web content from static and dynamic websites via HTTP, browser, and stealth methods.

Updated Jun 25, 2026
Search Tags:#browser automation#web scraping#cloudflare#crawler#spider#stealth#html extraction
One-click install
npx skills add https://github.com/davpatel605-beep/hermusagent --skill scrapling-davpatel605-beep
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: scrapling
Source: https://github.com/davpatel605-beep/hermusagent/tree/main/backend/vendor/hermes/optional-skills/research/scrapling
Command: npx skills add https://github.com/davpatel605-beep/hermusagent --skill scrapling-davpatel605-beep

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

This Skill helps collect web data from static pages, JavaScript applications, and bot-protected websites without relying on manual browsing or fragile extraction methods.

Core Features & Use Cases

  • Multi-Mode Web Fetching: Retrieve content through HTTP requests, dynamic browser rendering, or stealth automation for complex websites.
  • Advanced Crawling Tools: Build spiders, follow links, manage sessions, and extract structured information from multiple pages.
  • Use Case: Research teams can gather product information, articles, or public datasets from websites that require JavaScript execution or have anti-bot protections.

Quick Start

Use the scrapling skill to extract structured content from a website and save the results in a usable format.

Frequently Asked Questions about scrapling

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I scrape dynamic websites that require JavaScript execution?▼

To scrape dynamic websites, you need browser automation that renders JavaScript and extracts HTML. This Skill handles dynamic browser rendering and stealth automation to reliably retrieve content from modern web applications requiring script execution.

What is the best way to extract web content from Cloudflare protected pages?▼

Extracting web content from Cloudflare protected pages requires stealth automation to bypass anti-bot detection. This Skill handles bot-protected websites by utilizing stealth fetching modes and browser automation to retrieve structured data without manual browsing.

How do I build a web crawler to follow links across multiple pages?▼

Building a web crawler involves creating spiders that follow links and manage sessions across multiple pages. This Skill provides advanced crawling tools to extract structured information, supporting research and data collection workflows.

Can I retrieve static HTML without launching a full browser instance?▼

Yes, you can retrieve static HTML without a full browser instance using HTTP requests. This Skill offers multi-mode web fetching, allowing you to choose standard HTTP requests for static pages or browser rendering only when JavaScript execution is required.

Does this stealth web scraper require any external dependencies to function?▼

No, this stealth web scraper does not require external dependencies to function. It operates independently without listed dependencies, handling HTML extraction, browser automation, and stealth fetching internally for reliable web data retrieval.

Related Skills

Explore More Education & Research Skills→
jason660519jason660519

scrapling

Fetch HTTP pages, automate stealth browsers, bypass Cloudflare, and crawl spiders via CLI or Python.

Community
Intermediate
IgosukiIgosuki
1

web-scraper

Extract clean text from web pages via concurrent scraping with deduplication.

Community
Intermediate
mvanhornmvanhorn
1.9k

firecrawl

Coordinate web scraping and crawling workflows through Firecrawl API CLI commands.

Community
Intermediate
haomingzhaomingz
12

smart-web-scraper

Extract titles, content, and screenshots from JavaScript-rendered websites using Playwright.

Community
Advanced