headless-fallback
OfficialAutomate web scraping with headless-Chrome fallback for JavaScript-only pages.
Software Engineering#data extraction#browser automation#web scraping#headless-chrome#JavaScript rendering
Authorxberg-io
Version1.0.0
Installs0
System Documentation
What problem does it solve?
This Skill addresses the issue of scraping web pages that rely heavily on JavaScript, which can't be rendered with a static fetch. It automates the process using headless-Chrome as a fallback.
Core Features & Use Cases
- Headless-Chrome Fallback: Handles JavaScript-only pages that static scraping can't process.
- Custom Browser Modes: Supports 'auto', 'always', and 'never' modes for different scraping scenarios.
- External CDP Endpoint: Allows pointing to an existing headless-Chrome instance for more control and performance.
- Performance Optimization: Provides wait strategies and browser profile persistence for better resource management.
- Use Case: When scraping a dynamic web page with complex JavaScript rendering, this Skill ensures complete data extraction by automatically falling back to headless-Chrome.
Quick Start
Run the crawlberg scrape command with the '--browser-mode always' option for pages requiring headless-Chrome.
Dependency Matrix
Required Modules
None requiredComponents
scripts
💻 Claude Code Installation
Recommended: Let Claude install automatically. Simply copy and paste the text below to Claude Code.
Please help me install this Skill: Name: headless-fallback Download link: https://github.com/xberg-io/plugins/archive/main.zip#headless-fallback Please download this .zip file, extract it, and install it in the .claude/skills/ directory.
Agent Skills Search Helper
Install a tiny helper to your Agent, search and equip skill from 620,000+ vetted skills library on demand.