openclaw-ultra-scraping
CommunityStealthy, scalable web scraping with anti-bot bypass.
AuthorLeoYeAI
Version1.0.0
Installs0
System Documentation
What problem does it solve?
This Skill enables AI assistants to perform robust web scraping and crawling by overcoming anti-bot measures and handling site redesigns seamlessly.
Core Features & Use Cases
- Anti-Bot Bypass: Effortlessly bypass Cloudflare, Turnstile, CAPTCHAs, and other anti-detection mechanisms.
- Adaptive Element Tracking: Maintain selector accuracy despite webpage reorganization or redesigns.
- Large-Scale Crawling: Conduct multi-page crawling with concurrency, pause/resume, and proxy rotation.
- Precise Data Extraction: Use CSS and XPath selectors, with support for JavaScript-rendered pages via headless browsers.
- Use Case: Collect product data from protected e-commerce sites or aggregate content from dynamic SPA websites automatically.
Quick Start
Ask your AI assistant to scrape product details from a protected site using the stealth mode with adaptive element tracking.
Dependency Matrix
Required Modules
scrapyplaywrightbeautifulsoup4api-python-client
Components
scriptsreferencesassets
💻 Claude Code Installation
Recommended: Let Claude install automatically. Simply copy and paste the text below to Claude Code.
Please help me install this Skill: Name: openclaw-ultra-scraping Download link: https://github.com/LeoYeAI/openclaw-ultra-scraping/archive/main.zip#openclaw-ultra-scraping Please download this .zip file, extract it, and install it in the .claude/skills/ directory.
Agent Skills Search Helper
Install a tiny helper to your Agent, search and equip skill from 471,000+ vetted skills library on demand.