crawlee
OfficialStreamline web crawling with advanced features and configuration.
Authoraurumorinc
Version1.0.0
Installs0
System Documentation
What problem does it solve?
This Skill addresses the challenges of web crawling, including scalability, resource management, and maintaining stealth and resilience in scraping activities.
Core Features & Use Cases
- Resilient Crawl Management: Offers robust handling of web crawling with automatic recovery from failures.
- Configurable Crawler: Customize the crawler's behavior and capabilities based on specific project requirements.
- Use Case: Ideal for web scraping tasks where consistent performance and reliability are crucial, such as e-commerce price monitoring or content indexing.
Quick Start
Initialize the crawlee skill with your specific configuration and start crawling from the URL 'https://www.example.com'.
Dependency Matrix
Required Modules
crawlee
Components
scriptsreferencesassets
💻 Claude Code Installation
Recommended: Let Claude install automatically. Simply copy and paste the text below to Claude Code.
Please help me install this Skill: Name: crawlee Download link: https://github.com/aurumorinc/koda/archive/main.zip#crawlee Please download this .zip file, extract it, and install it in the .claude/skills/ directory.
Agent Skills Search Helper
Install a tiny helper to your Agent, search and equip skill from 620,000+ vetted skills library on demand.