web-crawling
CommunityEfficiently extract web data with tailored crawling strategies.
Authorhanumin
Version1.0.0
Installs0
System Documentation
What problem does it solve?
This Skill addresses the challenge of gathering online information by providing flexible web crawling and data extraction tools, saving time and effort in research and data collection.
Core Features & Use Cases
- Basic web fetching using fetch-plugin for quick retrieval of static page content
- Structured data extraction from complex sites employing Crawl4AI with JavaScript rendering
- Batch web crawling across multiple URLs for comprehensive literature reviews or guideline collection
- Use Case: Automate retrieval of medical research guidelines from various websites and organize them into accessible formats for analysis.
Quick Start
Use this Skill to fetch HTML from a URL and extract specific content types like tables or metadata to streamline your web data collection.
Dependency Matrix
Required Modules
crawl4ai
Components
scriptsreferences
💻 Claude Code Installation
Recommended: Let Claude install automatically. Simply copy and paste the text below to Claude Code.
Please help me install this Skill: Name: web-crawling Download link: https://github.com/hanumin/Tumi-DentAI-ResearchNexus/archive/main.zip#web-crawling Please download this .zip file, extract it, and install it in the .claude/skills/ directory.
Agent Skills Search Helper
Install a tiny helper to your Agent, search and equip skill from 471,000+ vetted skills library on demand.