crwl
CommunityCrawl sites and extract clean data fast
Data & Analytics#markdown#json#web crawling#content extraction#CSS selectors#site scraping#LLM extraction
Authorivanrvpereira
Version1.0.0
Installs0
System Documentation
What problem does it solve?
This Skill reduces the time and effort required to manually browse web pages by automatically fetching content, pruning it into clean markdown, and extracting structured information that you can use for answers or downstream workflows.
Core Features & Use Cases
- Web page crawling and markdown extraction: Converts a URL into filtered, LLM-friendly markdown output (recommended mode for reading and Q&A).
- Question answering over page content: Retrieves and summarizes what a page says about a specific topic using a single command.
- Structured data extraction (LLM or CSS-driven): Extracts entities and fields into JSON using either LLM-based instructions or CSS selector targeting plus a schema.
Quick Start
Ask the AI to read a URL and summarize the key points in pruned markdown: run crwl with the URL and use the default pruning flags.
Dependency Matrix
Required Modules
None requiredComponents
Standard package💻 Claude Code Installation
Recommended: Let Claude install automatically. Simply copy and paste the text below to Claude Code.
Please help me install this Skill: Name: crwl Download link: https://github.com/ivanrvpereira/.agents/archive/main.zip#crwl Please download this .zip file, extract it, and install it in the .claude/skills/ directory.
Agent Skills Search Helper
Install a tiny helper to your Agent, search and equip skill from 471,000+ vetted skills library on demand.