crwl

Community

Crawl sites and extract clean data fast

Authorivanrvpereira
Version1.0.0
Installs0

System Documentation

What problem does it solve?

This Skill reduces the time and effort required to manually browse web pages by automatically fetching content, pruning it into clean markdown, and extracting structured information that you can use for answers or downstream workflows.

Core Features & Use Cases

  • Web page crawling and markdown extraction: Converts a URL into filtered, LLM-friendly markdown output (recommended mode for reading and Q&A).
  • Question answering over page content: Retrieves and summarizes what a page says about a specific topic using a single command.
  • Structured data extraction (LLM or CSS-driven): Extracts entities and fields into JSON using either LLM-based instructions or CSS selector targeting plus a schema.

Quick Start

Ask the AI to read a URL and summarize the key points in pruned markdown: run crwl with the URL and use the default pruning flags.

Dependency Matrix

Required Modules

None required

Components

Standard package

💻 Claude Code Installation

Recommended: Let Claude install automatically. Simply copy and paste the text below to Claude Code.

Please help me install this Skill:
Name: crwl
Download link: https://github.com/ivanrvpereira/.agents/archive/main.zip#crwl

Please download this .zip file, extract it, and install it in the .claude/skills/ directory.
View Source Repository

Agent Skills Search Helper

Install a tiny helper to your Agent, search and equip skill from 471,000+ vetted skills library on demand.