documentation-scraper

Convert documentation sites into a single Markdown file for AI context.

49|9|Updated Dec 18, 2025
One-click install
npx skills add https://github.com/ratacat/claude-skills --skill documentation-scraper
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: documentation-scraper
Source: https://github.com/ratacat/claude-skills/tree/main/skills/documentation-scraper
Command: npx skills add https://github.com/ratacat/claude-skills --skill documentation-scraper

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

This Skill converts documentation sites into a single Markdown file optimized for AI context. It emphasizes sitemap analysis before scraping and is designed to run outside sandboxes.

Core Features & Use Cases

  • Sitemap-first scraping guidance to determine base-path and max pages
  • Slurp partials, then compile into a single markdown file
  • Output to slurp_compiled/compiled_docs.md for AI consumption

Quick Start

  1. node analyze-sitemap.js https://docs.example.com
  2. slurp https://docs.example.com/docs/ --base-path https://docs.example.com/docs/ --max 80
  3. cat slurp_compiled/compiled_docs.md | head -100