docs-scraper

Scrape web documentation to clean markdown by fetching URLs and exporting deterministic, readable offline artifacts. The skill preserves structure, metadata, and source attribution to support quick references and audit trails.

Yes, you can preserve metadata and provenance when scraping docs. The tool automatically records source attribution and timestamps alongside the markdown content, ensuring a reliable audit trail for archived documentation.

Yes, you need Python 3.12+, uv>=0.4, Crawl4AI, and Playwright installed in your active environment. These dependencies are required to fetch web pages and save deterministic markdown outputs.

The best way to archive API documentation offline is automating URL extraction into deterministic markdown files. This produces shareable team briefs with consistent formatting and embedded provenance for easy offline reference.

Yes, Crawl4AI works for scraping multiple docs into offline markdown. It operates across multiple URLs to fetch documentation, preserving structure while exporting deterministic markdown artifacts for auditing.

Scraped docs missing source attribution and timestamps indicate a lack of provenance tracking. This skill solves that by preserving metadata and provenance during fetch, ensuring deterministic markdown outputs for audit trails.