Headless Browse

Name: Headless Browse
Availability: InStock
Author: Microscaler

Scrape external documentation via headless browser and return structured markdown.

1|Updated Apr 5, 2026

Search Tags:#documentation #markdown #research #api-docs #web-scraping #headless-browse

Ready to run

npx skills add https://github.com/microscaler/cylon-skills --skill headless-browse

💬 Prompt for ChatGPT / Claude Chat▼

Please help me install this Agent Skill.
Skill: Headless Browse
Source: https://github.com/microscaler/cylon-skills/tree/main/skills/headless-browse
Command: npx skills add https://github.com/microscaler/cylon-skills --skill headless-browse

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

This Skill enables researchers to locate, fetch, and structure external documentation by driving a headless browser to unknown integrations (OpenAPI docs, crate docs) and inject the resulting context into the task cache for AI agents.

Core Features & Use Cases

Headless scraping of documentation across allowed domains to gather API references, crates, and guides.
Structured markdown payloads for seamless ingestion into AI task contexts.
Use Case: When integrating a new Rust crate, fetch its docs from docs.rs and convert to markdown for immediate analysis.

Quick Start

Provide a valid target_url to initiate a headless browse and receive structured markdown in the response.

Frequently Asked Questions about Headless Browse

High-intent search queries and answers about installing and using this skill.

FAQPage Schema

How do I scrape external API documentation for AI agents?▼

You scrape external API documentation by providing a valid target URL to a headless browse process that fetches content and returns structured markdown. This enables AI agents to securely ingest and analyze up-to-date references.

What is headless scraping for markdown research?▼

Headless scraping for markdown research is the automated process of navigating external documentation domains to extract content. It structures the fetched data into markdown payloads for seamless ingestion into AI task contexts.

Can I fetch Rust crate docs from docs.rs as markdown?▼

Yes, you can fetch Rust crate docs from docs.rs as markdown. The headless browser navigates the specified URL, validates the domain, extracts the documentation, and returns it as structured markdown for immediate analysis.

Does headless scraping work with all web domains?▼

Headless scraping does not work with all web domains. It applies domain filtering to allowed TLDs including .gov, .com, .org, .io, and .rs, enforcing URL validation and secure scraping with zero external side effects.

What are the limitations of automated web scraping for research?▼

Limitations of automated web scraping include restrictions to specific allowed domains like .gov, .com, .org, .io, and .rs. It focuses on fetching static documentation and returning markdown payloads without executing external side effects.