skills.rest
microscaler
microscalerOFFICIAL
Explore all skills by this author →
GitHub

Headless Browse

Scrape external documentation via headless browser and return structured markdown.

1|Updated Apr 5, 2026
Search Tags:#documentation#markdown#research#api-docs#web-scraping#headless-browse
One-click install
npx skills add https://github.com/microscaler/cylon-skills --skill headless-browse
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: Headless Browse
Source: https://github.com/microscaler/cylon-skills/tree/main/skills/headless-browse
Command: npx skills add https://github.com/microscaler/cylon-skills --skill headless-browse

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

This Skill enables researchers to locate, fetch, and structure external documentation by driving a headless browser to unknown integrations (OpenAPI docs, crate docs) and inject the resulting context into the task cache for AI agents.

Core Features & Use Cases

  • Headless scraping of documentation across allowed domains to gather API references, crates, and guides.
  • Structured markdown payloads for seamless ingestion into AI task contexts.
  • Use Case: When integrating a new Rust crate, fetch its docs from docs.rs and convert to markdown for immediate analysis.

Quick Start

Provide a valid target_url to initiate a headless browse and receive structured markdown in the response.

Frequently Asked Questions about Headless Browse

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I scrape external API documentation for AI agents?▼

You scrape external API documentation by providing a valid target URL to a headless browse process that fetches content and returns structured markdown. This enables AI agents to securely ingest and analyze up-to-date references.

What is headless scraping for markdown research?▼

Headless scraping for markdown research is the automated process of navigating external documentation domains to extract content. It structures the fetched data into markdown payloads for seamless ingestion into AI task contexts.

Can I fetch Rust crate docs from docs.rs as markdown?▼

Yes, you can fetch Rust crate docs from docs.rs as markdown. The headless browser navigates the specified URL, validates the domain, extracts the documentation, and returns it as structured markdown for immediate analysis.

Does headless scraping work with all web domains?▼

Headless scraping does not work with all web domains. It applies domain filtering to allowed TLDs including .gov, .com, .org, .io, and .rs, enforcing URL validation and secure scraping with zero external side effects.

What are the limitations of automated web scraping for research?▼

Limitations of automated web scraping include restrictions to specific allowed domains like .gov, .com, .org, .io, and .rs. It focuses on fetching static documentation and returning markdown payloads without executing external side effects.

Related Skills

Explore More Education & Research Skills→
26mitch2626mitch26

setup-browser-cookies

Import cookies from a Chromium browser into Playwright headless sessions.

Community
Basic
legoutlegout
3

exa-search

Perform semantic web searches and structured research via the Exa API.

Community
Intermediate
daidrdaidr
8

create-evlog-adapter

Creates custom evlog adapters for external observability platforms like Datadog, Sentry, and Loki.

Community
Advanced
xfs96192xfs96192

wechat-article-to-markdown

Fetch WeChat public account articles and convert them to Markdown with metadata and local images.

Community
Advanced