web-fetch

Name: web-fetch
Availability: InStock
Author: 0xbigboss

Fetches web pages and converts main content into clean markdown using CSS selectors.

53|7|Updated Jun 28, 2025

Search Tags:#markdown #fetch #web-content #content-extraction #html-to-markdown #selector-based

Ready to run

npx skills add https://github.com/0xBigBoss/claude-code --skill web-fetch-0xbigboss

💬 Prompt for ChatGPT / Claude Chat▼

Please help me install this Agent Skill.
Skill: web-fetch
Source: https://github.com/0xBigBoss/claude-code/tree/main/.claude/skills/web-fetch
Command: npx skills add https://github.com/0xBigBoss/claude-code --skill web-fetch-0xbigboss

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires linkedom, turndown, and includes scripts (resource) components.

What problem does it solve?

Fetches web pages and converts them into clean markdown by extracting the main content, removing clutter like navbars and ads, and preserving readable text.

Core Features & Use Cases

Selector-based content extraction: identify the main article or content blocks using CSS selectors.
Universal fallback: Bun-based script supports unknown pages with automatic content detection.
Use cases: documentation, articles, reference pages, and knowledge bases that need clean, export-ready markdown.

Quick Start

Install dependencies with bun install Fetch and convert a page with bun run fetch.ts https://example.com Output the markdown to stdout or redirect to a file for storage

Frequently Asked Questions about web-fetch

High-intent search queries and answers about installing and using this skill.

FAQPage Schema

How do I convert web pages to markdown?▼

You convert web pages to markdown by fetching the URL and extracting the main content using CSS selectors. This Skill runs a TypeScript script to parse the HTML and output clean markdown text.

How do I extract main article content from HTML?▼

You extract main article content from HTML by using selector-based extraction to isolate content blocks. It automatically removes clutter like navbars and ads, preserving only the readable text for your markdown output.

Do I need Bun to run web content extraction scripts?▼

Yes, you need Bun to run these web content extraction scripts. The Skill is built with TypeScript and uses Bun as its runtime environment to execute the scripts that fetch and convert pages.

Can I convert unknown web pages to markdown without manual selectors?▼

Yes, you can convert unknown web pages to markdown without manual selectors. The Skill includes a universal Bun-based fallback that automatically detects and extracts the main content from unconfigured sites.

What is the best way to get clean markdown from documentation sites?▼

The best way to get clean markdown from documentation sites is using site-specific selectors. This Skill supports known sites with tailored CSS selectors to accurately isolate and convert reference pages into export-ready markdown.

Why does web to markdown conversion remove page clutter?▼

Web to markdown conversion removes page clutter to ensure the output is clean and readable. By parsing the DOM and targeting main content blocks, it strips away navigation bars and advertisements before applying the markdown conversion.