web-scraper

Convert web pages to Markdown using the url-to-markdown-cli-tool.

Updated Feb 8, 2026
One-click install
npx skills add https://github.com/eykd/vance-ts --skill web-scraper-eykd
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: web-scraper
Source: https://github.com/eykd/vance-ts/tree/main/.claude/skills/web-scraper
Command: npx skills add https://github.com/eykd/vance-ts --skill web-scraper-eykd

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires url-to-md, and includes scripts (resource) components.

What problem does it solve?

This Skill streamlines the conversion of web pages into clean Markdown format, making it easier to analyze, document, and share web content.

Core Features & Use Cases

  • Markdown Conversion: Convert web pages to Markdown using the url-to-markdown-cli-tool.
  • Content Extraction: Extract clean text from websites while removing navigation, footers, scripts, and styles.
  • Use Case: Quickly convert web pages into Markdown for easier reading, sharing, or analysis.

Quick Start

Use the web-scraper skill to convert the URL 'https://example.com' to Markdown and save it as 'example.md'.

Frequently Asked Questions about web-scraper

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I convert web pages to Markdown format for content analysis?

To convert web pages to Markdown, this Skill uses the url-to-markdown-cli-tool to fetch HTML content and extract clean text. It removes navigation, footers, scripts, and styles, delivering readable Markdown output for documentation or analysis.

What is the best way to extract clean text from websites without HTML clutter?

The best way to extract clean text is using a web scraper that strips non-essential HTML elements like scripts and styles. This Skill processes URLs to isolate core content and converts it into a structured Markdown format for easier reading.

Do I need the url-to-md dependency to scrape web content?

Yes, you need the url-to-md dependency installed to process HTML content into Markdown text. This Skill relies on the url-to-markdown-cli-tool to handle the actual conversion and content extraction from the provided URLs.

Can I use web scraping for documentation and saving URLs as Markdown files?

Yes, you can use web scraping for documentation by converting URLs into Markdown files. By processing a URL like 'https://example.com', the Skill extracts the web content and outputs it as a structured Markdown file for your documentation.

Does web content conversion remove navigation and scripts automatically?

Yes, web content conversion automatically removes navigation, footers, scripts, and styles during extraction. The Skill isolates the main textual content from the HTML and converts only the relevant information into Markdown format.

When do I need to convert HTML to Markdown instead of keeping raw HTML?

You need to convert HTML to Markdown when you want a cleaner, more readable format for analysis or documentation. Converting strips complex HTML structures like scripts and styles, leaving lightweight text that is easier to share and process.