skills.rest
danielscholl
danielschollCOMMUNITY
Explore all skills by this author →
GitHub

web

Fetch web pages and convert HTML to clean Markdown.

1|Updated Nov 19, 2025
Search Tags:#automation#markdown#web#web-search#HTML-to-markdown#Brave API
One-click install
npx skills add https://github.com/danielscholl/agent-skills --skill web
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: web
Source: https://github.com/danielscholl/agent-skills/tree/main/plugins/agent-tools/skills/web
Command: npx skills add https://github.com/danielscholl/agent-skills --skill web

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires httpx, beautifulsoup4, markdownify, click, and includes scripts (resource) components.

What problem does it solve?

This Skill helps you quickly search the internet and fetch page content, converting it to clean Markdown for easy sharing and ingestion into automation.

Core Features & Use Cases

  • Web search: Use Brave Search API to retrieve results with summaries.
  • HTML-to-markdown: Fetch pages and convert HTML to readable Markdown.
  • Dual output modes: Return JSON for automation or a human-friendly display.
  • Use Case: Find up-to-date documentation or blog posts and capture their content in Markdown for a knowledge base.

Quick Start

Use the web skill to search for "Claude Code plugins" or fetch a page at https://example.com and preview the Markdown.

Frequently Asked Questions about web

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I convert HTML to markdown when fetching web pages?▼

This Skill fetches HTML content over HTTP/HTTPS and converts it to clean Markdown using the markdownify library, automatically removing scripts, styles, and non-content elements for readability and downstream processing.

Can I search the web and get current information beyond my knowledge cutoff?▼

Yes, the Skill uses the Brave Search API to retrieve live search results with summaries, letting you access up-to-date documentation, blog posts, and web content in real time.

What output formats does this Skill support?▼

The Skill returns either human-friendly Markdown for direct reading or structured JSON output for automation and downstream processing of fetched content.

How do I fetch content from a specific URL and convert it to markdown?▼

Provide a URL with HTTP/HTTPS protocol, and the Skill validates it, fetches the HTML content with configurable timeouts and size limits, then converts it to clean Markdown for easy sharing and ingestion.

What are the prerequisites for using web search and page fetching?▼

You need a valid Brave Search API key for search queries, and valid HTTP/HTTPS URLs for page fetching. The Skill handles validation, timeout enforcement, and response size limits automatically.

Does this Skill work with automation workflows?▼

Yes, the Skill includes dual output modes and click-based CLI components designed for automation, allowing you to integrate live web content fetching and markdown conversion into broader workflows.

Related Skills

Explore More Software Engineering Skills→
junghan0611junghan0611
6

brave-search

Query the Brave API for web search results with optional content extraction.

Community
Advanced
mupengi-botmupengi-bot
11

data-scraper

Fetch HTML from URLs and extract structured data into JSON or Markdown.

Community
Intermediate
mshaheerzmshaheerz
1

publish-x-article

Convert Markdown files to X Articles drafts with image insertion.

Community
Advanced
XyHalcyonXyHalcyon

blogwatcher

Monitor blogs and RSS/Atom feeds with a CLI tool.

Community
Basic