skills.rest
sky770825
sky770825COMMUNITY
Explore all skills by this author →
GitHub

web-fetch

Fetch web content via HTTP requests and convert it to Markdown or plain text.

Updated Feb 3, 2026
Search Tags:#markdown#content#fetch#text extraction#scraping#web
One-click install
npx skills add https://github.com/sky770825/openclaw-console-hub --skill web-fetch-sky770825
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: web-fetch
Source: https://github.com/sky770825/openclaw-console-hub/tree/main/skills/web-fetch
Command: npx skills add https://github.com/sky770825/openclaw-console-hub --skill web-fetch-sky770825

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

This Skill provides a standardized and reliable way to retrieve content from web pages, overcoming the limitations and potential instability of browser-based tools.

Core Features & Use Cases

  • Direct HTTP Fetching: Uses direct HTTP requests for stability and speed.
  • Content Conversion: Automatically converts fetched content into Markdown or plain text.
  • Use Case: Quickly get the main article text from a news website without needing to navigate the page or deal with browser extensions.

Quick Start

Use the web_fetch tool to get the markdown content from https://example.com.

Frequently Asked Questions about web-fetch

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I fetch web content and convert it to Markdown without using a browser?▼

You can fetch web content by sending direct HTTP requests to any publicly accessible URL, which retrieves the page directly and converts the HTML into readable Markdown or plain text without browser automation.

What is the best way to extract article text from a news website reliably?▼

Direct HTTP fetching is the best way to extract article text reliably, bypassing browser-based tools to avoid instability and quickly retrieving the main content as Markdown or plain text.

Does direct HTTP fetching work for extracting data from any public URL?▼

Yes, direct HTTP fetching works for any publicly accessible URL, allowing you to extract information and convert it into a readable format as long as the page does not require browser rendering.

Why use direct HTTP requests instead of browser automation for web scraping?▼

Direct HTTP requests are used instead of browser automation to ensure stable and efficient data acquisition, overcoming the potential instability and speed limitations associated with browser-based tools.

What are the limitations of fetching web content via direct HTTP requests?▼

The main limitation of fetching web content via direct HTTP requests is that it cannot handle pages requiring JavaScript rendering or browser interaction, as it only retrieves statically served HTML content.

Can I get plain text instead of Markdown when extracting web page content?▼

Yes, the content conversion process automatically supports extracting web page content into both readable Markdown and plain text formats to suit different downstream processing needs.

Related Skills

Explore More Content & Communication Skills→
ErixWongErixWong
17

net-operations

Perform DNS lookups, SSL certificate analysis, and HTTP header checks.

Community
Intermediate
ChrisWilesChrisWiles

data-ingest

Parse text-based sources into structured Obsidian wiki pages.

Community
Advanced
SpaceZephyrSpaceZephyr
333

web-scraper

Fetch URLs and convert HTML page content into readable markdown.

Community
Intermediate
richardnguyen0715richardnguyen0715

scrapling

Scrape static and JavaScript-rendered web content with stealth and Cloudflare bypass.

Community
Advanced