web-fetch

Fetch web pages, JSON APIs, and file URLs to extract readable text.

3|Updated Feb 13, 2026

Search Tags:#markdown #api #readability #fetch #curl #web #scrape

Ready to run

npx skills add https://github.com/jholhewres/goclaw-skills --skill web-fetch-jholhewres

💬 Prompt for ChatGPT / Claude Chat▼

Please help me install this Agent Skill.
Skill: web-fetch
Source: https://github.com/jholhewres/goclaw-skills/tree/main/skills/web-fetch
Command: npx skills add https://github.com/jholhewres/goclaw-skills --skill web-fetch-jholhewres

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes scripts (resource) components.

What problem does it solve?

This Skill allows you to retrieve and extract readable content from any web page, API endpoint, or file URL, simplifying data gathering from the internet.

Core Features & Use Cases

Fetch Web Pages: Extract clean, readable text from HTML by stripping away scripts, styles, and tags.
API Interaction: Make requests to JSON APIs and parse the responses using jq.
File Downloading: Download files from URLs to a specified location.
Use Case: You need to get the main article text from a news website to summarize it. Use this skill to fetch the URL and extract only the article content.

Quick Start

Fetch the content of the URL 'https://example.com' and display the first 300 characters of readable text.

Frequently Asked Questions about web-fetch

High-intent search queries and answers about installing and using this skill.

FAQPage Schema

How do I extract readable text from HTML web pages?▼

To extract readable text from HTML web pages, this Skill fetches the URL and strips away scripts, styles, and tags. This leaves only the clean article content for immediate use or summarization.

Can I parse JSON API responses using curl and jq?▼

Yes, you can parse JSON API responses using curl and jq. The Skill makes requests to JSON API endpoints and processes the returned data using jq for targeted extraction.

How do I download files from a URL to a specific location?▼

You can download files from a URL to a specific location by using the Skill's file downloading capability. It handles file URLs via curl to acquire files directly to your designated path.

Does this web scraping tool work with markdown and API endpoints?▼

This web scraping tool works with both markdown and API endpoints. It retrieves and extracts readable content from web pages, handles JSON API parsing, and processes various URL types efficiently.

What is the best way to get main article text from a news website?▼

The best way to get main article text from a news website is using this Skill's targeted content extraction. It fetches the news URL and strips HTML scripts and styles, returning only the readable article text.

What are the limitations of fetching web content with curl?▼

A limitation of fetching web content with curl is that it handles basic retrieval and HTML stripping. Complex dynamic web pages requiring JavaScript rendering may not return fully readable text content.