web-fetch

Retrieve web content and API responses as markdown or structured JSON.

310|45|Updated Feb 22, 2026
One-click install
npx skills add https://github.com/Mathews-Tom/praxis-skills --skill web-fetch-mathews-tom
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: web-fetch
Source: https://github.com/Mathews-Tom/praxis-skills/tree/main/skills/web-fetch
Command: npx skills add https://github.com/Mathews-Tom/praxis-skills --skill web-fetch-mathews-tom

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Remove the friction of retrieving content from a provided URL and converting it into readable or structured data for downstream tasks. Users who need HTML, JSON, markdown, or plain text from a specific URL get reliable retrieval with control over authentication, redirects, cookies, and timeouts.

Core Features & Use Cases

  • HTML retrieval for parsing and element extraction, suitable for documentation pages and articles.
  • JSON API consumption with guidance to pipe responses through jq to filter and reduce token usage.
  • Markdown/plain text extraction using a built-in WebFetch tool that renders JavaScript and strips boilerplate while curl is recommended for custom headers, POST bodies, and cookie management.
  • Advanced patterns for pagination, retries, response inspection, cookie handling, and saving binary responses to disk.

Quick Start

Fetch the URL https://example.com/article and return the cleaned markdown content, using WebFetch by default and falling back to curl when custom headers or POST bodies are required.

Frequently Asked Questions about web-fetch

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I convert HTML from a URL into clean markdown?

To convert HTML from a URL into clean markdown, the WebFetch tool retrieves web content and automatically strips boilerplate while rendering JavaScript. This approach yields readable markdown suitable for documentation pages and articles.

What is the best way to consume JSON API responses and reduce token usage?

The best way to consume JSON API responses is to retrieve the payload and pipe it through jq to filter and reduce token usage. This method ensures you extract only the necessary structured data from the API endpoint.

Can I send HTTP POST requests with custom headers and cookies?

Yes, you can send HTTP POST requests with custom headers and cookies by using curl as a fallback to WebFetch. Curl provides the necessary control for authentication headers, POST bodies, and cookie management.

Does web scraping work with JavaScript-rendered pages?

Yes, web scraping works with JavaScript-rendered pages by preferring the built-in WebFetch tool, which renders JS and extracts plain text or markdown. For static content or custom headers, curl is recommended instead.

How do I handle pagination and retries when fetching web content?

To handle pagination and retries when fetching web content, you can apply advanced retrieval patterns supporting timeouts and redirect management. This ensures reliable content extraction across multiple pages.

When should I use curl instead of WebFetch for URL retrieval?

You should use curl instead of WebFetch for URL retrieval when you need custom headers, POST body control, or cookie management. WebFetch is preferred for extracting markdown or plain text from JS-rendered pages.