skills.rest
devskale
devskaleCOMMUNITY
Explore all skills by this author →
WebsiteGitHub

fetch-url

Convert web pages into readable text using local text browsers or a remote API.

1|Updated Jan 27, 2026
Search Tags:#api#fetch#web#text-extraction#bearer-token#w3m#lynx
One-click install
npx skills add https://github.com/devskale/skale-skills --skill fetch-url
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: fetch-url
Source: https://github.com/devskale/skale-skills/tree/main/skills/fetch-url
Command: npx skills add https://github.com/devskale/skale-skills --skill fetch-url

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires requests.

What problem does it solve?

Users often need to quickly extract readable text from web pages for study, summarization, or accessibility, without manual copying of HTML content.

Core Features & Use Cases

  • Local mode: use built-in text browsers (w3m/lynx) to fetch and dump readable content.
  • API mode: fetch via a remote API when local browsers are unavailable, with optional Bearer authentication.
  • Output options: clean text, optional link numbering, and automatic URL normalization to ensure consistent results.
  • Use Case: extract article text from a news site for offline reading or to feed into a summarization model.

Quick Start

  • cd ~/.pi/agent/skills/fetch-url
  • uv venv
  • uv run fetch.py "https://example.com"

Frequently Asked Questions about fetch-url

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I extract readable text from a web page without copying HTML manually?▼

Fetch-url converts web pages into clean, readable text using local text browsers like w3m or lynx, or via a remote API. It handles articles, documentation, and long-form content by stripping HTML and returning formatted text you can read offline or feed into other tools.

Can I fetch web content if I don't have w3m or lynx installed locally?▼

Yes. Fetch-url supports API mode for remote text extraction when local browsers aren't available. You only need the requests library and can optionally authenticate with a bearer token for API access.

What's the best way to extract article text for summarization or study?▼

Fetch-url is designed for this workflow. It fetches web pages, normalizes URLs, optionally numbers links, and outputs clean text suitable for feeding into summarization models or offline reading without manual HTML parsing.

How do I authenticate when fetching content via the remote API?▼

Fetch-url accepts a bearer token for API authentication. Pass the token when using API mode, and the tool handles authorization so you can fetch protected or restricted content securely.

Does fetch-url work with any URL, or are there limitations?▼

Fetch-url normalizes URLs automatically for consistent results and works with standard web pages. Local mode works with any site accessible to w3m or lynx; API mode depends on the remote service's coverage and rate limits.

Related Skills

Explore More Content & Communication Skills→
BedaBeda-GrowthBedaBeda-Growth

Fix Together AI Source

Configure Together AI as a Craft Agent source with bearer token authentication.

Official
Intermediate
winsorllcwinsorllc

document-indexer

Index text documents into a JSONL file with full-text search and keyword extraction.

Community
Intermediate
veniceaiveniceai
130

venice-augment

Extract text from documents, scrape web pages, and perform web searches via Venice API.

Official
Advanced
appautomatonappautomaton
18

html-to-markdown

Converts HTML or live web pages into structured Markdown with metadata and link inventories.

Official
Intermediate