skills.rest
rcstrue
rcstrueCOMMUNITY
Explore all skills by this author →
GitHub

web-reader

Fetch and parse web pages to extract structured content and metadata.

Updated Aug 23, 2026
Search Tags:#backend#metadata#web-scraping#content-extraction#web-reader#html-processing
One-click install
npx skills add https://github.com/rcstrue/php_payroll --skill web-reader-rcstrue
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: web-reader
Source: https://github.com/rcstrue/php_payroll/tree/main/php_payroll/skills/web-reader
Command: npx skills add https://github.com/rcstrue/php_payroll --skill web-reader-rcstrue

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires z-ai-web-dev-sdk, and includes scripts (resource) components.

What problem does it solve?

Web Reader enables programmatic extraction of content from web pages using the z-ai-web-dev-sdk, returning the page title, HTML, and metadata for downstream applications.

Core Features & Use Cases

  • Extract main article content, title, URL, and publication time from web pages.
  • Retrieve metadata such as description, keywords, and author from page HTML.
  • Operate from backend code with examples for SDK usage and CLI workflows, enabling batch processing, caching, and error handling.
  • Use cases include building news aggregators, SEO tools, research assistants, and content monitoring dashboards.

Quick Start

Invoke the page_reader function in your backend with a URL to fetch the page content and metadata.

Frequently Asked Questions about web-reader

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I extract structured content and metadata from web pages programmatically?▼

To extract structured content and metadata from web pages, you can use a backend processing function to fetch URLs and parse the HTML. This approach returns the page title, URL, HTML content, and publication time for downstream applications like content readers or aggregators.

What is the best way to build a news aggregator that ingests article data from URLs?▼

Building a news aggregator requires fetching web pages and parsing the HTML to retrieve the main article content, title, and metadata. Using a backend extraction function enables batch processing and caching to efficiently ingest article data from multiple URLs.

Does web content extraction work with the z-ai-web-dev-sdk in backend code?▼

Yes, web content extraction works directly with the z-ai-web-dev-sdk in backend code. The SDK provides the page_reader function to fetch and parse web pages, returning the title, URL, HTML, publishedTime, and usage tokens with robust error handling.

Can I retrieve page metadata like description, keywords, and author from raw HTML?▼

Yes, you can retrieve page metadata like description, keywords, and author from raw HTML. The extraction process parses the fetched web page to isolate main article content alongside its metadata, providing structured data suitable for SEO analysis and research tools.

What are the limitations of web scraping for content extraction in backend environments?▼

Limitations of web scraping for content extraction include handling robust error scenarios during URL fetching and managing usage tokens returned by the SDK. Proper backend implementation is required to handle parsing failures and ensure reliable metadata retrieval.

Related Skills

Explore More Software Engineering Skills→
zeustritonzeustriton

web-reader

Extract page titles, HTML, and metadata from single or batch URLs.

Community
Intermediate
jeffvincentjeffvincent
5

UXR Report Analyzer

Extract UXR report PDFs into standardized Markdown analyses with metadata.

Community
Advanced
OldCoderIsMeOldCoderIsMe

Article Metadata Extractor

Extract structured metadata from article URLs or content.

Community
Intermediate
marktantongcomarktantongco
2

web-reader

Extract title, HTML, text, and publish time from web pages.

Community
Intermediate