web-reader

Extract structured content and metadata from public web pages.

Updated May 30, 2026
One-click install
npx skills add https://github.com/zeroix07/mcp-skill-agent --skill web-reader-zeroix07
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: web-reader
Source: https://github.com/zeroix07/mcp-skill-agent/tree/main/web-reader
Command: npx skills add https://github.com/zeroix07/mcp-skill-agent --skill web-reader-zeroix07

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires z-ai-web-dev-sdk, and includes scripts (resource) components.

What problem does it solve?

Manually copying and cleaning web page content is time-consuming and error-prone, especially for articles, research papers, and news sites with messy HTML, ads, and irrelevant elements. This Skill automates the extraction of structured, clean content including page titles, main text, and publication metadata from any public web URL.

Core Features & Use Cases

  • Automated Content Extraction: Fetches and parses any public web page to return structured data including title, clean HTML, plain text, and publication timestamp.
  • Dual Usage Modes: Supports simple CLI commands for quick one-off scraping and SDK integration for building custom applications, pipelines, and APIs.
  • Common Use Cases: Ideal for news aggregation, content monitoring, research data collection, SEO analysis, price tracking, and competitive intelligence gathering.

Quick Start

Use the web-reader skill to extract the full article content, title, and publication date from the news article at https://news.example.com/ai-breakthrough-2024.

Frequently Asked Questions about web-reader

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I extract clean article text and metadata from a public web page URL?

To extract clean article text and metadata from a public web page URL, you can use an automated content extraction tool that parses the HTML and returns structured data including the title, plain text, and publication timestamp.

What is the best way to automate web scraping for news aggregation without manual HTML parsing?

The best way to automate web scraping for news aggregation is to use a page reader function that fetches public URLs and eliminates manual HTML parsing, directly returning structured plain text and metadata suitable for content monitoring.

Does web content extraction require the z-ai-web-dev-sdk to fetch publication times and token usage?

Yes, web content extraction requires the z-ai-web-dev-sdk backend package to invoke the page_reader function, which returns structured data including publish time, clean HTML, plain text, and token usage metrics.

Can I use content extraction scripts for SEO analysis and competitive intelligence tracking?

Yes, you can use content extraction scripts for SEO analysis and competitive intelligence tracking, as they automatically retrieve structured data and publication metadata from any publicly accessible URL.

How do I retrieve plain text and clean HTML from a news site with messy ads and irrelevant elements?

To retrieve plain text and clean HTML from a news site with messy ads, you can apply an automated page reader that filters out irrelevant elements and returns only the structured main text and metadata.

Are there limitations when extracting content from public web pages using a page reader?

Limitations of extracting content from public web pages include the inability to access restricted or private URLs, as the page reader is designed specifically for publicly accessible web pages to retrieve structured data.