Extract structured content and metadata from public web URLs.
npx skills add https://github.com/XJTLUmedia/Modernblog --skill web-reader-xjtlumedia
Please help me install this Agent Skill. Skill: web-reader Source: https://github.com/XJTLUmedia/Modernblog/tree/main/skills/web-reader Command: npx skills add https://github.com/XJTLUmedia/Modernblog --skill web-reader-xjtlumedia
Manually copying and processing web content is time-consuming and error-prone, especially when working with multiple pages or large volumes of text. This Skill automates the extraction of structured page data, metadata, and plain text from any public web URL, eliminating repetitive manual work.
Use the web-reader skill to extract the full content, title, and publication timestamp from the web page at https://example.com/ai-research-article.
High-intent search queries and answers about installing and using this skill.
To extract plain text and metadata for research data collection, this Skill automates fetching raw page HTML, titles, and publication timestamps from any public URL using the z-ai-web-dev-sdk page_reader function. It eliminates manual copying by returning structured data suitable for aggregating datasets.
For batch web scraping without getting blocked, this Skill processes multiple URLs concurrently with built-in rate limiting and caching. This approach optimizes performance, manages request frequency, and reduces API costs when extracting content from large volumes of pages.
Yes, you can use z-ai-web-dev-sdk to integrate content extraction logic into backend applications. The Skill leverages the page_reader function to fetch structured web page content and associated metadata, acting as an automated extraction layer for news aggregation or SEO analysis workflows.
Web content extraction works effectively for monitoring news aggregation across multiple URLs. The Skill concurrently fetches page titles, HTML content, plain text, and publication timestamps, enabling automated content monitoring workflows for research or SEO analysis.
To retrieve publication timestamps and page titles during web scraping, the Skill automates the extraction of structured page data and associated metadata from any public URL. It returns plain text alongside temporal metadata, supporting content monitoring and research data collection.
zakaroooExtract web page content and metadata via the page_reader function.
ericwang915Extract text and metadata from PDFs using PyPDF2.
markus41Implement prompt caching for Claude API interactions with configurable TTL options.
zeustritonExtract page titles, HTML, and metadata from single or batch URLs.
