skills.rest
augustscl
augustsclCOMMUNITY
Explore all skills by this author →
GitHub

content-parser

Extract and normalize content from HTTP(S) URLs into structured data.

2|Updated Apr 6, 2026
Search Tags:#content#metadata#references#url parsing#web extraction#content preprocessing
One-click install
npx skills add https://github.com/augustscl/awesome-xiawang-skills --skill content-parser
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: content-parser
Source: https://github.com/augustscl/awesome-xiawang-skills/tree/main/content-parser
Command: npx skills add https://github.com/augustscl/awesome-xiawang-skills --skill content-parser

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Extract and normalize content from URLs across supported platforms. Returns structured data including the content body, metadata, and references to help downstream skills.

Core Features & Use Cases

  • URL content extraction and normalization from HTTP(S) URLs
  • Returns structured data: content body, metadata, and references for downstream processing
  • Use case: preprocess article pages for summarization, extraction, or translation by other skills

Quick Start

Provide a URL to extract content from, and receive a structured payload containing the content body, metadata, and references.

Frequently Asked Questions about content-parser

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I extract web content from a URL for preprocessing?▼

To extract web content from a URL, provide a valid HTTP(S) link. The skill validates the URL and returns a structured payload containing the normalized content body, metadata, and references for downstream processing.

What is URL content extraction and normalization?▼

URL content extraction and normalization is the process of parsing web pages to retrieve the main content body. It structures the extracted text alongside metadata and references, making it ready for tasks like article summarization or translation.

Can I use this to preprocess article pages before summarization?▼

Yes, you can use this to preprocess article pages before summarization. It parses URLs and outputs structured data including the content body and metadata, serving as a reliable input stage for other generation or extraction skills.

Does URL parsing work with non-HTTP(S) links?▼

URL parsing does not work with non-HTTP(S) links. The skill explicitly validates for HTTP and HTTPS protocols to ensure secure extraction, returning structured content and metadata only for supported web URLs.

What metadata do I get when extracting content from URLs?▼

When extracting content from URLs, you get a structured data payload that includes the normalized content body, page metadata, and references. This output is designed to integrate with ListenHub API patterns for downstream skills.

Related Skills

Explore More Content & Communication Skills→
mrclrchtrmrclrchtr
54

web-fetch-to-markdown

Fetch HTTP(S) webpages and normalize content into clean Markdown.

Community
Intermediate
X-McKayX-McKay
3

fetch-rss-feeds

Fetch RSS/Atom articles, deduplicate by URL, and store metadata in memory.

Community
Intermediate
Aurora-AIAurora-AI
1

Elysian Integrator

Integrate AI agents with Postgres databases and orchestrate workflows via @start and @listen.

Community
Advanced
AlejandroFiginiAlejandroFigini

scrape

Extract structured data from web pages using CSS selectors into JSON or CSV.

Community
Advanced