web-article-extractor

Extract web articles into Markdown with YAML front matter.

365|61|Updated Dec 21, 2025
One-click install
npx skills add https://github.com/dongbeixiaohuo/writing-agent --skill web-article-extractor
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: web-article-extractor
Source: https://github.com/dongbeixiaohuo/writing-agent/tree/main/.claude/skills/%E5%85%AC%E4%BC%97%E5%8F%B7%E6%96%87%E7%AB%A0%E8%8E%B7%E5%8F%96
Command: npx skills add https://github.com/dongbeixiaohuo/writing-agent --skill web-article-extractor

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires fs, path, https, http, url, and includes scripts (resource) and references (resource) components.

What problem does it solve?

This Skill automates the extraction and transformation of web articles into structured data, enabling quick integration into knowledge bases, summaries, and content workflows. It excels at handling articles from diverse sources, including 微信公众号 (WeChat) articles, which often have dynamic content and safety constraints.

Core Features & Use Cases

  • Automated article extraction: Extracts title, author, publish date, content, images, and metadata from web pages.
  • Markdown export ready: Converts content to Markdown with YAML front matter for easy publishing and archiving.
  • Image handling: Downloads embedded images and updates references to local paths for offline use.
  • WeChat support: Includes specialized flows for 微信公众号 content with configurable user-agent and selectors.
  • Use Case: Create a personal knowledge library by batch extracting articles from blogs, news sites, and WeChat public accounts.

Quick Start

Use the web-article-extractor skill to extract content from a URL, e.g. https://example.com/article

Frequently Asked Questions about web-article-extractor

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I extract web articles and convert them to Markdown format?

Web article extraction automates pulling title, author, date, and content from URLs, converting them to Markdown with YAML front matter. This enables quick integration into knowledge bases, summaries, and archival workflows.

Can I use this for WeChat public account article extraction?

Yes, WeChat article extraction is supported with specialized flows. It handles dynamic content and safety constraints using configurable user-agent strings and selectors to capture WeChat public account articles.

How does Readability-based extraction handle embedded images?

Readability-based extraction downloads embedded images during parsing and updates references to local paths. This ensures offline use and preserves visual content within the extracted Markdown output.

Does web article extraction capture metadata beyond the main content?

Yes, metadata capture is a core feature. It extracts title, author, publish date, and other metadata alongside the main content, structuring everything into data ready for aggregation and research notes.

What is the best way to batch extract articles from blogs and news sites?

Batch extracting articles is achieved by applying automated extraction pipelines to multiple URLs. It aggregates content from diverse sources like blogs and news sites, outputting structured Markdown files for a personal knowledge library.

Are there limitations when extracting content from sites with dynamic safety constraints?

Dynamic sites with safety constraints may require configurable user-agent settings. While specialized flows handle WeChat articles, highly dynamic platforms might still block automated extraction if strict anti-scraping measures are active.