rss-article-retriever

Fetch, clean, and structure RSS articles into JSON via WeWe-RSS and Playwright.

Updated Jul 20, 2025
One-click install
npx skills add https://github.com/sungaoxiang-backend/intelligent-evidence-platform --skill rss-article-retriever
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: rss-article-retriever
Source: https://github.com/sungaoxiang-backend/intelligent-evidence-platform/tree/main/app/agentic/skills/rss-article-retriever
Command: npx skills add https://github.com/sungaoxiang-backend/intelligent-evidence-platform --skill rss-article-retriever

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires playwright, and includes scripts (resource) and references (resource) components.

What problem does it solve?

This Skill automates fetching, cleaning, and structuring RSS article content for downstream processing, eliminating manual collection and normalization steps.

Core Features & Use Cases

  • RSS retrieval: List or search articles from the local WeWe-RSS service.
  • Content cleaning: Remove noise such as ads, promotional blocks, and non-content elements while preserving main article text.
  • Content structuring: Output a structured JSON with plain_text, sections, and source for use by downstream tools (e.g., video-script-generator).

Quick Start

Use the rss-article-retriever to fetch the latest articles or search by keyword, then fetch full content for a specific article URL using the provided scripts:

  • Fetch RSS feed: python3 app/agentic/skills/rss-article-retriever/scripts/fetch_rss.py --limit 5
  • Fetch full content: python3 app/agentic/skills/rss-article-retriever/scripts/fetch_content.py "https://mp.weixin.qq.com/s/..."

Frequently Asked Questions about rss-article-retriever

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I automate fetching and cleaning RSS article content for downstream analytics?

You can automate fetching and cleaning RSS article content by running Playwright-based extraction scripts that pull feeds from a local WeWe-RSS service, remove noise like ads, and output structured JSON for analytics.

How do I extract plain text from WeWe-RSS feeds without ads or promotional noise?

To extract plain text from WeWe-RSS feeds without ads, use a content cleaning script that strips promotional blocks and non-content elements, outputting structured JSON with plain text and sections.

Does RSS article extraction with Playwright require a local WeWe-RSS service?

Yes, RSS article extraction with Playwright requires a local WeWe-RSS service to supply the feed lists and article URLs needed to fetch and extract full content.

What's the best way to structure RSS article data for video script generation?

The best way to structure RSS article data for video script generation is to output JSON containing plain text, sections, and source metadata, ensuring compatibility with downstream video-script-generator tools.

How do I list and search articles in a local RSS feed using Python?

You can list and search articles in a local RSS feed using Python by running the fetch_rss.py script with a limit parameter to list items, or by passing keywords to search specific articles.

Why do I need Playwright to fetch full content from an RSS article URL?

You need Playwright to fetch full content from an RSS article URL because it handles browser-based rendering and extraction, ensuring dynamically loaded text is captured and cleaned for analytics.