skills.rest
tentacle-pro
tentacle-proCOMMUNITY
Explore all skills by this author →
GitHub

news-aggregator-skill

Aggregate real-time news from multiple sources into structured JSON output.

Updated Feb 4, 2026
Search Tags:#multi-source#real-time#aggregation#news#web-scraping#deep-analysis
One-click install
npx skills add https://github.com/tentacle-pro/woa-skill --skill news-aggregator-skill-tentacle-pro
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: news-aggregator-skill
Source: https://github.com/tentacle-pro/woa-skill/tree/main/skills/news-aggregator-skill
Command: npx skills add https://github.com/tentacle-pro/woa-skill --skill news-aggregator-skill-tentacle-pro

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires requests, beautifulsoup4, and includes scripts (resource) components.

What problem does it solve?

通过从八大来源实时聚合新闻、过滤不相关信息并进行深度分析，帮助用户快速获得高价值的新闻洞察。

Core Features & Use Cases

  • 多源抓取：从 Hacker News、GitHub Trending、Product Hunt、36Kr、腾讯新闻、华尔街见闻、V2EX 与微博热搜等源获取实时信息。
  • 过滤与深度抓取：支持关键词过滤和可选深度抓取，附带文章全文内容。
  • 结构化输出：输出 JSON，字段包含 source、title、url、heat、time，深度抓取时还包含 content。
  • 使用场景示例：每日要闻汇总、科技新闻简报、财经更新及热点话题解读。

Quick Start

请使用新闻聚合技能从 Hacker News、GitHub Trending、Product Hunt 等源抓取最新条目，按需过滤并可选择启用深度抓取以获取全文。

Frequently Asked Questions about news-aggregator-skill

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I aggregate real-time news from multiple sources for daily briefings?▼

To aggregate real-time news for daily briefings, this Skill fetches and consolidates updates from eight sources including Hacker News, GitHub Trending, and 36Kr, outputting structured JSON fields like source, title, url, heat, and time.

Can I filter aggregated news by keywords and extract full article content?▼

Yes, you can filter aggregated news by keywords and enable optional deep content extraction. Deep scraping fetches the full article text, appending it as a content field within the standard JSON output alongside title and heat.

Does this news aggregation tool support scraping financial updates from Wall Street Journal China?▼

Yes, this news aggregation tool supports scraping financial updates from Wall Street Journal China. It also covers Tencent News and Weibo hot topics, structuring the extracted financial data into JSON format with heat and time metrics.

What is the best way to collect trending tech topics from Product Hunt and V2EX?▼

The best way to collect trending tech topics from Product Hunt and V2EX is using a multi-source web scraping approach. This Skill automates the process, capturing titles, URLs, and heat scores to deliver structured JSON data for analysis.

Do I need beautifulsoup4 to scrape structured JSON data from these news sources?▼

Yes, the web scraping relies on beautifulsoup4 and requests to parse HTML and gather real-time news. These dependencies enable the extraction of structured JSON data fields including source, title, url, heat, and time from the target platforms.

What are the limitations of using web scraping for real-time news aggregation?▼

A limitation of web scraping for real-time news aggregation is potential source structure changes causing extraction failures. Additionally, enabling deep content scraping increases processing time and may hit rate limits on platforms like GitHub Trending or Weibo.

Related Skills

Explore More Data & Analytics Skills→
rlagycksrlagycks
3

data-scraper-agent

Scrape, process, and store public data from websites, APIs, and RSS feeds.

Community
Advanced
abdullah1854abdullah1854
1

crawl-cli

Crawl websites and extract content into Markdown, JSON, or text.

Community
Basic
X-McKayX-McKay
3

deduplicate-articles

Remove duplicate articles from a list by comparing URLs and report statistics.

Community
Basic
joylarkinjoylarkin
32

openclaw_security_news

Fetch and summarize OpenClaw security news from an RSS feed.

Community
Intermediate