skills.rest
SenseTime-FVG
SenseTime-FVGOFFICIAL
Explore all skills by this author →
GitHub

union-search-skill

Aggregate search queries across multiple platforms into structured JSON and Markdown results.

8|Updated Feb 25, 2026
Search Tags:#cli#aggregation#social-media#web-scraping#json-output#image-search#multi-platform-search
One-click install
npx skills add https://github.com/SenseTime-FVG/sensenova-claw --skill union-search-skill-sensetime-fvg
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: union-search-skill
Source: https://github.com/SenseTime-FVG/sensenova-claw/tree/main/.sensenova-claw/skills/union-search-skill
Command: npx skills add https://github.com/SenseTime-FVG/sensenova-claw --skill union-search-skill-sensetime-fvg

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires requests, python-dotenv, lxml, pyimagedl, serpapi, tavily-python, and includes scripts (resource) and references (resource) components.

What problem does it solve?

Provide a single, standardized interface to search and aggregate results from dozens of heterogeneous platforms so users no longer need to run multiple ad-hoc scrapers or remember different APIs and formats.

Core Features & Use Cases

  • Multi-platform aggregation: Concurrently query GitHub, Reddit, Xiaohongshu, Douyin, Bilibili, YouTube, Twitter, Google, Tavily, Metaso, Volcengine and many no-API search engines and combine results.
  • Structured outputs & archiving: Produce JSON/Markdown outputs, preserve raw API responses in responses/, and provide download candidates for media.
  • Flexible authentication & fallbacks: Support API-key, cookie-based access, proxy configuration, retry/backoff and no-API scraping fallbacks for robust monitoring, research, and content discovery workflows.

Quick Start

Run the union-search CLI to search a keyword across desired platform groups and save the aggregated JSON results to a file.

Frequently Asked Questions about union-search-skill

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I search and aggregate results across multiple social media platforms at once?▼

Multi-platform search aggregation lets you concurrently query platforms like Reddit, Douyin, and Bilibili, retrieving unified structured JSON or Markdown outputs from a single CLI call.

What is the best way to collect structured JSON data from various search engines and GitHub?▼

Aggregating search queries across multiple platforms provides structured JSON outputs while preserving raw API responses, replacing the need to run multiple ad-hoc scrapers for GitHub and search engines.

Can I scrape platforms like Xiaohongshu and YouTube without an official API?▼

Yes, multi-platform search aggregation supports no-API scraping fallbacks using cookie-based access and proxies, enabling data collection from platforms like Xiaohongshu and YouTube when APIs are unavailable.

Do I need API keys for Serpapi and Tavily to perform cross-platform content discovery?▼

You need API keys for Serpapi and Tavily to access general search engines, but the tool also supports cookie-based authentication and fallback scraping for platforms requiring alternative access methods.

How does concurrent web scraping handle timeouts and rate limits across heterogeneous platforms?▼

Cross-platform aggregation manages timeouts and rate limits using configurable concurrent requests, retry logic, and backoff strategies, ensuring robust monitoring and bulk data collection.

What are the limitations of using no-API scraping fallbacks for cross-platform research?▼

No-API scraping fallbacks depend on cookie persistence and platform HTML structures via lxml, making them vulnerable to structural changes and potential blocking if concurrent request limits are exceeded.

Related Skills

Explore More Software Engineering Skills→
0xHoneyJar0xHoneyJar
1

loa-credentials

Manage API credentials across environment variables, encrypted stores, and dotenv files.

Official
Intermediate
OneWave-AIOneWave-AI
245

linkedin-post-optimizer

Optimize LinkedIn post drafts with hooks, hashtags, and markdown formatting.

Official
Basic
s-hiraokus-hiraoku
21

firecrawl-api

Extract web content via Firecrawl API using curl requests.

Community
Basic
xfs96192xfs96192

mx_search

Query financial sources and return cited summaries with structured metadata.

Community
Intermediate