skills.rest
Adelie-Squad
Adelie-SquadOFFICIAL
Explore all skills by this author →
GitHub

data-collector

Collect and aggregate data from APIs, web scraping, and event streams into a unified pipeline.

17|1|Updated Feb 3, 2026
Search Tags:#api#data-pipeline#web-scraping#data-collection#event-tracking#data-ingestion
One-click install
npx skills add https://github.com/Adelie-Squad/solosquad --skill data-collector-adelie-squad
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: data-collector
Source: https://github.com/Adelie-Squad/solosquad/tree/main/assets/agents/engineering/data-collector
Command: npx skills add https://github.com/Adelie-Squad/solosquad --skill data-collector-adelie-squad

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Data Collector automates multi-source data gathering across external APIs, web scraping, and event streams, eliminating manual ingestion and speeding up analytics workflows.

Core Features & Use Cases

  • External API data collection and ingestion
  • Web scraping and content harvesting
  • Event tracking design and data-pipeline orchestration
  • Schedule-driven data collection and scalable pipelines
  • Lightweight routing of collected data to storage and analysis backends

Quick Start

Start collecting data from defined sources (APIs, websites, and events) and route it into the data pipeline.

Frequently Asked Questions about data-collector

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I automate multi-source data collection from APIs and web scraping?▼

Multi-source data collection is automated by defining structured configurations for data sources, collection frequency, and constraints, using specific adapters for API ingestion and web scraping to build reproducible data pipelines.

What is the best way to build a unified data pipeline for event tracking and API ingestion?▼

A unified data pipeline for event tracking and API ingestion is built by applying structured adapters that route collected data to storage and analysis backends, enabling schedule-driven collection and scalable data workflows.

Can I schedule API data collection and route it to my analysis backends?▼

Yes, schedule-driven API data collection is supported through structured configuration inputs, allowing you to define collection frequency and route the aggregated data directly to downstream analysis backends.

How do I ensure reproducible data pipelines when harvesting web data?▼

Reproducible web data pipelines are ensured by enforcing structured configurations with defined inputs for data sources and constraints, utilizing specific web scraping adapters to maintain consistent data harvesting.

Do I need specific adapters for event-tracking data ingestion?▼

Yes, event-tracking data ingestion requires defined event-tracking adapters within the pipeline configuration to properly collect, aggregate, and route event stream data into your unified data workflows.

Related Skills

Explore More Data & Analytics Skills→
yudameyudame
2

podcast-feed-validator

Validate podcast RSS feeds against the Yudame RSS specification.

Official
Intermediate
Thiago-Cruz-engThiago-Cruz-eng

data-analysis

Analyze datasets to extract insights and produce structured reports.

Community
Intermediate
MicrockMicrock
322

Swarm Orchestration

Coordinate multi-agent swarms for parallel task execution across mesh, hierarchical, and adaptive topologies.

Community
Advanced
mor-duongmhmor-duongmh
3

dispatching-parallel-agents

Dispatch parallel agents with isolated context to investigate failures and consolidate remediation plans.

Community
Advanced