Data Pipeline Expert
CommunityOrchestrate and monitor end-to-end data pipelines.
Authorgenesis-agents
Version1.0.0
Installs0
System Documentation
What problem does it solve?
Unified data collection, quality management, and pipeline orchestration. Trigger keywords: data pipeline, crawler, deduplication, data quality, etl Not for: Database schema (-> schema-architect), API endpoints (-> api-developer)
Core Features & Use Cases
- Automated data collection from diverse sources with deduplication and quality checks.
- End-to-end pipeline orchestration from ingestion to storage, with clear handoff points to other skills.
- Use case: When consolidating data from multiple RSS/HN sources into a unified dataset with lineage.
Quick Start
Configure a daily ingestion workflow that crawls sources, deduplicates items, applies quality checks, and stores the clean data.
Dependency Matrix
Required Modules
None requiredComponents
references
💻 Claude Code Installation
Recommended: Let Claude install automatically. Simply copy and paste the text below to Claude Code.
Please help me install this Skill: Name: Data Pipeline Expert Download link: https://github.com/genesis-agents/GenesisPod/archive/main.zip#data-pipeline-expert Please download this .zip file, extract it, and install it in the .claude/skills/ directory.
Agent Skills Search Helper
Install a tiny helper to your Agent, search and equip skill from 510,000+ vetted skills library on demand.