des-ingestion-design
CommunityDesign safe ingestion before Bronze build.
Software Engineering#data engineering#idempotency#schema drift#phase orchestration#data observability#replay backfill#ingestion specification
AuthorDKSang
Version1.0.0
Installs0
System Documentation
What problem does it solve?
Prevents data engineering agents from starting Bronze/table design and pipelines with vague or unsafe ingestion assumptions by forcing an explicit, source-specific Ingestion Specification that covers correctness, replay/idempotency, schema drift, security, and evidence requirements.
Core Features & Use Cases
- Source-specific ingestion specification covering pattern, bounded/unbounded behavior, extraction method, and operational expectations.
- Correctness controls for incremental/checkpointing, idempotency, replay/backfill, late-arriving data, ordering, and deduplication.
- Governance & operational evidence defining monitoring/audit expectations and the Phase 08 evidence pack and handoff to Phase 09.
Quick Start
Use the des-ingestion-design skill to create or revise _des-output/planning-artifacts/08-ingestion-specification.md based on Phase 07 architecture decisions and the phase-07-to-08 handoff.
Dependency Matrix
Required Modules
None requiredComponents
Standard package💻 Claude Code Installation
Recommended: Let Claude install automatically. Simply copy and paste the text below to Claude Code.
Please help me install this Skill: Name: des-ingestion-design Download link: https://github.com/DKSang/DES-SKILL/archive/main.zip#des-ingestion-design Please download this .zip file, extract it, and install it in the .claude/skills/ directory.
Agent Skills Search Helper
Install a tiny helper to your Agent, search and equip skill from 471,000+ vetted skills library on demand.