des-transformation-design

Design contract-aligned transformation specs for Bronze-to-Silver-to-Gold data pipelines.

2|Updated May 20, 2026
One-click install
npx skills add https://github.com/DKSang/DES-SKILL --skill des-transformation-design
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: des-transformation-design
Source: https://github.com/DKSang/DES-SKILL/tree/main/skills/des-transformation-design
Command: npx skills add https://github.com/DKSang/DES-SKILL --skill des-transformation-design

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

des-transformation-design helps you define transformation logic clearly and safely so downstream layers can be implemented without guessing, while ensuring contract alignment, grain correctness, dependency order, incremental/backfill behavior, and testable validation expectations across Bronze → Silver → Gold.

Core Features & Use Cases

  • Transformation specification (design, not code): Produce a Transformation Specification that captures scope, non-scope, principles, inventory, and layer-to-layer mapping.
  • Dependency, mapping, and grain definition: Define the dependency graph, input/output dataset mapping, and the exact output grain to prevent incorrect joins, premature aggregation, and ambiguous entity meaning.
  • Rules for business logic and data behavior: Specify business rules, cleaning/conformance rules, join/relationship rules, deduplication/survivorship rules, SCD/history handling, aggregation/metric calculation rules, incremental strategy, backfill/replay, late/corrected data behavior, error/quarantine behavior, and validation expectations.
  • Contract-aligned traceability: Ensure contracted outputs map to transformation paths and record lineage and metadata expectations for evidence-driven handoff.

Quick Start

Use the des-transformation-design skill when your Phase 12 data contract and Bronze/Silver/Gold layer designs exist and you need a Phase 13 Transformation Specification before writing any SQL or pipeline code.

Frequently Asked Questions about des-transformation-design

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I design data transformation logic for Bronze to Silver to Gold layers?

Designing Bronze-to-Silver-to-Gold transformations requires producing a specification that captures dependency graphs, grain definitions, and business rules, ensuring contract alignment and testable validation expectations across data layers.

What is transformation specification in data engineering?

Transformation specification in data engineering is the design of contract-aligned logic covering mapping, grain definition, and business rules for Bronze-to-Silver-to-Gold layers, producing implementable specs without writing actual code.

How do I handle incremental processing and backfill in data transformation design?

Handling incremental processing and backfill in data transformation design involves specifying incremental strategies, replay behavior, and late or corrected data handling within the transformation specification to ensure contracted output consistency.

What do I need before creating a data transformation specification?

Before creating a data transformation specification, you need complete upstream planning artifacts, including Phase 12 data contracts and Bronze/Silver/Gold layer designs, to ensure a proper Phase 12-to-13 handoff.

How do you define output grain to prevent premature aggregation in data pipelines?

To define output grain and prevent premature aggregation, specify the exact output dataset mapping and grain definition in the transformation specification, ensuring correct joins and unambiguous entity meaning across layers.

Does transformation design handle SCD and deduplication rules without writing implementation code?

Yes, transformation design handles SCD, history, and deduplication survivorship rules by specifying the logic and validation expectations in the design phase, delivering testable specs without writing actual implementation code.