skills.rest
RDEWAI
RDEWAIOFFICIAL
Explore all skills by this author →
GitHub

update-gold

Align Gold layer builders with approved upstream design documents and Silver inputs.

5|1|Updated Sep 23, 2025
Search Tags:#data-quality#data-pipeline#gold-layer#upstream-sync#data-versioning#silver-reconciliation#dag-patching
One-click install
npx skills add https://github.com/RDEWAI/Redefining-DataEngineering-With-AI --skill update-gold
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: update-gold
Source: https://github.com/RDEWAI/Redefining-DataEngineering-With-AI/tree/main/chapter-6/developer-plugin/skills/update-gold
Command: npx skills add https://github.com/RDEWAI/Redefining-DataEngineering-With-AI --skill update-gold

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Manually reconciling Gold layer data implementations when upstream design documents or Silver layer inputs change is time-consuming and error-prone. This Skill automates the alignment process to ensure Gold layer code stays consistent with the latest approved specifications without rewriting unchanged code.

Core Features & Use Cases

  • Multi-mode operation: Run in story mode for authorized changes, diff mode to detect and fix drift between current Gold and latest upstream/Silver contracts, or full mode to regenerate all Gold builders from scratch.
  • Versioning and validation: Enforces 3-scenario versioning rules, validates that all upstream artifacts are approved and the Silver layer is complete before making changes, and warns when Silver input changes require Gold rebuilds.
  • Pipeline integration: Automatically patches DAG wiring for added or removed Gold tables and regenerates unit tests for modified builders.
  • Use Case: For data engineering teams working on the patient_360 project, use this skill to quickly update Gold layer tables after a Silver schema change or re-approved upstream design document, preserving all unmodified builder code.

Quick Start

Use the update-gold skill to align all Gold layer builders with the latest approved upstream specifications and current Silver layer contracts.

Frequently Asked Questions about update-gold

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I sync my Gold layer data with upstream Silver schema changes?▼

To sync your Gold layer data with upstream Silver schema changes, you can use a reconciliation skill that detects drift against approved contracts and regenerates Gold builders while preserving unchanged code.

What is the best way to detect drift between Gold layer tables and upstream design documents?▼

Detecting drift between Gold layer tables and upstream design documents requires running a diff mode operation that compares current Gold implementations against the latest approved LLD and DMS specifications to identify misalignments.

How do I update DAG wiring when adding or removing Gold layer tables?▼

Updating DAG wiring for Gold layer table additions or removals is handled automatically by patching the pipeline connections when you regenerate or modify Gold builders during the synchronization process.

Do I need Silver layer completion before rebuilding Gold layer builders?▼

Yes, Silver layer completion is a mandatory validation gate; the system enforces upstream artifact approval and verifies that Silver inputs are fully complete before allowing any Gold layer builder modifications.

Can I regenerate all Gold layer builders from scratch without losing unchanged code?▼

Running a full mode regeneration rebuilds all Gold layer builders from scratch while strategically preserving unmodified builder code to minimize unnecessary pipeline disruptions and maintain data versioning rules.

When should I avoid full mode regeneration for Gold layer synchronization?▼

You should avoid full mode regeneration when only minor story-authorized changes are needed, as targeted story or diff modes are more efficient for localized updates without overwriting the entire Gold layer implementation.

Related Skills

Explore More Data & Analytics Skills→
databricks-solutionsdatabricks-solutions
5

02-merge-patterns

Provides Gold layer MERGE patterns including SCD Type 1/2 and schema evolution for PySpark data lakes.

Official
Advanced
RDEWAIRDEWAI
5

validate-gold

Validate Gold layer implementations against approved design specifications and data quality standards.

Official
Advanced
RDEWAIRDEWAI
5

update-silver

Align Silver data transformation layers with updated upstream specifications.

Official
Advanced
qwwiwiqwwiwi
3

agentos-content

Author Python source-of-truth content and apply it to TS mock and Supabase blocks.

Community
Advanced