update-dqs

Updates DQS documents with new mappings, schemas, SLAs, and thresholds.

5|1|Updated Sep 23, 2025
One-click install
npx skills add https://github.com/RDEWAI/Redefining-DataEngineering-With-AI --skill update-dqs
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: update-dqs
Source: https://github.com/RDEWAI/Redefining-DataEngineering-With-AI/tree/main/chapter-6/dq-engineer-plugin/skills/update-dqs
Command: npx skills add https://github.com/RDEWAI/Redefining-DataEngineering-With-AI --skill update-dqs

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Manually updating data quality specifications (DQS) when upstream artifacts like source-to-target mappings, database schemas, or SLA requirements change is error-prone, often leading to missing traceability, inconsistent rule updates, and versioning conflicts that cause downstream engineering delays.

Core Features & Use Cases

  • Automated DQS Revision: Merges updates to STM rules, DMS schema changes, SLA requirements, and alert thresholds into existing DQS documents while preserving all unchanged content and maintaining full cross-layer coverage for bronze, silver, and gold medallion layers.
  • Traceability & Validation Enforcement: Ensures every updated rule traces back to an upstream STM mapping or DRD requirement, runs mandatory validation checks, and regenerates Spark-Expectations rule files to align with the updated specification.
  • Use Case: For example, if your source-to-target mappings are updated to add a new lab_results table with foreign key relationships, this skill will automatically add the corresponding referential integrity rules, update statistical baselines, bump the DQS version, and add a change log entry without overwriting existing quality rules.

Quick Start

Use the update-dqs skill to revise the latest data quality specification to incorporate the new patient_id field validation rules and updated 24-hour freshness SLA thresholds from the latest DRD document.

Frequently Asked Questions about update-dqs

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I update data quality specifications when source-to-target mappings change?

Update data quality specifications by merging STM mapping changes into existing DQS documents while preserving unchanged validation rules. This process maintains full traceability to upstream requirements and regenerates Spark-Expectations rule files to align with the revised specification across bronze, silver, and gold medallion layers.

What is the best way to maintain traceability across medallion layers during DQS revisions?

Maintain medallion layer traceability by ensuring every updated validation rule traces back to an upstream STM mapping or DRD requirement. This approach automatically bumps the DQS version, adds change log entries, and runs mandatory validation gate checks before handing off to engineering teams.

How do I add referential integrity rules to a DQS when new foreign key relationships are introduced?

Add referential integrity rules to a DQS by applying approved STM updates that automatically generate corresponding validation checks. The process updates statistical baselines, bumps the DQS version, and adds change log entries without overwriting existing quality rules.

Can I adjust SLA thresholds and alert configurations in an existing data quality specification?

Adjust SLA thresholds and alert configurations in an existing data quality specification by merging approved DRD requirement changes. The revision updates freshness SLA thresholds and alert configurations while preserving all unchanged content and maintaining cross-layer coverage for bronze, silver, and gold layers.

How do I regenerate Spark-Expectations rules after modifying database schemas in a DMS?

Regenerate Spark-Expectations rules after DMS schema modifications by applying the schema changes to the DQS document. This action triggers automated rule file regeneration to align with the updated specification, followed by read-only database volume verification for baseline updates.

What happens to unchanged validation rules when a data quality specification is updated?

Unchanged validation rules are preserved when a data quality specification is updated. The revision process merges approved changes to STM rules, DMS schema, SLA requirements, and alert thresholds while keeping all existing quality rules intact across the bronze, silver, and gold medallion layers.