What problem does it solve?
Manually updating data quality specifications (DQS) when upstream artifacts like source-to-target mappings, database schemas, or SLA requirements change is error-prone, often leading to missing traceability, inconsistent rule updates, and versioning conflicts that cause downstream engineering delays.
Core Features & Use Cases
- Automated DQS Revision: Merges updates to STM rules, DMS schema changes, SLA requirements, and alert thresholds into existing DQS documents while preserving all unchanged content and maintaining full cross-layer coverage for bronze, silver, and gold medallion layers.
- Traceability & Validation Enforcement: Ensures every updated rule traces back to an upstream STM mapping or DRD requirement, runs mandatory validation checks, and regenerates Spark-Expectations rule files to align with the updated specification.
- Use Case: For example, if your source-to-target mappings are updated to add a new lab_results table with foreign key relationships, this skill will automatically add the corresponding referential integrity rules, update statistical baselines, bump the DQS version, and add a change log entry without overwriting existing quality rules.
Quick Start
Use the update-dqs skill to revise the latest data quality specification to incorporate the new patient_id field validation rules and updated 24-hour freshness SLA thresholds from the latest DRD document.