databricks-dq-automation
CommunityAutomate Databricks data quality checks.
Authoralexeyban
Version1.0.0
Installs0
System Documentation
What problem does it solve?
Databricks pipelines often change data structures and data flows; this skill automates the post-change validation of Databricks SQL data quality, turning pipeline updates into clear PASS/FAIL signals.
Core Features & Use Cases
- Runs repository-defined data quality checks against Silver data using stored SQL queries in dq_queries/silver.
- Generates a consolidated pass/fail report with per-check details and an overall status.
- Integrates with existing pipelines and notebooks to automatically gate quality after changes, reducing manual validation effort.
Quick Start
Run the dq automation after pipeline changes to validate Silver outputs and produce a pass/fail report.
Dependency Matrix
Required Modules
databricks-sdkpython-dotenv
Components
scripts
💻 Claude Code Installation
Recommended: Let Claude install automatically. Simply copy and paste the text below to Claude Code.
Please help me install this Skill: Name: databricks-dq-automation Download link: https://github.com/alexeyban/databricks-lab/archive/main.zip#databricks-dq-automation Please download this .zip file, extract it, and install it in the .claude/skills/ directory.
Agent Skills Search Helper
Install a tiny helper to your Agent, search and equip skill from 471,000+ vetted skills library on demand.