create-deploy-validation

Generate POSIX shell scripts and pytest smoke tests for data layer deploy validation.

5|1|Updated Sep 23, 2025
One-click install
npx skills add https://github.com/RDEWAI/Redefining-DataEngineering-With-AI --skill create-deploy-validation
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: create-deploy-validation
Source: https://github.com/RDEWAI/Redefining-DataEngineering-With-AI/tree/main/chapter-6/developer-plugin/skills/create-deploy-validation
Command: npx skills add https://github.com/RDEWAI/Redefining-DataEngineering-With-AI --skill create-deploy-validation

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Manually creating deploy validation scripts and smoke tests for data engineering layers is time-consuming and error-prone, leading to broken deployments and failed DAG runs in production. This Skill automates the entire process to ensure local deploy steps work correctly before shipping.

Core Features & Use Cases

  • Automated CD Script Generation: Creates POSIX shell scripts under _infra/cd/ to re-apply DDL migrations and sync Airflow DAG bags against the local docker-compose stack.
  • Smoke Test Authoring: Generates pytest integration tests that verify deploy scripts exit successfully, Airflow has no DAG import errors, and re-triggered DAG runs complete end-to-end.
  • Use Case: A data engineer working on a silver layer feature can use this Skill to automatically generate all required deploy validation artifacts for a deploy-validation story, eliminating manual scripting and reducing deployment risk.

Quick Start

Use the create-deploy-validation skill to generate local deploy smoke tests for the silver layer deploy-validation story STORY-06-123.

Frequently Asked Questions about create-deploy-validation

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I automate Airflow DAG deploy validation and smoke testing?

Automate Airflow DAG deploy validation by generating POSIX shell scripts to sync DAG bags and pytest integration tests to verify DAG execution. This ensures DDL migrations apply correctly and DAG runs complete end-to-end before shipping.

What is the best way to test DDL migrations locally before production deployment?

The best way to test DDL migrations locally is generating reproducible CD shell scripts that re-apply migrations against a local docker-compose stack. This validates schema changes and prevents broken production deployments.

How do I write pytest smoke tests for Airflow DAG import errors?

Write pytest smoke tests for Airflow by generating integration tests that assert deploy scripts exit successfully and check for DAG import errors. This validates bronze, silver, and gold data layer workflows automatically.

Can I use deploy validation scripts with a local docker-compose stack?

Yes, deploy validation scripts work with a local docker-compose stack by applying DDL migrations and syncing Airflow DAG bags locally. POSIX-compliant shell scripts ensure reproducible continuous delivery steps before production release.

Why do I need deploy validation for bronze, silver, and gold data layers?

Deploy validation for bronze, silver, and gold data layers is needed to verify DDL migration application and end-to-end Airflow DAG execution. Automated smoke testing eliminates manual scripting errors and reduces deployment risk across data engineering workflows.

When should I not use automated deploy validation scripts?

Automated deploy validation scripts may not suit workflows outside data engineering layers or environments without docker-compose and Airflow. They specifically target DDL migration verification and DAG bag sync for local continuous delivery validation.