skills.rest
ivanshamaev
ivanshamaevCOMMUNITY
Explore all skills by this author →
WebsiteGitHub

github-actions-dataops

Generate GitHub Actions pipelines for dbt and Airflow CI/CD with quality gates.

14|1|Updated May 5, 2026
Search Tags:#github actions#cicd#data quality gates#dbt slim ci#sqlfluff lint#airflow dagbag#oidc secrets
One-click install
npx skills add https://github.com/ivanshamaev/de-agent-skills --skill github-actions-dataops
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: github-actions-dataops
Source: https://github.com/ivanshamaev/de-agent-skills/tree/main/skills/github_actions_dataops
Command: npx skills add https://github.com/ivanshamaev/de-agent-skills --skill github-actions-dataops

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

This Skill solves the problem of reliably building, linting, validating, testing, and deploying data engineering workflows using GitHub Actions with strong DataOps/CI/CD guardrails.

Core Features & Use Cases

  • dbt slim CI/CD: Runs only changed models using state:modified+, --defer, and manifest.json artifact passing to keep CI fast while preserving correctness through downstream awareness.
  • Quality gates in the pipeline: Integrates SQLFluff linting with PR annotations, plus Great Expectations and Soda checks as CI blockers.
  • Airflow integrity testing: Validates DAG structure and prevents breaking changes via pytest/DagBag import and structural tests.
  • Secure authentication and secrets: Uses OIDC for AWS/GCP with environment-scoped secrets (no static long-lived credentials).
  • Scalable workflow patterns: Supports reusable workflows (workflow_call), matrix builds, and composite actions, plus multi-stage Docker builds and pushing to ghcr.io.

Quick Start

Use the github-actions-dataops skill to generate a complete end-to-end GitHub Actions workflow for dbt CI/CD that includes SQLFluff linting, dbt slim CI with prod manifest/defer, Airflow DAG validation, and Great Expectations/Soda quality gates.

Frequently Asked Questions about github-actions-dataops

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I set up dbt slim CI in GitHub Actions to run only changed models?▼

Use dbt slim CI in GitHub Actions by utilizing state-based selection with `state:modified+` and `--defer`. Passing the `manifest.json` artifact between jobs ensures CI runs only changed models while preserving downstream awareness for fast, correct deployments.

Can I use keyless OIDC authentication for AWS and GCP in GitHub Actions workflows?▼

Yes, you can use keyless OIDC authentication for AWS and GCP in GitHub Actions. This approach requires setting `id-token: write` permissions and using environment-scoped secrets to completely eliminate static, long-lived cloud credentials.

What's the best way to add SQLFluff linting annotations to pull requests?▼

The best way to add SQLFluff linting annotations is by integrating SQLFluff directly into your GitHub Actions pipeline. The workflow runs the linter against your SQL files and automatically surfaces violations as annotations on the pull request.

How do I validate Airflow DAG integrity and prevent breaking changes in CI?▼

Validate Airflow DAG integrity in CI by running pytest with DagBag import and structural tests within your GitHub Actions workflow. This automatically catches import errors and structural issues before DAGs reach production.

Does GitHub Actions support data quality gates with Great Expectations or Soda?▼

Yes, GitHub Actions supports data quality gates with Great Expectations and Soda. Integrating these tools as CI blockers ensures that pipelines fail automatically when data quality checks do not meet your defined expectations.

How do I build and push multi-stage Docker images to ghcr.io using reusable workflows?▼

Build and push multi-stage Docker images to ghcr.io by structuring your GitHub Actions with reusable workflows, matrix builds, and composite actions. This pattern enforces least-privilege permissions and scalable CI/CD architecture.

Related Skills

Explore More Software Engineering Skills→
ivanshamaevivanshamaev
14

dbt-starrocks-production-readiness

Configure dbt StarRocks production readiness with RBAC, secrets, and slim CI.

Community
Advanced
rory-datarory-data

testing-dags

Trigger Airflow DAG runs, diagnose failures, inspect logs, and apply fixes in iterative cycles.

Community
Advanced
timequitytimequity
6

data-quality

Detect data quality issues in dbt and Great Expectations pipelines.

Official
Advanced
UnicornUnicorn

ci-cd-agent

Generate multi-stage CI/CD pipeline configurations for GitHub Actions, GitLab CI, and Jenkins.

Official
Intermediate