ml-pipeline-workflow

Automate end-to-end ML pipeline orchestration from data preparation to deployment.

Updated Apr 19, 2026
One-click install
npx skills add https://github.com/ArogyaReddy/https-github.com-wshobson-agents --skill ml-pipeline-workflow-arogyareddy
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: ml-pipeline-workflow
Source: https://github.com/ArogyaReddy/https-github.com-wshobson-agents/tree/main/plugins/machine-learning-ops/skills/ml-pipeline-workflow
Command: npx skills add https://github.com/ArogyaReddy/https-github.com-wshobson-agents --skill ml-pipeline-workflow-arogyareddy

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes references (resource) and assets (resource) components.

What problem does it solve?

Build end-to-end MLOps pipelines from data preparation through model deployment, enabling repeatable, auditable workflows for production ML.

Core Features & Use Cases

  • Pipeline Architecture: End-to-end workflow design and DAG-based orchestration (Airflow, Dagster, Kubeflow).
  • Data Preparation: Data validation, feature engineering, data versioning, and lineage tracking.
  • Model Training: Training job orchestration, hyperparameter management, and experiment tracking.
  • Model Validation: Validation frameworks, metrics, A/B testing, and performance regression checks.
  • Deployment Automation: Model serving, canary/blue-green deployments, and rollout monitoring.

Quick Start

Create a simple end-to-end ML pipeline that ingests data, trains a model, validates performance, and deploys to production with monitoring.

Frequently Asked Questions about ml-pipeline-workflow

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I orchestrate an end-to-end ML pipeline from data preparation to deployment?

Orchestrate an end-to-end ML pipeline by automating DAG-based workflows across data prep, training, validation, and deployment using major orchestrators like Airflow, Dagster, or Kubeflow.

Can I use this ML pipeline orchestration with Airflow, Dagster, and Kubeflow?

Yes, this ML pipeline orchestration supports compatibility with major orchestrators including Airflow, Dagster, and Kubeflow to enable reusable, scalable pipeline designs.

What's the best way to automate model validation and regression checks in an ML pipeline?

Automate model validation by integrating validation frameworks, evaluation metrics, A/B testing, and performance regression checks directly into your pipeline architecture.

Does this ML pipeline workflow support canary and blue-green deployment patterns?

Yes, this ML pipeline workflow supports deployment automation including model serving, canary deployments, blue-green deployments, and rollout monitoring.

How does data versioning and lineage tracking work in MLOps pipelines?

Data versioning and lineage tracking operate during the data preparation phase, ensuring repeatable and auditable workflows by validating data and engineering features.

Do I need modular design and experiment tracking to build production ML workflows?

Yes, modular design and experiment tracking are required to enable reusable, scalable pipelines and to orchestrate training jobs with hyperparameter management.