ml-pipeline-workflow

Orchestrate end-to-end MLOps pipelines from data ingestion to deployment.

3|1|Updated Feb 3, 2026

Search Tags:#deployment #mlops #model-training #ml-pipeline #data-preparation #model-validation #pipeline-orchestration

Ready to run

npx skills add https://github.com/duanbiao2000/obsidianDoc26 --skill ml-pipeline-workflow-duanbiao2000

💬 Prompt for ChatGPT / Claude Chat▼

Please help me install this Agent Skill.
Skill: ml-pipeline-workflow
Source: https://github.com/duanbiao2000/obsidianDoc26/tree/main/agents-main/plugins/machine-learning-ops/skills/ml-pipeline-workflow
Command: npx skills add https://github.com/duanbiao2000/obsidianDoc26 --skill ml-pipeline-workflow-duanbiao2000

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes references (resource) and assets (resource) components.

What problem does it solve?

Build end-to-end MLOps pipelines from data preparation through model training, validation, and production deployment. Use when creating ML pipelines, implementing MLOps practices, or automating model training and deployment workflows.

Core Features & Use Cases

Pipeline Architecture: End-to-end workflow design, DAG orchestration patterns (Airflow, Dagster, Kubeflow), component dependencies and data flow, error handling and retry strategies.
Data Preparation: Data validation, feature engineering pipelines, data versioning and lineage, train/validation/test splitting strategies.
Model Training & Validation: Training job orchestration, experiment tracking integration, validation frameworks and metrics, A/B testing infrastructure.
Deployment Automation: Model serving patterns, canary/blue-green deployment strategies, rollback mechanisms.

Quick Start

Orchestrate an end-to-end ML pipeline from data ingestion through deployment with automated validation and monitoring.

Frequently Asked Questions about ml-pipeline-workflow

High-intent search queries and answers about installing and using this skill.

FAQPage Schema

How do I build an end-to-end MLOps pipeline from data ingestion to deployment?▼

To build an end-to-end MLOps pipeline, you orchestrate workflows using DAG patterns with tools like Airflow, Dagster, or Kubeflow. This automates data preparation, model training, validation, and production deployment across cloud and on-prem environments.

What is the best way to orchestrate ML training jobs and track experiments?▼

The best way to orchestrate ML training jobs is by integrating pipeline orchestration tools with experiment tracking platforms like MLflow or Weights & Biases. This setup monitors validation metrics and manages component dependencies throughout the training workflow.

Can I use canary and blue-green deployment strategies for automated model serving?▼

Yes, automated model serving supports canary and blue-green deployment strategies. These patterns are integrated into the MLOps pipeline alongside rollback mechanisms, ensuring safe production releases and continuous monitoring of deployed models.

Does this ML pipeline workflow support data versioning and feature engineering pipelines?▼

This ML pipeline workflow supports data validation, feature engineering pipelines, and data versioning. It manages data lineage and train/validation/test splitting strategies, ensuring consistent data preparation before model training begins.

What are the limitations of using DAG orchestration for production ML workflows?▼

DAG orchestration for production ML workflows requires configuring error handling and retry strategies to manage component dependencies. Without proper integration of orchestration and tracking tools, complex data flow and deployment automation may fail during execution.