skills.rest
yusoofsh
yusoofshCOMMUNITY
Explore all skills by this author →
WebsiteGitHub

ml-pipeline-workflow

Orchestrate end-to-end ML pipelines from data ingestion to deployment.

Updated Aug 27, 2026
Search Tags:#workflow automation#data science#MLOps#Airflow#model deployment#ML pipeline#Kubeflow
One-click install
npx skills add https://github.com/yusoofsh/dotfiles --skill ml-pipeline-workflow-yusoofsh
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: ml-pipeline-workflow
Source: https://github.com/yusoofsh/dotfiles/tree/main/home/dot_claude/private_plugins/private_marketplaces/claude-code-workflows/plugins/machine-learning-ops/skills/ml-pipeline-workflow
Command: npx skills add https://github.com/yusoofsh/dotfiles --skill ml-pipeline-workflow-yusoofsh

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes references (resource) and assets (resource) components.

What problem does it solve?

This Skill provides a structured approach to building robust, reproducible, and automated MLOps pipelines, eliminating manual steps and ensuring consistent model performance in production.

Core Features & Use Cases

  • End-to-End Orchestration: Design DAG-based workflows for data ingestion, feature engineering, training, and deployment.
  • Data & Model Versioning: Implement strategies for tracking data lineage and model artifacts for reproducibility.
  • Automated Validation & Deployment: Set up continuous validation and safe deployment patterns like canary releases.
  • Use Case: Create a fully automated system for a fraud detection model, from daily data updates and retraining to A/B testing new model versions in production.

Quick Start

Use the ml-pipeline-workflow skill to define the basic stages for an end-to-end ML pipeline, including data ingestion, training, and deployment.

Frequently Asked Questions about ml-pipeline-workflow

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I build an end-to-end ML pipeline from data ingestion to model deployment?▼

Build an end-to-end ML pipeline by designing DAG-based workflows using orchestrators like Airflow, Dagster, or Kubeflow that automate data ingestion, validation, feature engineering, training, and deployment stages. This approach eliminates manual steps and ensures consistent model performance across the full lifecycle.

What's the best way to automate model retraining and deployment in production?▼

Automate retraining and deployment using orchestration frameworks with integrated validation checks and safe deployment patterns like canary releases or blue-green strategies. This ensures models are continuously validated before production rollout and can be safely tested against live traffic.

How do I track data lineage and model versioning in an MLOps workflow?▼

Implement data lineage tracking and model versioning by integrating experiment tracking and model registry systems into your DAG-based pipeline. This provides reproducibility, audit trails, and the ability to roll back to prior model or data versions when needed.

Can I use Airflow, Dagster, or Kubeflow for ML pipeline orchestration?▼

Yes, all three—Airflow, Dagster, and Kubeflow—are DAG-based orchestration frameworks suitable for ML pipelines. Each supports data ingestion, training, validation, and deployment stages; choose based on your infrastructure, scale, and operational requirements.

What validation and error handling should I include in a production ML pipeline?▼

Include data validation at ingestion, model performance validation before deployment, robust error handling with retries, and observability for monitoring. These safeguards prevent invalid data or degraded models from reaching production and enable quick diagnosis of failures.

Related Skills

Explore More Software Engineering Skills→
karrtik159karrtik159

mlops-engineer

Build and manage Kubernetes-based ML pipelines with experiment tracking and model versioning.

Community
Advanced
nirukk52nirukk52
1

dev-log-monitoring

Monitor Encore.ts and SvelteKit logs to diagnose drift and verify run events.

Community
Advanced
davpatel605-beepdavpatel605-beep

weights-and-biases

Track machine learning experiments and manage model artifacts with Weights & Biases workflows.

Community
Advanced
Sumeet138Sumeet138
1

ml-pipeline-workflow

Orchestrate end-to-end ML pipelines from data ingestion to deployment.

Community
Advanced