skills.rest
Jhabbig
JhabbigCOMMUNITY
Explore all skills by this author →
GitHub

ml-pipeline-workflow

Orchestrate end-to-end machine learning pipelines from data preparation to deployment.

Updated Apr 5, 2026
Search Tags:#monitoring#deployment#validation#mlops#orchestration#pipeline#training
One-click install
npx skills add https://github.com/Jhabbig/Habbig --skill ml-pipeline-workflow-jhabbig
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: ml-pipeline-workflow
Source: https://github.com/Jhabbig/Habbig/tree/main/.claude/plugins/wshobson/machine-learning-ops/skills/ml-pipeline-workflow
Command: npx skills add https://github.com/Jhabbig/Habbig --skill ml-pipeline-workflow-jhabbig

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

This Skill removes the complexity of turning scattered machine learning steps into a dependable production pipeline, helping teams move from raw data to validated, deployed models with less manual coordination and fewer failures.

Core Features & Use Cases

  • Pipeline Architecture: Design end-to-end workflows with clear stage dependencies, retries, and orchestration patterns for tools like Airflow, Dagster, Kubeflow, and Prefect.
  • Data Preparation and Validation: Build repeatable ingestion, cleaning, feature engineering, and dataset versioning steps with quality checks and lineage tracking.
  • Training, Validation, and Deployment: Automate model training jobs, experiment tracking, performance evaluation, rollout strategies, and rollback safeguards for production ML systems.
  • Use Case: A team launching a new fraud model can use this Skill to standardize preprocessing, train multiple candidates, compare metrics, and deploy the winner safely with monitoring.

Quick Start

Ask the Skill to design a production ML pipeline for your use case, including data preparation, training, validation, deployment, and monitoring stages.

Frequently Asked Questions about ml-pipeline-workflow

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I build an end-to-end machine learning pipeline from data preparation to deployment?▼

An end-to-end machine learning pipeline requires modular stages for data preparation, training, validation, and deployment. This Skill orchestrates these workflows with clear stage dependencies, retries, and failure handling for reproducible production execution.

What is the best way to orchestrate MLOps workflows across batch and DAG-based systems?▼

Orchestrating MLOps workflows involves designing DAG-based pipelines with clear stage dependencies and retries. This Skill supports orchestration patterns for tools like Airflow, Dagster, Kubeflow, and Prefect to automate training and validation.

How do I automate model training jobs and track experiments for production ML systems?▼

Automating model training jobs requires modular pipeline stages with experiment tracking and performance evaluation. This Skill automates training jobs, compares metrics across multiple candidates, and applies rollout strategies for safe production deployment.

How do I add data validation and quality checks to an ML pipeline?▼

Data validation in an ML pipeline involves building repeatable ingestion, cleaning, and feature engineering steps. This Skill designs pipelines with quality checks, dataset versioning, and lineage tracking to ensure data reliability.

How do I handle failure and rollback safeguards in production ML pipelines?▼

Failure handling in production ML pipelines requires clear stage dependencies, retries, and rollback safeguards. This Skill orchestrates deployment automation with monitoring and failure handling to ensure reproducible execution.

Can I use this Skill to design pipelines for Airflow, Dagster, Kubeflow, and Prefect?▼

Yes, this Skill designs end-to-end workflows with orchestration patterns for Airflow, Dagster, Kubeflow, and Prefect. It applies to MLOps workflows for training automation, validation, and monitoring across batch and DAG-based systems.

Related Skills

Explore More Software Engineering Skills→
ouakarouakar

data-engineer

Automate end-to-end data pipelines from ingestion to analytics-ready datasets.

Community
Advanced
chiruu12chiruu12
1

canary

Monitor production apps for errors and regressions after deployment.

Community
Advanced
devMoezdevMoez
1

weights-and-biases

Log ML experiment metrics, artifacts, and sweeps with the wandb Python client.

Community
Intermediate
AI-Foundry-CoreAI-Foundry-Core
4

ml-pipeline-workflow

Orchestrate end-to-end MLOps pipelines from data ingestion through deployment.

Official
Advanced