ml-pipeline

Automate end-to-end ML training and deployment pipelines with MLflow logging.

Updated Mar 17, 2026
One-click install
npx skills add https://github.com/Estom/aiflex --skill ml-pipeline-estom
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: ml-pipeline
Source: https://github.com/Estom/aiflex/tree/main/skills-repo/Jeffallan-skills/ml-pipeline
Command: npx skills add https://github.com/Estom/aiflex --skill ml-pipeline-estom

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes references (resource) components.

What problem does it solve?

End-to-end machine learning workflows are complex, error-prone, and difficult to reproduce; this Skill reduces operational friction by providing patterns, templates, and guidance to design, implement, and operate reliable ML training-to-deployment pipelines.

Core Features & Use Cases

  • Pipeline Architecture & Orchestration: Design DAGs and pipeline components for Kubeflow, Airflow, Prefect, or custom orchestrators to manage data ingestion, preprocessing, training, evaluation, and deployment.
  • Feature Engineering & Stores: Implement transformation pipelines, feature versioning, and online/offline consistency patterns with Feast-style examples.
  • Training & HPO: Configure distributed training, checkpointing, Optuna/Ray Tune hyperparameter searches, and GPU resource management.
  • Experiment Tracking & Model Registry: Integrate MLflow and Weights & Biases for logging parameters, metrics, artifacts, and registering model versions.
  • Validation & Monitoring: Provide evaluation suites, shadow deployments, A/B testing, drift detection, and validation checklists for safe production rollouts.
  • Use Case: Build a repeatable nightly retraining pipeline that materializes features, runs distributed training with HPO, logs experiments to MLflow, validates best models, and deploys a versioned model if validation passes.

Quick Start

Run a complete training pipeline on my dataset, log experiments to MLflow, validate the best model, and register the deployment-ready model to the model registry.

Frequently Asked Questions about ml-pipeline

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I build a reproducible ML pipeline for model training and deployment?

Build a reproducible ML pipeline by automating orchestration for data ingestion, distributed training, and deployment using DAG components. This ensures artifact versioning, experiment tracking, and robust error handling for reliable production rollouts.

How do I integrate MLflow for experiment tracking in a Kubeflow pipeline?

Integrate MLflow for experiment tracking in a Kubeflow pipeline by applying built-in patterns to log parameters, metrics, and artifacts during distributed training. This automatically registers validated model versions to the model registry.

What is the best way to automate hyperparameter tuning and distributed training?

The best way to automate hyperparameter tuning and distributed training is configuring pipeline components for Optuna or Ray Tune searches with checkpointing and GPU resource management. This integrates directly with experiment tracking workflows.

Can I use this for feature engineering and online offline consistency?

Yes, you can use this for feature engineering and online offline consistency. It provides transformation pipelines, feature versioning, and Feast-style patterns to ensure feature store consistency across training and serving environments.

Does the pipeline support shadow deployments and data drift detection?

Yes, the pipeline supports shadow deployments and data drift detection. It provides evaluation suites, A/B testing, and validation checklists to monitor models and ensure safe production rollouts after nightly retraining.