Verified:GitHub

ml-pipeline

Construct automated ML pipelines with data validation, feature engineering, training, and deployment.

17|3|Updated Mar 18, 2026

Search Tags:#workflow automation #feature engineering #orchestration #model deployment #experiment tracking #kubeflow #ml pipelines

Ready to run

npx skills add https://github.com/codeApe-7/ai-agent-workflowGroup --skill ml-pipeline-codeape-7

💬 Prompt for ChatGPT / Claude Chat▼

Please help me install this Agent Skill.
Skill: ml-pipeline
Source: https://github.com/codeApe-7/ai-agent-workflowGroup/tree/main/skills/ai-ml/ml-pipeline
Command: npx skills add https://github.com/codeApe-7/ai-agent-workflowGroup --skill ml-pipeline-codeape-7

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires mlflow, kfp, great_expectations, kubernetes, and includes scripts (resource) and references (resource) components.

What problem does it solve?

This Skill facilitates the design and implementation of robust, production-grade ML pipelines, helping data scientists and engineers automate experiment tracking, feature engineering, model training, and deployment processes.

Core Features & Use Cases

Pipeline Automation: Set up end-to-end ML workflows from data ingestion to deployment with minimal manual intervention.
Experiment Tracking & Validation: Log metrics, parameters, and artifacts; validate data schemas and model performance before deployment.
Use Case: Automate hyperparameter tuning for a fraud detection model leveraging Kubeflow or Airflow orchestrations, ensuring consistent, reproducible results.

Quick Start

Define your ML pipeline components and execute a Kubeflow pipeline to automate your model lifecycle from data preprocessing to deployment.

Frequently Asked Questions about ml-pipeline

High-intent search queries and answers about installing and using this skill.

FAQPage Schema

How do I build an automated machine learning pipeline for model training and deployment?▼

To build an automated machine learning pipeline, you define components for data validation, feature engineering, and model training, then orchestrate the workflow using Kubeflow to streamline deployment from data preprocessing to production.

Can I use Kubeflow and Airflow for ML pipeline orchestration with experiment tracking?▼

Yes, you can use Kubeflow or Airflow for ML pipeline orchestration while leveraging mlflow to log metrics, parameters, and artifacts, ensuring consistent experiment tracking and reproducible results across your automated workflows.

What is the best way to validate data schemas before model deployment in ML pipelines?▼

The best way to validate data schemas in ML pipelines is to integrate data validation libraries like great_expectations within your automated workflow, verifying data quality and model performance before proceeding to deployment.

Do I need Kubernetes to run scalable ML workflows with mlflow and Kubeflow?▼

Yes, Kubernetes is required to run scalable ML operations with Kubeflow, providing the underlying infrastructure to orchestrate complex workflows on-prem or in cloud environments while managing dependencies like mlflow.

How do I set up hyperparameter tuning for fraud detection models in a production ML pipeline?▼

You set up hyperparameter tuning for fraud detection by defining pipeline components that automate the tuning process within Kubeflow or Airflow orchestrations, tracking experiments with mlflow to ensure reproducible model results.

Why does my ML pipeline fail during data validation and feature engineering steps?▼

ML pipelines often fail during data validation when schemas are not properly defined or input data quality drops, requiring automated validation checks using great_expectations before proceeding to feature engineering and training.