skills.rest
doanchienthangdev
doanchienthangdevCOMMUNITY
Explore all skills by this author →
GitHub

ML Pipelines

Orchestrate end-to-end ML workflows with Kubeflow Pipelines and Apache Airflow.

4|1|Updated Dec 30, 2025
Search Tags:#ci/cd#mlops#airflow#pipelines#model deployment#kubeflow
One-click install
npx skills add https://github.com/doanchienthangdev/omgkit --skill ml-pipelines
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: ML Pipelines
Source: https://github.com/doanchienthangdev/omgkit/tree/main/plugin/skills/ai-ml/ml-pipelines
Command: npx skills add https://github.com/doanchienthangdev/omgkit --skill ml-pipelines

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes scripts (resource) and references (resource) components.

What problem does it solve?

This Skill automates the complex, multi-step process of building, training, evaluating, and deploying machine learning models, ensuring reproducibility and efficiency.

Core Features & Use Cases

  • End-to-End Orchestration: Manages the entire ML lifecycle from data ingestion to model deployment.
  • Reproducibility & Versioning: Ensures consistent results and tracks changes in data, code, and models.
  • Scalability: Supports distributed execution for large-scale ML tasks.
  • Use Case: Deploying a new fraud detection model by automating data preprocessing, model training with hyperparameter tuning, evaluation against a validation set, and finally deploying the best performing model to a production API.

Quick Start

Use the ML Pipelines skill to define and compile a Kubeflow pipeline for training a model using the provided data path.

Frequently Asked Questions about ML Pipelines

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I orchestrate end-to-end ML workflows for model deployment?▼

End-to-end ML workflows are orchestrated by managing data ingestion, preprocessing, model training, evaluation, and deployment using tools like Kubeflow Pipelines and Apache Airflow.

What is the best way to automate MLOps and ensure reproducibility in machine learning pipelines?▼

Automating MLOps ensures reproducibility by tracking changes in data, code, and models while integrating CI/CD pipelines for automated ML operations and versioning.

Can I use Apache Airflow with Kubeflow Pipelines for distributed execution?▼

Apache Airflow and Kubeflow Pipelines are used to orchestrate ML workflows, supporting distributed execution for large-scale ML tasks to ensure scalability.

How do I compile a Kubeflow pipeline for training a model using a specific data path?▼

To compile a Kubeflow pipeline for training a model, you define the workflow steps and use the provided data path to initiate the automated training process.

Does this ML pipeline orchestration support automated fraud detection model deployment?▼

Automated fraud detection model deployment is supported by automating data preprocessing, training with hyperparameter tuning, evaluation, and deploying the best model to a production API.

Related Skills

Explore More Software Engineering Skills→
Leonard-DataLeonard-Data

pydantic

Validate Python data using type annotations with automatic coercion and JSON Schema generation.

Community
Advanced
gizixgizix
2

model-deployment

Package trained machine learning models with versioning, ONNX export, and FastAPI endpoints.

Community
Advanced
89jobrien89jobrien
4

machine-learning

Automate the machine learning lifecycle from experimentation to production deployment.

Community
Advanced
jeninhjeninh

scripting-with-go

Execute Go scripts directly as standalone programs with go run.

Community
Advanced