ml-ops

Guide MLOps practices with Python code for FastAPI, MLflow, and Prometheus.

1|Updated Jan 6, 2026
One-click install
npx skills add https://github.com/hyukudan/ai-skills --skill ml-ops-hyukudan
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: ml-ops
Source: https://github.com/hyukudan/ai-skills/tree/main/examples/skills/ml-ops
Command: npx skills add https://github.com/hyukudan/ai-skills --skill ml-ops-hyukudan

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes scripts (resource) and references (resource) components.

What problem does it solve?

This Skill provides comprehensive guidance and code examples for deploying, monitoring, and managing Machine Learning and Large Language Model systems in production environments.

Core Features & Use Cases

  • Model Serving: Implement robust serving patterns (REST API, batch, streaming) with code examples.
  • Model Registry & Versioning: Integrate with tools like MLflow for tracking and managing model versions.
  • Monitoring & Observability: Set up metrics tracking, data drift detection, and performance degradation alerts.
  • CI/CD for ML: Automate the ML lifecycle with pipeline examples for validation, training, testing, and deployment.
  • A/B Testing: Frameworks for experimenting with different model variants and assessing statistical significance.

Quick Start

Use the ml-ops skill to deploy a FastAPI model server for text classification.

Frequently Asked Questions about ml-ops

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I deploy a model serving API using FastAPI?

Deploy a FastAPI model serving API by using the provided Python code snippets to create REST endpoints for text classification. This sets up robust serving patterns for ML systems in production environments.

How do I set up CI/CD pipelines for ML model deployment?

Set up CI/CD pipelines for ML model deployment by using the included YAML examples for GitHub Actions. These automate the ML lifecycle including validation, training, testing, and deployment stages.

How does data drift detection work for production ML systems?

Data drift detection in production ML systems works by tracking metrics via Prometheus and monitoring performance degradation. The provided code helps set up observability to alert when input data distributions shift.

Can I use MLflow for model registry and versioning?

You can use MLflow for model registry and versioning. The Skill provides Python code for MLflow integration to track and manage model versions throughout the deployment lifecycle.

What is the best way to run A/B testing for different model variants?

The best way to run A/B testing for different model variants is using the provided A/B testing frameworks. These frameworks help experiment with different models and assess statistical significance of results.

Do I need Prometheus to monitor ML pipeline performance?

You need Prometheus or similar monitoring tools to track ML pipeline metrics effectively. The Skill includes Python code for Prometheus metrics to set up observability and detect performance degradation.