skills.rest
fmind
fmindCOMMUNITY
Explore all skills by this author →
Website𝕏@fmind_devGitHub

MLOps Observability

Configure ML observability with MLflow, Evidently, and SHAP for drift detection and alerting.

1.4k|198|Updated Jun 23, 2023
Search Tags:#monitoring#mlops#observability#drift-detection#reproducibility#explainability#data-lineage
One-click install
npx skills add https://github.com/fmind/mlops-python-package --skill mlops-observability
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: MLOps Observability
Source: https://github.com/fmind/mlops-python-package/tree/main/.gemini/skills/MLOps%20Observability
Command: npx skills add https://github.com/fmind/mlops-python-package --skill mlops-observability

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

This Skill enables end-to-end ML observability by ensuring reproducibility, data lineage, health monitoring, alerting, and explainability across ML workflows and deployments.

Core Features & Use Cases

  • Reproducibility & traceability: ensure deterministic results by locking environments, seeds, and versioning data and models.
  • Data lineage & logging: track data origins, transformations, and model inputs/outputs with MLflow, DVC, and related tools.
  • Monitoring, alerting & explainability: detect drift, monitor system health, trigger alerts, and generate SHAP/global explanations for production predictions.

Quick Start

Configure a minimal observability flow: seed all randomness, lock dependencies, and log datasets and runs to MLflow. Enable drift detection with Evidently and generate explanations with SHAP for production predictions. Validate the setup with a small end-to-end run and verify alerting dashboards update accordingly.

Frequently Asked Questions about MLOps Observability

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I set up ML pipeline reproducibility and data lineage tracking?▼

Ensure ML pipeline reproducibility by locking dependencies, seeding randomness, and versioning data with MLflow and DVC to track transformations and model inputs.

What is the best way to detect data drift in production machine learning models?▼

Detect data drift in production machine learning models by integrating Evidently for monitoring system health, evaluating distribution changes, and triggering alerts when drift occurs.

How do I generate explainability for production ML predictions?▼

Generate explainability for production ML predictions by computing SHAP values to create local and global explanations, clarifying feature importance for deployed model outputs.

Can I use MLflow and Evidently together for end-to-end MLOps observability?▼

Yes, you can use MLflow and Evidently together for MLOps observability by logging datasets and runs to MLflow while enabling drift detection and health monitoring with Evidently.

How do I configure alerting dashboards for machine learning monitoring?▼

Configure alerting dashboards for machine learning monitoring by integrating drift detection and system health checks, then validating the setup with a small end-to-end run to verify dashboard updates.

Related Skills

Explore More Software Engineering Skills→
andikarachmanandikarachman
14

reproducibility-checklist

Audit seeds, versions, data hashes, and environments for ML experiment reproducibility.

Community
Advanced
nahisahonahisaho
3

scientific-model-monitoring

Detect data and concept drift in production ML models.

Community
Advanced
HermeticOrmusHermeticOrmus

data-versioning-patterns

Implement reproducible ML data management with DVC, Delta Lake, and OpenLineage.

Community
Advanced
galeepgaleep

shap

Compute SHAP values and generate feature attribution visualizations for any model type.

Community
Advanced