accessing-mlflow

Query MLflow evaluation results by invocation_id and tags to extract artifacts.

Updated May 23, 2026
One-click install
npx skills add https://github.com/yo-steven/skills-exploration-20260522 --skill accessing-mlflow-yo-steven
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: accessing-mlflow
Source: https://github.com/yo-steven/skills-exploration-20260522/tree/main/skills/Model-Optimizer/accessing-mlflow
Command: npx skills add https://github.com/yo-steven/skills-exploration-20260522 --skill accessing-mlflow-yo-steven

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

It helps you locate relevant MLflow runs and extract their configs, metrics, and artifacts when you need to analyze evaluation results, compare model performance, or investigate a specific invocation by ID.

Core Features & Use Cases

  • Run discovery by invocation_id or tags: Search across experiments when only an invocation_id is known, using tags like invocation_id, model, and task_name.
  • Artifact retrieval for deep debugging: Fetch fully resolved configs and nested evaluation metrics (e.g., eval_factory_metrics.json) to understand why results differ.
  • MLflow MCP-powered browsing: Use the mlflow-mcp server through natural-language queries to operationalize analysis without manual browsing.

Quick Start

Ask the assistant to find MLflow runs for invocation_id 71f3f3199ea5e1f0 and return the relevant run IDs plus the eval_factory_metrics.json content.

Frequently Asked Questions about accessing-mlflow

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I query MLflow runs using an invocation_id?

To query MLflow runs by invocation_id, you can search across experiments using tags like invocation_id, model, and task_name. The invocation_id is interpreted as both a tag and a param on MLflow runs to help locate relevant runs.

Can I retrieve resolved configs and nested evaluation metrics from an MLflow run?

Yes, you can retrieve fully resolved configs and nested evaluation metrics such as eval_factory_metrics.json from MLflow runs. This allows you to fetch artifacts for deep debugging to understand why evaluation results differ.

Do I need an MLflow MCP server to search runs and extract artifacts?

Yes, you need the mlflow-mcp server configured with the MLFLOW_TRACKING_URI environment variable. It enables natural-language queries to browse and operationalize analysis without manual UI navigation.

What is the best way to compare model performance across MLflow experiments?

The best way to compare model performance is querying MLflow runs by tags like model and task_name across experiments. You can then extract nested metrics and configs for direct comparison of evaluation results.

Why does my MLflow run query fail when searching by invocation_id?

MLflow run queries by invocation_id may fail if the mlflow-mcp server is not properly configured with MLFLOW_TRACKING_URI, or if the invocation_id is not correctly interpreted as both a tag and a param on the runs.

How do I find specific MLflow runs when I only have an invocation ID?

You can find specific MLflow runs using only an invocation ID by searching across experiments with the invocation_id tag. The system returns relevant run IDs and can extract associated artifact content like eval_factory_metrics.json.