mlflow-cli

Inspect and export remote MLflow experiments, runs, metrics, and artifacts via CLI.

3|Updated Apr 21, 2024
One-click install
npx skills add https://github.com/gabrielfruet/.dotfiles --skill mlflow-cli
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: mlflow-cli
Source: https://github.com/gabrielfruet/.dotfiles/tree/main/pi/agent/skills/mlflow-cli
Command: npx skills add https://github.com/gabrielfruet/.dotfiles --skill mlflow-cli

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Manually navigating remote MLflow tracking servers to inspect experiments, runs, metrics, and artifacts is time-consuming and inefficient, especially when comparing performance across multiple machine learning experiments.

Core Features & Use Cases

  • Read-Only MLflow Inspection: Query experiments, runs, metrics, parameters, tags, and artifacts directly from the CLI without accessing the web UI or writing custom API code.
  • Offline Run Comparison: Export full experiment run tables to CSV for sorting, filtering, and side-by-side performance analysis.
  • Use Case: A data scientist can quickly identify the best-performing hyperparameter configuration for a computer vision model by comparing metric trends and artifact contents across 20+ training runs in minutes.

Quick Start

Use the mlflow-cli skill to retrieve the top 3 runs by validation accuracy from the remote MLflow experiment named 'resnet50-training' and summarize their key hyperparameters, final metrics, and artifact contents.

Frequently Asked Questions about mlflow-cli

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I inspect MLflow experiment metrics from the command line?

You can inspect MLflow experiment metrics from the command line by using a CLI tool to execute read-only search, list, and describe operations directly against a remote MLflow tracking server. This avoids the need to access the web UI or write custom API integration code.

Can I export MLflow runs to CSV for offline analysis without writing Python scripts?

Yes, you can export MLflow runs to CSV for offline analysis without writing Python scripts by using CLI commands to retrieve full experiment run tables. This allows you to sort, filter, and compare model performance side-by-side locally.

What is the best way to compare machine learning hyperparameters across multiple MLflow runs?

The best way to compare machine learning hyperparameters across multiple MLflow runs is to use a CLI tool to query and export run metrics, parameters, and tags from the tracking server. You can then review the exported data to quickly identify the best-performing configurations.

Do I need a local MLflow installation to review remote tracking server artifacts?

Yes, you need a local MLflow CLI installation and a configured MLFLOW_TRACKING_URI pointing to a valid remote MLflow server to review tracking server artifacts. These prerequisites allow you to execute read-only download and inspection operations.

Can I download and review MLflow artifact contents directly via CLI?

Yes, you can download and review MLflow artifact contents directly via CLI. The skill enables read-only inspection and download operations for artifacts associated with remote experiments and runs, bypassing the standard web UI entirely.