analyze-mlflow-session

Analyze MLflow chat session traces to diagnose conversation issues.

69|21|Updated Jan 14, 2026
One-click install
npx skills add https://github.com/mlflow/skills --skill analyze-mlflow-session-mlflow
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: analyze-mlflow-session
Source: https://github.com/mlflow/skills/tree/main/analyze-mlflow-chat-session
Command: npx skills add https://github.com/mlflow/skills --skill analyze-mlflow-session-mlflow

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes scripts (resource) and references (resource) components.

What problem does it solve?

This Skill analyzes and debugs MLflow sessions for chat conversations or user interactions, identifying issues, understanding root causes, and improving the overall conversation quality.

Core Features & Use Cases

  • Reconstruct and Inspect Sessions: Group multiple traces, identify user and system inputs, and output data to diagnose specific conversation issues.
  • Session Traces Search: Use filter strings to pinpoint session metadata and retrieve full trace details, providing in-depth trace search capabilities.
  • Assessment Analysis: Understand assessment signals, quality judgments, and errors in traces for deeper insight.

Quick Start

To analyze a chat session with MLflow, first find the session ID, then discover the input/output schema using the first trace and extract necessary information from all session traces. To view specific turns in detail, use the provided script.

Frequently Asked Questions about analyze-mlflow-session

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I debug an MLflow chat session to find the root cause of poor responses?

To debug an MLflow chat session, you can analyze trace spans to identify user and system inputs, assess conversation quality, and pinpoint root causes of issues using Python and MLflow tools.

What is the best way to inspect trace spans for an MLflow conversation?

The best way to inspect trace spans is to search session metadata using filter strings, retrieve full trace details, and reconstruct the session history to diagnose specific conversation issues.

How do I extract input and output schemas from MLflow session traces?

You can extract input and output schemas by discovering the schema using the first trace in the MLflow session, then extracting necessary fields from all subsequent traces for in-depth analysis.

Can I assess conversation quality and errors using MLflow trace inspection?

Yes, MLflow trace inspection supports assessment analysis to understand quality judgments, assessment signals, and errors found within the chat session traces for deeper insight.

How do I group multiple traces to reconstruct a full MLflow session history?

You can reconstruct a full MLflow session history by grouping multiple traces, identifying user and system inputs, and outputting the data to diagnose specific conversation issues.

Does analyzing MLflow sessions require any specific external dependencies?

Analyzing MLflow sessions requires no specific external dependencies, relying solely on Python and MLflow tools to identify issues and improve overall conversation quality.