evaluating-models

Analyze MLflow evaluation artifacts to generate data-driven model performance reports.

Updated Jan 20, 2026
One-click install
npx skills add https://github.com/Alanlee0323/my-agent-skills --skill evaluating-models
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: evaluating-models
Source: https://github.com/Alanlee0323/my-agent-skills/tree/main/evaluating-models
Command: npx skills add https://github.com/Alanlee0323/my-agent-skills --skill evaluating-models

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Expert system for evaluating machine learning models. Automates the analysis of Confusion Matrices, PR Curves, and MLflow history comparison to provide objective, data-driven recommendations.

Core Features & Use Cases

  • Confusion Matrix analysis to identify class-level errors and misclassifications.
  • PR Curve interpretation and F1-score guidance across thresholds.
  • Historical benchmarking via MLflow to compare best runs and track performance trends.

Quick Start

Run the evaluation workflow on a completed training run to generate a concise performance report.

Frequently Asked Questions about evaluating-models

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I evaluate machine learning models using MLflow history?

Evaluate machine learning models by analyzing MLflow history to compare best runs and track performance trends. The system automatically evaluates completed training runs, generating concise reports that summarize historical benchmarks and provide data-driven recommendations.

What does confusion matrix analysis tell me about model errors?

Confusion matrix analysis identifies class-level errors and misclassifications in your machine learning model. By evaluating completed training runs, the system generates reports that highlight specific class performance issues and provides actionable next steps to address them.

How do I interpret PR curves and F1-scores across thresholds?

Interpreting PR curves and F1-scores involves analyzing precision-recall trade-offs across different classification thresholds. The evaluation system processes these artifacts from completed training runs to generate objective performance reports with actionable next steps.

Can I compare multiple training runs to find the best model performance?

Comparing multiple training runs to find the best model performance is supported through historical benchmarking via MLflow. The system applies cross-run comparisons, referencing the best_run to generate data-driven reports that summarize performance trends.

What happens if my model evaluation artifacts are missing?

If model evaluation artifacts are missing, the evaluation system guards against incomplete data by ensuring comparisons and reports account for absent artifacts. This prevents failed evaluations and provides actionable next steps based on available training run data.

Do I need completed training runs before starting model evaluation?

Completed training runs are required before starting model evaluation, as the system analyzes resulting artifacts like confusion matrices and PR curves. Apply the evaluation workflow to these completed runs to generate concise, data-driven performance reports.