eval-running

Run Loa evaluation suites to detect regressions and benchmark skill quality.

Updated Feb 23, 2026
One-click install
npx skills add https://github.com/Adeitasuna/MibeStats --skill eval-running-adeitasuna
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: eval-running
Source: https://github.com/Adeitasuna/MibeStats/tree/main/.claude/skills/eval-running
Command: npx skills add https://github.com/Adeitasuna/MibeStats --skill eval-running-adeitasuna

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Evaluates the Loa framework by running evaluation suites to detect regressions and benchmark skill quality across releases.

Core Features & Use Cases

  • Automated evaluation: Executes framework, regression, and skill-quality suites to validate changes.
  • Baseline management: Updates baselines and provides differential results to track regressions.
  • Use Case: When shipping a new Loa update, run all eval suites to guarantee no regressions before deployment.

Quick Start

Run the evaluation suites against the Loa framework to detect regressions and benchmark skill quality.

Frequently Asked Questions about eval-running

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I run automated evaluation suites to detect skill regressions?

Run automated evaluation suites to detect regressions by executing framework, regression, and skill-quality tests. Provide inputs for suite, task, skill, update_baseline, and compare to generate per-trial results suitable for auditing.

What is benchmarking skill quality and how does it work across releases?

Benchmarking skill quality evaluates Loa framework updates by running differential test suites against baselines. It compares per-trial results across releases to track performance changes and guarantee no regressions before deployment.

Can I update evaluation baselines and compare results across framework versions?

Yes, you can update evaluation baselines and compare results by setting the update_baseline and compare inputs. This provides differential results to track regressions and benchmark skill quality across different framework releases.

When do I need to run regression testing suites before deploying an update?

Run regression testing suites before deploying any new Loa update to validate changes and guarantee no regressions. This ensures framework correctness and skill quality are maintained across releases through automated evaluation.

What inputs do I need to configure for framework correctness evaluation?

Configure inputs for suite, task, skill, update_baseline, and compare to run framework correctness evaluation. The suites output per-trial results suitable for auditing, validating changes and detecting regressions across releases.

What's the best way to benchmark a skill update without breaking existing functionality?

The best way to benchmark a skill update is running all eval suites to validate changes and detect regressions before deployment. Use baseline management to update baselines and compare differential results across releases for auditing.