dec-bench-run

Build and run DEC Bench scenarios, inspect results, and open the audit UI.

1|2|Updated Feb 22, 2026

Search Tags:#evaluation #scenarios #run #matrix #dec-bench #audit-ui

Ready to run

npx skills add https://github.com/514-labs/agent-evals --skill dec-bench-run

💬 Prompt for ChatGPT / Claude Chat▼

Please help me install this Agent Skill.
Skill: dec-bench-run
Source: https://github.com/514-labs/agent-evals/tree/main/.claude/skills/dec-bench-run
Command: npx skills add https://github.com/514-labs/agent-evals --skill dec-bench-run

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Build and run DEC Bench scenarios, inspect results, and open the audit UI to streamline agent evaluation workflows.

Core Features & Use Cases

Build and run DEC Bench scenarios from the CLI, including single scenarios and full matrices across agents, harnesses, and domains.
Inspect results, gate scores, and artifacts, and open the audit UI for detailed traces and metadata.
Reproduce experiments reliably and validate scenarios across multiple setups to ensure consistent evaluation.

Quick Start

Ask me to build and run a DEC Bench scenario, and I will execute it and present the results.

Frequently Asked Questions about dec-bench-run

High-intent search queries and answers about installing and using this skill.

FAQPage Schema

How do I run agent evaluation scenarios across multiple harnesses?▼

You can execute matrix runs across agents, harnesses, and domains to evaluate agent evaluation scenarios. The tool automates building, running, and inspecting results to streamline the entire evaluation workflow.

How do I inspect detailed traces and metadata for agent evaluation runs?▼

You inspect detailed traces and metadata for agent evaluation runs by opening the audit UI. The interface surfaces artifacts, scores, and run metadata for comprehensive result inspection.

Can I reproduce agent evaluation experiments reliably across different setups?▼

Yes, you can reproduce experiments reliably by validating scenarios across multiple setups. The tool enforces compatibility and validates inputs to ensure consistent evaluation results.

How do I build and execute a single DEC Bench scenario from the CLI?▼

To build and execute a single DEC Bench scenario from the CLI, request the tool to build and run it. It will execute the scenario and present the results, including scores and artifacts.