Build and run DEC Bench scenarios, inspect results, and open the audit UI.
npx skills add https://github.com/514-labs/agent-evals --skill dec-bench-run
Please help me install this Agent Skill. Skill: dec-bench-run Source: https://github.com/514-labs/agent-evals/tree/main/.claude/skills/dec-bench-run Command: npx skills add https://github.com/514-labs/agent-evals --skill dec-bench-run
Build and run DEC Bench scenarios, inspect results, and open the audit UI to streamline agent evaluation workflows.
Ask me to build and run a DEC Bench scenario, and I will execute it and present the results.
High-intent search queries and answers about installing and using this skill.
You can execute matrix runs across agents, harnesses, and domains to evaluate agent evaluation scenarios. The tool automates building, running, and inspecting results to streamline the entire evaluation workflow.
You inspect detailed traces and metadata for agent evaluation runs by opening the audit UI. The interface surfaces artifacts, scores, and run metadata for comprehensive result inspection.
Yes, you can reproduce experiments reliably by validating scenarios across multiple setups. The tool enforces compatibility and validates inputs to ensure consistent evaluation results.
To build and execute a single DEC Bench scenario from the CLI, request the tool to build and run it. It will execute the scenario and present the results, including scores and artifacts.
514-labsCompile the DEC Bench CLI from source and run scenario tests in Docker containers.
yoshisadaRun Playwright tests and output a PASS/FAIL report.
ToXMonTrace GenAI applications in Domino to capture token usage, latency, cost, and errors.
vercel-labsExecute Vercel plugin benchmark scenarios in isolated Vercel Sandboxes.
