Automate Terminal-Bench 2.0 benchmarking and failure analysis for Mux agents.
npx skills add https://github.com/coder/mux --skill tbench-coder
Please help me install this Agent Skill. Skill: tbench Source: https://github.com/coder/mux/tree/main/.mux/skills/tbench Command: npx skills add https://github.com/coder/mux --skill tbench-coder
Terminal-Bench integration for Mux agent benchmarking and failure analysis streamlines evaluating agent performance, diagnosing failures, and iterating improvements in a reproducible way.
Run a full Terminal-Bench benchmark suite in CI using workflow_dispatch.
High-intent search queries and answers about installing and using this skill.
Automate Terminal-Bench benchmarking in CI/CD by triggering workflow_dispatch to run end-to-end workloads against agents, compare model performance across configurations, and collect per-task failure analysis results.
Terminal-Bench is used for agent performance evaluation to run end-to-end benchmarking workloads, diagnose failures, and iterate agent improvements in a reproducible way across different model configurations and task sets.
Yes, Harbor works with Terminal-Bench by acting as the evaluation harness, enabling scalable benchmarking and failure-rate analysis across cloud or on-prem environments for agent workloads.
Analyze agent failure rates by collecting per-task results and logs after a Terminal-Bench run, which identifies bottlenecks and reliability issues across various model configurations and task sets.
Compare Mux agent model performance by running full Terminal-Bench benchmark suites in CI, leveraging Harbor as the evaluation harness to evaluate and contrast results across different configurations.
onchainengineerAutomate Unix agent benchmarking with Terminal-Bench 2.0 on Docker or Daytona.
shafibabarMeasure deployment frequency, lead time, MTTR, and change failure rate.
lwyBZss8924dAutomate Harbor TB2 environment evaluations for ReCodeAgent workflows.
gobifrostBuild Bifrost automation artifacts across v1 and v2 workspace modes.
