Skills
.Work. You
Rest

ai-agent-bench

Community

Benchmark AI agents on real coding tasks.

Software Engineering#workflow#transcript#diff#benchmark#ai-agent#anomaly#coding-task
Authorreidemeister94
Version1.0.0
Installs0

System Documentation

What problem does it solve?

This Skill enables quantitative benchmarking of AI agents (Claude Code, Codex, OpenCode) on real coding tasks within the current repository, so you can compare performance, accuracy, and behavior.

Core Features & Use Cases

  • Orchestrated agent trials: isolated worktrees, baseline checks, agent execution, post-check, and artifact collection.
  • Rich telemetry: transcripts, diffs, timings, and resulting metrics for cross-agent comparison.
  • Real-world scenarios: refactoring tasks, performance experiments, and agent evaluation across diverse codebases.

Quick Start

Run the ai-agent-bench workflow on a repository with a task prompt to benchmark and compare agents.

Dependency Matrix

Required Modules

None required

Components

scriptsreferences

💻 Claude Code Installation

Recommended: Let Claude install automatically. Simply copy and paste the text below to Claude Code.

Please help me install this Skill:
Name: ai-agent-bench
Download link: https://github.com/reidemeister94/development-skills/archive/main.zip#ai-agent-bench

Please download this .zip file, extract it, and install it in the .claude/skills/ directory.
View Source Repository

Agent Skills Search Helper

Install a tiny helper to your Agent, search and equip skill from 510,000+ vetted skills library on demand.