benchmark-suite
CommunityOrchestrate multi-lane benchmarks across providers.
AuthorassafYavnai
Version1.0.0
Installs0
System Documentation
What problem does it solve?
Coordinating and supervising multi-lane benchmarks across a provider/model/runtime matrix with isolation, KPI capture, and Brain persistence.
Core Features & Use Cases
- Orchestrates end-to-end benchmark lifecycles across multiple lanes (implement-plan → machine verification → review-cycle) with per-lane isolation and run control.
- Captures KPIs, artifacts, and summaries for each lane and the whole suite.
- Use Case: Run a 3-provider, 4-model benchmark matrix to compare performance across configurations.
Quick Start
Start a new benchmark suite by providing a valid config JSON; the system will spin up lanes, run them, and generate a final summary.
Dependency Matrix
Required Modules
None requiredComponents
scriptsreferences
💻 Claude Code Installation
Recommended: Let Claude install automatically. Simply copy and paste the text below to Claude Code.
Please help me install this Skill: Name: benchmark-suite Download link: https://github.com/assafYavnai/ADF-V1/archive/main.zip#benchmark-suite Please download this .zip file, extract it, and install it in the .claude/skills/ directory.
Agent Skills Search Helper
Install a tiny helper to your Agent, search and equip skill from 510,000+ vetted skills library on demand.