What problem does it solve?
Setting up a multi-agent competition requires manually creating session directories, generating session IDs, and configuring evaluation criteria, which is repetitive and error-prone.
Core Features & Use Cases
- Session Initialization: Creates the
.agenthub/ directory structure with a unique session ID and stores task, agent count, and evaluation configuration.
- Dual Evaluation Modes: Supports command-based evaluation with a named metric and direction, or LLM judge mode when no eval command is provided.
- Baseline Capture: Runs the eval command once at setup and records a baseline metric for later delta comparison during ranking.
- Use Case: Run
/hub:hub-init --task "Optimize API" --agents 3 --eval "pytest bench.py" --metric p50_ms --direction lower to start a three-agent optimization competition with a measured baseline.
Quick Start
Ask the AI to initialize an AgentHub session for your task with a chosen number of agents and an optional evaluation command.