agent-evaluation

Name: agent-evaluation
Availability: InStock
Author: VibeTechnologies

Run agent benchmarks with agents/benchmark.py and compile results into a table.

1|Updated Jan 23, 2026

Search Tags:#testing #evaluation #benchmark #agent-evaluation #openhands #vibeteam

Ready to run

npx skills add https://github.com/VibeTechnologies/VibeTeam --skill agent-evaluation-vibetechnologies

💬 Prompt for ChatGPT / Claude Chat▼

Please help me install this Agent Skill.
Skill: agent-evaluation
Source: https://github.com/VibeTechnologies/VibeTeam/tree/main/.opencode/skills/agent-evaluation
Command: npx skills add https://github.com/VibeTechnologies/VibeTeam --skill agent-evaluation-vibetechnologies

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Automates the evaluation pipeline for VibeTeam agents by running standardized benchmarks and summarizing results in a clear table.

Core Features & Use Cases

Automated benchmarking: executes agent benchmarks using agents/benchmark.py and aggregates results.
Comparative reporting: presents scores, feedback, and recommendations in a tabular format for quick decision-making.
Use Case: teams evaluating AutoGen, CrewAI, and OpenHands to determine the best-fit agent for specific tasks within the VibeTeam workflow.

Quick Start

Run the evaluation workflow to benchmark all VibeTeam agents against agents/benchmark.py and generate a results table.

Frequently Asked Questions about agent-evaluation

High-intent search queries and answers about installing and using this skill.

FAQPage Schema

How do I benchmark AutoGen, CrewAI, and OpenHands agents for comparison?▼

Agent benchmarking evaluates framework performance by running standardized tasks through agents/benchmark.py. This process invokes ComparativeEvaluator to parse results and present standardized metrics in a table, solving the problem of manually comparing agent performance across different frameworks.

What's the best way to automate agent evaluation pipelines for VibeTeam?▼

Automating agent evaluation pipelines involves executing agents/benchmark.py to run end-to-end tests across agents like AutoGen and CrewAI. The workflow aggregates scores, parses results, and presents standardized metrics in a table, streamlining the evaluation process for VibeTeam workflows.

Can I generate tabular reports comparing AutoGen, CrewAI, and OpenHands performance?▼

Yes, you can generate tabular reports comparing AutoGen, CrewAI, and OpenHands performance. The agent-evaluation workflow parses benchmark results from agents/benchmark.py and presents standardized metrics, feedback, and recommendations in a structured table format.

Does the VibeTeam benchmarking workflow support performance scoring and feedback generation?▼

Yes, the VibeTeam benchmarking workflow supports performance scoring and feedback generation. It executes benchmarks using agents/benchmark.py and compiles results to include scores, feedback, and recommendations for evaluated agents like AutoGen, CrewAI, and OpenHands.

How does ComparativeEvaluator in agents/benchmark.py work for agent benchmarking?▼

ComparativeEvaluator in agents/benchmark.py works by executing standardized benchmark tasks across specified agents. It parses the results from these end-to-end evaluations and presents standardized metrics in a table for direct comparison of frameworks like AutoGen, CrewAI, and OpenHands.