opp-eval

Aggregate per-skill eval verdicts into run-level scorecards with weighted category scores.

1|2|Updated Apr 1, 2026
One-click install
npx skills add https://github.com/jjackson/ace --skill opp-eval
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: opp-eval
Source: https://github.com/jjackson/ace/tree/main/skills/opp-eval
Command: npx skills add https://github.com/jjackson/ace --skill opp-eval

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Consolidates individual per-skill evaluation verdicts into a single run-level scorecard to reveal overall health of an opportunity and point to improvement areas.

Core Features & Use Cases

  • Aggregate per-skill verdicts across modes (--quick, --deep, --monitor) into a single scorecard.
  • Produce per-skill breakdowns, identify the weakest dimensions, and surface improvement recommendations.
  • Generate both machine-readable verdict YAML and human-readable scorecards for governance and operator reviews.

Quick Start

Run opp-eval after an opportunity run to generate the run-level scorecard and recommendations.

Frequently Asked Questions about opp-eval

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I aggregate per-skill evaluation verdicts into a run-level scorecard?

You aggregate per-skill evaluation verdicts into a run-level scorecard by reading individual verdict files, computing weighted category scores, and handling missing data gracefully to output both machine-readable YAML and human-readable scorecards.

What is a run-level scorecard for opportunity evaluation?

A run-level scorecard for opportunity evaluation consolidates individual per-skill verdicts to reveal overall opportunity health, identify the weakest dimensions, and surface improvement recommendations for governance reviews.

How do I generate machine-readable verdict YAML from opportunity evaluations?

You generate machine-readable verdict YAML from opportunity evaluations by running an aggregation process across per-skill verdicts that computes weighted category scores and writes structured YAML files alongside human-readable scorecards.

Does opportunity evaluation support different evaluation modes like quick and deep?

Opportunity evaluation supports --quick, --deep, and --monitor modes, allowing you to aggregate per-skill verdicts across different analysis depths to produce both machine-readable and human-readable scorecards.

How are missing data points handled when computing weighted category scores?

Missing data points are handled gracefully when computing weighted category scores, ensuring the aggregation process continues to produce a complete run-level scorecard without failing on incomplete per-skill verdict files.