One-click install
npx skills add https://github.com/dimagi-internal/ace --skill cycle-grade-eval
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: cycle-grade-eval
Source: https://github.com/dimagi-internal/ace/tree/main/skills/cycle-grade-eval
Command: npx skills add https://github.com/dimagi-internal/ace --skill cycle-grade-eval

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

The built-in Phase 10 cycle-grade skill has a structural self-evaluation bias, as the same model that executed the opportunity cycle is responsible for grading its own performance. This leads to inflated scores, missed actionable learnings, and vague recommendations that fail to improve future cycle outcomes.

Core Features & Use Cases

  • Unbiased Re-grading: Independently evaluates closed cycle closeout scorecards to detect self-eval inflation, missing concrete learnings, and non-specific recommendations.
  • Evidence-Anchored Scoring: Requires re-deriving at least one load-bearing cycle outcome from raw, out-of-chain run data (FLW delivery records, observation logs, per-phase artifacts, run state) instead of relying on potentially inflated per-skill verdict files.
  • Structured Verdict Generation: Grades across 5 weighted dimensions (self-eval agreement, learnings concreteness, recommendation specificity, evidence citation discipline, trajectory framing) with hard guards against inflation and uncorroborated claims, then writes a standardized verdict YAML.
  • Archetype Support: Works across all ACE opportunity archetypes (atomic visit, focus group, multi-stage) and handles edge cases like incomplete Phase 10 closeouts by emitting an explicit incomplete verdict.
  • Use Case: ACE program managers and cycle leads can use this skill to get an unbiased, evidence-backed assessment of cycle performance instead of relying on the self-graded scorecard that may overstate success.

Quick Start

Use the cycle-grade-eval skill to independently audit the closeout scorecard for the latest Connect opportunity cycle and generate a structured, unbiased verdict YAML.

Frequently Asked Questions about cycle-grade-eval

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I eliminate self-evaluation inflation bias from closed ACE opportunity cycle scorecards?

To eliminate self-evaluation inflation bias, independently re-grade closed ACE opportunity cycle closeout scorecards by anchoring scoring strictly to out-of-chain raw data sources like FLW delivery records, observation logs, and per-phase artifacts rather than relying on potentially inflated per-skill verdict files.

What is evidence-anchored cycle evaluation and how does it work?

Evidence-anchored cycle evaluation independently validates performance claims by re-deriving at least one load-bearing cycle outcome directly from raw run evidence, such as observation logs and run state product blocks, structurally preventing the executing model from grading its own performance without external corroboration.

How do I validate closeout grades for multi-stage and focus group opportunity archetypes?

To validate closeout grades across all ACE opportunity archetypes including atomic visit, focus group, and multi-stage cycles, apply an independent re-grading process across five weighted dimensions to detect missing concrete learnings and non-specific recommendations, outputting a standardized verdict YAML.

Does cycle evaluation work on incomplete Phase 10 closeouts?

Cycle evaluation explicitly handles incomplete Phase 10 closeouts by detecting missing closeout data and emitting an explicit incomplete verdict instead of forcing an inaccurate grade, ensuring edge cases are documented without corrupting the audit trail.

What's the best way to independently audit cycle closeout performance for vague recommendations?

The best way to audit cycle closeout performance for vague recommendations is to apply structured verdict generation across weighted dimensions including recommendation specificity and trajectory framing, enforcing hard guards against uncorroborated claims to ensure actionable learnings for future cycles.

What raw run data do I need to audit self-graded closeout scorecards?

Auditing self-graded closeout scorecards requires out-of-chain raw run data sources including FLW delivery records, observation logs, per-phase artifacts, and run state product blocks to independently re-derive performance claims and eliminate structural self-evaluation bias.