eval-run

Coordinate parallel agent-eval and orch-eval workflows to grade agent sessions.

1|Updated Mar 24, 2026
One-click install
npx skills add https://github.com/EdgeApp/edge-dev-agents --skill eval-run-edgeapp
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: eval-run
Source: https://github.com/EdgeApp/edge-dev-agents/tree/main/.cursor/skills/eval-run
Command: npx skills add https://github.com/EdgeApp/edge-dev-agents --skill eval-run-edgeapp

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires jq, and includes scripts (resource) and references (resource) components.

What problem does it solve?

This skill solves the challenge of verifying and scoring the performance of autonomous agent runs, ensuring that complex development workflows meet quality standards without manual oversight.

Core Features & Use Cases

  • Dual-Mode Evaluation: Supports both lightweight report-based grading and deep-dive transcript analysis for comprehensive quality assurance.
  • Adversarial Verification: Automatically re-verifies negative findings to ensure accuracy and prevent false positives in agent performance reports.
  • Actionable Remediation: Generates a checklist of approved remediation drafts, allowing operators to fix workflow gaps or promote successful patterns directly from the evaluation results.

Quick Start

Invoke the eval-run skill to evaluate all agent runs from yesterday using the default report-based mode.

Frequently Asked Questions about eval-run

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I automate quality assurance for autonomous agent workflows?

Automate quality assurance by orchestrating parallel agent-eval and orch-eval workflows to grade Asana-backed development tasks against defined rubric dimensions and infrastructure gates.

What is adversarial verification in agent performance grading?

Adversarial verification automatically re-verifies negative findings during agent performance grading to ensure accuracy and prevent false positives in the evaluation reports.

How do I evaluate autonomous agent sessions using transcript analysis?

Evaluate autonomous agent sessions by invoking the dual-mode evaluation feature, which supports both lightweight report-based grading and deep-dive transcript analysis.

Does the agent workflow evaluation process require any specific command-line dependencies?

Yes, agent workflow evaluation requires the jq command-line dependency to be installed in your environment to parse and process the evaluation data.

Can I generate remediation checklists directly from agent evaluation results?

Yes, you can generate actionable remediation checklists containing approved drafts to fix workflow gaps or promote successful patterns directly from the evaluation results.

What is the best way to synthesize cohort-level patterns from development task evaluations?

The best way to synthesize cohort-level patterns is by coordinating parallel evaluation workflows that systematically grade Asana-backed development tasks against defined rubric dimensions.