interpret-e2e-result

Analyzes e2e benchmark run logs to explain recovered findings, stop reasons, and likely failure causes.

3|3|Updated Apr 8, 2026
One-click install
npx skills add https://github.com/PioneerAIAcademy/cowork-genealogy --skill interpret-e2e-result-pioneeraiacademy
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: interpret-e2e-result
Source: https://github.com/PioneerAIAcademy/cowork-genealogy/tree/main/.claude/skills/interpret-e2e-result
Command: npx skills add https://github.com/PioneerAIAcademy/cowork-genealogy --skill interpret-e2e-result-pioneeraiacademy

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve? After an e2e genealogy benchmark run finishes, the raw run log is hard to read: it mixes harness facts, tool calls, narration, and judge output. This Skill reads those artifacts and explains in plain language what the agent recovered, what it missed, why it stopped, and the most likely cause — without leaking the judge's grade so the run can still be graded blind afterward. ## Core Features & Use Cases - Recall analysis: Compares the agent's final GedcomX tree against the fixture's expected-findings.json to state which required findings were recovered, missed, or recorded off-shape. - Stop-reason diagnosis: Translates stop_reason values (completed, natural_end, inactivity, timeout, tool_cap, cost_cap, error, mcp_unavailable) into actionable explanations with pointers to the exact tool call and narration turn. - Cause attribution: Distinguishes agent reasoning regressions, /research routing regressions, sub-skill regressions, FamilySearch data drift, and single-run jitter, while staying blind to judge_output, verdict, and outcome. - Use Case: A maintainer asks "why did this fixture fail?" and receives a grounded summary — e.g., the agent looped on place_search until the tool cap — plus a recommendation to diff against the last passing run and grade the run blind with /grade-e2e-run. ## Quick Start Interpret the latest e2e run log for the fixture in eval/runlogs/e2e and tell me what the agent recovered, why it stopped, and the most likely cause.

Frequently Asked Questions about interpret-e2e-result

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I interpret an e2e benchmark run log?▼

Point the skill at a run-<ts>.json file in eval/runlogs/e2e/<test-id>/ or name the fixture. It reads the harness fields, the final tree, and the fixture's expected-findings.json, then reports recovered findings, stop reason, and likely cause.

What does the tool_cap stop reason mean in an e2e run?▼

tool_cap means the agent hit the per-run tool-call cap (default 200), which almost always indicates looping. Read the last 20 tool calls in the run log; the repeating pattern is usually obvious, such as near-duplicate search queries.

Why can't the interpretation include the judge's verdict?▼

The judge's grade (judge_output, verdict, outcome) must stay hidden so the maintainer can grade the run blind afterward with /grade-e2e-run. Surfacing it would corrupt the calibration grade's independence. Compliance and guardrail violations are harness facts and remain reportable.

How do I tell FamilySearch data drift from an agent regression?▼

Diff tool_calls against the last passing run for the same fixture. Same calls with different response_summary values suggests FS data drift; different decisions on the same evidence suggests an agent reasoning regression. Check harness_schema_version first, since capture format changes across version boundaries.

Can this skill modify a failing e2e fixture?▼

No. It is read-only and performs interpretation only. If the diagnosis points at a fixture problem, such as a finding description too literal to match the tree, it suggests using /author-e2e-fixture to revise the fixture.