Validate benchmark run data and save structured JSON output to a specified path.
npx skills add https://github.com/slabgorb/sidequest --skill finalize-run
Please help me install this Agent Skill. Skill: finalize-run Source: https://github.com/slabgorb/sidequest/tree/main/.pennyfarthing/skills/pf-finalize-run Command: npx skills add https://github.com/slabgorb/sidequest --skill finalize-run
Benchmark runs often fail to enforce a consistent finalization step, risking unreliable results and audit gaps.
Invoke the finalize-run skill with a complete JSON payload to validate the run and write the results to the specified output path.
High-intent search queries and answers about installing and using this skill.
To validate benchmark run results, you can enforce a single guardrail exit point that checks ISO8601 timestamps, required token counts, and score extraction before saving structured JSON output to a specified file path.
Yes, multi-judge relay benchmark scenarios are supported. The validation guardrail enforces score verification and timestamp sanity checks across agent and judge inputs, ensuring consistent finalization for solo, duel, or relay runs.
Timestamp sanity checking enforces strict ISO8601 timestamp formats for benchmark runs. This ensures chronological consistency across agent and judge inputs before results pass through the final save point.
You can enforce required token counts by passing a complete JSON payload through a validation guardrail. This verifies agent and judge token data alongside score extraction and timestamp formats before writing to an output path.
The best way to prevent audit gaps is enforcing a single guardrail save point for benchmark runs. This validates all agent, judge, and score fields with timestamp sanity checks before storing structured JSON results.
Yes, benchmark validation works with duel scenarios and multiple judges. It enforces consistent score verification and timestamp sanity across all agent and judge inputs before finalizing structured JSON output.
scottatronTrack tasks and dependencies with a CLI supporting JSONL storage.
bencharoenwongAnalyze peer snapshots and generate structured JSON peer comparison outputs.
EurecaMomentProcess and validate raw simulation data for benchmark evaluations.
HainrixzAudit and score database schemas for integrity, performance, and scale.
