Parse Model A/B logs into structured execution evidence files with runtime summaries.
npx skills add https://github.com/MinhOmega/marlin-skill --skill fill-evidence
Please help me install this Agent Skill. Skill: fill-evidence Source: https://github.com/MinhOmega/marlin-skill/tree/main/.claude/skills/fill-evidence Command: npx skills add https://github.com/MinhOmega/marlin-skill --skill fill-evidence
Turning raw Model A/B logs into structured execution evidence files, saving time during checkpoint reviews.
After saving logs with step_4_save_logs.sh, run /fill-evidence <workspace_path> <turn_number> to generate evidence files.
High-intent search queries and answers about installing and using this skill.
To generate execution evidence from logs, parse the Model A/B text files to extract test results, build output, runtimes, and changed files into structured markdown summaries. This produces dedicated evidence files that streamline checkpoint assessment.
Extract test results and build output by applying the evidence generation skill to a workspace path and turn number. It reads the logs_a.txt and logs_b.txt files in the turn directory to produce structured execution evidence markdown files.
The best way to summarize runtime and changed files is to parse the raw logs into structured evidence files. This process extracts execution metrics and file change data, generating concise summaries for quick post-run validation and reporting.
Yes, you need to save logs using step_4_save_logs.sh before generating evidence files. The evidence generation process requires logs_a.txt and logs_b.txt to be present in the turn directory to extract the test results and runtime data.
Yes, you can automate evidence generation for multi-turn experiments by running the skill with the workspace path and turn number. It automatically parses the existing logs to produce structured execution evidence files without manual extraction.
A key limitation is that the logs must be present in the turn directory as logs_a.txt and logs_b.txt. Evidence generation only works for turn-level reviews where these specific raw log files already exist from prior runs.
jackspaceManage stateful agent conversations with the OpenAI Responses API.
MykhailoDmytriakhaEnforce test coverage and lint checks on changed code with npm scripts.
czh-ee-2023Deploy experiments from an experiment plan to GPU resources and collect initial results.
mvillmowParse test logs to extract and categorize failures by type.
