What problem does it solve?
This Skill helps researchers and engineers verify that metric implementations and pipeline steps are correct, reproducible, and appropriately documented so that reported values in analyses and papers can be trusted.
Core Features & Use Cases
- Locate implementation: Find the function or script that computes the named metric or pipeline step and enumerate inputs, outputs, and assumptions.
- Verify embeddings and checkpoints: Check embedding provenance and ensure computations use validated checkpoints and expected sample counts.
- Recompute and compare: Run reproducible scripts to recompute metric values, capture diagnostics, and compare them to reported numbers.
- Produce formal audit report: Generate a structured markdown audit with pre-conditions, process checks, post-conditions, findings, limitations, and a safe claim statement.
- Governance actions: Create issues for investigation, update global audit trackers, and reference commits and evidence for traceability.
Quick Start
Audit the metric gaussian entropy by locating its implementation, recomputing results against the canonical embeddings, and writing a reproducible audit document to report/sprints/week-NN/gaussian-entropy-audit.md.