What problem does it solve?
LLM agents running machine learning experiments can inadvertently produce fraudulent results, including fake ground truth derived from model outputs, manipulated score normalization, phantom unrun experiments, and overstated evaluation scope. This Skill adds integrity constraints to catch these failure modes before results are used to support research claims.
Core Features & Use Cases
- Cross-model independent review: Uses an external reviewer backend to evaluate experiment artifacts without executor bias, ensuring judgment separation.
- Fraud pattern detection: Checks for fake ground truth, score normalization fraud, phantom results, dead code, and scope mismatches between claims and actual testing.
- Pipeline integration: Automatically tags research claims with integrity status (PASS/WARN/FAIL) without blocking workflow progression, and generates structured audit reports for machine and human consumption.
- Use Case: A researcher preparing a conference paper can run this Skill after completing experiments to audit result validity before writing claims, avoiding retractions or credibility issues from accidental fraud.
Quick Start
Use the experiment-audit skill to audit the integrity of all experiment results in your current project before finalizing research paper claims.