experiment-audit

Audit machine learning experiment results for fraud patterns using GPT-5.5.

Updated Jul 6, 2026
One-click install
npx skills add https://github.com/caw111/2026-SoftwareCup --skill experiment-audit-caw111
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: experiment-audit
Source: https://github.com/caw111/2026-SoftwareCup/tree/main/.agents/skills/experiment-audit
Command: npx skills add https://github.com/caw111/2026-SoftwareCup --skill experiment-audit-caw111

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes scripts (resource) and references (resource) components.

What problem does it solve?

This Skill ensures the integrity of experiments by auditing the results, preventing common fraudulent practices in machine learning experiments.

Core Features & Use Cases

  • Experiment Integrity Audit: Checks for fake ground truth, score normalization fraud, phantom results, and insufficient scope.
  • Cross-Model Review: Uses GPT-5.5 to verify the authenticity of the experiment results.
  • Workflow Automation: Automates the process of collecting files, reviewing them, and generating an audit report.

Quick Start

Run the experiment-audit skill with the path to your experiment directory or results file.

Frequently Asked Questions about experiment-audit

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I audit machine learning experiment results for fraud?

To audit machine learning experiment results for fraud, you can run a cross-model review process that checks for fake ground truth, score normalization fraud, and phantom results to ensure experiment integrity.

What is cross-model review in machine learning experiment integrity?

Cross-model review is a verification process that uses a secondary model like GPT-5.5 to independently validate machine learning experiment results and detect common fraudulent practices or scope issues.

How do I detect fake ground truth or score normalization fraud in my experiments?

You can detect fake ground truth or score normalization fraud by running an automated experiment audit that collects your result files and generates a report flagging these specific fraud patterns.

Can I automate the collection and review of machine learning experiment files?

Yes, you can automate the collection and review of machine learning experiment files by running an audit skill that gathers the files, performs a cross-model review, and outputs an audit report.

Does the experiment audit process require any specific dependencies?

The experiment audit process does not require any specific external dependencies, allowing you to directly verify your machine learning experiment results without additional environment setup.

What are the limitations of using automated audits for machine learning experiments?

Automated audits for machine learning experiments focus on detecting known fraud patterns like fake ground truth and phantom results, but may not catch novel or complex manipulation tactics outside this scope.