ml-audit-repo

Audit ML repositories by verifying claims across code, data, training, and metrics.

Updated Mar 21, 2026
One-click install
npx skills add https://github.com/ManfronEnrico/thesis-manifold --skill ml-audit-repo
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: ml-audit-repo
Source: https://github.com/ManfronEnrico/thesis-manifold/tree/main/.claude/skills/ml-audit-repo
Command: npx skills add https://github.com/ManfronEnrico/thesis-manifold --skill ml-audit-repo

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Evidence-driven ML repository verification prevents unverified claims from slipping into production by systematically auditing code, data, training, and metrics, and by producing verifiable artifacts.

Core Features & Use Cases

  • Conducts staged audits (quick / standard / forensic) to verify executability, data reality, training authenticity, and metric validity.
  • Generates verdicts, findings JSON, evidence manifest, and human-readable audit reports to support pre-merge and post-release checks.
  • Enables teams to enforce reproducibility and traceable provenance for ML models and datasets.

Quick Start

Point the audit_skill at a repository path and choose an audit level to generate a complete evidence bundle and verdicts.

Frequently Asked Questions about ml-audit-repo

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I verify ML repository reproducibility before a model release?

You can verify ML repository reproducibility by running staged audits that check executability, data reality, training authenticity, and metric validity, generating verdicts and evidence bundles for pre-release validation.

What is evidence-driven ML repo verification?

Evidence-driven ML repo verification is the process of systematically auditing code, data, training, and metrics artifacts to prevent unverified claims from reaching production, producing verifiable artifacts like findings JSON and audit reports.

How do I audit machine learning training claims during a PR review?

Point the audit process at a repository path and select an audit level to generate a complete evidence bundle, verifying training authenticity and metric validity to support pre-merge checks.

What artifacts do I need to perform an ML model audit?

Performing an ML model audit requires structured artifacts such as run manifests, predictions, and requirements to successfully evaluate claims and generate verifiable findings.

Does ML repo verification support forensic level audits for high-stakes deployments?

Yes, ML repo verification supports forensic level audits alongside quick and standard levels, allowing teams to enforce traceable provenance and deep validation for high-stakes model deployments.

What is the best way to enforce traceable provenance for ML datasets?

The best way to enforce traceable provenance is conducting systematic audits of code and data artifacts, generating human-readable audit reports and evidence manifests that verify dataset reality and training authenticity.