reproducibility-checklist

Audit seeds, versions, data hashes, and environments for ML experiment reproducibility.

14|2|Updated Feb 24, 2026
One-click install
npx skills add https://github.com/andikarachman/data-science-plugin --skill reproducibility-checklist-andikarachman
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: reproducibility-checklist
Source: https://github.com/andikarachman/data-science-plugin/tree/main/skills/reproducibility-checklist
Command: npx skills add https://github.com/andikarachman/data-science-plugin --skill reproducibility-checklist-andikarachman

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

ML experiments often suffer from irreproducibility due to unclear data provenance, missing random seeds, and untracked software environments.

Core Features & Use Cases

  • Audit random seeds, library versions, and data hashes to enable exact re-runs.
  • Capture and verify environment details and code state to support full reproducibility across machines and teams.
  • Use in experimentation workflows to identify gaps and drive improvements in auditability and traceability.

Quick Start

Run this checklist on your latest experiment to confirm reproducibility.

Frequently Asked Questions about reproducibility-checklist

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I make machine learning experiments reproducible and auditable across teams?

Machine learning experiment reproducibility requires auditing random seeds, library versions, data hashes, and environment captures. Enforcing these checks ensures exact re-runs, auditability, and traceability across different machines and team members.

What is included in an ML experiment reproducibility checklist?

An ML experiment reproducibility checklist includes verifying random seeds, library versions, data provenance, code state, and environment capture. It applies a scoring rubric to identify gaps and enforce deterministic results for your experimentation workflows.

How do I audit data provenance and random seeds for machine learning workflows?

You audit data provenance and random seeds by capturing data hashes and verifying seed values during your experimentation workflows. This process identifies reproducibility gaps and drives improvements in experiment auditability and traceability.

Why do my machine learning experiments yield non-deterministic results across machines?

Machine learning experiments yield non-deterministic results across machines due to untracked software environments, missing random seeds, and unclear data provenance. Capturing environment details and code state is required to support full reproducibility.

Can I use a reproducibility checklist to score the auditability of my ML experiments?

Yes, you can use a reproducibility checklist to score the auditability of your ML experiments. It applies a scoring rubric to establish checks for deterministic results, evaluating seeds, versions, data hashes, and environment capture.