reproducibility-package-review

Validate result reproducibility by checking producer scripts, regeneration commands, and seeds.

1|Updated Dec 13, 2025
One-click install
npx skills add https://github.com/stephendor/TDL --skill reproducibility-package-review
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: reproducibility-package-review
Source: https://github.com/stephendor/TDL/tree/main/.agents/skills/reproducibility-package-review
Command: npx skills add https://github.com/stephendor/TDL --skill reproducibility-package-review

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes scripts (resource) and references (resource) components.

What problem does it solve?

This Skill unit helps researchers ensure the reproducibility of their results before submitting them for publication.

Core Features & Use Cases

  • End-to-End Reproducibility Check: Confirms that all committed results can be regenerated from committed scripts, seeds, and parameters.
  • Git Integration: Validates that producer scripts and regeneration commands are correctly committed to the branch.
  • Seed and Parameter Recording: Ensures that seeds and run parameters for stochastic steps are properly recorded in the script and vault.
  • Intermediates Presence Verification: Checks for the existence of gitignored files needed for downstream processing.
  • Final Reproducibility Verification: Verifies that results can be rebuilt following the recorded commands, ensuring full reproducibility.

Quick Start

Run the reproducibility-package-review skill to check the reproducibility of your latest result set.

Frequently Asked Questions about reproducibility-package-review

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I ensure reproducibility of research results before academic publication?

Reproducibility validation checks that committed result sets can be regenerated from producer scripts, seeds, and parameters. It confirms that regeneration commands are correctly committed to the branch and verifies that results can be fully rebuilt from source.

How do I validate that producer scripts and regeneration commands are committed to Git?

Git integration validation confirms that producer scripts and regeneration commands are correctly committed to the active branch. This ensures the version control system maintains the necessary source code to rebuild results from committed scripts.

What is the best way to verify seeds and run parameters are recorded for stochastic steps?

Seed and parameter recording verification ensures that seeds and run parameters for stochastic steps are properly recorded in both the script and the vault. This guarantees stochastic processes can be identically regenerated during reproducibility checks.

How do I check for missing gitignored intermediate files needed for downstream processing?

Intermediates presence verification checks for the existence of gitignored files needed for downstream processing. This validates that all necessary intermediate data files are present before attempting to regenerate the final result set.

Can I use reproducibility checks for research workflows without robust academic publication requirements?

Reproducibility validation applies primarily to research workflows that require robust reproducibility guarantees for academic publications. While it can verify any result set, its core design targets ensuring results can be rebuilt from source before paper submission.

Why does reproducibility verification fail when results cannot be rebuilt following recorded commands?

Final reproducibility verification fails when results cannot be rebuilt following the recorded commands, indicating missing producer scripts, incorrect seeds, or absent intermediate files. This confirms the result set lacks the necessary components for full reproducibility.