sue-interface-check

Audit ML experiment codebases for portable scale-up readiness across HPC and cloud backends.

Updated Aug 27, 2026
One-click install
npx skills add https://github.com/dongzhuoyao/deepresearch --skill sue-interface-check
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: sue-interface-check
Source: https://github.com/dongzhuoyao/deepresearch/tree/main/.codex/skills/sue-interface-check
Command: npx skills add https://github.com/dongzhuoyao/deepresearch --skill sue-interface-check

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

This skill solves the problem of teachers and operators needing to validate that student-submitted ML experiment codebases are portable, safe, and ready for large-scale runs across HPC and cloud sandboxes without exposing private infrastructure details or wasting expensive compute on broken code.

Core Features & Use Cases

  • 4 Hard Gate Enforcement: Automatically checks for the 4 mandatory scale-up readiness controls: real dry-run profiling, inode-saving output mode, first-run smoke test, and committed running README under scale_up_scripts/.
  • 22 Prioritized Audit Rules: Evaluates codebases against a ranked set of rules covering W&B logging, CSV result/progress ledgers, Hydra configuration, PyTorch DDP support, and queryable progress monitoring.
  • Use Case: A machine learning educator can run this audit on student experiment submissions before allocating GPU resources on LUMI, RunPod, or other sandboxes, catching missing interfaces early to avoid failed runs and wasted cloud costs.

Quick Start

Use the sue-interface-check skill to audit a student-provided ML experiment codebase for portable scale-up readiness before submitting teacher-led training or generation runs to a sandbox backend.

Frequently Asked Questions about sue-interface-check

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I validate ML experiment code for safe scale-up readiness across HPC and cloud sandboxes?

Validating ML experiment code for scale-up readiness requires auditing the codebase against 22 prioritized rules covering dry-run profiling, inode-safe output controls, and preflight smoke tests. This ensures code is portable and safe for HPC and cloud backends like LUMI or RunPod before allocating compute.

What is a dry-run profiling check for PyTorch DDP training pipelines?

A dry-run profiling check is a mandatory hard gate that verifies training pipelines execute correctly on minimal resources before full scale-up. It ensures PyTorch DDP support and Hydra configuration function properly, preventing wasted GPU compute on broken or non-portable code.

How do I enforce W&B and CSV logging contracts in student ML experiment submissions?

Enforcing W&B and CSV logging contracts involves auditing the experiment codebase to verify it exposes minimum portable interfaces for queryable progress monitoring. This checks that result ledgers and logging pipelines meet the required standards for safe, cost-effective scale-up.

Does this ML experiment audit work with LUMI, Snellius, and RunPod backends?

Yes, the audit evaluates codebases targeting HPC and cloud sandbox backends including LUMI, Snellius, NM5, Brev, RunPod, and AutoDL. It verifies that training, generation, and evaluation pipelines meet the portable interface requirements specific to these platforms.

What are the mandatory hard gates for ML code pre-submission validation in educational settings?

The four mandatory hard gates for pre-submission validation are real dry-run profiling, inode-saving output mode, first-run smoke test, and a committed running README under scale_up_scripts/. These gates ensure student code is portable and will not waste expensive compute resources.

Why do I need an inode-safe output mode for large-scale ML training runs?

An inode-safe output mode is required to prevent file system exhaustion during large-scale ML training runs on HPC systems. It acts as a mandatory hard gate during code audits to ensure output controls are properly configured before allocating expensive GPU resources.