day0-release

Orchestrate quantized model release workflows with gated validation and publish decisions.

3.4k|535|Updated Apr 23, 2024
One-click install
npx skills add https://github.com/NVIDIA/Model-Optimizer --skill day0-release
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: day0-release
Source: https://github.com/NVIDIA/Model-Optimizer/tree/main/.agents/skills/day0-release
Command: npx skills add https://github.com/NVIDIA/Model-Optimizer --skill day0-release

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes scripts (resource) components.

What problem does it solve?

This Skill removes the complexity of coordinating a full day-0 model release workflow by enforcing a reliable path from quantization through evaluation and final publish decisions.

Core Features & Use Cases

  • End-to-End Release Orchestration: Chains setup, post-training quantization, baseline evaluation, quantized evaluation, comparison, and closeout into a gated workflow.
  • Validation Gates and Failure Handling: Runs deterministic checks after each stage to prevent invalid checkpoints, incomplete evaluations, or unsupported releases from progressing.
  • Production Readiness Decisions: Produces ACCEPT, REGRESSION, ANOMALOUS, INFEASIBLE, or NEEDS_HUMAN outcomes with traceable metrics and recommendations for model deployment teams.

Quick Start

Use the day0-release skill to quantize and validate my model checkpoint against its baseline and determine whether it is ready for publication.

Frequently Asked Questions about day0-release

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I validate a quantized model checkpoint for production release?

To validate a quantized model checkpoint for production release, you orchestrate a gated workflow that runs post-training quantization, baseline evaluation, and quantized evaluation, then compares accuracy thresholds to produce a traceable publish decision.

What is post-training quantization regression comparison in machine learning?

Post-training quantization regression comparison is the process of evaluating a quantized model against its baseline checkpoint to detect accuracy drops, classifying any failures to determine if the model meets production release standards.

How do I automate post-training quantization and baseline evaluation gates?

You automate PTQ and baseline evaluation gates by chaining deterministic validation checks after each stage, ensuring invalid checkpoints or incomplete evaluations are blocked before progressing to final publish decisions.

Can I use deterministic gate execution to block invalid checkpoint releases?

Yes, deterministic gate execution blocks invalid checkpoint releases by enforcing evaluation integrity checks and accuracy threshold comparisons at each stage, preventing unsupported models from advancing to production.

What production readiness outcomes are generated for quantized model deployment?

Production readiness outcomes for quantized model deployment include ACCEPT, REGRESSION, ANOMALOUS, INFEASIBLE, or NEEDS_HUMAN, providing traceable metrics and deployment recommendations for model teams.

Why does my quantized model fail the accuracy threshold comparison during release?

A quantized model fails accuracy threshold comparison during release when evaluation gates detect significant regression against the baseline checkpoint, resulting in a REGRESSION or NEEDS_HUMAN outcome with classified failure details.