sglang-nemotron-super-optimization

Codify PR-backed optimization patterns for Nemotron Super and Nano Hybrid in SGLang.

721|65|Updated Apr 1, 2026
One-click install
npx skills add https://github.com/BBuf/AI-Infra-Auto-Driven-SKILLS --skill sglang-nemotron-super-optimization
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: sglang-nemotron-super-optimization
Source: https://github.com/BBuf/AI-Infra-Auto-Driven-SKILLS/tree/main/skills/model-optimization/sglang/sglang-nemotron-super-optimization
Command: npx skills add https://github.com/BBuf/AI-Infra-Auto-Driven-SKILLS --skill sglang-nemotron-super-optimization

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes references (resource) components.

What problem does it solve?

PR-backed optimization manual provides canonical guidance to audit, extend, and document Nemotron Super and Nano Hybrid optimizations within SGLang, ensuring diffs are production-ready and evidence-backed.

Core Features & Use Cases

  • PR-diff dossier-guided optimization for Nemotron Super family, including NemotronH, Nemotron Nano VL, NVFP4, and MoE variants.
  • Evidence-driven validation with runtime surface mappings and change-history references to ensure traceability across PRs.
  • Use cases include auditing model changes, extending hybrid architectures, and validating performance and safety improvements in CI pipelines.

Quick Start

Begin by reviewing the non-negotiable evidence rule and the PR history reference in references/pr-history.md to start applying the canonical Nemotron optimization patterns.

Frequently Asked Questions about sglang-nemotron-super-optimization

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I optimize Nemotron Super models in SGLang using PR diffs?

You optimize Nemotron Super in SGLang by applying codified PR-backed patterns to model changes. It uses a PR-diff dossier to guide edits across NemotronH, NVFP4, and MoE variants, ensuring auditable, repeatable improvements.

What is the evidence rule for validating Nemotron Nano Hybrid architecture changes?

The evidence rule for Nemotron Nano Hybrid changes mandates traceable validation through runtime surface mappings and change-history references. This ensures performance and safety improvements are production-ready and auditable across PRs.

Does SGLang optimization support Nemotron MoE and NVFP4 configurations?

Yes, SGLang optimization supports Nemotron MoE and NVFP4 configurations. It applies canonical optimization patterns across these specific variants, validating changes through CI tests and runtime surface mappings.

How do I audit model changes for NemotronH and Nemotron Nano VL variants?

You audit model changes for NemotronH and Nemotron Nano VL by referencing the PR history dossier. This provides canonical guidance to trace diffs, validate runtime surfaces, and ensure production readiness.

What's the best way to validate Nemotron performance improvements in CI pipelines?

The best way to validate Nemotron performance improvements in CI pipelines is by applying codified optimization patterns alongside runtime surface mappings. This ensures changes are evidence-backed and pass CI tests.

Why do I need a PR-diff dossier for SGLang Nemotron optimization?

You need a PR-diff dossier for SGLang Nemotron optimization to establish an auditable history of changes. It references specific model-pr-diffs to guide edits, enforcing a non-negotiable evidence rule for repeatable improvements.