vllm-nemotron-super-optimization

Identify diff-driven optimizations for Nemotron models in vLLM.

721|65|Updated Apr 1, 2026
One-click install
npx skills add https://github.com/BBuf/AI-Infra-Auto-Driven-SKILLS --skill vllm-nemotron-super-optimization
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: vllm-nemotron-super-optimization
Source: https://github.com/BBuf/AI-Infra-Auto-Driven-SKILLS/tree/main/skills/model-optimization/vllm/vllm-nemotron-super-optimization
Command: npx skills add https://github.com/BBuf/AI-Infra-Auto-Driven-SKILLS --skill vllm-nemotron-super-optimization

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes references (resource) components.

What problem does it solve?

Identify and apply production-grade optimizations to Nemotron family models within vLLM, emphasizing diff-based evidence and reproducible improvements.

Core Features & Use Cases

  • PR-diff driven optimization workflow for NemotronH, Nemotron-3-Super, Nemotron Nano VL, and Nemotron VL architectures.
  • Guidance covers model wrappers, MoE, MTP, NVFP4, and VL adjacencies, with references to runtime surfaces and PR histories.
  • Validation paths include startup checks, quantization, and end-to-end tests; uses the Non-Negotiable Evidence Rule as the standard.

Quick Start

Review an open Nemotron optimization PR and apply the diff-driven changes to NemotronH or Nemotron Nano VL in vLLM, then run the corresponding validation lanes.

Frequently Asked Questions about vllm-nemotron-super-optimization

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I optimize Nemotron models in vLLM using PR diffs?

To optimize Nemotron models in vLLM, apply diff-driven changes from open PRs to model wrappers, then execute corresponding validation lanes like startup checks and end-to-end tests to ensure reproducible improvements.

What is the diff-driven evaluation standard for vLLM Nemotron optimizations?

The diff-driven evaluation standard for vLLM Nemotron optimizations enforces a Non-Negotiable Evidence Rule, requiring production-grade improvements to be validated through PR-diff dossiers and regression validation workflows.

Does vLLM support MTP and NVFP4 quantization for Nemotron architectures?

Yes, vLLM supports MTP and NVFP4 for Nemotron architectures, providing optimization guidance for these components alongside MoE and VL adjacencies with references to runtime surfaces and PR histories.

What is the best way to validate Nemotron Nano VL optimizations in vLLM?

The best way to validate Nemotron Nano VL optimizations in vLLM is running validation paths that include startup checks, quantization tests, and end-to-end regression workflows based on PR-diff dossiers.

When do I need to use diff-based PR evaluation for Nemotron model wrappers?

You need diff-based PR evaluation for Nemotron model wrappers when targeting production-grade reliability and maintainability, ensuring that optimizations for NemotronH or Nemotron-3-Super are backed by reproducible evidence.

Why should I use diff dossiers for vLLM Nemotron Super optimization?

You should use diff dossiers for vLLM Nemotron Super optimization because they identify production-grade, diff-driven improvements by referencing runtime surfaces and PR histories, ensuring changes maintain speed and reliability.