Skills
.Work. You
Rest

vllm-omni-npu-model-runner-upgrade

Official

Upgrade vllm-omni NPU runners to vllm-ascend.

Software Engineering#upgrade#npu#omni#vllm-ascend#model-runner#kv-transfer#graph-wrapper
Authorvllm-project
Version1.0.0
Installs0

System Documentation

What problem does it solve?

Upgrade vllm-omni NPU model runners to align with the latest vllm-ascend codebase while preserving omni-specific logic.

Core Features & Use Cases

  • Updates OmniNPUModelRunner, NPUARModelRunner, and NPUGenerationModelRunner to the latest vllm-ascend interface, including ACLGraphWrapper integration and talker MTP handling.
  • Ensures compatibility with Omni models (Qwen3-Omni, Bagel, MiMo-Audio) across Ascend NPUs, with KV transfer hooks and multimodal outputs preserved.
  • Provides a structured upgrade workflow with omni-specific markers to guide safe porting, testing, and validation.

Quick Start

Follow the upgrade workflow to port the NPU model runners from vllm-omni to vllm-ascend, preserving Omni-specific logic.

Dependency Matrix

Required Modules

None required

Components

references

💻 Claude Code Installation

Recommended: Let Claude install automatically. Simply copy and paste the text below to Claude Code.

Please help me install this Skill:
Name: vllm-omni-npu-model-runner-upgrade
Download link: https://github.com/vllm-project/vllm-omni/archive/main.zip#vllm-omni-npu-model-runner-upgrade

Please download this .zip file, extract it, and install it in the .claude/skills/ directory.
View Source Repository

Agent Skills Search Helper

Install a tiny helper to your Agent, search and equip skill from 471,000+ vetted skills library on demand.