vllm-ascend-deploy

Automate end-to-end vLLM deployment on Ascend NPU platforms via SSH.

31|1|Updated Mar 28, 2026
One-click install
npx skills add https://github.com/Ascend/agent-skills --skill vllm-ascend-deploy
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: vllm-ascend-deploy
Source: https://github.com/Ascend/agent-skills/tree/main/skills/vllm-ascend-deploy
Command: npx skills add https://github.com/Ascend/agent-skills --skill vllm-ascend-deploy

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires requests, and includes scripts (resource) and references (resource) components.

What problem does it solve?

Automates the end-to-end deployment workflow of vLLM on Ascend NPU platforms, eliminating manual steps and reducing risk in complex hardware setups.

Core Features & Use Cases

  • End-to-end deployment for vLLM on Ascend hardware (A2/A3) with automated SSH checks, NPU verification, configuration discovery, and user confirmations.
  • Cron-based startup monitoring and health validation with automated notifications to keep operators informed.
  • Supports models such as Qwen/Qwen3.5, GLM, and other compatible variants, with script-driven container orchestration and validation.

Quick Start

Provide the target model path and deployment environment to start the vLLM deployment flow.

Frequently Asked Questions about vllm-ascend-deploy

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I deploy vLLM on Ascend NPU platforms remotely?

You can deploy vLLM on Ascend NPU platforms remotely by automating the end-to-end workflow with SSH-based checks, NPU resource verification, and script-driven docker container orchestration. Provide the target model path and environment to initiate the deployment flow.

Can I use Docker containers to run vLLM on Ascend A2 or A3 hardware?

Yes, Docker-based container orchestration is supported for running vLLM on Ascend A2 or A3 hardware. The deployment applies script-driven container orchestration alongside automated NPU verification and configuration discovery to ensure the environment is correctly set up.

What models are supported for automated vLLM deployment on Ascend NPU?

Supported models for automated vLLM deployment on Ascend NPU include Qwen and GLM variants. The deployment process applies official configuration validation to ensure these models run correctly within the orchestrated Docker containers.

Does vLLM deployment on Ascend NPU include health validation and monitoring?

vLLM deployment on Ascend NPU includes cron-based startup monitoring and health validation with automated notifications. This cron-monitored background startup approach keeps operators informed and ensures the deployed models remain stable and operational.

What are the prerequisites for automating vLLM deployment on Ascend NPU?

Prerequisites for automating vLLM deployment on Ascend NPU include an SSH-accessible remote environment and compatible Ascend hardware. The automation applies secure pre-checks to verify NPU resources and validate official configurations before proceeding with the deployment.