llm-deploy-training

Deploy and train LLM and VLM systems with version-aware configuration and validation.

7|1|Updated May 9, 2026
One-click install
npx skills add https://github.com/black-yt/skills --skill llm-deploy-training
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: llm-deploy-training
Source: https://github.com/black-yt/skills/tree/main/llm-deploy-training
Command: npx skills add https://github.com/black-yt/skills --skill llm-deploy-training

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes references (resource) components.

What problem does it solve?

This Skill helps you deploy, validate, troubleshoot, and train large language and vision-language models without breaking shared environments or relying on guesswork.

Core Features & Use Cases

  • Model serving: Set up vLLM OpenAI-compatible endpoints with correct multimodal limits, tool calling, reasoning controls, CUDA Graph settings, and remote access validation.
  • Model training: Configure ms-swift SFT, DPO, and GRPO runs with version-aware hyperparameters, full-training settings, loss masking, long-context handling, and checkpoint hygiene.
  • Operational safety: Avoid unsafe environment edits, verify labels and loss scales before training, and use dry runs plus logs to catch OOMs, parser issues, and masking errors early.

Quick Start

Ask for a version-aware deployment or training plan for your target model, including the correct vLLM or ms-swift commands, validation checks, and troubleshooting steps.

Frequently Asked Questions about llm-deploy-training

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I deploy a multimodal LLM using vLLM with OpenAI-compatible endpoints?

To deploy a multimodal LLM with vLLM, configure OpenAI-compatible endpoints with correct multimodal limits, tool calling, reasoning controls, and CUDA Graph settings, followed by remote access validation to ensure safe serving.

What is the best way to configure ms-swift for SFT and DPO training runs?

Configuring ms-swift for SFT and DPO requires version-aware hyperparameters, full-training settings, loss masking verification, long-context handling, and checkpoint hygiene to train models safely without breaking shared environments.

How do I verify loss masking and avoid OOM errors during LLM training?

To verify loss masking and avoid OOM errors during LLM training, use dry runs plus logs to catch parser issues, masking errors, and memory limits early, validating labels and loss scales before executing full runs.

Does vLLM support Qwen tool calling and reasoning control for multimodal inference?

Yes, vLLM supports Qwen tool calling and reasoning control for multimodal inference by applying version-aware configuration and validation to manage CUDA Graph settings and multimodal limits correctly during serving.

Why do I need version-aware configuration for LLM deployment and training?

You need version-aware configuration for LLM deployment and training to prevent unsafe environment edits, ensure compatibility across vLLM and ms-swift workflows, and validate hyperparameters for safe shared-environment usage.

How do I set up GRPO workflows with ms-swift while maintaining checkpoint hygiene?

Setting up GRPO workflows with ms-swift requires applying version-aware hyperparameters, full-training settings, and strict checkpoint hygiene to ensure safe shared-environment usage and prevent data loss during training.