support-new-model

Guide new LLM or VLM adaptation to dlinfer on domestic hardware.

74|15|Updated Jul 9, 2024
One-click install
npx skills add https://github.com/DeepLink-org/dlinfer --skill support-new-model-deeplink-org
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: support-new-model
Source: https://github.com/DeepLink-org/dlinfer/tree/main/.claude/skills/zh_cn/support-new-model
Command: npx skills add https://github.com/DeepLink-org/dlinfer --skill support-new-model-deeplink-org

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

在国产 AI 硬件上通过 dlinfer 适配一个新模型,降低跨厂商集成难度并加速落地。

Core Features & Use Cases

  • 提供从信息收集到分析实现的完整工作流,用于将新模型接入 Ascend CAMB MACA 等硬件后端。
  • 自动分析模型与后端能力差异,给出实现路径与实现清单,帮助工程师按步骤落地新模型。
  • 适用于 LMDeploy CUDA backend 已支持的模型,快速扩展到国产芯片生态的场景。

Quick Start

Provide the model name and target vendor, then run the analysis to identify integration gaps and recommended changes.

Frequently Asked Questions about support-new-model

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I adapt a new LLM for inference on Ascend hardware?

To adapt a new LLM for Ascend hardware, you provide the model name and target vendor to analyze integration gaps and generate an end-to-end implementation plan via dlinfer.

What is the workflow for integrating a VLM with dlinfer on domestic chips?

Integrating a VLM with dlinfer involves gathering model information, analyzing capability gaps against the target backend, and outlining step-by-step implementation artifacts for the vendor-specific hardware.

Can I use LMDeploy to run CUDA-supported models on MACA backends?

Yes, models already supported by the LMDeploy CUDA backend can be expanded to MACA backends by using dlinfer to determine the necessary artifacts and implementation steps for the domestic chip ecosystem.

Does dlinfer support model integration across different hardware vendors?

Yes, dlinfer supports model integration across vendor-specific backends including Ascend, Camb, and MACA by guiding information gathering and gap analysis for each target environment.

What inputs are required to start the new model adaptation process?

You need to provide the model name and target vendor to start the adaptation process, which then determines the necessary implementation artifacts and integration steps.

Are there limitations when adapting models to the Camb backend?

The adaptation process assumes the model is already supported by the LMDeploy CUDA backend; if not, you must ensure baseline compatibility before using dlinfer to generate the implementation plan for the Camb backend.