skills.rest
BBuf
BBufCOMMUNITY
Explore all skills by this author →
WebsiteGitHub

sglang-ernie45-optimization

Identify Ernie4.5-VL optimization practices from PR-diff evidence in SGLang runtime.

721|65|Updated Apr 1, 2026
Search Tags:#optimization#multimodal#sglang#pr-diff#ernie45#rotary-embedding
One-click install
npx skills add https://github.com/BBuf/AI-Infra-Auto-Driven-SKILLS --skill sglang-ernie45-optimization
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: sglang-ernie45-optimization
Source: https://github.com/BBuf/AI-Infra-Auto-Driven-SKILLS/tree/main/skills/model-optimization/sglang/sglang-ernie45-optimization
Command: npx skills add https://github.com/BBuf/AI-Infra-Auto-Driven-SKILLS --skill sglang-ernie45-optimization

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes references (resource) components.

What problem does it solve?

PR-backed optimization manual for Ernie4.5 / Ernie4.5-VL in SGLang. Use when Codex needs to audit, debug, extend, or document the SGLang Ernie4.5 multimodal runtime, especially the initial VL landing, fused Triton rotary path, and later cos/sin cache rewrite for Ernie4.5-VL.

Core Features & Use Cases

  • PR-backed diff-driven guidance for optimizing Ernie4.5/Ernie4.5-VL in the SGLang runtime, including VL bring-up and rotary embedding improvements.
  • Tracks production-ready changes across layers such as srt/models/ernie45_vl.py, rotary_embedding.py, and model_config.py with references to diff history.
  • Provides a repeatable evidence baseline using references/pr-history.md and diff-based PR cards to support audits and future work.

Quick Start

Review the PR-diff dossiers for Ernie4.5-VL and apply the recommended changes to the SGLang runtime.

Frequently Asked Questions about sglang-ernie45-optimization

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I optimize Ernie4.5 multimodal runtime in SGLang?▼

Optimizing Ernie4.5 multimodal runtime in SGLang involves applying PR-backed diff-driven changes to VL bring-up, fused Triton rotary embedding paths, and cos/sin cache rewrites across srt layers.

What is the cos/sin cache rewrite for Ernie4.5-VL?▼

The cos/sin cache rewrite for Ernie4.5-VL is a production-ready optimization practice tracked across rotary_embedding.py and model_config.py, validated through diff history to improve runtime performance.

How do I audit SGLang rotary embedding improvements for Ernie4.5?▼

You can audit SGLang rotary embedding improvements by reviewing the PR-diff dossiers and diff-based PR cards that establish a repeatable evidence baseline for Ernie4.5-VL production deployments.

Does SGLang support Ernie4.5-VL bring-up and deployment?▼

SGLang supports Ernie4.5-VL bring-up and deployment by applying validated changes across srt/models/ernie45_vl.py and model_config.py, satisfying diff-based evidence and historical PR references for rigorous production guidance.

What are the limitations of using PR-diff evidence for Ernie4.5 optimization?▼

The limitation of using PR-diff evidence for Ernie4.5 optimization is that guidance strictly follows tracked historical PRs and diff history, requiring validated deployment criteria to ensure changes match production-ready baselines.

Related Skills

Explore More Software Engineering Skills→
BBufBBuf
721

vllm-ernie45-optimization

Apply PR-backed optimizations to Ernie4.5 variants in vLLM.

Community
Advanced
FutureMLS-LabFutureMLS-Lab
556

generate-profile

Generate end-to-end performance profiling traces for SGLang server runs.

Official
Intermediate
spacecat2002spacecat2002

debug-cuda-crash

Diagnose CUDA crashes in SGLang by logging tensors at kernel API boundaries.

Community
Advanced
BBufBBuf
721

model-pr-diff-dossier

Create diff-reviewed PR cards for model optimization PR history documents.

Community
Advanced