MOSS-VL
Real-time video understanding, GPU kernels, and inference tuning
All Skills in This Repository (14)
Pure Emerald Level Indicatorssglang-diffusion-modelopt-quant
Quantize diffusion DiT models with NVIDIA ModelOpt to FP8 or NVFP4 checkpoints for SGLang Diffusion.
sglang-diffusion-benchmark-profile
Analyze SGLang diffusion denoise latency and profile bottlenecks via perf dumps.
sglang-diffusion-add-model
Automate diffusion model integration into SGLang with Hybrid or Modular pipelines.
sglang-diffusion-ako4all-kernel
Optimize SGLang diffusion kernels with AKO4ALL tuning and ncu-guided iteration.
sglang-diffusion-performance
Optimize SGLang diffusion performance settings for a model, GPU, and VRAM budget.
write-sglang-test
Author and register SGLang CI/UT tests using CustomTestCase.
ci-workflow-guide
Document SGLang CI pipeline stage ordering, gating, and fast-fail mechanisms.
add-jit-kernel
Add a lightweight JIT CUDA kernel with host wrapper, tests, and benchmarks to SGLang's jit_kernel module.
debug-cuda-crash
Log CUDA kernel API calls and tensor metadata around crash boundaries in SGLang.
sglang-torch-profiler-analysis
Triage SGLang torch-profiler traces into kernel, overlap, and fuse-pattern tables.
generate-profile
Launch an SGLang server, validate readiness, and generate a Chrome-compatible profiling trace.
sglang-auto-benchmark
Automate SGLang benchmark sweeps with dataset preparation and CSV export.
Frequently Asked Questions
FAQPage SchemaHow to install MOSS-VL?โผ
Run `npx skills add OpenMOSS/MOSS-VL --all -g -y` in your terminal to install all skills in this suite globally.
What is MOSS-VL used for?โผ
MOSS-VL is an open-weight 11B model family for real-time and offline video understanding, supporting interruptible streaming dialogue and long-video question answering.
How to speed up diffusion model inference?โผ
The included skills guide you through torch.compile, multi-GPU parallelism, CPU offload, and FP8/NVFP4 quantization with validated benchmark recipes.
How to debug CUDA crashes in SGLang?โผ
A dedicated skill shows how to enable kernel API logging, capture crash-safe tensor dumps, and combine them with compute-sanitizer or cuda-gdb.
Do I need GPU experience to use these skills?โผ
Basic GPU access is required to run the models, but the skills give step-by-step commands so your agent handles the complex kernel and tuning work.
Related Repositories in Software Engineering
View All in Software Engineeringโopenclaw
Run a personal AI assistant across your devices and chat apps
superpowers
Gives coding agents a disciplined workflow from idea to merged code
react
AI agent skills for building, testing, and porting React core