add-jit-kernel

Integrate custom CUDA JIT kernels into the sglang framework with Python wrappers.

12|2|Updated Mar 22, 2026
One-click install
npx skills add https://github.com/scottgl9/sglang-spark-gb10-optimizations --skill add-jit-kernel-scottgl9
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: add-jit-kernel
Source: https://github.com/scottgl9/sglang-spark-gb10-optimizations/tree/main/.claude/skills/add-jit-kernel
Command: npx skills add https://github.com/scottgl9/sglang-spark-gb10-optimizations --skill add-jit-kernel-scottgl9

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes scripts (resource) and references (resource) components.

What problem does it solve?

This Skill streamlines the process of integrating new lightweight CUDA JIT kernels into the sglang framework, reducing development complexity.

Core Features & Use Cases

  • Kernel Implementation: Provides a template and guidelines to implement efficient CUDA kernels using project abstractions.
  • Python Wrappers: Automates the generation of Python bindings for JIT kernels to enable easy invocation.
  • Validation & Testing: Facilitates writing consistent tests and benchmarks to ensure correctness and performance, applicable in optimizing custom CUDA functions for AI workloads.

Quick Start

Use this Skill to add a new element-wise CUDA kernel for tensor scaling, including its Python wrapper and validation tests.

Frequently Asked Questions about add-jit-kernel

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I add a custom CUDA JIT kernel to sglang?

To add a custom CUDA JIT kernel to sglang, you can use this Skill to implement the kernel using project abstractions, generate Python wrappers for invocation, and validate correctness with provided testing utilities.

How do I create Python wrappers for CUDA JIT kernels?

Creating Python wrappers for CUDA JIT kernels is automated by this Skill, which generates the necessary Python bindings to enable easy invocation of your custom kernels within the sglang framework.

How do I benchmark and test custom CUDA kernels for AI workloads?

Benchmarking and testing custom CUDA kernels for AI workloads is facilitated by this Skill through writing consistent tests and benchmarks to ensure both correctness and performance before deployment.

Does sglang support integrating lightweight custom CUDA functions for tensor operations?

Yes, sglang supports integrating lightweight custom CUDA functions, allowing you to implement element-wise operations like tensor scaling with validation tests through established conventions and abstracted utilities.

What is the best way to streamline the deployment of custom CUDA kernels?

The best way to streamline deployment of custom CUDA kernels is using this Skill, which reduces development complexity by providing templates, validation, and benchmarking for safe integration into the sglang framework.