kernel-skills
Expert playbooks for writing fast, correct GPU kernels
All Skills in This Repository (10)
Pure Emerald Level IndicatorsChoose Tile Size and Work Partitioning
Determine tile sizes and grid layouts for CUDA or Triton kernels.
Write CUDA LayerNorm Kernel
Write CUDA LayerNorm kernels with Welford reduction and FP32 accumulation.
Choose CUDA Launch Configuration
Determine optimal CUDA launch configurations by analyzing resource usage and hardware limits.
Avoid Warp Divergence
Classify warp divergence in CUDA kernels and estimate cost with Nsight Compute metrics.
Write Triton LayerNorm Kernel
Write a Triton LayerNorm kernel with RMSNorm support and masking.
Optimize Triton Block Parameters
Autotune Triton GEMM block sizes and launch parameters for GPU throughput.
Write an FP8 Kernel
Design FP8 compute kernels with E4M3/E5M2 scaling for NVIDIA Hopper and Ada GPUs.
Port CUDA Kernel to HIP
Port CUDA kernels to HIP for ROCm-enabled AMD GPUs.
Write a Triton RMSNorm Kernel
Implement a numerically stable RMSNorm kernel in Triton with fp32 accumulation.
Write a Triton Dequant Kernel (int4 / int8 โ fp16 / bf16)
Implements Triton dequantization of int4/int8 weights to fp16/bf16 with AWQ/GPTQ/NF4 support.
Frequently Asked Questions
FAQPage SchemaHow to install kernel-skills?โผ
Run `npx skills add tensormux/kernel-skills --all -g -y` in your terminal to install all skills globally.
What does kernel-skills do?โผ
It provides structured SKILL.md playbooks that guide coding agents to write correct, fast CUDA, Triton, and quantized GPU kernels. Each skill enforces constraint gathering, numerical stability, and honest performance reasoning.
Which kernels and frameworks are covered?โผ
Skills cover CUDA and Triton GEMM, softmax, layernorm, attention, reductions, INT8/FP8 quantization, and LLM inference kernels like RoPE, RMSNorm, KV cache, and sampling. Portability skills cover CUDA-to-Triton and CUDA-to-HIP migrations.
Does kernel-skills work with Claude Code and Cursor?โผ
Yes. The skills are plain Markdown files that work with Claude Code, ChatGPT, Cursor, Gemini CLI, Codex, and any agent that accepts skill files.
Is there proof these skills improve kernel quality?โผ
Yes. The proof directory contains measured before-and-after results, such as fixing naive softmax failures across all tested shapes and achieving 2.6-8.6x speedups on reduction and GEMM kernels.
Related Repositories in Software Engineering
View All in Software Engineeringโopenclaw
Run a personal AI assistant across your devices and chat apps
superpowers
Gives coding agents a disciplined workflow from idea to merged code
react
AI agent skills for building, testing, and porting React core