What problem does it solve?
This Skill provides expert knowledge for optimizing NVIDIA Blackwell (SM100, B200) and Hopper (SM90, H100) GPU kernels, enabling users to improve performance and efficiency.
Core Features & Use Cases
- Kernel Optimization: Offers insights into performance patterns, techniques, and specific kernel case studies for both architectures.
- Performance Patterns: Helps identify issues like low SM utilization, memory-bound, register pressure, and compute-bound scenarios.
- DSLs & Languages: Provides guidance on using CuTe DSL, CUDA C++ with PTX inline, Triton on Blackwell, and other relevant languages/DSLs.
- Migration Guides: Offers guidance for migrating Hopper features to Blackwell.
- PR References: Allows users to query specific PRs for implementation details.
Quick Start
Use the KernelWiki skill to search for information on optimizing a specific kernel, such as python3 scripts/query.py "optimization for FlashAttention-4".