KernelWiki

Provide expert guidance for optimizing NVIDIA GPU kernels on Blackwell and Hopper architectures.

364|46|Updated Apr 17, 2026
One-click install
npx skills add https://github.com/mit-han-lab/KernelWiki --skill kernelwiki
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: KernelWiki
Source: https://github.com/mit-han-lab/KernelWiki/tree/main
Command: npx skills add https://github.com/mit-han-lab/KernelWiki --skill kernelwiki

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires PyYAML, and includes scripts (resource) and references (resource) and assets (resource) components.

What problem does it solve?

This Skill provides expert knowledge for optimizing NVIDIA Blackwell (SM100, B200) and Hopper (SM90, H100) GPU kernels, enabling users to improve performance and efficiency.

Core Features & Use Cases

  • Kernel Optimization: Offers insights into performance patterns, techniques, and specific kernel case studies for both architectures.
  • Performance Patterns: Helps identify issues like low SM utilization, memory-bound, register pressure, and compute-bound scenarios.
  • DSLs & Languages: Provides guidance on using CuTe DSL, CUDA C++ with PTX inline, Triton on Blackwell, and other relevant languages/DSLs.
  • Migration Guides: Offers guidance for migrating Hopper features to Blackwell.
  • PR References: Allows users to query specific PRs for implementation details.

Quick Start

Use the KernelWiki skill to search for information on optimizing a specific kernel, such as python3 scripts/query.py "optimization for FlashAttention-4".

Frequently Asked Questions about KernelWiki

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I optimize NVIDIA GPU kernels for Blackwell and Hopper architectures?

To optimize NVIDIA GPU kernels for Blackwell (SM100, B200) and Hopper (SM90, H100) architectures, you need expert knowledge of performance patterns, techniques, and specific kernel case studies to improve performance and efficiency.

What causes low SM utilization and memory-bound bottlenecks in CUDA kernels?

Low SM utilization, memory-bound scenarios, register pressure, and compute-bound bottlenecks in CUDA kernels are common performance patterns that require specific optimization techniques and case studies to resolve effectively.

Does KernelWiki support Triton and CuTe DSL for Blackwell GPU optimization?

Yes, KernelWiki provides guidance on using CuTe DSL, CUDA C++ with PTX inline, and Triton on Blackwell architecture, offering language and DSL-specific insights for kernel optimization.

How do I migrate Hopper GPU kernel features to the Blackwell architecture?

To migrate Hopper GPU kernel features to Blackwell, you can query migration guides and specific PR references within KernelWiki to find implementation details and architecture adaptation techniques.

Do I need PyYAML to search for FlashAttention-4 optimization patterns?

Yes, PyYAML is a required dependency to run the query scripts and search for specific kernel optimization patterns like FlashAttention-4 within the KernelWiki knowledge base.