What problem does it solve?
Keeping FlashInfer's expert-parallel MoE fast on Blackwell GPUs requires periodically re-vendoring NVIDIA's CuTeDSL MegaMoE kernel drop (NVFP4, MXFP8, BF16) without breaking the shim adapters, backend wrappers, or tuning profiles that depend on exact kernel symbols and launch signatures.
Core Features & Use Cases
- Verbatim drop replacement workflow: Defines the exact procedure for replacing
src/ with a new kernel-team drop while keeping all adaptation isolated in shim/.
- Compatibility audit checklists: Provides symbol-by-symbol tables mapping shim imports to kernel source files so a renamed helper or changed launch signature breaks in exactly one auditable place.
- Tuning and validation guidance: Pairs with TUNING.md for knob taxonomy, autotuning behavior, CuTe-DSL runtime version floors, and the multi-rank torchrun test command that confirms a drop works.
- Use Case: When the NVIDIA kernel team publishes a new MegaMoE drop, follow this workflow to swap in the five kernel packages, audit the construct/launch signatures against the training drivers, and run the 4-GPU cutedsl test suite before merging.
Quick Start
Update the CuTeDSL MegaMoE kernel sources to the latest kernel-team drop and verify the shim adapters and tests still pass.