siso-cuda-kernel-opt-tradeoffs

What problem does it solve?

Document SISO (Mamba3 state-space) CUDA FFI kernel optimization tradeoffs — N-split structural constraint (V buffer not split), union SMEM lifetimes, launch_bounds occupancy tuning, per-sample speedup saturation with BSZ. Use when tuning K3 kernel for different d_state values or similar state-scan kernels.

Core Features & Use Cases

• N_SPLITS tradeoff analysis and guidance for SMEM traffic and occupancy
• SMEM lifetime unions to reduce memory footprint without sacrificing correctness
• Launch_bounds tuning and CS sizing recommendations for different d_state values
• Per-sample speedup saturation curve methodology and verification workflow

Quick Start

Run the optimization workflow to identify the optimal N_SPLITS, SMEM lifetime unions, and CS settings for your d_state values.