cute-dsl-kernel

Implement and optimize CuTe DSL GPU kernels across NVIDIA architectures.

1.2k|77|Updated Jun 12, 2025
One-click install
npx skills add https://github.com/vipshop/cache-dit --skill cute-dsl-kernel
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: cute-dsl-kernel
Source: https://github.com/vipshop/cache-dit/tree/main/.copilot/skills/cute-dsl-kernel
Command: npx skills add https://github.com/vipshop/cache-dit --skill cute-dsl-kernel

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Developers need a reliable, reference-backed workflow to write, port, debug, and integrate CuTe DSL GPU kernels that meet correctness and performance expectations across multiple NVIDIA GPU generations. This Skill centralizes the CuTe DSL API snapshots, architecture-specific optimization guidance, profiling advice, and validation requirements so engineers do not guess APIs or optimization strategies from memory.

Core Features & Use Cases

  • API Reference Bundles: Includes curated CuTe DSL API snapshots and runtime helpers for rapid lookup while coding.
  • Architecture Guidance: Per-generation optimization notes (sm89, sm90, sm100, sm103, sm120) and TMEM/TMA/WGMMA guidance for interpreting nsys and ncu results.
  • Implementation Workflow: Step-by-step workflow for designing, implementing, integrating, testing, and validating kernels, including unit-test and PyTorch-baseline comparisons.
  • Profiling & Debugging: Recommended profiling order and actionable checks (nsys → ncu) with shape-reduction and synchronization diagnostics for pipelined or shared-memory kernels.
  • Rewrite & Integration Rules: Guidance for preserves-behavior-first rewrites, artifact layout, launcher expectations, and pairing with operator migration tasks.

Quick Start

Implement a tiled GEMM CuTe DSL kernel targeting SM100, consult the bundled cute.md and sm100-optimization-guide.md for tiling and TMA usage, compile, and validate numerics and performance against a PyTorch baseline.

Frequently Asked Questions about cute-dsl-kernel

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I write a high-performance CuTe DSL GPU kernel using CUTLASS?

To build a CuTe DSL GPU kernel, design your tiled operations by consulting bundled API snapshots and architecture-specific optimization notes, then compile and validate the implementation against a PyTorch baseline. The workflow covers designing, testing, and integrating kernels across SM80 to SM120 architectures.

What is the recommended profiling workflow for debugging CuTe DSL kernels?

The recommended profiling workflow for CuTe DSL kernels starts with nsys to identify high-level bottlenecks, followed by ncu for detailed kernel-level analysis. This sequence includes shape-reduction and synchronization diagnostics specifically tailored for debugging pipelined or shared-memory GPU kernels.

Does CuTe DSL support GPU kernel optimization for SM100 and newer architectures?

Yes, CuTe DSL provides per-generation optimization guidance for SM89, SM90, SM100, SM103, and SM120 architectures. This includes specific TMEM, TMA, and WGMMA guidance to interpret profiling results and optimize GPU kernel execution across supported NVIDIA GPU generations.

How do I validate my CuTe DSL kernel correctness against PyTorch?

You validate CuTe DSL kernel correctness by implementing unit tests that compare numerical outputs against a PyTorch baseline. The implementation workflow includes step-by-step testing and validation requirements to ensure your GPU kernel meets expected correctness standards before integration.

Why does my shared-memory CuTe DSL kernel show synchronization issues during profiling?

Shared-memory CuTe DSL kernel synchronization issues often stem from incorrect pipelining or barrier management, identifiable through ncu profiling. The Skill provides actionable synchronization diagnostics and shape-reduction checks to isolate and resolve these specific GPU kernel execution bottlenecks.

Can I use CuTe DSL for JIT compilation of GPU kernels?

Yes, CuTe DSL supports both JIT and AOT compilation workflows for GPU kernels. The Skill provides API reference bundles and runtime helpers that facilitate rapid lookup and integration when compiling kernels for high-performance execution across multiple NVIDIA GPU generations.