kernel-cute-writing

Write GPU kernels with NVIDIA CuTe DSL using Python decorators.

2.8k|332|Updated Feb 25, 2026
One-click install
npx skills add https://github.com/NVIDIA/skills --skill kernel-cute-writing
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: kernel-cute-writing
Source: https://github.com/NVIDIA/skills/tree/main/skills/TensorRT-LLM/kernel-cute-writing
Command: npx skills add https://github.com/NVIDIA/skills --skill kernel-cute-writing

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes scripts (resource) components.

What problem does it solve?

Write and implement GPU kernels using NVIDIA CuTe DSL (CUTLASS 4.x Python API) — NOT for Triton, CUDA C++, or conceptual explanations. Trigger only when the user wants to write or implement a kernel, not when asking questions about CuTe DSL concepts or layouts. CuTe DSL uses cute.jit/cute.kernel decorators and cutlass.cute imports. Covers element-wise kernels, GEMM patterns, reductions, memory hierarchy.

Core Features & Use Cases

  • CuTe DSL kernel authoring: create element-wise and GEMM-style kernels with Python decorators.
  • Workflow guidance: follow patterns for elements like element-wise operations, reductions, and memory layouts.
  • Framework integration: build host wrappers and connect with Torch/JAX via DLPack for testing and deployment.

Quick Start

Install the CuTe DSL, implement a kernel with @cute.kernel, and run a host wrapper to verify.

Frequently Asked Questions about kernel-cute-writing

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I write GPU kernels using CuTe DSL in Python?

Author GPU kernels in CuTe DSL by decorating Python functions with @cute.kernel and @cute.jit decorators. This workflow supports element-wise operations, GEMM-style computations, and reductions within the CUTLASS 4.x Python API framework.

Can I integrate CuTe DSL kernels with PyTorch workflows?

Integrate CuTe DSL kernels with PyTorch by using from_dlpack-based tensor conversion to pass tensors between frameworks. This enables building host wrappers for testing and deploying custom GPU kernels within PyTorch workflows.

How do I reduce JIT compilation latency for CuTe DSL kernels?

Reduce JIT compilation latency for CuTe DSL kernels by pre-compiling them with cute.compile. Combined with dynamic layout marking, this approach minimizes runtime overhead and ensures low JIT latency during GPU kernel execution.

What types of computations does CuTe DSL support for GPU kernel development?

CuTe DSL supports element-wise kernels, GEMM-style computations, and reductions for GPU kernel development. The framework provides patterns for managing memory hierarchy and layouts, covering the core computational patterns needed for high-performance GPU programming.

Does CuTe DSL work with JAX for GPU kernel testing?

CuTe DSL works with JAX for GPU kernel testing and deployment through DLPack-based tensor conversion. This allows you to build host wrappers that connect custom kernels with JAX workflows for verification and execution.

Do I need CUDA C++ knowledge to use CuTe DSL for kernel writing?

You do not need CUDA C++ knowledge to use CuTe DSL for kernel writing. The framework allows you to author high-performance GPU kernels entirely in Python using decorators, bypassing the need for direct CUDA C++ programming.