cutlass-cpp-kernel

Implement and optimize CUTLASS and CuTe C++ kernels with validation.

1.2k|77|Updated Jun 12, 2025
One-click install
npx skills add https://github.com/vipshop/cache-dit --skill cutlass-cpp-kernel
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: cutlass-cpp-kernel
Source: https://github.com/vipshop/cache-dit/tree/main/.copilot/skills/cutlass-cpp-kernel
Command: npx skills add https://github.com/vipshop/cache-dit --skill cutlass-cpp-kernel

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Provides a focused workflow to read, implement, debug, and optimize CUTLASS and CuTe C++ kernels so engineers can achieve correct, high-performance GEMM, pipeline, and epilogue implementations across modern NVIDIA architectures.

Core Features & Use Cases

  • Source navigation: Maps key CUTLASS and CuTe header locations and example kernels for fast discovery and reuse.
  • Template and tiling reasoning: Analyze tile shapes, MMA/copy atoms, schedules, stage counts, and epilogue choices to guide kernel configuration.
  • Architecture-aware tuning: Bundled smXX optimization guides and Nsight interpretation advice for Hopper, Blackwell, and desktop Blackwell variants.
  • Debugging & validation: Stepwise checklist for synchronization, schedule errors, numerical parity, unit tests, and PyTorch baseline comparisons.
  • Rewrite guidance: Preserve operator contracts and validate accuracy/performance when porting between handwritten C++, CUTLASS, and CuTe DSL workflows.

Quick Start

Open the workspace CUTLASS checkout at /workspace/dev/vipshop/cutlass and ask to analyze or optimize a specific CUTLASS/CuTe kernel by naming the target file, target GPU architecture, data types, and the desired correctness or performance goal.

Frequently Asked Questions about cutlass-cpp-kernel

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I optimize a CUTLASS C++ kernel for Hopper and Blackwell architectures?

Optimize CUTLASS C++ kernels by analyzing tile shapes, MMA/copy atoms, stage counts, and epilogue choices. Apply architecture-specific smXX optimization guides and interpret Nsight outputs to tune performance for Hopper and Blackwell GPU targets.

What is the best way to debug CuTe C++ kernel correctness and numerical parity?

Debug CuTe C++ kernel correctness using a stepwise checklist for synchronization and schedule errors. Validate numerical parity by running unit tests and comparing kernel outputs against PyTorch baselines to ensure accuracy.

Can I port handwritten C++ GEMM code to a CuTe DSL workflow?

Port handwritten C++ GEMM code to CuTe DSL workflows using rewrite guidance that preserves operator contracts. Validate both accuracy and performance during the transition to ensure the new implementation matches the original kernel behavior.

Do I need a specific CUTLASS checkout path to analyze and tune GEMM kernels?

You need a workspace CUTLASS checkout path to analyze and tune GEMM kernels. Provide the target file, GPU architecture, data types, and desired correctness or performance goal to begin the optimization process.

How do I find the right CuTe C++ headers and example kernels for my GEMM implementation?

Find CuTe C++ headers and example kernels for GEMM implementation using source navigation. This maps key CUTLASS header locations and example kernels to enable fast discovery and code reuse across template-based pipelines.

Why does my CUTLASS epilogue pipeline have schedule errors and synchronization issues?

CUTLASS epilogue pipeline schedule errors and synchronization issues arise from misconfigured tiling and staging. Diagnose these problems by analyzing collective-builder code and applying a stepwise debugging checklist to validate execution.