cutlass

Execute architecture-tuned GPU matrix multiplication kernels via NVIDIA CUTLASS.

4|Updated May 6, 2026
One-click install
npx skills add https://github.com/jstzwj/ai-infra-plugins --skill cutlass
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: cutlass
Source: https://github.com/jstzwj/ai-infra-plugins/tree/main/plugins/cutlass/skills/cutlass
Command: npx skills add https://github.com/jstzwj/ai-infra-plugins --skill cutlass

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes assets (resource) and references (resource) and scripts (resource) components.

What problem does it solve?

This Skill provides access to NVIDIA's CUTLASS library, enabling the deployment of optimized GPU kernels for matrix multiplication and tensor operations critical in AI and scientific computing.

Core Features & Use Cases

  • Accelerated GEMM and Tensor Operations: Implements high-throughput matrix multiplications leveraging Tensor Cores across architectures like Volta, Turing, Ampere, Hopper, and Blackwell.
  • Architecture-Aware Optimization: Tailors kernel execution strategies for specific GPU architectures, maximizing performance and resource utilization.
  • Versatile Data Type Support: Includes FP64, FP32, FP16, BF16, TF32, FP8, INT8, INT4, and complex types, catering to diverse workload precision requirements.
  • Use Case: Example: Optimize training of large language models by leveraging CUTLASS kernels for mixed-precision matrix multiplications.

Quick Start

Provide the target matrices' pointers and dimensions to run a GEMM operation with the CUTLASS library's Python API or C++ interface, specifying data types and architecture identifiers as needed.

Frequently Asked Questions about cutlass

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I optimize matrix multiplication for different GPU architectures?

To optimize matrix multiplication across GPU architectures like Volta, Turing, Ampere, and Hopper, this Skill deploys architecture-tuned GPU kernels that maximize Tensor Core utilization and resource efficiency for linear algebra workloads.

Can I run mixed-precision GEMM operations using FP8 and BF16 data types?

Yes, you can run mixed-precision GEMM operations. It supports a versatile range of data precisions including FP64, FP32, FP16, BF16, TF32, FP8, INT8, INT4, and complex types to cater to diverse workload requirements.

What's the best way to accelerate large language model training with CUDA?

The best way to accelerate large language model training with CUDA is by leveraging architecture-aware CUTLASS kernels for high-throughput, mixed-precision matrix multiplications. You provide target matrix pointers and dimensions to execute the operation.

Do I need to install specific libraries to execute high-performance GPU kernels?

Yes, you need to install the CUDA toolkit and the CUTLASS library. These dependencies are required to facilitate architecture-tuned GPU kernel execution for complex linear algebra tasks.

Does high-performance GPU computing work with both AI and scientific workloads?

High-performance GPU computing works with both AI and scientific workloads. It enables the deployment of optimized GPU kernels for tensor operations critical in scientific computing and HPC, supporting diverse data precisions.