tilelang-developer

Develop, optimize, and debug TileLang GPU kernels for AI workloads.

141|11|Updated Jan 7, 2026
One-click install
npx skills add https://github.com/yzlnew/infra-skills --skill tilelang-developer
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: tilelang-developer
Source: https://github.com/yzlnew/infra-skills/tree/main/tilelang-developer
Command: npx skills add https://github.com/yzlnew/infra-skills --skill tilelang-developer

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Designs, optimizes, and debugs high-performance TileLang GPU kernels for AI workloads.

Core Features & Use Cases

  • End-to-end kernel scaffolding, memory management, and pipelining patterns for CUDA/HIP targets.
  • Cross-vendor portability (NVIDIA, AMD, Ascend) and support for non-standard operators like DeepSeek MLA.
  • Debugging practices, performance heuristics, and validation strategies with example workflows.

Quick Start

Design, implement, and benchmark a minimal TileLang kernel by executing a simple 32x32 GEMM on a CUDA device.

Frequently Asked Questions about tilelang-developer

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I write a custom GPU kernel for AI workloads using TileLang?

To write a custom GPU kernel using TileLang, you scaffold the kernel structure, apply shared memory swizzle layouts, implement 3-stage software pipelining, and ensure explicit FP32 accumulation for high-performance AI workloads.

Can I port my CUDA kernel to run on AMD or Ascend hardware?

Yes, you can port CUDA kernels to AMD and Ascend backends using TileLang. It provides cross-vendor portability, allowing the same kernel logic to target NVIDIA, AMD, and Ascend hardware.

What is the best way to optimize GEMM or Attention operators in TileLang?

The best way to optimize GEMM or Attention operators in TileLang is by utilizing shared memory swizzle layouts, implementing 3-stage software pipelining, and enforcing explicit FP32 accumulation to maximize throughput.

Does TileLang support non-standard operators like DeepSeek MLA?

Yes, TileLang supports implementing non-standard operators like DeepSeek MLA. It provides the necessary kernel scaffolding and memory management patterns to develop and debug these custom operators.

How do I start benchmarking a minimal TileLang kernel on a CUDA device?

To start benchmarking a minimal TileLang kernel on a CUDA device, you design, implement, and execute a simple 32x32 GEMM operation to validate performance and establish a baseline for optimization.

Why does my TileLang kernel require explicit FP32 accumulation?

Your TileLang kernel requires explicit FP32 accumulation to maintain numerical precision and prevent overflow during high-throughput matrix operations, which is essential for validating correctness and achieving stable performance.