aiter-ck-gemm-tune

What problem does it solve?

This Skill automates the tuning of AITER's Composable Kernel (CK) GEMM and fused MoE kernels, improving performance for specific model shapes on AMD GPUs.

Core Features & Use Cases

• Kernel Tuning: Automatically discover, benchmark, and tune GEMM and MoE kernel configurations for optimal performance.
• Shape Discovery: Extracts model shapes from inference logs for tuning.
• Benchmarking: Compares performance before and after tuning.
• Use Case: Ideal for optimizing the performance of LLM inference on ROCm/AMD GPUs.

Quick Start

Use the aiter-ck-gemm-tune skill to tune the GEMM and MoE kernels for your model shapes.