biren-supti

What problem does it solve?

This Skill provides comprehensive APIs for tracking and analyzing GPU kernel performance, enabling performance bottleneck identification and hardware utilization optimization.

Core Features & Use Cases

• Performance Bottleneck Analysis: Collects kernel execution times and communication metrics to diagnose low GPU utilization.
• Hardware Counters Analysis: Reads hardware events like GEMM efficiency and memory counters for detailed hardware utilization insights.
• Code Segment Tagging: Uses suTX API to mark specific code regions for precise timeline analysis during training or inference.
• Training/Inference Optimization: Supports establishing performance baselines and quantifying improvements in AI model workflows.

Quick Start

Set up the environment, enable Activity API to start collecting kernel data, and use suTX markers to delineate code regions for performance profiling.