perf-optimization

Coordinates CUDA Graph, Triton, TileIR, and CuTe DSL performance optimization workflows.

Updated May 23, 2026
One-click install
npx skills add https://github.com/yo-steven/skills-exploration-20260522 --skill perf-optimization-yo-steven
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: perf-optimization
Source: https://github.com/yo-steven/skills-exploration-20260522/tree/main/skills/TensorRT-LLM/perf-optimization
Command: npx skills add https://github.com/yo-steven/skills-exploration-20260522 --skill perf-optimization-yo-steven

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

This Skill coordinates end-to-end performance optimization work across model code changes, kernel generation, and measurement so you can improve throughput or latency without breaking correctness.

Core Features & Use Cases

  • Specialist delegation and routing: Assigns CUDA Graph, profiling, Triton kernel generation, TileIR optimization, and CuTe DSL work to the correct specialist.
  • Iterative optimize–profile loop: Enforces a repeatable cycle of implement, measure, analyze, and iterate based on bottleneck findings.
  • Safe modification workflow: Requires baseline measurement, backup-before-edit, validation after changes, and rollback when regressions occur.
  • Remote execution context reuse: Ensures SLURM cluster allocations are reused across specialists via a shared context block.

Quick Start

Use the perf-optimization Skill when you want to apply an optimization (for example, CUDA Graph or a TileIR kernel improvement) and require validated before-and-after performance results.

Frequently Asked Questions about perf-optimization

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I coordinate CUDA Graph and Triton kernel optimizations without breaking model correctness?

To coordinate CUDA Graph and Triton kernel optimizations safely, establish a baseline benchmark first, apply changes through specialist routing, validate correctness after modifications, and roll back if regressions occur.

What is the best way to profile and tune TileIR or CuTe DSL kernels iteratively?

The best way to tune TileIR or CuTe DSL kernels is running an iterative optimize-profile loop that measures baseline performance, delegates tuning to specialists, analyzes bottlenecks, and validates before-and-after metrics.

Does this performance optimization workflow support remote SLURM cluster execution?

Yes, the performance optimization workflow supports remote SLURM cluster execution by ensuring cluster allocations are reused across specialists through a shared context block during kernel generation and profiling.

How do I validate before-and-after performance metrics when generating PTX kernels?

To validate PTX kernel performance metrics, enforce a safe modification workflow that requires baseline measurement, backs up code before editing, validates changes against the baseline, and rolls back if regressions appear.

When should I not use an autopilot-driven iterative optimization loop for kernel generation?

You should avoid autopilot-driven iterative optimization loops when you lack a baseline benchmark to measure against, or when your environment cannot support the required backup-edit-validate-rollback safety workflow.

Can I use this approach to improve model latency across multiple backend improvements simultaneously?

Yes, you can improve model latency across multiple backend improvements simultaneously by routing CUDA Graph, Triton, TileIR, and CuTe DSL tasks to the correct specialists while maintaining a single coordinated optimization loop.