What problem does it solve?
It helps you identify performance bottlenecks and wasted resources by profiling a target (script/process/GPU/memory/interconnect) and turning the results into actionable recommendations.
Core Features & Use Cases
- End-to-end profiling guidance: Selects appropriate profiling strategies based on the target type (CPU, memory, GPU, interconnect, or a running service).
- Tool + instrumentation approach: Uses external tools when available and writes targeted instrumentation code when external tooling alone is insufficient.
- Structured performance reports: Produces reports covering CPU overhead, memory overhead, interconnect communication, and GPU compute to support clear next steps.
- Use Case: When training and serving models, run a system profile on a specific PID or on “vllm serving” to find whether delays come from CPU overhead, memory replication, PCIe/NVLink transfer issues, NCCL communication inefficiency, or low SM utilization.
Quick Start
Run the system-profile skill and provide the target you want to analyze, such as a process ID, a training script name, or the phrase "vllm serving".