nsys-capture

What problem does it solve?

This Skill provides a deterministic GPU profiling workflow for FastDeploy inference services using Nsight Systems (nsys). It automates injection of profiling hooks into the codebase, script generation for launching with nsys, and end-to-end workflows to collect .nsys-rep files for performance analysis.

Core Features & Use Cases

• Automatic detection and injection of nvprof_start / nvprof_stop calls into fastdeploy/worker/gpu_model_runner.py
• Automated generation of a start_nsys.sh script that wraps the actual startup command with NSYS_CMD
• End-to-end profiling pipeline: information collection, profiling, script generation, user confirmation, execution, and file collection
• Works in scenarios where users want to profile GPU inference services and analyze operator-level and CUDA graph traces

Quick Start

Run the end-to-end workflow to profile your FastDeploy GPU inference service with nsight systems and generate a .nsys-rep file.