graphsignalgraphsignalOfficialยท1 Agent Skills Included

graphsignal-python

GPU inference profiling, tracing, and performance monitoring

Profiles GPU inference workloads for vLLM, SGLang, TensorRT-LLM, and PyTorch with per-step timing and token throughput. Captures CUDA kernel activity, hardware metrics, and error events without slowing down production services. Eliminates blind guesswork when diagnosing latency bottlenecks and tuning engine launch flags.
npx skills add graphsignal/graphsignal-python --all -g -y

All Skills in This Repository (1)

Pure Emerald Level Indicators

Frequently Asked Questions

FAQPage Schema
How to install Graphsignal Profiler?โ–ผ

Run `npx skills add graphsignal/graphsignal-python --all -g -y` in your terminal to install this skill globally.

How to profile a vLLM server?โ–ผ

Set your GRAPHSIGNAL_API_KEY environment variable, then wrap your launch command with `graphsignal-run vllm serve <model> --port 8000` to start profiling automatically.

Does Graphsignal work with SGLang and PyTorch?โ–ผ

Yes. It auto-instruments SGLang, PyTorch, TensorRT-LLM, and dstack services, capturing Prometheus metrics and GPU profiling out of the box.

Will profiling slow down my inference workload?โ–ผ

No. The profiler runs as a separate sidecar process and uses low-overhead CUPTI APIs, so production performance impact is minimal.

Is my prompt data sent to Graphsignal?โ–ผ

No. The profiler never records prompts or completions and only makes outbound connections to api.graphsignal.com.

Related Repositories in Software Engineering

View All in Software Engineeringโ†’