doca-gpunetio-ib-write-lat

Measures GPU-kernel-initiated RDMA WRITE latency through the doca-gpunetio ib_write_lat benchmark.

3.2k|370|Updated Feb 25, 2026
One-click install
npx skills add https://github.com/NVIDIA/skills --skill doca-gpunetio-ib-write-lat
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: doca-gpunetio-ib-write-lat
Source: https://github.com/NVIDIA/skills/tree/main/skills/doca-gpunetio-ib-write-lat
Command: npx skills add https://github.com/NVIDIA/skills --skill doca-gpunetio-ib-write-lat

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Measuring the latency of RDMA WRITE work requests posted from CUDA kernels through doca-gpunetio requires building a source-shipped client/server benchmark, validating GPU-NIC PCIe pairing, and correctly interpreting half-iter, full-iter, and CUDA-side timing columns. This Skill guides agents through that entire workflow so latency numbers for real-time control-loop decisions are reproducible and defensible.

Core Features & Use Cases

  • Build and run guidance: Walks through meson-based compilation of the gpunetio_ib_write_lat client and server pair against the installed DOCA SDK, plus smoke-before-bulk execution.
  • Latency characterization: Teaches median vs p99 vs jitter statistic selection, the latency-vs-batching trade-off intrinsic to GPU-initiated RDMA, and sound measurement practices.
  • Surface selection and debugging: Helps choose between GPUNetIO, GPI, and CPU-initiated perftest surfaces, and provides a layered error taxonomy from config syntax through RDMA connection failures.
  • Use Case: A performance engineer validating whether an H100 + ConnectX-7 pair meets a real-time control-loop deadline uses this Skill to build the benchmark, verify GPU-NIC pairing, and capture a median/p99/jitter distribution with the full version tuple.

Quick Start

Ask your agent to measure GPU-kernel-initiated RDMA WRITE latency between two hosts using the doca-gpunetio ib_write_lat benchmark and report median and p99 latency.

Frequently Asked Questions about doca-gpunetio-ib-write-lat

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I measure GPU-kernel-initiated RDMA WRITE latency with doca-gpunetio?

Build the gpunetio_ib_write_lat client and server from doca/tools/gpunetio_ib_write_lat using meson against the installed DOCA pkg-config modules, start the server first, then run the client with -c <server-ip>. The output reports half-iter, full-iter, and CUDA-side microseconds per iteration.

GPUNetIO vs GPI vs CPU-initiated perftest for RDMA latency?

GPUNetIO fits applications built on the doca-gpunetio framework, GPI fits applications committed to the doca-gpi channel and queue programming surface, and CPU-initiated perftest ib_write_lat is the baseline for comparing GPU-initiated overhead. The choice depends on which programming surface the application will actually run on.

What are the requirements to run gpunetio_ib_write_lat?

Both hosts need DOCA SDK installed with doca-gpunetio, doca-rdma, and doca-common at matching versions, a CUDA Toolkit with nvcc, the nvidia_peermem kernel module loaded, and a GPU plus InfiniBand device reachable through a common PCIe or NVLink fabric.

Should I quote median or p99 latency for a real-time control loop?

Quote p99 or p99.9 for deadline-bound real-time workloads, since the median hides tail events that violate deadlines. Use median for typical-case request-response patterns and jitter when predictability matters more than speed.

Why does gpunetio_ib_write_lat fail to build or run?

Common causes include missing doca-gpunetio.pc, nvcc not on PATH, nvidia_peermem not loaded, wrong GPU-NIC pairing, or GID index mismatches between client and server. Walk the layered error taxonomy from config syntax through build, pairing, lifecycle, and RDMA connection layers.

When should I not use the doca-gpunetio-ib-write-lat skill?

Do not use it for bandwidth measurements (use doca-gpunetio-ib-write-bw), GPI library programming, doca-gpunetio library debugging, DOCA installation, or application-level real-time deadline analysis. The benchmark measures WR latency only, not the full application pipeline.