nixl
Accelerate GPU and storage data transfers for AI inference
All Skills in This Repository (1)
Pure Emerald Level IndicatorsFrequently Asked Questions
FAQPage SchemaHow to install NIXL?โผ
Run `npx skills add ai-dynamo/nixl --all -g -y` in your terminal to install all skills in this suite globally.
What is NIXL used for?โผ
NIXL speeds up point-to-point data movement between CPU, GPU, and storage in AI inference systems like NVIDIA Dynamo, using pluggable backends such as UCX and GDS.
Does NIXL work with Python?โผ
Yes. NIXL provides Python bindings installable via pip, and the included skill helps your AI agent write correct agent, descriptor, and transfer code.
Which platforms does NIXL support?โผ
NIXL runs on Linux only, tested on Ubuntu 22.04/24.04 and Fedora, with support for both NVIDIA CUDA and AMD ROCm GPUs.
Can I benchmark NIXL transfer performance?โผ
Yes. The repository includes NIXLBench and KVBench tools to measure transfer throughput and simulate real inference workloads.
Related Repositories in Software Engineering
View All in Software Engineeringโopenclaw
Run a personal AI assistant across your devices and chat apps
superpowers
Gives coding agents a disciplined workflow from idea to merged code
react
AI agent skills for building, testing, and porting React core