Route requests to 200+ NVIDIA NIM models via an OpenAI-compatible API.
npx skills add https://github.com/EndUser123/cc-marketplace --skill ai-nvidia
Please help me install this Agent Skill. Skill: ai-nvidia Source: https://github.com/EndUser123/cc-marketplace/tree/main/plugins/cc-skills-ai-api/skills/ai-nvidia Command: npx skills add https://github.com/EndUser123/cc-marketplace --skill ai-nvidia
NVIDIA NIM unified AI API provides access to 200+ models through a single interface with intelligent routing, streaming, multimodal support, and GPU-accelerated inference. Use this skill when integrating NVIDIA NIM, building multi-model applications, implementing streaming responses, or working with NVIDIA's hosted models.
Get an API key at build.nvidia.com and start using the NVIDIA NIM OpenAI-compatible API with your preferred SDK.
High-intent search queries and answers about installing and using this skill.
NVIDIA NIM provides a unified API gateway to 200+ models using an OpenAI-compatible interface. You can access these models by obtaining an API key from build.nvidia.com and routing requests through your preferred SDK.
Intelligent routing in multi-model applications allows transparent model switching and fallback. The unified gateway handles provider and model identifiers, directing requests to the appropriate GPU-accelerated inference endpoint based on your configuration.
Yes, NVIDIA NIM supports streaming responses for real-time chat applications. The API gateway handles streaming patterns, allowing you to stream model outputs directly to users as they are generated.
Yes, the NVIDIA NIM unified AI API supports multimodal inputs. This allows you to send text, images, and other data formats to the 200+ available models through the single OpenAI-compatible interface.
To handle API keys, obtain credentials from build.nvidia.com. Model discovery is managed through the gateway's routing logic, which identifies available provider and model identifiers to enable fallback and health checks.
Limitations of the unified gateway include dependency on API key availability and proper routing configuration. You must manage provider identifiers and health checks to ensure production stability during multi-model fallback scenarios.
xiaoquqiEnable CPU-based LLM inference with GGUF quantization and OpenAI-compatible server endpoints.
rahul-s-bhattBuild Streamlit chat interfaces with managed message state and streaming responses.
TeoSlayerDeploy a four-agent API gateway manager with service discovery, routing, authentication, and monitoring.
arthtyagiRoute AI model calls through Vercel AI Gateway with failover and cost tracking.
