Verified:GitHub

domino-ai-gateway

Route Domino LLM requests through a secure proxy with vault-backed API keys.

Updated Apr 11, 2026

Search Tags:#monitoring #security #llm #gateway #api-proxy #api-key-management #domino

One-click install

npx skills add https://github.com/ToXMon/tolu --skill domino-ai-gateway-toxmon

Or copy as Structured Prompt for Agent▼

Please help me install this Agent Skill.
Skill: domino-ai-gateway
Source: https://github.com/ToXMon/tolu/tree/main/agent-zero-backup/workdir/memory-palace/skills/domino/domino-ai-gateway
Command: npx skills add https://github.com/ToXMon/tolu --skill domino-ai-gateway-toxmon

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Provides secure, centralized access to external LLM providers from within Domino, eliminating the need to distribute provider API keys and giving operators visibility and control over model usage and costs.

Core Features & Use Cases

Secure LLM Proxy: Routes workspace and job requests to external providers through a Domino-managed gateway.
Centralized API Key Management: Provider keys are stored in a secure vault with rotation and never exposed to end users.
Observability & Controls: Token usage metrics, audit logs, rate limits, cost alerts, and per-endpoint access control for compliance and cost management.
Use Case: Platform teams expose an endpoint (e.g., openai-gpt4) so data scientists can call advanced models from jobs and notebooks without needing provider credentials while admins monitor usage and enforce limits.

Quick Start

Use the Domino AI Gateway endpoint named production-gpt4 to route LLM calls through Domino, enforce access control, and inspect usage metrics for cost and audit purposes.

Frequently Asked Questions about domino-ai-gateway

High-intent search queries and answers about installing and using this skill.

FAQPage Schema

How do I secure LLM API keys for Domino workspaces and jobs?▼

To monitor token usage for LLM calls in Domino, use a centralized gateway that routes requests and applies usage metering, providing operators with metrics for cost tracking and compliance auditing.

Can I enforce rate limits and per-endpoint access control on OpenAI-compatible APIs?▼

You can set up a secure LLM proxy in Domino by configuring gateway endpoints to route workspace and job requests to external providers while keeping API keys stored securely in a vault.

What is the best way to centralize API key management for LLM providers?▼

Yes, an LLM proxy gateway can track token usage and audit logs by routing workspace and job requests through a centralized endpoint that meters usage and records access for compliance.

Does Domino support an OpenAI-compatible API surface for external LLM routing?▼

Platform teams should use a centralized LLM proxy gateway to expose endpoints, control access, and monitor usage, preventing data scientists from needing direct provider API keys for external models.