ai-gateway

Configure the TrueFoundry AI Gateway for unified LLM provider access via Bash and curl.

13|Updated Feb 13, 2026
One-click install
npx skills add https://github.com/truefoundry/tfy-agent-skills --skill ai-gateway-truefoundry
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: ai-gateway
Source: https://github.com/truefoundry/tfy-agent-skills/tree/main/skills/ai-gateway
Command: npx skills add https://github.com/truefoundry/tfy-agent-skills --skill ai-gateway-truefoundry

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires curl, python, and includes scripts (resource) and references (resource) components.

What problem does it solve?

This Skill simplifies LLM integration by providing a single, unified API endpoint for accessing numerous LLMs, abstracting away the complexities of individual provider authentication and API differences.

Core Features & Use Cases

  • Unified API Access: Connect to 25+ LLM providers (OpenAI, Anthropic, Google, etc.) and self-hosted models through one endpoint.
  • Simplified Authentication: Use a single Personal Access Token (PAT) or Virtual Access Token (VAT) for all LLM interactions.
  • Advanced Features: Configure rate limiting, budget controls, load balancing, and observability for LLM usage.
  • Use Case: A developer needs to integrate multiple LLMs into their application. Instead of managing separate API keys and SDKs for each, they configure the TrueFoundry AI Gateway once and use a single OpenAI-compatible endpoint for all their LLM needs.

Quick Start

Use the ai-gateway skill to configure your OpenAI SDK to use the TrueFoundry gateway endpoint.

Frequently Asked Questions about ai-gateway

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I use a single OpenAI-compatible API endpoint for multiple LLM providers?

You can use a single OpenAI-compatible API endpoint for multiple LLM providers by configuring the TrueFoundry AI Gateway, which abstracts individual provider differences and manages authentication through one Personal Access Token.

How do I manage API rate limiting and budget controls for LLM access?

To manage API rate limiting and budget controls for LLM access, configure the TrueFoundry AI Gateway, which supports advanced features like load balancing and observability to monitor and restrict LLM usage effectively.

Can I access self-hosted models and external LLMs using the same API interface?

Yes, you can access self-hosted models and external LLMs using the same API interface. The TrueFoundry AI Gateway connects to 25+ providers and self-hosted models through one unified endpoint.

Do I need curl and Bash to interact with the TrueFoundry AI Gateway?

Yes, you need curl and Bash to interact with the TrueFoundry AI Gateway. The Skill requires Bash and curl for executing API interactions and managing authentication via PAT or VAT.

What is the best way to simplify authentication across diverse LLM providers?

The best way to simplify authentication across diverse LLM providers is using a single Virtual Access Token (VAT) or Personal Access Token (PAT) via the AI Gateway, eliminating the need to manage separate API keys for each provider.