Route LLM API calls through a unified TrueFoundry AI Gateway.
npx skills add https://github.com/passionseed/ps_app --skill ai-gateway-passionseed
Please help me install this Agent Skill. Skill: ai-gateway Source: https://github.com/passionseed/ps_app/tree/main/.agents/skills/truefoundry-ai-gateway Command: npx skills add https://github.com/passionseed/ps_app --skill ai-gateway-passionseed
This skill provides a unified gateway to access OpenAI-compatible LLMs through TrueFoundry, consolidating authentication, routing, rate limiting, and budget controls behind a single API.
Configure your gateway base URL and a PAT or VAT, then run a sample chat request to a configured model via the gateway endpoint.
High-intent search queries and answers about installing and using this skill.
To route OpenAI-compatible LLM API calls through a unified gateway, configure your base URL and authenticate using a Personal Access Token or Virtual Access Token to enforce routing, load balancing, and budget controls.
An AI gateway is a unified endpoint that simplifies LLM access by consolidating authentication, routing, rate limiting, and budget controls for both cloud and self-hosted models behind a single API.
Yes, you can use the OpenAI SDK with self-hosted and cloud LLM providers by routing requests through a TrueFoundry gateway endpoint, enabling access to a diverse model pool.
To set up per-user budgets and rate limiting for LLM API requests, configure gateway-model settings within your TrueFoundry instance, which automatically enforces quotas and security on all routed traffic.
Yes, you need a TrueFoundry instance and gateway-model configuration to enforce routing, quotas, and security, along with a Personal Access Token or Virtual Access Token for authentication.
Limitations of using a centralized gateway for LLM access include the strict dependency on a TrueFoundry instance and the requirement of a PAT or VAT, meaning external TrueFoundry environments cannot authenticate.
passionseedManage TrueFoundry personal access tokens for API, CI/CD, and AI Gateway access.
martinrojasIntegrate Portkey AI Gateway into TypeScript and JavaScript applications for LLM routing.
truefoundryConfigure TrueFoundry AI Gateway with OpenAI-compatible endpoints, auth, routing, and rate limiting.
truefoundryConfigure the TrueFoundry AI Gateway for unified LLM provider access via Bash and curl.
