Manage LLM provider interactions through a unified OpenAI-compatible API.
npx skills add https://github.com/hung-phan/ml-skills --skill litellm-hung-phan
Please help me install this Agent Skill. Skill: litellm Source: https://github.com/hung-phan/ml-skills/tree/main/skills/ml-review/references/ml-libraries/litellm Command: npx skills add https://github.com/hung-phan/ml-skills --skill litellm-hung-phan
This Skill provides a unified interface for interacting with over 100 LLM providers, simplifying the process of switching between providers and handling fallbacks.
Use the litellm skill to generate a completion with the model 'openai/gpt-4o'.
High-intent search queries and answers about installing and using this skill.
You can access multiple LLM providers through a single API using a unified, OpenAI-compatible interface that routes requests to over 100 different providers based on a simple string format.
You can set up fallbacks and retries across different LLM providers by configuring a unified proxy interface that automates request routing and handles failures automatically.
The best way to track API costs and usage across multiple LLM providers is to route requests through a unified interface that includes built-in cost tracking and usage monitoring features.
Yes, the litellm unified API works with production proxy deployment, handling rate limiting, caching, and provider routing for services requiring access to multiple LLM providers.
Yes, you can use a single OpenAI-compatible API call for different LLM models by specifying the provider and model in a simple string format within the unified interface.
You handle rate limiting and caching when switching between LLM providers by deploying a unified proxy that manages these constraints automatically across all provider interactions.
marcusStream OpenRouter LLM responses in Python using LiteLLM with async streaming and retry logic.
gujincheng1128Unify access to 100+ LLM APIs through an OpenAI-compatible gateway.
NagyViktConfigure unified AI model routing, provider failover, and cost tracking.
xberg-ioIntegrate 143 LLM providers into applications with native bindings for 14 languages.
