litellm

Call over 100 LLM providers through a unified interface.

3|1|Updated Feb 2, 2026
One-click install
npx skills add https://github.com/HouseGarofalo/claude-code-base --skill litellm-housegarofalo
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: litellm
Source: https://github.com/HouseGarofalo/claude-code-base/tree/main/.claude/skills/litellm
Command: npx skills add https://github.com/HouseGarofalo/claude-code-base --skill litellm-housegarofalo

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires litellm, and includes references (resource) components.

What problem does it solve?

This Skill simplifies interactions with over 100 different Large Language Model (LLM) providers, eliminating the need to manage multiple SDKs and API formats.

Core Features & Use Cases

  • Unified Interface: Interact with various LLM providers (OpenAI, Anthropic, Cohere, Ollama, etc.) using a single, consistent API.
  • Cost Optimization & Fallbacks: Easily switch between providers for cost savings or implement automatic fallbacks to ensure service availability.
  • LLM Gateway/Proxy: Deploy a central point for managing LLM requests, routing, and monitoring.
  • Use Case: Integrate multiple LLM providers into your application to leverage their unique strengths or provide redundancy, all through one codebase.

Quick Start

Use the litellm skill to get a completion from the gpt-4o model with the message "Hello!".

Frequently Asked Questions about litellm

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I call multiple LLM providers without managing different SDKs?

To call multiple LLM providers without managing different SDKs, use a unified API interface that translates requests across over 100 services like OpenAI, Anthropic, and Cohere. This enables consistent synchronous, asynchronous, and streaming interactions through a single codebase.

What is an LLM gateway and how does it handle provider fallbacks?

An LLM gateway is a central proxy for managing and routing requests to various language models. It handles provider fallbacks by automatically switching to alternative LLM services if a primary provider fails, ensuring continuous service availability and cost optimization.

Can I track API costs and usage when routing requests to different LLM providers?

Yes, you can track API costs and usage when routing requests to different LLM providers. The unified interface includes built-in cost tracking functionalities, allowing you to monitor expenses and optimize spending across over 100 integrated services.

Does the litellm unified interface support function calling and embeddings?

Yes, the litellm unified interface supports function calling and embeddings. In addition to standard synchronous and asynchronous completions, it handles streaming outputs and embedding generation across the 100+ supported LLM providers.

What is the best way to integrate Ollama with a multi-provider AI application?

The best way to integrate Ollama into a multi-provider AI application is using a unified API gateway. This approach standardizes Ollama's local model interactions alongside commercial providers like OpenAI, enabling seamless fallbacks and centralized cost tracking.