litellm-usage

What problem does it solve?

Manages multiple LLM providers, normalizing responses, and simplifying fallback and cost tracking.

Core Features & Use Cases

• Unified Interface: Calls LLMs via a single format, regardless of the provider.
• Provider Routing: Routes requests to different providers based on configuration.
• Fallbacks & Retries: Implements fallback to other providers and retries on failure.
• Cost Tracking: Tracks costs associated with LLM calls.
• Use Case: When building a system that requires multiple LLM providers and needs to manage costs and reliability efficiently.

Quick Start

Use the litellm-usage skill to call an LLM with the model "openai/gpt-4o".