portkey-typescript-sdk

What problem does it solve?

Integrate Portkey into TypeScript and JavaScript applications to provide production-grade observability, caching, provider routing, and reliability for LLM requests so teams don't have to build gateway features from scratch.

Core Features & Use Cases

• Observability & Tracing: Capture request/response telemetry and traces across multiple LLM providers for debugging and SLA monitoring.
• Caching & Fallbacks: Reduce latency and cost with caching layers and automated fallback strategies when providers fail or hit rate limits.
• Provider Routing & Load Balancing: Route requests across hundreds of LLM providers using virtual keys, weight-based policies, and failover rules.
• Use Case: A backend chat service can use the SDK to route completions to preferred models, cache embeddings for fast retrieval, and automatically fail over to backup providers during outages.

Quick Start

Create a Portkey client with your API key and virtual key, then send a test chat completion to verify routing, caching, and observability.