What problem does it solve?
This skill provides a centralized, brand-free dashboard for platform teams to monitor and govern shared LLM gateway traffic, costs, and canary rollouts without needing to modify live routing configurations.
Core Features & Use Cases
- Cost & Performance Monitoring: Aggregates daily spend trends, call volumes, and error rates across multiple services and models.
- Canary Rollout Management: Provides a visual status board to track canary percentages and perform promote, rollback, or hold actions.
- Anomaly Detection: Automatically identifies cost and error-rate spikes using deterministic rolling baselines.
- Use Case: A platform engineer can use this tool to review a canary rollout for a new internal model, verify that error rates remain within thresholds, and promote the model to 100% traffic without touching the production gateway config.
Quick Start
Use the kelly-llm-gateway skill to open the local dashboard and review the current gateway cost and rollout status.