llm-monitoring-dashboard

Monitor LLM token usage, costs, and latency across providers via Tokuin CLI.

8|Updated Mar 9, 2026
One-click install
npx skills add https://github.com/JEO-tech-ai/oh-my-unity3d --skill llm-monitoring-dashboard-jeo-tech-ai
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: llm-monitoring-dashboard
Source: https://github.com/JEO-tech-ai/oh-my-unity3d/tree/main/.unity-skills/llm-monitoring-dashboard
Command: npx skills add https://github.com/JEO-tech-ai/oh-my-unity3d --skill llm-monitoring-dashboard-jeo-tech-ai

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Teams struggle to observe and optimize LLM usage across projects, leading to unseen costs and latency.

Core Features & Use Cases

  • Tokuin CLI-based token, cost, and latency tracking across providers (OpenAI, Anthropic, Gemini, OpenRouter).
  • User-ranking system and inactive-user tracking for governance and engagement insights.
  • Data-driven PM insights with per-user drilldown and Cmd+K global search to accelerate decision making.

Quick Start

Install and run the dashboard locally to see live LLM usage metrics in your admin panel.

Frequently Asked Questions about llm-monitoring-dashboard

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I track LLM usage costs and latency across different providers?

To track LLM usage costs and latency across different providers, you can use a dashboard that integrates with the Tokuin CLI to collect real-time token, cost, and latency metrics across models like OpenAI, Anthropic, and Gemini.

What is the best way to monitor active LLM users for product governance?

The best way to monitor active LLM users for product governance is using a PM dashboard that provides user-ranking systems, inactive-user tracking, and per-user drilldowns to evaluate engagement and model performance.

Can I monitor LLM token usage and costs for OpenAI and Anthropic in a single dashboard?

Yes, you can monitor LLM token usage and costs for OpenAI and Anthropic in a single dashboard that offers cross-model compatibility via Tokuin CLI, consolidating real-time data collection from multiple providers into one view.

How do I set up real-time LLM usage monitoring for my team?

To set up real-time LLM usage monitoring for your team, install and run the dashboard locally to connect your provider APIs through the Tokuin CLI, displaying live token consumption and latency metrics in your admin panel.

Why does tracking LLM model performance require per-user drilldown?

Tracking LLM model performance requires per-user drilldown because it enables product managers to isolate specific latency and cost anomalies to individual users, accelerating data-driven decision making and optimization.