What problem does it solve?
This Skill helps you understand and debug how your LLM system behaves by organizing high-volume traces into meaningful clusters, then quantifying cost, latency, and errors across those clusters.
Core Features & Use Cases
- Cluster run discovery: Identify recent LLM clustering runs (trace-level and generation-level) over a time window.
- Cluster inspection & summarization: Retrieve clusters from a chosen run and review cluster titles, descriptions, sizes, and representative traces.
- Metrics computation: Compute per-trace or per-generation cost, latency, token counts, and error rates within the cluster’s analysis window.
- Deep trace drilling: Select specific trace IDs from a cluster and inspect full trace details for root-cause investigation.
Quick Start
Use the skill to investigate your most recent clustering run by listing recent clustering runs for the last 7 days, selecting a run, then loading its clusters to identify the most representative and most expensive clusters before drilling into individual traces.