llm-observability-and-cost
CommunityMaster LLM production monitoring with precision observability & cost tracking.
Authorjpoindexter
Version1.0.0
Installs0
System Documentation
What problem does it solve?
This Skill offers a comprehensive solution to observe and attribute costs to production Large Language Models (LLMs), ensuring efficient operation, error identification, and financial tracking.
Core Features & Use Cases
- Observability: Tracks and records every LLM call with detailed traces, capturing model versions, prompts, responses, token counts, latency, and costs.
- Cost Tracking: Attributes costs per call based on tokens, supporting granular billing and cost management.
- Quality & Drift Detection: Monitors the quality of LLM responses and detects silent regressions to maintain service excellence.
Quick Start
Enable this Skill for detailed cost attribution and observability for your LLM systems, including real-time alerting and tracing.
Dependency Matrix
Required Modules
opentelemetry
Components
scriptsreferencesassets
💻 Claude Code Installation
Recommended: Let Claude install automatically. Simply copy and paste the text below to Claude Code.
Please help me install this Skill: Name: llm-observability-and-cost Download link: https://github.com/jpoindexter/design-and-ai-skills/archive/main.zip#llm-observability-and-cost Please download this .zip file, extract it, and install it in the .claude/skills/ directory.
Agent Skills Search Helper
Install a tiny helper to your Agent, search and equip skill from 620,000+ vetted skills library on demand.