skills.rest
eco2-team
eco2-teamOFFICIAL
Explore all skills by this author →
GitHub

langsmith-telemetry

Track LLM calls, token usage, and costs in LangChain/LangGraph applications.

3|Updated Oct 27, 2025
Search Tags:#LLM#observability#tracing#cost-tracking#token-usage#LangSmith#RunTree
One-click install
npx skills add https://github.com/eco2-team/backend --skill langsmith-telemetry
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: langsmith-telemetry
Source: https://github.com/eco2-team/backend/tree/main/.claude/skills/langsmith-telemetry
Command: npx skills add https://github.com/eco2-team/backend --skill langsmith-telemetry

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

LangSmith telemetry provides end-to-end observability for LangChain/LangGraph apps by tracking LLM calls, token usage, and costs, enabling teams to monitor performance and spending.

Core Features & Use Cases

  • Instrument LangSmith tracing across pipelines and agents.
  • Track token usage and cost estimates with RunTree metadata.
  • Integrate OTEL and LangSmith dashboards for unified observability in development and production.
  • Support tracing of multi-agent workflows, tool calls, and LLM responses.

Quick Start

Enable LangSmith tracing by setting LANGCHAIN_TRACING_V2=true and LANGCHAIN_API_KEY, and instrument your workflow with traceable decorators and a LangSmith run config.

Frequently Asked Questions about langsmith-telemetry

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I enable LangSmith tracing for LangChain applications?▼

Enable LangSmith tracing by setting LANGCHAIN_TRACING_V2=true and configuring your LANGCHAIN_API_KEY, then instrument workflows with traceable decorators to capture LLM calls and metadata.

What is the best way to track token usage and costs in multi-agent pipelines?▼

Track token usage and costs in multi-agent pipelines by attaching RunTree metadata to LLM calls, allowing you to monitor spending and performance across tool calls and agent steps.

Does LangSmith observability support OpenTelemetry integration for production monitoring?▼

LangSmith supports optional OpenTelemetry integration, allowing you to unify observability dashboards across development and production environments for comprehensive LLM workflow monitoring.

Can I trace tool calls and LLM responses in LangGraph workflows?▼

Tracing tool calls and LLM responses in LangGraph workflows is supported end-to-end, capturing full execution paths across multi-agent pipelines for detailed performance analysis.

Do I need a LangSmith API key to instrument observability in my LLM application?▼

A LangSmith API key is required to enable observability, as it authenticates your application to send tracing data, token usage metrics, and cost estimates to the LangSmith platform.

How does RunTree metadata help with cost tracking in LLM applications?▼

RunTree metadata captures token usage data across LLM calls and tool executions, enabling accurate cost estimates and detailed spending analysis for multi-agent and pipeline workflows.

Related Skills

Explore More Software Engineering Skills→
Harmeet10000Harmeet10000
7

langsmith-trace

Instrument and query LangSmith traces in Python and TypeScript projects.

Community
Intermediate
ContextJet-aiContextJet-ai
29

instrument-llm-observability

Add OpenTelemetry tracing to LLM applications capturing prompts, tool calls, token usage, latency, and cost.

Official
Intermediate
hoodinihoodini
262

langchain

Build end-to-end LLM applications with LangChain and LangGraph.

Community
Advanced
sammcjsammcj
155

aws-strands-agents-agentcore

Guide AWS Strands Agents SDK and AgentCore deployments across Lambda, ECS/Fargate, and AgentCore Runtime.

Community
Advanced