What problem does it solve?
Provides a clear workflow to add tracing to LLM and agent applications and to query, analyze, and export full execution traces for debugging, performance analysis, and dataset generation.
Core Features & Use Cases
- Automatic tracing for LangChain/LangGraph with environment switches to enable full trace capture across nested calls.
- Instrumentation for other frameworks via OpenTelemetry integration or language wrappers that trace individual LLM calls and nested functions.
- CLI-first querying and export using langsmith trace list, langsmith trace get, and langsmith trace export with rich filters for time, latency, errors, and metadata.
- Export to JSONL for downstream dataset creation, cost/token analysis, and offline inspection.
- Use Cases: Debug slow or failing agent runs, extract trajectories for dataset labeling, and audit LLM calls across environments.
Quick Start
Set LANGSMITH_API_KEY and optionally LANGSMITH_PROJECT, enable tracing or wrap your client, then use the langsmith trace list or langsmith trace get commands to inspect and export traces.