langsmith

Manage LangSmith runs, datasets, and prompts via a command-line interface.

9|1|Updated Jan 14, 2026
One-click install
npx skills add https://github.com/gigaverse-app/langsmith-cli --skill langsmith
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: langsmith
Source: https://github.com/gigaverse-app/langsmith-cli/tree/main/skills/langsmith
Command: npx skills add https://github.com/gigaverse-app/langsmith-cli --skill langsmith

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes scripts (resource) and references (resource) components.

What problem does it solve?

This Skill provides a command-line interface to interact with LangSmith, enabling efficient management and inspection of AI application traces, datasets, and prompts.

Core Features & Use Cases

  • Trace Management: Inspect, filter, and analyze runs (traces) for debugging and performance monitoring.
  • Dataset Operations: Create, list, and manage datasets and examples for evaluation and training.
  • Prompt Management: Push, get, and list prompt templates for version control and sharing.
  • Use Case: Debug a failing AI chain by listing recent errors, inspecting their inputs/outputs, and identifying the root cause.

Quick Start

Use the langsmith skill to list the last 5 runs in the 'my-project' project.

Frequently Asked Questions about langsmith

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I debug a failing AI chain using trace analysis?

Trace analysis allows you to inspect and filter AI application runs to debug failures. By listing recent errors and examining their inputs and outputs, you can identify the root cause of failing chains.

What is the best way to manage prompt versioning for AI applications?

Prompt versioning for AI applications is managed by pushing, getting, and listing prompt templates. This approach enables strict version control and easy sharing of prompts across different environments.

How do I extract examples from datasets for LLM evaluation?

You can extract examples from datasets for LLM evaluation by creating, listing, and managing datasets through a command-line interface. This supports advanced filtering and data extraction directly to files.

Can I monitor AI application performance in real-time via a CLI?

Yes, you can monitor AI application performance in real-time via a command-line interface. The CLI supports real-time monitoring and advanced filtering of runs to track application behavior continuously.

Does LangSmith CLI support advanced filtering for run inspection?

Yes, LangSmith CLI supports advanced filtering for run inspection. You can efficiently inspect, filter, and analyze runs to manage data and debug AI applications directly from your terminal.