tb-lf

Query Langfuse and DevPortal for LLM traces, evaluations, and triage queues.

Updated Mar 7, 2026
One-click install
npx skills add https://github.com/productiveio/cli-toolbox --skill tb-lf
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: tb-lf
Source: https://github.com/productiveio/cli-toolbox/tree/main/crates/tb-lf
Command: npx skills add https://github.com/productiveio/cli-toolbox --skill tb-lf

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes scripts (resource) and references (resource) components.

What problem does it solve?

This Skill provides a streamlined interface for querying and analyzing Langfuse and DevPortal LLM observability data, enabling faster debugging and performance analysis of AI models.

Core Features & Use Cases

  • Trace Analysis: Inspect individual LLM traces, including inputs, outputs, and associated metadata.
  • Evaluation Monitoring: Track evaluation runs, identify regressions, and monitor score trends.
  • Triage Queue Management: Review and manage flagged items for AI-driven issues.
  • Use Case: When an AI feature shows degraded performance, use this Skill to quickly find relevant traces, check evaluation results, and identify any items in the triage queue that might be contributing to the issue.

Quick Start

Use the tb-lf skill to list traces from the last 7 days.

Frequently Asked Questions about tb-lf

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I query Langfuse traces to debug LLM behavior?

Query Langfuse traces to debug LLM behavior by inspecting individual traces, inputs, outputs, and associated metadata. This Skill facilitates investigation of AI-related issues by providing direct access to detailed LLM observability data.

What is the best way to monitor LLM evaluation regressions?

Monitor LLM evaluation regressions by tracking evaluation runs, identifying score trends, and reviewing flagged items. This Skill queries Langfuse and DevPortal to help you quickly identify performance degradation in AI features.

Do I need DevPortal API access to retrieve LLM observability data?

Yes, you need DevPortal API access to retrieve LLM observability data. This Skill requires DevPortal API access to successfully query and pull detailed trace information, evaluation metrics, and triage queue status.

Can I manage triage queues for AI-driven issues using Langfuse?

Yes, you can manage triage queues for AI-driven issues using Langfuse. This Skill allows you to review and manage flagged items, checking queue status to identify elements contributing to degraded AI model performance.

How do I list LLM traces from the last 7 days for performance analysis?

List LLM traces from the last 7 days for performance analysis by querying Langfuse observability data. This Skill provides a streamlined interface to inspect inputs, outputs, and metadata for faster debugging of AI models.