eval-trace-rca
OfficialRoot-cause analysis for production LLM traces.
Authordatadog-labs
Version1.0.0
Installs0
System Documentation
What problem does it solve?
Diagnoses why production LLM traces show eval failures or runtime errors by tracing symptoms to the root cause across traces and spans.
Core Features & Use Cases
- End-to-end root-cause analysis of production traces using eval signals or runtime errors.
- Phase-by-phase workflow to map judge reasoning, trace context, and root causes, with actionable recommendations.
- Works with ml_app or eval_name contexts to identify systemic issues affecting multiple runs.
Quick Start
Run a full RCA on a target app or eval: select ml_app or eval_name, specify timeframe, and let the tool outline the likely root causes and suggested fixes.
Dependency Matrix
Required Modules
None requiredComponents
Standard package💻 Claude Code Installation
Recommended: Let Claude install automatically. Simply copy and paste the text below to Claude Code.
Please help me install this Skill: Name: eval-trace-rca Download link: https://github.com/datadog-labs/agent-skills/archive/main.zip#eval-trace-rca Please download this .zip file, extract it, and install it in the .claude/skills/ directory.
Agent Skills Search Helper
Install a tiny helper to your Agent, search and equip skill from 471,000+ vetted skills library on demand.