compare-trajectories
OfficialPinpoint how two model runs diverge.
Data & Analytics#model-comparison#behavioral-analysis#trajectory-diffing#trajectory-alignment#debugging-ai-systems
Authorunderstudylabs
Version1.0.0
Installs0
System Documentation
What problem does it solve?
Identify per-task behavioral differences between two trajectory exports, enabling you to understand not just which run scores higher, but how and why their trajectories diverge on the same tasks.
Core Features & Use Cases
- Align and compare trajectory exports to reveal per-task behavioral gaps and their classifications (persistence/recovery, knowledge, format/parsing).
- Generate an outcome-delta matrix and produce warm-start candidates by highlighting clean, actionable differences for distillation or improvement.
- Use alongside scalar model-sweep analyses to diagnose whether differences are due to strategy, retrieval, or decoding.
Quick Start
Diff two trajectory exports to identify per-task divergence and categorize the reachable gaps.
Dependency Matrix
Required Modules
None requiredComponents
scriptsreferences
💻 Claude Code Installation
Recommended: Let Claude install automatically. Simply copy and paste the text below to Claude Code.
Please help me install this Skill: Name: compare-trajectories Download link: https://github.com/understudylabs/understudy-agent-tools/archive/main.zip#compare-trajectories Please download this .zip file, extract it, and install it in the .claude/skills/ directory.
Agent Skills Search Helper
Install a tiny helper to your Agent, search and equip skill from 510,000+ vetted skills library on demand.