curate-trajectories

Curate trajectories into a decontaminated, provenance-tracked training dataset.

10|5|Updated Jun 3, 2026
One-click install
npx skills add https://github.com/understudylabs/understudy-agent-tools --skill curate-trajectories
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: curate-trajectories
Source: https://github.com/understudylabs/understudy-agent-tools/tree/main/skills/curate-trajectories
Command: npx skills add https://github.com/understudylabs/understudy-agent-tools --skill curate-trajectories

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Trajectories pile up as loose per-task JSON across runs, and once used for training, distillation, or RL they can leak frozen developer holdout. This skill provides a provenance-tracked, contamination-safe workflow to import, tag splits, perform hash-stamped selections, and emit a decontaminated pool that preserves holdout integrity.

Core Features & Use Cases

  • Index + attach provenance: Build a local index (one record per trajectory) at .understudy/curate-trajectories/index.jsonl with full provenance fields and corpus/hash metadata.
  • Tag splits from capture-evidence: Map trajectories to train/dev/holdout/none using the frozen splits.json and annotate index records for guarded pools.
  • Query as a hash-stamped selection: Express subsets by provenance filters, resolve to a named selection, compute a selection hash, and emit a manifest for downstream audits.
  • Contamination check & emission: Cross-check against holdout/dev id sets, produce a contamination report, and hard-block guarded pools unless overridden.
  • Emit decontaminated pool: Produce train-safe/distill-safe pools along with the selection hash, splits_sha256, corpus hash, and row counts for auditability.

Quick Start

Index your trajectories and generate a train-safe, decontaminated pool using the built-in workflow.

Frequently Asked Questions about curate-trajectories

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I prevent trajectory data leakage into my developer holdout sets?

To prevent trajectory data leakage, you can curate trajectories into a provenance-rich dataset that cross-checks against holdout id sets and hard-blocks guarded pools. This ensures only train-safe rows are emitted for downstream training.

What is a decontaminated trajectory pool and how is it generated?

A decontaminated trajectory pool is a train-safe dataset generated by indexing trajectories, tagging splits from frozen evidence, and applying contamination checks. The output includes a selection hash, corpus hash, and an auditable manifest for verification.

How do I track dataset provenance for machine learning training runs?

You track dataset provenance by building a local index with full provenance fields and corpus hash metadata for each trajectory. This index records the origin and split tags, enabling hash-stamped selections for downstream audits.

Can I tag train, dev, and holdout splits using a frozen splits.json file?

Yes, you can map trajectories to train, dev, holdout, or none by referencing a frozen splits.json file. The skill annotates index records with these split tags to create guarded pools for safe training and distillation.

What is the best way to audit trajectory selections before model training?

The best way to audit trajectory selections is to resolve filtered subsets into a named selection and compute a selection hash. This process emits a manifest containing the splits_sha256 and corpus hash for full downstream verification.

Does this trajectory curation workflow require external dependencies?

No, this trajectory curation workflow operates without external dependencies. It independently indexes your local trajectory files, applies contamination checks, and emits the decontaminated pool directly to your environment.