arbor

Coordinate iterative artifact improvement against measurable objectives with hypothesis trees and held-out gating.

74|5|Updated Dec 10, 2025
One-click install
npx skills add https://github.com/dralkh/seerai --skill arbor
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: arbor
Source: https://github.com/dralkh/seerai/tree/main/skills/arbor
Command: npx skills add https://github.com/dralkh/seerai --skill arbor

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes scripts (resource) and references (resource) components.

What problem does it solve?

It coordinates long-horizon improvement of a concrete artifact against a measurable objective, so you can run many experiments without losing track of what was learned.

Core Features & Use Cases

  • Hypothesis tree planning: organize competing directions, refinements, and negative constraints.
  • Isolated executor runs: test one hypothesis at a time in separate worktrees to avoid cross-contamination.
  • Dev/test gating: use a fast development evaluator during search and admit changes only after held-out confirmation.
  • Use cases: model training recipes, agent harness tuning, data pipelines, benchmark submissions, and prompt optimization.

Quick Start

Ask Arbor to improve your current artifact against a named dev evaluator and held-out test evaluator, then let it run iterative experiments, record evidence, and merge only the changes that generalize.

Frequently Asked Questions about arbor

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I track iterative experiments without losing what was learned?

Iterative experiment tracking uses a hypothesis tree to organize competing directions and isolated worktree execution to test one hypothesis at a time, recording evidence to prevent knowledge loss. It coordinates long-horizon improvement of a concrete artifact against a measurable objective.

What is dev/test separation for autonomous optimization?

Dev/test separation uses a fast development evaluator during the search phase and admits changes only after held-out confirmation. This merge gating prevents overfitting to evaluator metrics and ensures changes generalize before merging.

How do I run isolated experiments in git worktrees?

Isolated worktree execution tests one hypothesis per worktree to avoid cross-contamination between concurrent changes. Each worktree runs independently against a dev evaluator, recording evidence before merging the successful artifact updates.

Can I use this for prompt refinement and agent harness tuning?

Yes, prompt refinement and agent harness tuning are core use cases alongside model training recipes, data pipelines, and benchmark submissions. Any task requiring iterative improvement of a concrete artifact against a measurable objective applies.

Do I need a hypothesis tree for structured experiment tracking?

Yes, a hypothesis tree is required to organize competing directions, refinements, and negative constraints before executing isolated runs. It structures the search space so that evidence propagation and held-out merge gating can operate effectively.

Why does iterative refinement need held-out merge gating?

Held-out merge gating prevents overfitting by only merging changes that pass a separate test evaluator after succeeding on the fast dev evaluator. This ensures iterative artifact improvements generalize rather than just fitting the development metric.