understudy

You can improve a coding agent using local traces by running an orchestration loop that captures real traces, builds eval harnesses, compares incumbent vs candidate routes, and deploys improvements privately on your machine.

Local-first agent orchestration coordinates agent improvement workflows by routing each stage—trace capture, evaluation, optimization, and deployment—to a single worker skill, keeping all artifacts on your local machine without requiring hosted gateways.

Yes, you can run automatic prompt evolution and eval harnesses locally without registration or auth, applying safety gates to govern when data is uploaded or deployed while maintaining auditable decision records.

No, you do not need a hosted gateway to compare routes. The workflow operates entirely local-first, allowing you to evaluate candidate routes against incumbents on your own machine and generate structured improvement reports.

The best way to build an eval harness from traces is to use an orchestrator that routes trace capture to a dedicated worker skill, generates auditable artifacts, and applies safety gates before any comparison or deployment.

The main limitation is that the orchestrator does not perform work inline; it strictly routes each workload step to a separate worker skill, requiring those worker skills to be present to execute the actual evaluation and optimization.