AgentLoop AutoHarness

Orchestrate AI agent pipelines with human checkpoints and speculative Git worktrees.

Updated Jun 29, 2026
One-click install
npx skills add https://github.com/ML-Guy/agentloop-autoharness --skill agentloop-autoharness
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: AgentLoop AutoHarness
Source: https://github.com/ML-Guy/agentloop-autoharness/tree/main/docs
Command: npx skills add https://github.com/ML-Guy/agentloop-autoharness --skill agentloop-autoharness

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires agentloop-core, and includes scripts (resource) and references (resource) and assets (resource) components.

What problem does it solve?

This Skill automates the orchestration of AI agent pipelines, enabling iterative improvements with human-in-the-loop feedback and speculative exploration.

Core Features & Use Cases

  • Data-Driven Orchestration: Manages AI agent pipelines using Git-friendly YAML files, ensuring predictable and decoupled task executions.
  • Human-in-the-Loop Checkpoints: Implements explicit pause gates for human review, allowing evaluation and approval/rejection via CLI or dashboard.
  • Speculative Exploration: Spawns isolated Git branch worktrees to evaluate multiple fix approaches concurrently when human feedback is slow.
  • Lifecycle Hooks: Automatically triggers post-completion actions, such as updating objective score charts, cloning pipelines for next iteration cycles, or executing custom cleanup scripts.
  • Visual Dashboard: Serves a responsive, dark-themed HTML5 SPA displaying pipeline execution timelines, task decision logs, metric scores progression charts, and interactive DAGs.
  • State-Based Ledger: Injects historical decisions and prerequisite context directly into task handoffs, optimizing LLM tokens.
  • Doctor Self-Diagnostics: Includes a static validation engine that audits schemas, cross-references steps, verifies task-pipeline status alignments, and flags orphaned worktree branches.
  • Use Case: Imagine you have a series of AI agent tasks to evaluate and improve. Use this Skill to manage the pipeline, collect human feedback, and iterate on the agent's behavior.

Quick Start

Use the AgentLoop AutoHarness to start a new iteration of the 'accuracy-iter-1' pipeline.

agentloop pipeline run accuracy-iter-1

Frequently Asked Questions about AgentLoop AutoHarness

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I orchestrate AI agent pipelines with human-in-the-loop checkpoints?

You can orchestrate AI agent pipelines using Git-friendly YAML files that define explicit pause gates for human review. The pipeline supports human-in-the-loop feedback by allowing evaluation and approval or rejection directly via CLI or a visual dashboard.

How does speculative exploration work for AI pipeline branches?

Speculative exploration spawns isolated Git branch worktrees to evaluate multiple fix approaches concurrently. This mechanism optimizes iterative pipeline execution by continuing to process alternative solutions while waiting for slow human feedback.

Do I need agentloop-core to manage YAML-based AI pipelines?

Yes, you must install the agentloop-core package to use this orchestration harness. It requires YAML-based task, pipeline, and objective definitions to properly manage decoupled executions and state-based ledgers.

Can I visualize AI pipeline execution timelines and metric scores?

Yes, the orchestration harness serves a responsive HTML5 single-page application dashboard. This visual interface displays pipeline execution timelines, task decision logs, metric score progression charts, and interactive directed acyclic graphs.

What is the best way to automate post-completion actions in an AI pipeline?

Lifecycle hooks automatically trigger post-completion actions such as updating objective score charts, cloning pipelines for next iteration cycles, or executing custom cleanup scripts once the AI agent pipeline finishes its execution.

How do I validate AI pipeline schemas and flag orphaned worktree branches?

The built-in doctor self-diagnostics static validation engine audits schemas, cross-references steps, verifies task-pipeline status alignments, and flags orphaned worktree branches to ensure pipeline integrity.