terminal-bench-loop

Manage Terminal-Bench problems through iterative execution, diagnosis, and approval workflows.

Updated Mar 30, 2026
One-click install
npx skills add https://github.com/thetangstr/agentdash --skill terminal-bench-loop-thetangstr
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: terminal-bench-loop
Source: https://github.com/thetangstr/agentdash/tree/main/skills/terminal-bench-loop
Command: npx skills add https://github.com/thetangstr/agentdash --skill terminal-bench-loop-thetangstr

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes scripts (resource) and references (resource) components.

What problem does it solve?

Automates and streamlines the process of running Terminal-Bench problems through Paperclip, enabling bounded, human-in-the-loop improvement cycles to identify, diagnose, and confirm issues efficiently.

Core Features & Use Cases

  • Iterative Problem Solving: Enables automated repetition of Terminal-Bench tasks until completion or stopping conditions are met.
  • Issue Diagnosis & Stopping: Coordinates precise diagnosis, block detection, and stop reasons in complex Terminal-Bench workflows.
  • Use Case: When a Terminal-Bench problem requires multiple iterations to pass smoke tests, this skill manages the entire loop, diagnoses failures, and facilitates approval workflows.

Quick Start

Use this skill to run a bounded Terminal-Bench loop against a specific issue, testing the process and logic.

Frequently Asked Questions about terminal-bench-loop

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I automate iterative diagnosis for failing Terminal-Bench tasks?

Automated iterative diagnosis for Terminal-Bench tasks is managed through a bounded loop that repeatedly executes, diagnoses failures, and facilitates human-in-the-loop approval workflows until completion or stopping conditions are met.

What's the best way to manage issue resolution loops in Terminal-Bench workflows?

Issue resolution loops in Terminal-Bench workflows are managed by coordinating precise diagnosis, block detection, and stop reasons with strict invariants for progress and boundedness, ensuring detailed failure analysis across multiple automated iterations.

Can I set stopping conditions or bounds on automated Terminal-Bench problem iterations?

Stopping conditions and bounded cycles are enforced for Terminal-Bench problem iterations through strict invariants that track progress and blockers, ensuring the automation halts appropriately and facilitates human-in-the-loop validation.

How does human-in-the-loop validation work during Terminal-Bench failure analysis?

Human-in-the-loop validation during Terminal-Bench failure analysis works by pausing the iterative execution loop to present detailed diagnosis and block detection results, requiring human approval before proceeding to the next bounded cycle.

Do I need Paperclip to run bounded iteration and smoke test loops for Terminal-Bench?

Paperclip is required to run bounded iteration and smoke test loops for Terminal-Bench, as it enables the automated repetition, issue diagnosis, and stopping condition coordination needed for complex troubleshooting workflows.

Why does my Terminal-Bench issue loop stop before passing smoke tests?

A Terminal-Bench issue loop stops before passing smoke tests when block detection identifies a stopping condition or invariant bound is reached, triggering detailed failure analysis and human-in-the-loop validation rather than continuing unbounded cycles.