auto-iteration-loop

Iterates adversarial LLM reviews over verified research claims with bounded fix back-edges.

75|7|Updated May 2, 2026
One-click install
npx skills add https://github.com/zjunlp/Mechanist --skill auto-iteration-loop-zjunlp
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: auto-iteration-loop
Source: https://github.com/zjunlp/Mechanist/tree/main/skills/auto-iteration-loop
Command: npx skills add https://github.com/zjunlp/Mechanist --skill auto-iteration-loop-zjunlp

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve? Research claims that fail robustness verification need repeated cycles of external review, targeted fixes, and re-verification; doing this manually loses track of budgets, claim states, and which fixes were already attempted. ## Core Features & Use Cases - Five-state claim routing: Consumes /auto-verify output (PASS / FAIL / INCONCLUSIVE / ZERO_ELIGIBLE_VARIANTS / INTEGRITY_ONLY) and routes each claim to the correct back-edge — variant-only fix, main-experiment fix, or claim-stage re-entry. - Bounded iteration budget: Enforces MAX_ITERATIONS = 6 and a MAX_CLAIM_REENTRIES = 2 sub-budget so the loop terminates instead of endlessly rewriting claims. - External reviewer LLM: Calls a configurable reviewer model via the llm-chat MCP server or environment variables, with persistent reviewer memory and resumable state in REVIEW_STATE.json. - Use Case: After running /auto-verify on mechanistic interpretability claims, trigger the loop with "auto review loop llm" to autonomously fix failing variants, re-run experiments, and produce a final per-claim iteration report. ## Quick Start Run the auto review loop llm on my project after /auto-verify has produced VERIFY_REPORT.md so the reviewer iterates on failing claims until the budget is exhausted.

Frequently Asked Questions about auto-iteration-loop

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I run an automated LLM review loop on verified research claims?

Trigger the loop with "auto review loop llm" after /auto-verify has produced verify/VERIFY_REPORT.md. The skill reads the per-claim verdicts, asks an external reviewer LLM for assessment, applies the routed fix, and re-verifies until claims pass or the iteration budget runs out.

How do I configure the reviewer model for the auto iteration loop?

Set LLM_MODEL, LLM_BASE_URL, and LLM_API_KEY in the mcpServers.llm-chat.env section of the project .mcp.json, or in ~/.claude/settings.json, or as shell environment variables. The skill aborts with a hard-fail message if none of these three sources provides a model.

What happens when a claim FAILs robustness verification in the loop?

FAIL claims get two-phase routing: first a variant-integrity fix that re-runs /auto-verify with resume, then an optional claim-stage re-entry that rewrites the claim. Claim re-entries are capped at two to prevent endless rewriting without fixing experiments.

Can the iteration loop resume after being interrupted?

Yes, set RESUME=true and the loop reads review-stage/REVIEW_STATE.json to continue from iterations_consumed + 1. Budget counters are inherited across resumes and never reset, and a completed status returns immediately.

What are the iteration limits of the auto review loop?

The loop allows at most 6 back-edge actions total (MAX_ITERATIONS) and at most 2 claim-stage re-entries (MAX_CLAIM_REENTRIES). Pure reviewer cycles that change nothing on disk do not consume iterations.

Why does the loop abort saying no upstream artifacts found?

The loop iterates over existing artifacts and requires at least one of idea-stage/IDEA_REPORT.md, refine-logs/FINAL_PROPOSAL.md, refine-logs/EXPERIMENT_RESULTS.md, or verify/VERIFY_REPORT.md. Run /auto or at minimum /auto-claim then /auto-experiment first.