auto-review-loop

Automate iterative research-code review and repair until acceptance criteria are met.

2|1|Updated Apr 19, 2026
One-click install
npx skills add https://github.com/raja21068/AutoResearch --skill auto-review-loop-raja21068
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: auto-review-loop
Source: https://github.com/raja21068/AutoResearch/tree/main/skills/aris/auto-review-loop
Command: npx skills add https://github.com/raja21068/AutoResearch --skill auto-review-loop-raja21068

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

It helps teams turn a draft research output into a submission-ready artifact by repeatedly running an external reviewer, implementing the reviewer’s fixes, and re-checking progress until the work earns a positive acceptance decision.

Core Features & Use Cases

  • Autonomous multi-round review loop: Conducts review → parses score/verdict → produces a prioritized fix plan → executes fixes → re-reviews until a threshold is met or MAX_ROUNDS is reached.
  • Deterministic, execution-grounded repair: Applies concrete changes across code, experiments, analysis, figures, and documentation rather than only revising the narrative.
  • Reviewer modes for different risk profiles: Supports MCP-based review with thread persistence (medium/hard) or adversarial repo-reading verification (nightmare) for stricter scrutiny.
  • State recovery and audit trail: Persists progress in REVIEW_STATE.json, appends verbatim reviewer outputs to cumulative logs, and maintains traceability for each round.

Quick Start

Run the auto-review loop for your topic by calling: /auto-review-loop "topic".

Frequently Asked Questions about auto-review-loop

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How does automated iterative peer review work for research pipelines?

Automated iterative peer review repeatedly obtains an external review, implements the minimum recommended fixes across code and documentation, and re-submits the updated work for re-assessment until a score threshold is met.

How do I set up an autonomous review loop to fix and re-review research code?

You set up an autonomous review loop by defining YAML parameters for round limits and stop conditions, then running the process to parse reviewer verdicts, execute fixes, and re-check progress until submission-ready.

Can I use codex exec for adversarial repo-reading verification in my review loop?

Yes, you can route reviewer verification via codex exec for adversarial repo-reading scrutiny, or use Codex MCP for review with thread persistence to match different risk profiles.

What is the best way to ensure experiments and metrics are consistent before submission?

The best way to ensure consistency is using deterministic, execution-grounded repair that applies concrete changes across experiments, metrics, analysis, and figures rather than only revising the narrative.

How does state recovery work if an automated multi-round review loop is interrupted?

State recovery works by persisting progress in REVIEW_STATE.json and appending verbatim reviewer outputs to cumulative logs, maintaining full traceability and allowing the review loop to resume from the last saved round.

What are the limitations of using a maximum rounds stop condition for research verification?

The limitation is that reaching the MAX_ROUNDS threshold stops the loop regardless of acceptance status, meaning work that fails to earn a positive decision within the round limit will exit the review cycle unfinished.