auto-review-loop

Run multi-round external review and fix cycles on ML/AI research artifacts.

Updated May 25, 2026
One-click install
npx skills add https://github.com/duypham2801/ThS_LLM --skill auto-review-loop-duypham2801
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: auto-review-loop
Source: https://github.com/duypham2801/ThS_LLM/tree/main/.claude/skills/auto-review-loop
Command: npx skills add https://github.com/duypham2801/ThS_LLM --skill auto-review-loop-duypham2801

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

It helps researchers reach a “ready for submission” state by running an autonomous multi-round review-and-fix loop, systematically addressing weaknesses until an external reviewer approves the work.

Core Features & Use Cases

  • Autonomous multi-round review: Repeatedly sends the current research context to a reviewer (via Codex MCP or codex exec) to obtain a score, verdict, and prioritized minimum fixes.
  • Fix-then-re-review workflow: Implements the suggested actions (code, experiments, analysis, and documentation), then re-runs the review loop until the stop conditions are met or MAX_ROUNDS is reached.
  • Robust state persistence and recovery: Saves progress to REVIEW_STATE.json to resume after context compaction or interrupted runs.
  • Optional human checkpoints: Can pause after each review round to let the user approve, customize, skip specific fixes, or stop early.
  • Hard/nightmare adversarial modes: Supports reviewer memory and stricter verification modes to reduce blind spots and improve claim validity.

Quick Start

Run the auto-review loop on your project narrative by invoking the skill with a topic, for example: send the command “/auto-review-loop "your research topic" — compact: true, human checkpoint: true, difficulty: hard”.

Frequently Asked Questions about auto-review-loop

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I autonomously review and fix ML papers until they are ready for submission?

To autonomously review ML papers, you can use a multi-round review-and-fix loop that sends your research context to a reviewer, implements prioritized minimum fixes, and re-reviews until it reaches a submission-ready state.

How does state persistence and recovery work for interrupted research iteration loops?

State persistence for research iteration saves your current progress, including scores and fixes, to a REVIEW_STATE.json file, allowing the autonomous review loop to recover and resume seamlessly after context compaction or interrupted runs.

Can I use adversarial verification modes to improve ML paper claim validity?

Yes, you can use hard or nightmare adversarial verification modes during the review loop to enable reviewer memory and apply stricter verification, reducing blind spots and improving claim validity for your research artifacts.

Do I need to manually approve every fix during an autonomous review loop?

No, you do not need to manually approve every fix, but you can enable optional human checkpoints to pause after each review round to approve, customize, skip specific fixes, or stop the loop early based on your needs.

What is the best way to handle experiment fixes and documentation refinement across multiple review rounds?

The best way to handle experiment fixes and documentation refinement is using a fix-then-re-review workflow that systematically implements suggested code, analysis, and documentation updates before re-running the external review loop.

Why does my research iteration loop stop before reaching a submission-ready quality level?

Your research iteration loop stops before reaching submission-ready quality when it hits the defined MAX_ROUNDS limit or meets stop conditions where an external reviewer approves the work, even if minor weaknesses remain.