auto-review-loop-llm

Automates iterative research review cycles using any OpenAI-compatible LLM API.

Updated Jul 9, 2026
One-click install
npx skills add https://github.com/Lingjie-wang/autoRL --skill auto-review-loop-llm-lingjie-wang
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: auto-review-loop-llm
Source: https://github.com/Lingjie-wang/autoRL/tree/main/Auto-claude-code-research-in-sleep/skills/auto-review-loop-llm
Command: npx skills add https://github.com/Lingjie-wang/autoRL --skill auto-review-loop-llm-lingjie-wang

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve? Getting objective, rigorous feedback on research work before submission is slow and depends on scarce human reviewers. This Skill runs an autonomous review loop that scores your work, identifies weaknesses, implements fixes, and re-reviews until the work meets a quality threshold. ## Core Features & Use Cases - Autonomous Review Loop: Iterates review → fix → re-review for up to 4 rounds, stopping when the score reaches 6/10 with a "ready" or "almost" verdict. - Provider-Agnostic LLM Backend: Works with any OpenAI-compatible API (OpenAI, DeepSeek, Kimi, GLM, SiliconFlow, and more) via the llm-chat MCP server or direct curl calls. - State Persistence & Recovery: Saves round state to REVIEW_STATE.json and logs cumulative reviews to AUTO_REVIEW.md, enabling recovery after interruptions. - Use Case: A researcher preparing a NeurIPS submission runs the loop overnight; each round feeds the previous review summary into the next prompt, fixes are applied, and the loop stops when the external reviewer judges the paper ready. ## Quick Start Run an auto review loop with the LLM reviewer on my current research draft and iterate until it is ready for submission.

Frequently Asked Questions about auto-review-loop-llm

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I run an automated research review loop with an LLM?

Trigger the skill with "auto review loop llm" and a topic or scope. It reviews your work via an OpenAI-compatible API, implements fixes, and re-reviews for up to 4 rounds until the score reaches 6/10 with a ready or almost verdict.

Which LLM providers work with an OpenAI-compatible review API?

Any OpenAI-compatible endpoint works, including OpenAI, DeepSeek, MiniMax, Kimi (Moonshot), ZhiPu GLM, SiliconFlow, Alibaba DashScope, and Lingyiwanwu. Set LLM_BASE_URL, LLM_MODEL, and LLM_API_KEY in the llm-chat MCP server configuration.

Can I use this review loop without the llm-chat MCP server?

Yes, the skill falls back to direct curl calls against the configured LLM_BASE_URL chat completions endpoint. The MCP tool is preferred when available, but curl with the same environment variables produces equivalent reviews.

How does the review loop recover after an interruption?

State is persisted to review-stage/REVIEW_STATE.json after every round, recording the round number, status, last score, and verdict. On restart, the skill reads this file first and resumes from the saved round instead of starting over.

When does the automated review loop stop iterating?

The loop stops when the reviewer score is at least 6 out of 10 AND the verdict is "ready" or "almost" — both conditions must hold. It also stops after 4 rounds (MAX_ROUNDS) regardless of the assessment.

Should I schedule this review loop with a cron or timer?

No. The skill explicitly warns against wrapping it in /loop, /schedule, or CronCreate because it already loops internally and carries prior-round context between rounds. An external timer restarts from scratch each tick, losing accumulated context and wasting tokens.