auto-review-loop-llm

Automates iterative research review cycles using OpenAI-compatible LLM APIs until acceptance.

Updated Apr 1, 2026
One-click install
npx skills add https://github.com/zniihgnexy/vid_tokenizer --skill auto-review-loop-llm-zniihgnexy
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: auto-review-loop-llm
Source: https://github.com/zniihgnexy/vid_tokenizer/tree/main/.claude/skills/auto-review-loop-llm
Command: npx skills add https://github.com/zniihgnexy/vid_tokenizer --skill auto-review-loop-llm-zniihgnexy

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve? Research papers and ML projects need repeated external critique before submission, but manually soliciting reviewer feedback is slow and inconsistent. This Skill runs an autonomous loop that sends your work to an external LLM reviewer, parses the score and weaknesses, implements fixes, and re-reviews until the work is judged ready or a round limit is reached. ## Core Features & Use Cases - Autonomous Review Loop: Iterates review → fix → re-review for up to 4 rounds, stopping early when the score reaches 6/10 or the verdict indicates readiness. - Provider-Agnostic LLM Access: Works with any OpenAI-compatible API (OpenAI, DeepSeek, Kimi, GLM, SiliconFlow, and more) via an llm-chat MCP server or a curl fallback. - State Persistence & Recovery: Writes REVIEW_STATE.json after every round and maintains a cumulative AUTO_REVIEW.md log with verbatim reviewer responses. - Use Case: A researcher preparing a NeurIPS submission triggers the loop; the Skill obtains a brutally honest score, implements the minimum fixes for each ranked weakness, and re-submits until the reviewer says the paper is ready. ## Quick Start Ask the AI to run the auto review loop llm on the current research project and iterate until the external reviewer accepts it.

Frequently Asked Questions about auto-review-loop-llm

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I run an automated LLM review loop on my research paper?▼

Trigger the skill with "auto review loop llm" plus a topic or scope. It sends your research context to an external LLM reviewer, parses the score and weaknesses, implements fixes, and repeats up to 4 rounds until the verdict is positive.

Which LLM providers work with an OpenAI-compatible review API?▼

Any OpenAI-compatible endpoint works, including OpenAI, DeepSeek, MiniMax, Kimi (Moonshot), ZhiPu GLM, SiliconFlow, Alibaba DashScope, and Lingyiwanwu. Set LLM_BASE_URL, LLM_MODEL, and LLM_API_KEY to switch providers.

Can I use the review loop without the llm-chat MCP server?▼

Yes, the skill falls back to direct curl calls against the configured OpenAI-compatible chat completions endpoint. You only need the LLM_API_KEY, LLM_BASE_URL, and LLM_MODEL environment variables set.

When does the automated review loop stop iterating?▼

The loop stops when the reviewer score reaches 6/10 or higher and the verdict contains terms like ready, accept, or sufficient, or when the maximum of 4 rounds is reached. Final state is marked completed in REVIEW_STATE.json.

How does the review loop recover after an interruption?▼

State is persisted to REVIEW_STATE.json at the end of every round, recording the round number, last score, verdict, and pending experiments. On restart, the skill reads this file first and resumes from the saved state.