auto-review-loop-llm

Automate iterative research artifact review cycles via OpenAI-compatible LLM APIs.

2|Updated Mar 19, 2026
One-click install
npx skills add https://github.com/chenghaoYang/auto-coder-trainer --skill auto-review-loop-llm-chenghaoyang
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: auto-review-loop-llm
Source: https://github.com/chenghaoYang/auto-coder-trainer/tree/main/aris/skills/auto-review-loop-llm
Command: npx skills add https://github.com/chenghaoYang/auto-coder-trainer --skill auto-review-loop-llm-chenghaoyang

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Autonomous research review loop using any OpenAI-compatible LLM API. Configure via llm-chat MCP server or environment variables. Trigger with "auto review loop llm" or "llm review".

Core Features & Use Cases

  • Multi-round autonomous review: review → implement fixes → re-review until a positive assessment or MAX_ROUNDS is reached.
  • MCP-driven configuration: plug in your preferred LLM provider, via llm-chat MCP server or environment variables.
  • State persistence and traceability: writes REVIEW_STATE.json after each round and AUTO_REVIEW.md with round logs.
  • Decision and action planning: scores, verdicts, and concrete fixes guide subsequent experiments.

Quick Start

Configure your llm-chat MCP server or environment variables, then trigger the loop to start autonomous reviews.

Frequently Asked Questions about auto-review-loop-llm

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I automate LLM review cycles for research artifacts?

To automate LLM review cycles, configure an OpenAI-compatible API via llm-chat MCP server or environment variables, then trigger the loop to run iterative review phases until a positive verdict or maximum rounds are reached.

What is an autonomous LLM feedback loop and how does it work?

An autonomous LLM feedback loop is a multi-round process where an AI reviews research artifacts, generates scores and verdicts, implements fixes, and re-reviews. It persists state to JSON after each round to maintain traceability until a positive assessment is achieved.

Can I use any OpenAI-compatible LLM API provider for autonomous research review?

Yes, you can use any OpenAI-compatible LLM API provider. The system supports MCP-based configuration and environment variables, allowing you to plug in your preferred provider to guide fixes and escalation during the autonomous review loop.

How do I configure the llm-chat MCP server for an AI review loop?

You configure the llm-chat MCP server for an AI review loop by setting your preferred LLM provider details in the server configuration or environment variables. This setup enables the autonomous review phases to execute and persist state correctly.

When should I use an autonomous review loop instead of manual LLM review?

Use an autonomous review loop instead of manual LLM review when you need iterative, multi-round assessments with explicit scoring thresholds and state persistence. It is ideal for scaling research artifact validation without continuous human intervention.

Why does the autonomous review loop stop before reaching a positive verdict?

The autonomous review loop stops before a positive verdict when the configured MAX_ROUNDS limit is reached. This constraint prevents infinite cycles, ensuring the review process terminates and outputs the final state logs even if artifacts remain unresolved.