auto-review-loop

Automate iterative research-code review and repair until acceptance criteria are met.

2|1|Updated Apr 19, 2026
One-click install
npx skills add https://github.com/raja21068/AutoResearch --skill auto-review-loop-raja21068
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: auto-review-loop
Source: https://github.com/raja21068/AutoResearch/tree/main/skills/aris/auto-review-loop
Command: npx skills add https://github.com/raja21068/AutoResearch --skill auto-review-loop-raja21068

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

It helps teams turn a draft research output into a submission-ready artifact by repeatedly running an external reviewer, implementing the reviewer’s fixes, and re-checking progress until the work earns a positive acceptance decision.

Core Features & Use Cases

  • Autonomous multi-round review loop: Conducts review → parses score/verdict → produces a prioritized fix plan → executes fixes → re-reviews until a threshold is met or MAX_ROUNDS is reached.
  • Deterministic, execution-grounded repair: Applies concrete changes across code, experiments, analysis, figures, and documentation rather than only revising the narrative.
  • Reviewer modes for different risk profiles: Supports MCP-based review with thread persistence (medium/hard) or adversarial repo-reading verification (nightmare) for stricter scrutiny.
  • State recovery and audit trail: Persists progress in REVIEW_STATE.json, appends verbatim reviewer outputs to cumulative logs, and maintains traceability for each round.

Quick Start

Run the auto-review loop for your topic by calling: /auto-review-loop "topic".

Frequently Asked Questions about auto-review-loop

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How does automated iterative peer review work for research pipelines?▼

Automated iterative peer review repeatedly obtains an external review, implements the minimum recommended fixes across code and documentation, and re-submits the updated work for re-assessment until a score threshold is met.

How do I set up an autonomous review loop to fix and re-review research code?▼

You set up an autonomous review loop by defining YAML parameters for round limits and stop conditions, then running the process to parse reviewer verdicts, execute fixes, and re-check progress until submission-ready.

Can I use codex exec for adversarial repo-reading verification in my review loop?▼

Yes, you can route reviewer verification via codex exec for adversarial repo-reading scrutiny, or use Codex MCP for review with thread persistence to match different risk profiles.

What is the best way to ensure experiments and metrics are consistent before submission?▼

The best way to ensure consistency is using deterministic, execution-grounded repair that applies concrete changes across experiments, metrics, analysis, and figures rather than only revising the narrative.

How does state recovery work if an automated multi-round review loop is interrupted?▼

State recovery works by persisting progress in REVIEW_STATE.json and appending verbatim reviewer outputs to cumulative logs, maintaining full traceability and allowing the review loop to resume from the last saved round.

What are the limitations of using a maximum rounds stop condition for research verification?▼

The limitation is that reaching the MAX_ROUNDS threshold stops the loop regardless of acceptance status, meaning work that fails to earn a positive decision within the round limit will exit the review cycle unfinished.