idea-refine

Refines rough research ideas into venue-ready proposals via iterative external LLM review.

Updated Mar 27, 2026
One-click install
npx skills add https://github.com/megumi-ben/work17 --skill idea-refine-megumi-ben
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: idea-refine
Source: https://github.com/megumi-ben/work17/tree/main/AutoVibeIdea/skills/idea-refine
Command: npx skills add https://github.com/megumi-ben/work17 --skill idea-refine-megumi-ben

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve? Turning a rough research idea into a concrete, focused, venue-ready proposal is hard: ideas drift from the original problem, accumulate unnecessary modules, and lack method-level specificity. This Skill runs a structured multi-round refinement loop that anchors the problem, extracts a logical skeleton, and uses an external LLM reviewer to stress-test each revision. ## Core Features & Use Cases - Problem Anchor + Skeleton Extraction: Freezes the immutable bottom-line problem and maps the logical path a reviewer must follow, preventing drift across revision rounds. - Iterative External Review Loop: Sends proposals to GPT-5.4 via Codex MCP for 7-dimension scored reviews (problem fidelity, method specificity, contribution quality, frontier leverage, feasibility, validation focus, venue readiness), then revises until score >= 9 or max 3 rounds. - Full Audit Trail: Saves skeleton, per-round proposals and reviews, score history, review summary, final proposal, and refinement report to refine-logs/. - Use Case: A researcher has a vague idea like "use LLMs to improve retrieval in robotics." Run this Skill to produce a focused proposal with one dominant mechanism-level contribution, a concrete training recipe, and an evaluation sketch ready for a top venue. ## Quick Start Ask the AI to refine your research idea by saying: refine this idea into a venue-ready proposal, followed by your problem description and rough approach.

Frequently Asked Questions about idea-refine

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I turn a rough research idea into a concrete proposal?

Provide your problem description and rough approach as the argument. The Skill freezes a Problem Anchor, extracts a logical skeleton, scans local papers for grounding, writes an initial proposal, then iterates with external LLM review until the proposal reaches a score of 9 or hits 3 rounds.

How does iterative LLM review improve a research proposal?

Each round, GPT-5.4 scores the proposal on 7 weighted dimensions including method specificity and contribution quality. The Skill diagnoses the top 2 issues, checks skeleton gaps, revises the full proposal, and re-submits it in the same review thread for re-scoring.

What happens if the Codex MCP reviewer is unavailable?

The Skill falls back to Claude performing the review itself using the same 7-dimension prompt, logs a warning about reduced objectivity, and lowers the score threshold from 9 to 8. The pipeline continues without stopping or asking the user.

What output files does the idea refinement process produce?

All artifacts go to refine-logs/: skeleton.md, round-N proposals and reviews, score-history.md, REVIEW_SUMMARY.md, FINAL_PROPOSAL.md, and REFINEMENT_REPORT.md. The final proposal is a clean document without review chatter.

What are the limitations of automated research idea refinement?

The loop caps at 3 rounds to control context size, so proposals may converge at a REVISE verdict below the score threshold; in that case the best-scoring version is used. Review quality also depends on the reviewer model and available local grounding papers.