research-refine

Refines vague research directions into concrete method proposals via iterative external LLM review.

75|7|Updated May 2, 2026
One-click install
npx skills add https://github.com/zjunlp/Mechanist --skill research-refine-zjunlp
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: research-refine
Source: https://github.com/zjunlp/Mechanist/tree/main/skills/research-refine
Command: npx skills add https://github.com/zjunlp/Mechanist --skill research-refine-zjunlp

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve? Researchers often have a clear problem but only a vague technical approach, leading to bloated proposals, contribution sprawl, or methods that drift away from the original bottleneck. This Skill turns a fuzzy research direction into a focused, implementation-ready method plan through structured, multi-round external critique. ## Core Features & Use Cases - Problem Anchor Freezing: Extracts and locks an immutable problem statement (bottleneck, non-goals, constraints, success criteria) that is reused in every refinement round to prevent drift. - Iterative External Review Loop: Sends proposals to an external LLM reviewer (llm-chat MCP) for strict scoring across 7 dimensions, then revises until the score reaches 9 or the round cap is hit. - Checkpoint Recovery: Persists state to REFINE_STATE.json after each phase so interrupted sessions can resume within 24 hours without losing completed work. - Use Case: A PhD student has a rough idea for improving mechanistic interpretability probing. They run the skill, which scans local papers, drafts a focused method proposal, gets it critiqued by an external reviewer, and iterates until the plan is sharp enough to hand off to experiment planning. ## Quick Start Ask the assistant to refine your research approach by describing your problem and current vague method idea, for example by invoking the research-refine skill with your problem statement and draft approach.

Frequently Asked Questions about research-refine

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I refine a vague research idea into a concrete method plan?

Provide your problem statement and rough approach to the research-refine skill. It freezes a Problem Anchor, scans local papers for grounding, drafts a focused proposal, and iterates with an external LLM reviewer until the plan scores 9/10 or reaches 5 rounds.

What external tools does research-refine require to run?

The skill requires the llm-chat MCP server as the external reviewer backend, with the model configured via the LLM_MODEL environment variable. It also uses standard tools like Read, Write, Bash, WebSearch, and WebFetch for grounding and file output.

Can research-refine resume after an interrupted session?

Yes. The skill writes a REFINE_STATE.json checkpoint after each phase. If the state file is less than 24 hours old and marked in_progress, the run resumes from the last completed phase; older or completed states trigger a fresh start.

What happens when the reviewer score stays below the threshold?

The loop stops after 5 rounds maximum. The skill still writes the best current proposal to FINAL_PROPOSAL.md along with a refinement report listing remaining weaknesses, and suggests next steps such as re-running refinement or revisiting the core mechanism.

When should I not use research-refine for my research idea?

Avoid it when the research problem itself is not yet defined, since the skill assumes a visible problem with a fuzzy technical route. For open-ended ideation, use an idea-generation skill first, then hand the result to research-refine.