idea-screen

Screens and ranks research ideas via novelty checks, venue reviewer simulation, and strategic fit scoring.

Updated Mar 27, 2026
One-click install
npx skills add https://github.com/megumi-ben/work17 --skill idea-screen-megumi-ben
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: idea-screen
Source: https://github.com/megumi-ben/work17/tree/main/AutoVibeIdea/skills/idea-screen
Command: npx skills add https://github.com/megumi-ben/work17 --skill idea-screen-megumi-ben

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve? Researchers risk investing weeks into ideas that are not novel, would fail peer review, or are strategically unsound. This Skill screens candidate research ideas across three evaluation modules and produces ranked, scored recommendations before any execution effort is committed. ## Core Features & Use Cases - Novelty Assessment: Verifies each idea's core claims against recent literature via multi-source web search, cross-referencing with prior literature survey data, and cross-model verification through an external LLM. - Venue Reviewer Simulation: Simulates a 3-reviewer plus meta-review committee calibrated to a target venue (ICML, VLDB, NeurIPS, or all) to predict whether the executed idea would be accepted. - Strategic Fit Assessment: Scores each idea on five dimensions (longevity, roadmap viability, application grounding, execution uniqueness, iteration readiness) and computes a weighted composite score with PROCEED, PROCEED WITH CAUTION, or ABANDON recommendations. - Use Case: After generating candidate ideas with an idea-generation step, run this Skill to rank them by composite score and receive a detailed screening report plus a ranked summary ready for downstream refinement. ## Quick Start Screen the research ideas in outputs/IDEAS_FILTERED.md against the ICML venue and produce a ranked screening report.

Frequently Asked Questions about idea-screen

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I screen research ideas for novelty before starting a project?

Provide idea descriptions or a file of candidate ideas, and the Skill extracts core claims, searches arXiv and recent conference proceedings, then verifies novelty with an external LLM. Each claim receives a novelty rating with the closest prior work identified.

How does simulated peer review work for research ideas?

The Skill simulates three reviewers with distinct personas plus a meta-reviewer, calibrated to the target venue's standards. Each reviewer gives a verdict from Strong Reject to Strong Accept, which maps to a numeric venue score averaged across reviewers.

Can I evaluate ideas against multiple venues like ICML and VLDB?

Yes. Specify the venue directive with values ICML, VLDB, NeurIPS, or all. Using all runs the reviewer simulation against every available venue profile and produces comparative results. The default venue is ICML.

What happens if all my research ideas score poorly?

If every idea scores below the 5.0 caution threshold, the pipeline does not stop. The top two ideas by composite score are kept with a PROCEED WITH CAUTION recommendation so refinement can still attempt to improve them.

What are the limitations of automated novelty checking?

Novelty assessment depends on search coverage and LLM knowledge, so very recent or niche work may be missed. If web search fails, the assessment falls back to model knowledge only and logs a warning about reduced verification depth.