idea-evaluator

Evaluates research ideas against a five-dimension scoring framework with fatal-flaw audits and verdicts.

609|50|Updated Jul 7, 2026
One-click install
npx skills add https://github.com/poco-ai/Agentero --skill idea-evaluator-poco-ai
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: idea-evaluator
Source: https://github.com/poco-ai/Agentero/tree/main/templates/vault/.agents/skills/idea-evaluator
Command: npx skills add https://github.com/poco-ai/Agentero --skill idea-evaluator-poco-ai

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes references (resource) components.

What problem does it solve? Deciding whether a research idea is worth months of effort is hard: weak novelty, capability mismatches, and hidden fatal flaws often surface only after heavy investment. This Skill evaluates a draft research idea like a top-venue reviewer and advisor, killing weak ideas early and sharpening promising ones before writing begins. ## Core Features & Use Cases - Five-Dimension Scoring: Scores ideas on Higher, Faster, Stronger, Cheaper, and Broader axes with evidence-grounded rubrics, plus substitute frameworks for humanities, social science, finance, and law. - Fatal-Flaws Audit: Detects ten canonical fatal flaws (no novelty, wrong venue, capability mismatch, and more) with severity tagging and concrete defense strategies; CRITICAL flaws short-circuit to a Reject and Pivot verdict. - Lifecycle and Paradigm-Shift Analysis: Matches the idea's lifecycle against the user's weekly hours, skills, and infrastructure, and probes disruptive potential via First Principles, Elephant in the Room, Technology Cycle, and Hamming's Rule. - Use Case: A PhD student with a draft Text-to-SQL agent idea asks whether it is worth pursuing; the Skill scores all dimensions, checks feasibility against their GPU budget and 20 weekly hours, and returns a verdict with the top three actions to take first. ## Quick Start Ask the assistant to evaluate your draft research idea, including your available hours, skills, and compute resources, and request a scored verdict.

Frequently Asked Questions about idea-evaluator

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I evaluate whether a research idea is worth pursuing?

Submit your draft idea along with your weekly available hours, skill profile, and compute resources. The evaluation scores the idea on five dimensions, audits fatal flaws, checks lifecycle fit, and returns one of three verdicts with the top three actions to take first.

What are the most common fatal flaws in research ideas?

The ten canonical flaws include no novelty versus prior work, wrong venue fit, outdated baselines, weak motivation, capability mismatch, unverifiable claims, data-access blockers, oversized scope, solution-hunting, and ignoring failure cases. Any CRITICAL flaw triggers a Reject and Pivot verdict.

Can this evaluate non-STEM research ideas like humanities or economics?

Yes. Ideas are classified by research method, not department. Humanities and empirical social science use dimensions like theoretical contribution and explanatory power, while finance and economics use identification quality, economic magnitude, and policy relevance, each with substitute fatal flaws.

When should I not use idea evaluation for my research?

Skip it if you have already implemented the idea and are writing the paper, if you want open-ended brainstorming of new ideas from scratch, or if you need a review of an existing manuscript. It is designed for pre-commitment decisions on draft ideas.

How are novelty claims verified during idea evaluation?

When a literature-search capability is available, keyword groups are extracted from the idea and the three to five closest published works are named with the axis that actually differs. Without retrieval, novelty judgments are labeled unverified and flagged for a manual literature check.