research-output-evaluation

Evaluates research paper portfolios using multi-dimensional quality metrics and traceable statistics.

6|1|Updated May 11, 2026
One-click install
npx skills add https://github.com/yakeworld/Synthos --skill research-output-evaluation-yakeworld
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: research-output-evaluation
Source: https://github.com/yakeworld/Synthos/tree/main/skills/private/research/research-output-evaluation
Command: npx skills add https://github.com/yakeworld/Synthos --skill research-output-evaluation-yakeworld

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve? Research teams accumulate large paper portfolios without knowing which outputs are near publishable quality and which should be revised or archived. This Skill produces a cross-validated evaluation report where every number is traceable to source data, preventing decisions based on single scores or fabricated statistics. ## Core Features & Use Cases - Multi-Dimensional Cross-Validation: Combines quality gate status (PASS/CONDITIONAL/FAIL), tier grades (T1–T4), and D10a citation coverage instead of relying on a single quality score. - Compound-Threshold Filtering: Identifies the small set of core assets meeting strict criteria (T1+T2 and D10a≥95%) and separates factual measurements from inferred estimates. - Disposition Classification & Data Honesty: Labels each low-quality output as needing major revision or archival, counts zombie citations per paper without folding them into means, and rejects unsourced numbers with recovery suggestions. - Use Case: Given a directory of 98 papers with mixed .tex/PDF availability and quality scores, produce a report showing gate distribution, missing-data statistics, the 10–15 near-publishable papers, and per-paper disposition labels. ## Quick Start Evaluate this directory of research papers and produce a multi-dimensional quality report with gate distribution, core asset filtering, and per-paper disposition labels.

Frequently Asked Questions about research-output-evaluation

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I evaluate the quality of a large research paper portfolio?

Cross-validate multiple metrics per paper: quality gate status, tier grade (T1–T4), and D10a citation coverage, rather than relying on a single score. Then apply a compound threshold such as T1+T2 with D10a≥95% to isolate the few near-publishable papers.

How to handle papers missing quality scores or PDF files in evaluation?

Count missing inputs separately and exclude them from distribution denominators instead of mixing them into main statistics. For example, papers without a quality_score must not be included when computing the mean, and the denominator should be stated explicitly.

What is a zombie citation and how should it be counted?

A zombie citation is a reference that cannot be traced to a valid source. Each zombie citation should be counted and attributed to its specific paper, never folded into aggregate quality score means where it would distort the average.

Why should evaluation reports separate facts from inferences?

Measured statistics like gate distributions are directly reproducible from data, while claims such as how many papers use real clinical data are estimates. Labeling inferences with uncertainty prevents downstream decisions based on unverified assumptions.

What happens when an evaluation report contains unsourced numbers?

The Skill rejects any number that cannot be recomputed from the input data, such as a mean that includes papers lacking scores. It returns the rejection reason, the corrected statistic with its valid denominator, and recovery suggestions like rerunning the quality gate.