scholar-evaluation

Score scholarly works across eight dimensions using a standardized rubric.

7|1|Updated Jan 25, 2026
One-click install
npx skills add https://github.com/daidong/PiPilot --skill scholar-evaluation-daidong
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: scholar-evaluation
Source: https://github.com/daidong/PiPilot/tree/main/lib/skills/builtin/scholar-evaluation
Command: npx skills add https://github.com/daidong/PiPilot --skill scholar-evaluation-daidong

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes scripts (resource) and references (resource) components.

What problem does it solve?

Systematic scholarly evaluation is essential for consistent, credible critique. This skill provides a standardized framework to assess research outputs across key quality dimensions, delivering structured feedback and a clear overall score.

Core Features & Use Cases

  • Dimension-based scoring: Applies the ScholarEval framework across eight dimensions (problem formulation, literature review, methodology, data collection, analysis, results, writing, and citations) and outputs a cohesive quality assessment.
  • Detailed reporting: Generates an overall score, qualitative level, bar-chart visualization, and a detailed breakdown with weighted contributions and prioritized recommendations.
  • Use cases: Suitable for evaluating research papers, proposals, literature reviews, and scholarly articles to guide revisions, grant submissions, and editorial decisions.

Quick Start

Run the evaluator on a manuscript by providing dimension scores and optional weights to generate a full assessment.

Frequently Asked Questions about scholar-evaluation

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I evaluate a research paper using a standardized rubric?

To evaluate a research paper using a standardized rubric, score the manuscript across eight scholarly dimensions and provide the results as a JSON file. The framework processes these dimension scores alongside optional weights to generate an overall quality assessment, detailed breakdown, and bar-chart visualization.

What is structured scholarly evaluation and when do I need it?

Structured scholarly evaluation systematically assesses research outputs across key quality dimensions like methodology and literature review. You need this standardized framework when you require consistent, credible critique to guide manuscript revisions, grant submissions, or editorial decisions.

Can I apply custom weighting to specific dimensions in a manuscript assessment?

Yes, you can apply custom weighting to specific dimensions in a manuscript assessment by providing an optional weights file alongside the required JSON file of dimension scores. The evaluator uses these weights to calculate a detailed breakdown of weighted contributions for the final quality report.

Does the scholarly evaluation framework work for literature reviews and proposals?

Yes, the scholarly evaluation framework works for literature reviews and proposals. It is designed to assess various scholarly works including research papers, proposals, literature reviews, and scholarly manuscripts by applying the ScholarEval framework across eight scoring dimensions.

How do I generate a visual report from academic writing dimension scores?

You generate a visual report from academic writing dimension scores by inputting your JSON file of scores into the evaluator. The skill outputs a full assessment that includes an overall score, qualitative level, detailed breakdown, and an ASCII bar chart visualization.

What is the best way to critique a research paper systematically?

The best way to critique a research paper systematically is to use a rubric-based framework that scores eight dimensions ranging from problem formulation to citations. This approach produces structured feedback with prioritized recommendations rather than relying on unstructured peer review.