scholar-evaluation

Evaluate scholarly work across multiple quality dimensions using the ScholarEval framework.

1|Updated Jan 26, 2026
One-click install
npx skills add https://github.com/Victory-Hugo/S2-Agent-Skill --skill scholar-evaluation-victory-hugo
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: scholar-evaluation
Source: https://github.com/Victory-Hugo/S2-Agent-Skill/tree/main/skills/writing/scholar-evaluation
Command: npx skills add https://github.com/Victory-Hugo/S2-Agent-Skill --skill scholar-evaluation-victory-hugo

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes scripts (resource) and references (resource) components.

What problem does it solve?

ScholarEval provides a rigorous, repeatable framework to evaluate scholarly work across multiple quality dimensions, enabling objective feedback, structured improvement guidance, and publication-ready insights.

Core Features & Use Cases

  • Dimension-based assessment across problem formulation, literature review, methodology, data collection, analysis, results, writing, and citations.
  • Automated reporting: generates both qualitative feedback and a quantitative overall score; supports comparison across drafts.
  • Use Case: Evaluate a research paper, a grant proposal, or a literature review to identify gaps, strengths, and actionable revisions, then generate a balanced feedback report.

Quick Start

  1. Prepare a scores.json containing dimension scores (keys: problem_formulation, literature_review, methodology, data_collection, analysis, results, writing, citations) with values 1-5.
  2. Run: python scripts/calculate_scores.py --scores scores.json
  3. (Optional) Provide custom weights: python scripts/calculate_scores.py --scores scores.json --weights weights.json --output report.txt
  4. Review the generated report on stdout or in report.txt. For interactive scoring, run: python scripts/calculate_scores.py --interactive

Frequently Asked Questions about scholar-evaluation

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I evaluate a research paper across multiple quality dimensions?

Evaluating a research paper requires scoring dimensions like problem formulation, methodology, data collection, and citations from 1-5. The framework then calculates a weighted score and generates structured qualitative feedback.

What is ScholarEval framework assessment for academic writing?

ScholarEval framework assessment for academic writing is a systematic method to provide structured, multi-dimension evaluations. It identifies gaps, strengths, and actionable revisions to generate publication-ready insights and balanced feedback reports.

How do I generate a weighted evaluation report for a literature review?

To generate a weighted evaluation report for a literature review, prepare a scores.json file with dimension ratings, then run the calculation script with custom weights. The tool outputs both a quantitative score and qualitative feedback to stdout or a text file.

Can I use this academic evaluation framework for grant proposals?

Yes, this academic evaluation framework supports grant proposals. It systematically assesses proposals across dimensions like problem formulation, methodology, and data collection to identify gaps and provide actionable revision guidance.

Do I need to prepare a scores file before running the scholarly evaluation script?

Yes, you need to prepare a scores.json file containing dimension scores from 1-5 before running the script. Alternatively, you can run the calculation script in interactive mode to input scores directly without predefining a file.

What are the limitations of automated methodology assessment for scholarly work?

Automated methodology assessment limitations include relying on manual dimension scoring from 1-5 rather than autonomous reading. The framework requires pre-populated scores to calculate weighted results, meaning users must manually evaluate the text beforehand.