scholar-evaluation

Evaluate scholarly work across quality dimensions using the ScholarEval methodology.

3|Updated Jan 1, 2026
One-click install
npx skills add https://github.com/kjgarza/marketplace-claude --skill scholar-evaluation-kjgarza
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: scholar-evaluation
Source: https://github.com/kjgarza/marketplace-claude/tree/main/plugins/scholarly-comms-researcher/skills/scholar-evaluation
Command: npx skills add https://github.com/kjgarza/marketplace-claude --skill scholar-evaluation-kjgarza

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes scripts (resource) and references (resource) components.

What problem does it solve?

The ScholarEval framework provides a rigorous, objective method to evaluate scholarly work across multiple quality dimensions, enabling consistent feedback and improvement.

Core Features & Use Cases

  • Systematic evaluation across core dimensions: Problem Formulation, Literature Review, Methodology, Data Collection, Analysis, Results, Writing, and Citations.
  • Structured scoring with actionable feedback, including qualitative observations and quantitative scores.
  • Use Case: Evaluate a research paper to produce a comprehensive assessment and a prioritized improvement plan.

Quick Start

Run the evaluation using the provided scoring workflow: prepare a dimension scores JSON, run the calculate_scores.py script to generate a detailed report, and review the assessment outputs to guide revisions.

Frequently Asked Questions about scholar-evaluation

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I systematically evaluate a research paper for methodology and reproducibility?

A scholarly evaluation framework assesses research papers across core dimensions including problem formulation, methodology, analysis, and citations. It generates structured scoring with qualitative observations and quantitative scores to provide rigorous, objective feedback for improvement.

How do I generate a structured assessment report for academic writing?

To generate an assessment report for academic writing, prepare a dimension scores JSON file and run the calculate_scores.py script. This workflow produces a detailed, evidence-based evaluation report containing qualitative observations and quantitative scores across multiple quality dimensions.

Can I use this scholarly evaluation framework for literature reviews and methodologies?

Yes, you can use this framework to evaluate literature reviews and methodologies. It applies systematically to research papers and scholarly writing across multiple quality dimensions, providing consistent evaluation and actionable feedback regardless of the specific academic document type.

What dimensions are scored when evaluating scholarly work?

The framework scores scholarly work across eight core dimensions: Problem Formulation, Literature Review, Methodology, Data Collection, Analysis, Results, Writing, and Citations. This comprehensive assessment ensures all aspects of academic research are rigorously evaluated using quantitative and qualitative criteria.

What is the best way to get actionable feedback on a research paper?

The best way to get actionable feedback is using a systematic evaluation framework that produces a prioritized improvement plan. By applying structured scoring across core dimensions, it identifies specific areas for revision and generates evidence-based recommendations to enhance your research paper.