scholar-evaluation

To systematically evaluate research papers, this skill applies the ScholarEval methodology to assess problem formulation, literature reviews, methodology, data collection, analysis, and writing quality across multiple dimensions using detailed criteria and rubrics.

Standardizing academic assessment requires a structured framework that scores research work across dimensions like methodology and data collection. This skill generates detailed qualitative and quantitative evaluations with actionable recommendations for consistent peer review.

Yes, you can calculate aggregate scores for scholarly work evaluation using the included Python script `scripts/calculate_scores.py`, which processes the systematic assessment results generated from the evaluation framework.

Yes, this research evaluation framework explicitly critiques problem formulation and data analysis. It evaluates scholarly work comprehensively, covering literature review, methodology, data collection, results interpretation, and scientific writing quality.

The ScholarEval methodology assesses literature reviews across multiple dimensions including problem formulation, methodology, data collection, analysis, results interpretation, and scholarly writing quality, utilizing detailed criteria found in the evaluation framework.

While this framework provides a systematic approach for methodology critique, it moves beyond subjective assessments by using structured rubrics. It serves as a standardized evaluation tool for journal editors to ensure critical aspects are assessed consistently before peer review.