Scholar Evaluation

Evaluate scholarly work across eight defined dimensions with scoring rubrics.

557|98|Updated Nov 7, 2025

Search Tags:#evaluation #framework #academic writing #peer review #scholarship #research quality

Ready to run

npx skills add https://github.com/jimmc414/Kosmos --skill scholar-evaluation-jimmc414

💬 Prompt for ChatGPT / Claude Chat▼

Please help me install this Agent Skill.
Skill: Scholar Evaluation
Source: https://github.com/jimmc414/Kosmos/tree/main/kosmos-reference/kosmos-claude-scientific-writer/.claude/skills/scholar-evaluation
Command: npx skills add https://github.com/jimmc414/Kosmos --skill scholar-evaluation-jimmc414

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires json, argparse, sys, typing, pathlib, and includes scripts (resource) and references (resource) components.

What problem does it solve?

This Skill provides a structured, systematic methodology for evaluating the quality and rigor of scholarly work, addressing the need for objective and comprehensive academic assessment.

Core Features & Use Cases

Dimension-Based Evaluation: Assesses work across 8 key dimensions (Problem Formulation, Literature Review, Methodology, Data Collection, Analysis, Results, Writing, Citations).
Scoring and Feedback: Generates qualitative assessments, quantitative scores, and actionable feedback.
Use Case: A researcher can use this Skill to evaluate a draft manuscript, identify strengths and weaknesses across all critical academic criteria, and receive prioritized recommendations for improvement before submission.

Quick Start

Use the Scholar Evaluation skill to evaluate the attached research paper using the comprehensive dimension-based assessment.

Frequently Asked Questions about Scholar Evaluation

High-intent search queries and answers about installing and using this skill.

FAQPage Schema

How do I evaluate a research paper systematically before peer review?▼

To evaluate a research paper systematically, apply the ScholarEval framework to assess eight dimensions including problem formulation, methodology, and citations. This generates quantitative scores and actionable feedback to identify manuscript strengths and weaknesses.

What criteria should I use for academic writing evaluation of a draft manuscript?▼

Academic writing evaluation criteria should cover problem formulation, literature review, methodology, data collection, analysis, results, writing quality, and citations. Using a structured rubric across these dimensions ensures comprehensive assessment and prioritized improvement recommendations.

Can I score research quality objectively using a structured framework?▼

Yes, you can score research quality objectively by applying a structured evaluation framework with defined criteria and scoring rubrics. This process yields both qualitative assessments and quantitative scores for research papers and literature reviews.

Does peer review evaluation require specific software dependencies?▼

Peer review evaluation using this framework supports optional script-based score calculation requiring standard Python libraries like json, argparse, and sys. The core dimension-based assessment can function without these dependencies.

What is the best way to assess a research proposal's methodology and data collection?▼

The best way to assess a research proposal's methodology and data collection is using a dimension-based evaluation framework. This systematically scores specific criteria within these dimensions, providing actionable feedback to improve research quality.