evaluation-protocol-checker

Analyze research paper evaluation protocols for research questions, design decisions, and validity threats.

43|2|Updated Apr 5, 2026
One-click install
npx skills add https://github.com/PKU-ASAL/CoPaper-OpenCode --skill evaluation-protocol-checker-pku-asal
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: evaluation-protocol-checker
Source: https://github.com/PKU-ASAL/CoPaper-OpenCode/tree/main/.agents/skills/evaluation-protocol-checker
Command: npx skills add https://github.com/PKU-ASAL/CoPaper-OpenCode --skill evaluation-protocol-checker-pku-asal

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes scripts (resource) and references (resource) components.

What problem does it solve?

This Skill ensures that the evaluation protocol of research papers is thorough and valid, addressing key aspects such as research questions, design decisions, and threats to validity.

Core Features & Use Cases

  • Evaluation Protocol Analysis: Checks the research questions, design decisions, and validity threats of a paper's evaluation protocol.
  • Insight Validation: Assesses whether research questions adequately test the main insight and design decisions.
  • Validity Checks: Identifies and mitigates threats to internal and external validity.
  • Use Case: Use this Skill to verify that your paper's evaluation is rigorous and reliable before submission.

Quick Start

Run the evaluation-protocol-checker skill on your research paper 'paper.md'.

Frequently Asked Questions about evaluation-protocol-checker

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I check the evaluation protocol of a research paper for validity threats?

To check an evaluation protocol, you parse the research paper to ensure research questions test the main insight and design decisions address threats to validity. This automated analysis verifies evaluation rigor before paper submission.

What is evaluation protocol analysis in academic paper review?

Evaluation protocol analysis parses a research paper to assess whether research questions, design decisions, and threats to validity are comprehensively addressed. It ensures research integrity by validating the evaluation's rigor and reliability.

How do I validate research questions against design decisions before submission?

You validate research questions by running an automated analysis on the paper to check if questions adequately test the main insight and align with design decisions. This insight validation ensures the evaluation protocol is structurally thorough.

Can I use automated tools to identify threats to validity in research papers?

Yes, automated analysis identifies and mitigates threats to internal and external validity by parsing structured content in research papers. This process enhances research integrity by ensuring design decisions adequately address potential validity threats.

Does the evaluation protocol analysis require a specific paper format?

The evaluation protocol analysis requires parsing research papers and analyzing structured content, typically using a markdown file like 'paper.md'. It processes this structured text input to check research questions, design decisions, and validity threats.