grading-qa

Inspect grading outputs and summaries for quality issues across directories.

Updated Aug 27, 2026
One-click install
npx skills add https://github.com/AKCqhzdy/dse-subject-grading --skill grading-qa
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: grading-qa
Source: https://github.com/AKCqhzdy/dse-subject-grading/tree/main/skills-v3/grading-qa
Command: npx skills add https://github.com/AKCqhzdy/dse-subject-grading --skill grading-qa

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Phase 8 grading QA provides a structured, repeatable process to validate the accuracy and completeness of grading outputs, reducing risk of inconsistent scoring or missing files.

Core Features & Use Cases

  • Score distribution review: assess mean, median, stddev, and identify anomalies so instructors can trust reported results.
  • Spot-checks: automatically re-validate 2–3 random students via a sub-agent to confirm per-question marks align with rubrics.
  • Output completeness: verify that required files (final_scores.json, qa_summary.md) exist and are up-to-date, and that datasets across output/, rubric/, and extracted/ are coherent.
  • QA summary generation: produce a concise QA summary documenting findings and any remediation steps.

Quick Start

Run the grading-qa process on the current grading batch to generate the qa_summary.md.

Frequently Asked Questions about grading-qa

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
What is grading quality assurance and how does it verify score consistency?

Grading quality assurance systematically validates score consistency by performing random spot-checks on students, assessing score distributions, and verifying output file completeness. It flags significant cross-student disparities to ensure reported results are accurate and reliable.

How do I check if final_scores.json exists and validate grading output completeness?

To validate grading output completeness, the QA process checks that final_scores.json and qa_summary.md exist and are up-to-date. It also verifies data coherence across the output/, rubric/, and extracted/ directories.

How do I perform random spot-checks to confirm per-question marks align with rubrics?

You can perform random spot-checks by running a QA process that selects 2–3 students and uses a sub-agent to re-validate their per-question marks against the grading rubrics, ensuring scoring accuracy and consistency.

Can I assess score distribution anomalies for a yearly grading batch?

Yes, you can assess score distribution anomalies for a yearly grading batch. The QA process calculates mean, median, and standard deviation to identify outliers, helping instructors trust the reported results.

What is the best way to generate a qa_summary.md documenting grading findings?

The best way to generate a qa_summary.md is to run a structured grading QA process on your current batch. It automatically documents all quality findings, cross-student consistency checks, and any necessary remediation steps.

Why does my grading QA process flag significant cross-student disparities?

Your grading QA process flags significant cross-student disparities to enforce consistency requirements. It identifies quality issues where scoring outputs deviate significantly, reducing the risk of inconsistent grading across the dataset.