grading-reference-calibration

Iterative rubric calibration grades reference students, analyzes score gaps, and refines criteria across multiple rounds. It generates reference scores, gap analyses, and an updated grading guide to ensure accurate and consistent assessment outcomes.

Rubric calibration requires reference mapping files, reference student PDFs, and a rubric draft. The workflow reads these inputs to generate reference scores, per-level analysis, gap documents, and an updated grading guide.

Rubric calibration generates reference_scores.json, reference_calibration.md, per_level_analysis.md, rubric_gaps.md, rubric_refinements.md, and an updated grading_guide.md. These artifacts document scores, gaps, and refinements.

Yes, rubric calibration supports resume-safe operation using atomic writes and round-based calibration directories. This allows the process to recover from interruptions and continue from the last completed round.

Discrimination checks in rubric refinement analyze per-level performance and identify rubric gaps. The process refines criteria based on reference scores to ensure the rubric accurately distinguishes between different performance levels.