assessment-validity-checker

Evaluate assessments for construct validity, reliability, and learning alignment.

583|96|Updated Mar 1, 2026
One-click install
npx skills add https://github.com/GarethManning/claude-education-skills --skill assessment-validity-checker
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: assessment-validity-checker
Source: https://github.com/GarethManning/claude-education-skills/tree/main/skills/curriculum-assessment/assessment-validity-checker
Command: npx skills add https://github.com/GarethManning/claude-education-skills --skill assessment-validity-checker

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Audit a proposed assessment for construct validity, reliability, and alignment to learning objectives. Use when reviewing or quality-assuring assessments before deployment.

Core Features & Use Cases

  • Evaluates construct validity, content validity, reliability, and consequential validity to ensure assessments measure intended learning.
  • Provides actionable recommendations to improve assessment design, marking schemes, and alignment with learning outcomes.
  • Supports both formative and summative assessment validation across subject areas and grade levels.

Quick Start

Provide the assessment description, intended learning, and student level to generate a formal validity analysis.

Frequently Asked Questions about assessment-validity-checker

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I check if an assessment is valid and aligned to learning objectives?

Assessment validity is checked by auditing a proposed test against construct, content, and consequential validity frameworks to ensure it measures intended learning outcomes. Provide the assessment description, intended learning, and student level to generate a formal analysis.

What is consequential validity in educational assessment design?

Consequential validity evaluates the broader impacts and fairness of an assessment on student learning. It is enforced alongside Messick's validity framework and Stobart's concerns to ensure proposed assessments do not produce adverse unintended consequences.

Can I evaluate reliability for both formative and summative classroom tasks?

Reliability evaluation supports both formative and summative assessment validation across various subject areas and grade levels. It applies Brookhart's reliability concepts to check the consistency of classroom tasks, marking schemes, and high-stakes tests.

How do I audit a proposed test for construct validity before deployment?

Auditing construct validity involves reviewing a proposed assessment description alongside its intended learning objectives. The analysis applies Messick's validity framework to return structured recommendations that improve assessment design and marking schemes before deployment.

Does this assessment validation framework work for high-stakes tests and multiple subjects?

Assessment validation applies to classroom tasks across all subjects and grade levels, ranging from formative checks to high-stakes tests. It evaluates construct validity, reliability, and consequential validity regardless of the specific discipline or assessment stakes.

What is the best way to quality-assure an assessment marking scheme?

Quality-assuring a marking scheme involves evaluating its reliability and alignment with learning outcomes. Analyze the proposed assessment description and intended learning to receive actionable recommendations that improve marking consistency and assessment design.