assessment-validity-checker

Evaluate assessments for validity, reliability, and alignment with learning objectives.

Updated Jun 14, 2026
One-click install
npx skills add https://github.com/vvieira010-pixel/education-agent-skills --skill assessment-validity-checker-vvieira010-pixel
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: assessment-validity-checker
Source: https://github.com/vvieira010-pixel/education-agent-skills/tree/main/Users/vviei/education-agent-skills-main/skills/curriculum-assessment/assessment-validity-checker
Command: npx skills add https://github.com/vvieira010-pixel/education-agent-skills --skill assessment-validity-checker-vvieira010-pixel

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

This Skill helps educators identify whether an assessment truly measures its intended learning goals by uncovering validity, reliability, and fairness issues before deployment.

Core Features & Use Cases

  • Validity Analysis: Reviews assessments for construct validity, content alignment, construct-irrelevant variance, and underrepresentation of learning.
  • Reliability Review: Evaluates marking approaches, scoring consistency, and potential sources of disagreement between assessors.
  • Use Case: A teacher designing a science assessment can use this Skill to check whether the task measures scientific understanding rather than unrelated writing ability, presentation skills, or resource access.

Quick Start

Ask the assessment validity checker to evaluate my proposed assessment for validity, reliability, and alignment with my intended learning objectives.

Frequently Asked Questions about assessment-validity-checker

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I check if my assessment measures the intended learning objectives?

Assessment validity is determined by analyzing construct validity, content alignment, and scoring consistency. This Skill evaluates whether assessment tasks measure intended learning objectives or introduce construct-irrelevant variance, providing actionable improvement recommendations.

What is construct-irrelevant variance in classroom assessment design?

Construct-irrelevant variance occurs when an assessment measures unrelated factors like writing ability instead of the target construct. This Skill detects construct-irrelevant variance, underrepresentation, and content misalignment to improve curriculum design and classroom assessment quality.

How do I review assessment reliability and scoring consistency?

Assessment reliability is reviewed by evaluating marking approaches and potential sources of disagreement between assessors. This Skill analyzes scoring consistency to identify reliability issues in classroom assessment review and educational measurement scenarios before deployment.

Can I use this for curriculum design and quality assurance?

Yes, this Skill applies to curriculum design, classroom assessment review, and quality assurance scenarios. It evaluates assessment validity and reliability by identifying whether assessments measure intended learning objectives and constructs across these educational measurement contexts.

What are the limitations of automated assessment validity evaluation?

Automated assessment validity evaluation requires structured assessment analysis across validity, reliability, and consequential effects. This Skill's evaluation depth depends on receiving well-structured assessment data and clear intended learning objectives to generate actionable improvement recommendations.