benchclaw-stage4-cdm-irt-analysis

Name: benchclaw-stage4-cdm-irt-analysis
Availability: InStock
Author: EurecaMoment

Analyze item-level scores for IRT/CDM diagnostics from grey-batch validation results.

Updated May 7, 2026

Search Tags:#data analysis #cdm #model diagnostics #irt #grey-batch validation

Ready to run

npx skills add https://github.com/EurecaMoment/BenchClaw --skill benchclaw-stage4-cdm-irt-analysis

💬 Prompt for ChatGPT / Claude Chat▼

Please help me install this Agent Skill.
Skill: benchclaw-stage4-cdm-irt-analysis
Source: https://github.com/EurecaMoment/BenchClaw/tree/main/BenchClaw/skills/benchmark-stage4-build/skills/grey-batch-validation/subskills/cdm-irt-analysis
Command: npx skills add https://github.com/EurecaMoment/BenchClaw --skill benchclaw-stage4-cdm-irt-analysis

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires subskill_invocation, and includes scripts (resource) components.

What problem does it solve?

This Skill addresses the challenge of performing item response theory (IRT) and cognitive diagnosis model (CDM) analyses on grey-batch validation results, allowing for detailed diagnostic checks on the performance of a model's ability.

Core Features & Use Cases

IRT/CDM Diagnostics: Provides analysis of score matrices from grey-batch validations to estimate item difficulty, discrimination, and model ability.
Subskill Activation: Designed as a subskill within the larger BenchClaw benchmark pipeline, requiring explicit dispatch via /benchclaw-subskill command.
Use Case: In the context of a benchmark's grey-batch validation phase, use this Skill to diagnose issues in small-batch model responses and ensure data quality before full synthesis.

Quick Start

To execute the analysis, ensure you're running in the appropriate sub-agent context, then invoke the skill with /benchclaw-subskill <SKILL_PATH> <Skill_Name> <Project_Root> <Node_ID> <Input_Artifact> <Output_Artifact> <DAG_Dependency>.

Frequently Asked Questions about benchclaw-stage4-cdm-irt-analysis

High-intent search queries and answers about installing and using this skill.

FAQPage Schema

How do I run IRT and CDM diagnostics on item-level scores from a grey-batch validation?▼

To run IRT and CDM diagnostics on item-level scores, you must dispatch this analysis as a subskill within a benchmark pipeline using the `/benchclaw-subskill` command, passing the appropriate project root, node ID, and artifact paths.

What does IRT difficulty and discrimination analysis check during model validation?▼

IRT difficulty and discrimination analysis evaluates item-level score matrices to estimate model ability and item performance, diagnosing quality control issues in small-batch model responses before full benchmark synthesis.

Can I use this IRT diagnostic tool directly or do I need a sub-agent context?▼

You need a sub-agent context to use this IRT diagnostic tool, as it is designed specifically as a subskill that requires explicit dispatch via the `/benchclaw-subskill` command rather than standalone execution.

When should I perform cognitive diagnosis model analysis before a full benchmark synthesis?▼

You should perform cognitive diagnosis model analysis during the grey-batch validation phase to diagnose issues in small-batch model responses and ensure data quality prior to executing full benchmark synthesis.

What parameters do I need to pass when invoking the IRT analysis subskill command?▼

When invoking the IRT analysis subskill command, you must pass the skill path, skill name, project root, node ID, input artifact, output artifact, and DAG dependency parameters to execute the diagnostic analysis correctly.