benchclaw-stage4-grey-batch-validation
OfficialAutomate grey-batch validation for BenchClaw benchmarks.
Software Engineering#benchmark validation#benchclaw#grey batch#cdm irt analysis#benchmark quality assurance
AuthorEurecaMoment
Version1.0.0
Installs0
System Documentation
What problem does it solve?
This Skill automates the grey-batch validation process for BenchClaw benchmarks, allowing users to efficiently evaluate the quality and reliability of their benchmark items.
Core Features & Use Cases
- Small-Batch Evaluation: Automates the evaluation of small batches of benchmark items, including synthesis, screening, and analysis.
- CDM/IRT Analysis: Performs CDM/IRT analysis on the evaluated items to estimate difficulty, discrimination, and capability mastery.
- Use Case: When you have a set of grey-batch items that need to be validated before full synthesis, this Skill can help you ensure their quality and prepare them for further analysis.
Quick Start
Run the benchclaw-stage4-grey-batch-validation skill to evaluate the grey-batch items for the current benchmark.
Dependency Matrix
Required Modules
opencodebenchclaw
Components
scriptsreferences
💻 Claude Code Installation
Recommended: Let Claude install automatically. Simply copy and paste the text below to Claude Code.
Please help me install this Skill: Name: benchclaw-stage4-grey-batch-validation Download link: https://github.com/EurecaMoment/BenchClaw/archive/main.zip#benchclaw-stage4-grey-batch-validation Please download this .zip file, extract it, and install it in the .claude/skills/ directory.
Agent Skills Search Helper
Install a tiny helper to your Agent, search and equip skill from 620,000+ vetted skills library on demand.