Skills
.Work. You
Rest

benchclaw-stage2-simulator-gt-materialization

Official

Materialize Ground Truth for simulator tasks in BenchClaw

Software Engineering#benchmarking#task execution#ground truth#simulator#AI training
AuthorEurecaMoment
Version1.0.0
Installs0

System Documentation

What problem does it solve?

BenchClaw's subskill benchclaw-stage2-simulator-gt-materialization addresses the need to generate and manage Ground Truth (GT) for simulator tasks, ensuring that the training and evaluation data for AI models are accurately represented.

Core Features & Use Cases

  • GT Materialization: Generates GT for a specific simulator task family.
  • Input Handling: Accepts various inputs including simulator_id, simulator_card_skill, and task_family.
  • GT Validation: Ensures GT records are correctly associated with the task execution details.
  • Use Case: When a simulator task is executed, this subskill can be dispatched to create GT that will be used for training or evaluation of AI models.

Quick Start

To initiate the Ground Truth materialization for a simulator task, dispatch the skill with the /benchclaw-subskill command, specifying the necessary parameters.

Dependency Matrix

Required Modules

None required

Components

scripts

💻 Claude Code Installation

Recommended: Let Claude install automatically. Simply copy and paste the text below to Claude Code.

Please help me install this Skill:
Name: benchclaw-stage2-simulator-gt-materialization
Download link: https://github.com/EurecaMoment/BenchClaw/archive/main.zip#benchclaw-stage2-simulator-gt-materialization

Please download this .zip file, extract it, and install it in the .claude/skills/ directory.
View Source Repository

Agent Skills Search Helper

Install a tiny helper to your Agent, search and equip skill from 620,000+ vetted skills library on demand.