generate-ready-benchmark-api

Community

Automate ANCHOR benchmark dataset creation and evaluation.

AuthorErrDivine
Version1.0.0
Installs0

System Documentation

What problem does it solve?

This Skill simplifies the process of creating and evaluating ANCHOR benchmark dataset classes, streamlining the workflow for data scientists and researchers.

Core Features & Use Cases

  • Dataset Creation: Automatically implements or updates ANCHOR inference-ready benchmark dataset classes.
  • Registration and Mapping: Ensures that datasets subclass InferenceReadyDataset, register with BenchmarkRegistry, and map Hugging Face rows correctly.
  • Evaluation: Evaluates single model outputs for quality control.
  • Use Case: When a data scientist needs to add a new benchmark to the ANCHOR system, this Skill can be used to ensure that the new dataset is properly formatted and evaluated.

Quick Start

Run the 'generate-ready-benchmark-api' Skill to create a new ANCHOR benchmark dataset.

Dependency Matrix

Required Modules

None required

Components

scripts

💻 Claude Code Installation

Recommended: Let Claude install automatically. Simply copy and paste the text below to Claude Code.

Please help me install this Skill:
Name: generate-ready-benchmark-api
Download link: https://github.com/ErrDivine/LiteCode/archive/main.zip#generate-ready-benchmark-api

Please download this .zip file, extract it, and install it in the .claude/skills/ directory.
View Source Repository

Agent Skills Search Helper

Install a tiny helper to your Agent, search and equip skill from 620,000+ vetted skills library on demand.