kaggle-benchmarks
OfficialCreate and evaluate AI benchmarks with ease.
Software Engineering#benchmarking#AI evaluation#task definition#large language models#model assessment
AuthorKaggle
Version1.0.0
Installs0
System Documentation
What problem does it solve?
This Skill empowers AI coding agents to write and evaluate benchmark tasks for AI models, ensuring reproducibility and robust evaluation.
Core Features & Use Cases
- Benchmark Task Creation: Define custom tasks using decorators and structured outputs.
- Model Evaluation: Interact with various large language models and assert correctness of outputs.
- Use Case: Design a benchmark to test a model's ability to answer mathematical questions, ensuring it provides accurate and relevant responses.
Quick Start
Use the kaggle-benchmarks skill to create a new benchmark task that evaluates a model's math skills.
Dependency Matrix
Required Modules
kaggle_benchmarks
Components
scriptsreferences
💻 Claude Code Installation
Recommended: Let Claude install automatically. Simply copy and paste the text below to Claude Code.
Please help me install this Skill: Name: kaggle-benchmarks Download link: https://github.com/Kaggle/kaggle-benchmarks/archive/main.zip#kaggle-benchmarks Please download this .zip file, extract it, and install it in the .claude/skills/ directory.
Agent Skills Search Helper
Install a tiny helper to your Agent, search and equip skill from 620,000+ vetted skills library on demand.