gad-eval-new-project

Scaffold GAD evaluation projects from design documents into evals directories.

Updated Aug 27, 2026
One-click install
npx skills add https://github.com/B2Gdevs/custom_portfolio --skill gad-eval-new-project
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: gad-eval-new-project
Source: https://github.com/B2Gdevs/custom_portfolio/tree/main/oneoff/raw/skill
Command: npx skills add https://github.com/B2Gdevs/custom_portfolio --skill gad-eval-new-project

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Bootstrap a new GAD evaluation project from source design documents — create the evals/<name>/ directory, convert source docs into a canonical REQUIREMENTS.xml, wire up scoring rubric dimensions (CLI efficiency, skill trigger accuracy, planning quality), and register the project so gad eval list and gad eval run <name> pick it up. Use this skill whenever the user says they want to add a new eval, turn this design doc into an eval, create an eval project from X, scaffold escape-the-dungeon / portfolio-bare / any new eval, or mentions feeding GAMEPLAY-DESIGN / REQUIREMENTS / spec documents into the GAD eval harness. Trigger even if the user doesn't say the exact word eval — any request that involves taking a spec and producing a testable, traceable GAD eval project should use this skill. Do NOT use for running an already-registered eval (that's gad eval run) or preserving completed outputs (that's gad eval preserve).

Core Features & Use Cases

  • Create evals/<name>/ structure with gad.json, REQUIREMENTS.xml, SCORING.md, and NOTES.md.
  • Reference source documents in REQUIREMENTS.xml and wire up the four canonical scoring dimensions.
  • Provide a NOTEs and gap notes to guide run and preservation processes.

Quick Start

Create a new eval scaffold named <project-name> from the provided design documents and register it with gad eval list.

Frequently Asked Questions about gad-eval-new-project

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I scaffold a new eval project from a design document?

Scaffolding a new eval project requires ingesting source design documents to automatically generate the evals/<name>/ directory structure containing gad.json, REQUIREMENTS.xml, SCORING.md, and NOTES.md, then registering it for discovery.

What is a REQUIREMENTS.xml file used for in eval project setup?

A REQUIREMENTS.xml file captures your ingested source design documents as traceable references and defines the canonical structure for the evaluation. It is automatically generated in the evals/<name>/ directory during project setup.

How do I set up scoring rubrics for a new testable eval project?

Setting up scoring rubrics for a testable eval project involves wiring up canonical scoring dimensions like CLI efficiency, skill trigger accuracy, and planning quality into the generated SCORING.md file during the scaffolding process.

Can I turn a gameplay design spec into a traceable GAD eval?

Yes, you can turn a gameplay design spec into a traceable GAD eval by feeding the spec documents into the scaffolding process, which converts them into a canonical REQUIREMENTS.xml and registers the project for future execution.

Does scaffolding an eval project also execute the evaluation run?

No, scaffolding an eval project does not execute the evaluation run. It only registers the project structure for discovery via gad eval list so that future gad eval run commands can execute it separately.

When should I not use eval project scaffolding?

You should not use eval project scaffolding if you intend to run an already-registered eval or preserve completed outputs, as this process is strictly for bootstrapping new projects from source design documents.