project-evals

Official

Create robust evals to validate guidance quality.

AuthorGoogleChrome
Version1.0.0
Installs0

System Documentation

What problem does it solve?

This skill solves the problem of unvalidated web guidance that may fail to produce correct, modern implementations when used by coding agents, ensuring guidance is reliable and effective before deployment.

Core Features & Use Cases

  • Eval File Authoring: Guides you to write compliant expectations.md, grader.ts, and tasks/task.md files aligned with eval pipeline requirements.
  • Grader Calibration: Helps you use the gd dev tool to generate, test, and fine-tune Playwright-based graders against reference and anti-example implementations.
  • Use Case: When authoring a new guidance for a modern web feature (e.g., Dialog API, View Transitions), use this skill to create evals that confirm coding agents implement the guidance correctly when given realistic developer prompts.

Quick Start

Use this skill to author and calibrate evaluation files for your new web guidance use case.

Dependency Matrix

Required Modules

None required

Components

Standard package

💻 Claude Code Installation

Recommended: Let Claude install automatically. Simply copy and paste the text below to Claude Code.

Please help me install this Skill:
Name: project-evals
Download link: https://github.com/GoogleChrome/modern-web-guidance-src/archive/main.zip#project-evals

Please download this .zip file, extract it, and install it in the .claude/skills/ directory.
View Source Repository

Agent Skills Search Helper

Install a tiny helper to your Agent, search and equip skill from 536,000+ vetted skills library on demand.