project-evals
OfficialCreate robust evals to validate guidance quality.
Software Engineering#Playwright#grader calibration#web guidance#eval authoring#guidance testing#coding agent evals
AuthorGoogleChrome
Version1.0.0
Installs0
System Documentation
What problem does it solve?
This skill solves the problem of unvalidated web guidance that may fail to produce correct, modern implementations when used by coding agents, ensuring guidance is reliable and effective before deployment.
Core Features & Use Cases
- Eval File Authoring: Guides you to write compliant
expectations.md,grader.ts, andtasks/task.mdfiles aligned with eval pipeline requirements. - Grader Calibration: Helps you use the
gd devtool to generate, test, and fine-tune Playwright-based graders against reference and anti-example implementations. - Use Case: When authoring a new guidance for a modern web feature (e.g., Dialog API, View Transitions), use this skill to create evals that confirm coding agents implement the guidance correctly when given realistic developer prompts.
Quick Start
Use this skill to author and calibrate evaluation files for your new web guidance use case.
Dependency Matrix
Required Modules
None requiredComponents
Standard package💻 Claude Code Installation
Recommended: Let Claude install automatically. Simply copy and paste the text below to Claude Code.
Please help me install this Skill: Name: project-evals Download link: https://github.com/GoogleChrome/modern-web-guidance-src/archive/main.zip#project-evals Please download this .zip file, extract it, and install it in the .claude/skills/ directory.
Agent Skills Search Helper
Install a tiny helper to your Agent, search and equip skill from 536,000+ vetted skills library on demand.