start-evals

Generate 20 spreadsheet-ready evaluation test cases for AI features.

16|3|Updated Oct 23, 2025
One-click install
npx skills add https://github.com/breethomas/bette-think --skill start-evals
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: start-evals
Source: https://github.com/breethomas/bette-think/tree/main/plugins/bette-think/skills/start-evals
Command: npx skills add https://github.com/breethomas/bette-think --skill start-evals

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Reduce overengineering and uncertainty when validating AI features by providing a concise, repeatable evaluation starter that emphasizes error analysis over premature automation. The approach helps teams quickly surface failure modes with a small, high-value set of tests so they can iterate product and model improvements faster.

Core Features & Use Cases

  • 20-test starter kit: Generates 15 happy-path and 5 edge-case test cases suitable for spreadsheet-driven QA.
  • Pragmatic workflow: Includes a spreadsheet template, run-and-record guidance, and a Week 1 workflow to get results in 30–90 minutes.
  • Scale and next steps: Guidance to graduate from 20→50→200+ tests, options to build an LLM-as-judge, and optional project creation for tracking.
  • Use cases: Validating product recommendations, customer support assistants, summarization features, and retrieval-augmented generation systems.

Quick Start

Type /start-evals "AI product recommendations" to generate 20 spreadsheet-ready test cases, pass/fail criteria, and an actionable evaluation workflow.

Frequently Asked Questions about start-evals

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I create test cases for AI feature evaluation?

AI evaluation test cases are structured inputs designed to validate specific AI features like recommendation engines or summarization tools. This approach generates 20 spreadsheet-ready tests, including 15 happy-path and 5 edge-case inputs, to surface failure modes with pass/fail criteria during initial QA.

What is the best way to start QA for an AI product recommendation system?

The best way to start QA for an AI product recommendation system is applying a focused 20-test starter kit formatted for spreadsheets. This method emphasizes error analysis over premature automation, providing a Week 1 workflow to surface failure modes and iterate model improvements within 30 to 90 minutes.

Can I use spreadsheet-driven QA for RAG pipeline validation?

Yes, spreadsheet-driven QA works for RAG pipeline validation by providing 20 structured test cases with pass/fail criteria. This approach fits early-stage retrieval-augmented generation systems, enabling rapid error analysis and product iteration without requiring complex automated testing infrastructure.

How do I scale AI evaluation tests from 20 to 200+ cases?

You scale AI evaluation tests from 20 to 200+ cases by following provided graduation guidance to incrementally expand test coverage. The workflow supports this scale-up by introducing options to build an LLM-as-judge for automated scoring and optional Linear project creation for tracking.

Do I need an automated testing framework to validate customer support assistants?

No, an automated testing framework is not required to initially validate customer support assistants. A pragmatic spreadsheet-driven workflow using 20 targeted test cases helps you quickly identify failure modes and perform error analysis before investing in premature automation or complex infrastructure.