promptfoo-evals

What problem does it solve?

This Skill provides a structured approach to creating and maintaining promptfoo evaluation suites, enabling teams to scaffold eval configurations, prompts, tests, and providers to ensure robust prompt evaluation.

Core Features & Use Cases

• Scaffold and manage eval configurations: promptfooconfig.yaml, prompts, tests, and assertions, plus provider references.
• Debug regressions and extend coverage by adding new evaluation matrices and scenarios.
• Centralize guidelines and workflows to standardize prompt evaluation across teams.

Quick Start

Create or update a promptfoo eval suite scaffold to cover prompts, tests, and assertions.