quality-eval

Create and maintain qualitative evaluation briefs under .ai/evals/<slug>.

1|Updated Apr 6, 2026
One-click install
npx skills add https://github.com/Honigbart/honeyflow --skill quality-eval
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: quality-eval
Source: https://github.com/Honigbart/honeyflow/tree/main/quality-eval
Command: npx skills add https://github.com/Honigbart/honeyflow --skill quality-eval

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Qualitative validation can be slow to organize and reproduce across fresh sessions. This skill provides a durable workflow for creating and running eval briefs, and scaffolds the artifacts under .ai/evals/<slug>/ to preserve context, runs, and conclusions.

Core Features & Use Cases

  • Durable eval briefs with a structured brief.md
  • Two modes: Prepare to configure and Run/Resume to execute validations
  • Separate run logs and results under .ai/evals/<slug>/runs/ and .ai/evals/<slug>/results.md
  • Easy slug resolution from the feature or prompt being evaluated
  • Flexible to compare multiple variants, prompts, or UX flows

Quick Start

Create an eval slug and run Prepare mode to set up a durable eval brief in a fresh session.

Frequently Asked Questions about quality-eval

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I track qualitative evaluation results across multiple sessions?

You can track qualitative evaluation results across sessions by generating durable eval briefs and storing artifacts under .ai/evals/<slug>/. This structured file approach preserves context, run logs, and conclusions for slow or multi-variant scenarios.

What is the best way to compare model output quality across prompt variants?

The best way to compare model output quality is using a durable eval brief that logs separate runs and results for each variant. This method supports behavior checks and UX judgments across multiple variants, prompts, or flows.

How do I set up a durable evaluation brief for UX judgments?

To set up a durable evaluation brief, create an eval slug and run Prepare mode. This configures a structured brief.md file that scaffolds the necessary artifacts to execute and track your UX judgments.

Do I need special tooling to run qualitative model comparisons?

No, you do not need special tooling to run qualitative model comparisons. The process relies on standard file structures to store evaluations and requires no dependencies beyond the basic directory setup.

Can I resume a slow validation run without losing previous context?

Yes, you can resume a slow validation run without losing context. The Run/Resume mode executes validations using the preserved run logs and results tracked under the .ai/evals/<slug>/ directory.