eval-authoring

What problem does it solve?

Automates the creation and quality assurance of eval scenarios to assess and improve Tessl skills.

Core Features & Use Cases

• Scenario generation: produce diverse eval scenarios aligned with the REVIEW_CHECKLIST.
• Review and quality checks: evaluate tasks and criteria for bleeding, leaking, and coverage gaps.
• Coverage analysis: identify gaps and guide focused scenario expansion.
• Score-driven iteration: drive improvements via lift analysis and targeted fixes.
• Use Case: You are building a new skill and want to develop robust evals, review existing evals, or expand coverage.

Quick Start

Run tessl scenario generate to begin creating eval scenarios, then review and refine each scenario per the checklist.