What problem does it solve?
Poorly crafted LLO onboarding emails lead to slow Phase 9 response rates, and producers often miss critical flaws in their own drafts during self-review. This Skill provides an independent, rubric-based evaluation to catch these issues before the email is sent to the Local Lead Operator.
Core Features & Use Cases
- Weighted 5-Dimension Rubric: Scores emails on warmth, clarity, call-to-action effectiveness, context fidelity, and length discipline, with hard-deduct rules for critical failures like missing CTAs or incorrect org names.
- Structured Verdict Output: Generates a standardized YAML verdict aligned with ACE's eval template, including severity flags for issues that block email deployment.
- Calibration Logic: Includes targets to align grading accuracy with real Phase 9 LLO onboarding response rates over time, with plans to recalibrate based on real-world performance data.
- Use Case: When a Phase 6 producer finishes drafting the LLO onboarding email, run this eval to identify generic tone, buried CTAs, or context drift from the original PDD before the email is sent.
Quick Start
Use the training-onboarding-email-eval skill to grade the latest Phase 6 LLO onboarding email draft and receive a structured verdict with actionable improvement feedback.