What problem does it solve?
Quickly assess the quality and integrity of rendered UGC videos by producing a structured evaluation report that highlights scene segmentation, audio, captions, and visual consistency. The fixer agent can read the report to apply targeted fixes.
Core Features & Use Cases
- Automated quality evaluation across render modes (structure, keyframe, native-video, deep-style) and generation of eval.json + eval-report.md for downstream agents.
- Outputs deterministic findings and tailored handoffs for fixers, with references to scenario.json, BRIEF.md, STYLE_LOCK.md when present.
- Supports triggering phrases like "evaluate this video" or "is this ready to ship" to kick off the evaluation workflow.
Quick Start
Run the evaluator on a rendered mp4 using ralphy eval video <path-to-mp4>, then review the generated eval.json and eval-report.md for the results.