What problem does it solve?
Replay Vision scanners judge one session at a time, so two failure modes stay invisible: an enabled scanner silently stops observing (throughput cliffs, failures, quota exhaustion), and aggregate trends across sessions (rising yes-rates, shifting scores, concentrating tags) never get surfaced. This Skill watches both.
Core Features & Use Cases
- Observing integrity checks: Detects enabled scanners whose observation throughput collapses, whose observations fail or land ineligible, or whose org quota is exhausted, using SQL over
$recording_observed plus the vision MCP tools.
- Aggregate signal detection: Compares each scanner's verdict rate, mean score, or tag distribution against its own prior-week baseline to surface cross-session shifts no per-session scan can emit.
- Report authoring with dedupe: Authors or edits prioritized inbox reports via the report channel, deduping against the per-session push path and sibling scouts, and persists scanner baselines in a scratchpad.
- Use Case: A monitor scanner's yes-rate creeps from 8% to 22% week-over-week across 200 sessions. The scout quantifies the shift against the scanner's own baseline, links example recordings, and files a P2 report for the owning team.
Quick Start
Run the replay vision scout to check whether all enabled scanners are still observing and whether any scanner's aggregate output has shifted from its baseline.