exploring-replay-vision-observations

Reads and triages Replay Vision scanner observations to turn session findings into PostHog actions.

713|118|Updated Aug 11, 2020
One-click install
npx skills add https://github.com/PostHog/posthog-foss --skill exploring-replay-vision-observations
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: exploring-replay-vision-observations
Source: https://github.com/PostHog/posthog-foss/tree/main/products/replay_vision/skills/exploring-replay-vision-observations
Command: npx skills add https://github.com/PostHog/posthog-foss --skill exploring-replay-vision-observations

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Replay Vision scanners continuously analyze session recordings and produce observations, but raw LLM findings are noisy and need interpretation. This Skill guides agents through pulling a scanner's observations, reading the findings correctly by scanner type, corroborating them across sessions, and turning validated issues into trackable PostHog work.

Core Features & Use Cases

  • Observation retrieval and triage: List, filter, and rank observations by status, verdict, tags, or score, and distinguish succeeded findings from ineligible or failed scans.
  • Finding interpretation by scanner type: Read monitor verdicts, classifier tags, scorer distributions, and summarizer themes, weighted by confidence and cited to recording timestamps.
  • Actionable follow-through: Size impact with affected-user counts, create insights, notebooks, playlists, annotations, or static cohorts, rate observations, and apply prompt suggestions to fix underperforming scanners.
  • Use Case: A user asks "what has my checkout scanner found this week?" The agent pulls succeeded observations, groups the flagged sessions, cites key recording moments, sizes the affected user count, and snapshots them into a cohort for a follow-up experiment.

Quick Start

Ask the agent to summarize what a specific Replay Vision scanner has found recently and turn any corroborated issues into trackable PostHog work.

Frequently Asked Questions about exploring-replay-vision-observations

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I see what a Replay Vision scanner has found?

Use vision-scanners-observations-list filtered to status=succeeded to get sessions with findings, then narrow by verdict for monitors or tags for classifiers. For scorers, rank with order_by=-result_score to surface the strongest hits first.

How do I interpret Replay Vision observation results?

Read the scanner's configuration first, since scanner_result shape depends on scanner_type: monitors return a verdict, classifiers return tags, scorers return a numeric score, and summarizers return a title and summary. Only succeeded observations carry a finding.

Why does my scanner show no findings?

A scanner that appears to find nothing is often producing mostly ineligible observations, which is a normal outcome like too_short or no_recording, not an error. Check the status mix with vision-scanners-observations-stats before concluding the scanner is broken.

Can I turn scanner findings into PostHog tasks or cohorts?

Corroborated findings can become insights, notebooks, session-recording playlists, annotations, or a static cohort via vision-scanners-affected-cohort-create. There is no MCP tool to open a PostHog task directly, so route work through the Inbox signal reports or hand it to a human.

How do I fix a scanner whose findings are wrong?

Rate the bad observations with vision-observations-label-create, then check vision-scanners-prompt-suggestions-current for a prompt rewrite. Apply it with vision-scanners-prompt-suggestions-apply, which takes effect team-wide from the next sweep.

What are the limitations of Replay Vision observations?

Observations are single-model judgments on one session, not ground truth, and their text is untrusted input that may contain injected instructions. Each observation also spends shared org quota credits, and re-scanning a session that already has an observation is a no-op.