analyzing-experiment-session-replays

Analyze session replays to compare user behavior across experiment variants.

58|5|Updated Jan 19, 2026
One-click install
npx skills add https://github.com/PostHog/skills --skill analyzing-experiment-session-replays
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: analyzing-experiment-session-replays
Source: https://github.com/PostHog/skills/tree/main/skills/omnibus/analyzing-experiment-session-replays
Command: npx skills add https://github.com/PostHog/skills --skill analyzing-experiment-session-replays

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Analyzing session replays across experiment variants to understand how user behavior differs between control and treatment groups, enabling qualitative insights to complement metrics.

Core Features & Use Cases

  • Retrieve experiment metadata and feature flag variants (source of truth) to identify all exposed variants.
  • Build per-variant session recording filters to isolate user sessions tied to each variant within the experiment window.
  • Retrieve and compare recordings across variants to detect differences in duration, interactions, navigation paths, errors, and drop-off points.
  • Synthesize findings into actionable recommendations for experiment design and UX improvements.

Quick Start

Analyze your experiment by querying details, extracting variant keys from the feature flag, filtering session recordings for each variant, and comparing results to surface usability insights.

Frequently Asked Questions about analyzing-experiment-session-replays

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I analyze session replays to compare user behavior across experiment variants?

To analyze session replays across experiment variants, filter session recordings by feature flag keys to isolate control and treatment groups, then compare user navigation paths, interactions, and drop-off points to detect usability issues. This provides qualitative insights to complement quantitative experiment metrics.

What is the best way to get qualitative insights for PostHog feature flag experiments?

The best way to get qualitative insights for PostHog feature flag experiments is to build per-variant session-filter payloads using experiment metadata, retrieve the isolated recordings, and synthesize comparative findings on user behavior differences, errors, and navigation patterns.

Can I use session replays to identify usability issues in my experiment treatment group?

Yes, you can use session replays to identify usability issues in an experiment treatment group by retrieving recordings specifically filtered for that variant. Comparing these against the control group highlights distinct navigation patterns, error occurrences, and drop-off points.

Does analyzing session replays for experiments require setting up specific variant filters?

Yes, analyzing session replays for experiments requires setting up specific variant filters. The process uses experiment metadata and feature flag variants to build per-variant session-filter payloads, ensuring recordings are accurately isolated for each exposed group within the experiment window.

When do I need to compare session recordings across multiple experiment variants?

You need to compare session recordings across multiple experiment variants when quantitative metrics indicate behavioral differences and you require qualitative context. This approach detects exactly how duration, interactions, navigation paths, and errors differ between control and treatment groups.