configuring-experiment-analytics

Configure experiment analytics workflows for exposure, metrics, and interpretation.

58|5|Updated Jan 19, 2026
One-click install
npx skills add https://github.com/PostHog/skills --skill configuring-experiment-analytics
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: configuring-experiment-analytics
Source: https://github.com/PostHog/skills/tree/main/skills/omnibus/configuring-experiment-analytics
Command: npx skills add https://github.com/PostHog/skills --skill configuring-experiment-analytics

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes references (resource) components.

What problem does it solve?

This skill guides teams through configuring experiment analytics, clarifying exposure criteria, metric setup, and results interpretation to determine impact.

Core Features & Use Cases

  • Exposure criteria configuration: choose how users are counted (feature flag presses) or via custom exposure events, and handle test accounts.
  • Metric configuration: select metric types (mean, funnel, ratio, retention) and specify steps for funnel metrics with automatic exposure step.
  • Interpretation workflow: use project data schema discovery, select primary vs secondary metrics, and follow a decision framework for shipping or ending experiments.

Quick Start

Create an experiment analytics plan by documenting exposure criteria, selecting initial metrics, and outlining interpretation steps.

Frequently Asked Questions about configuring-experiment-analytics

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I configure experiment analytics to measure exposure and metric impact?

To configure experiment analytics, you define exposure criteria using feature flags or custom events, select metric types like funnel or ratio, and establish a workflow to interpret statistical significance and determine impact.

What's the best way to set up funnel and ratio metrics for A/B testing?

Setting up funnel and ratio metrics requires specifying sequential steps for funnels and automatic exposure steps, then classifying each metric as primary or secondary to correctly measure the experiment's impact.

How do I handle test accounts and custom exposure events in experiment analytics?

Handling test accounts and custom exposure events involves configuring explicit guardrails to exclude test data and defining custom exposure events to accurately count users entering the experiment.

When do I need to discover data schemas for interpreting experiment results?

You need data schema discovery during the interpretation workflow to identify available events, define metric types, and apply a decision framework for shipping or ending experiments based on statistical significance.

Can I use feature flags for exposure criteria in mean and retention metrics?

Yes, feature flags can define exposure criteria for mean and retention metrics by counting users who trigger the flag, ensuring reliable measurement across multiple variants within your experiment analytics.

Why does my experiment analysis require distinguishing primary versus secondary metrics?

Distinguishing primary versus secondary metrics is required to apply a structured decision framework, ensuring that shipping decisions rely on the main impact metric while secondary metrics provide contextual guardrails.