signals-scout-observability-gaps

Detects gaps between high-volume PostHog events and existing insight, dashboard, or alert coverage.

713|118|Updated Aug 11, 2020
One-click install
npx skills add https://github.com/PostHog/posthog-foss --skill signals-scout-observability-gaps
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: signals-scout-observability-gaps
Source: https://github.com/PostHog/posthog-foss/tree/main/products/signals/skills/signals-scout-observability-gaps
Command: npx skills add https://github.com/PostHog/posthog-foss --skill signals-scout-observability-gaps

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Teams instrument many events in PostHog but often lack insights, dashboards, or alerts covering them, leaving meaningful product signals unobserved. This Skill autonomously scans event volumes against existing observability coverage and files evidence-backed recommendations only when a real gap clears strict quality bars.

Core Features & Use Cases

  • Six gap families: Detects uncovered high-volume custom events, insight drift from renamed or sunset events, failure-semantics events without alerts, dashboard scope gaps, missing funnel insights, and unused property breakdowns.
  • Dedupe and watch lifecycle: Parks candidate gaps in a scratchpad until they meet a 7-day stability bar, edits existing reports instead of duplicating, and retires stale recommendations.
  • False-positive guards: Disqualifies builtin events, internal test traffic, backfill spikes, experiment exposures, and deliberate engineering telemetry before recommending anything.
  • Use Case: A team ships a new payment_failed event firing 50 times per day with zero alerts configured; the scout verifies volume and reach, confirms no existing coverage, and files a P2 report recommending an alert.

Quick Start

Ask the Signals agent to run an observability-gaps scan on this PostHog project and report any high-volume events lacking insight, dashboard, or alert coverage.

Frequently Asked Questions about signals-scout-observability-gaps

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I find PostHog events with no insight coverage?

Use read-data-schema to list event volumes, then run execute-sql over system.insights checking whether each event name appears in any insight query. Events firing above roughly 100 per day with zero references are coverage-gap candidates.

How to detect stale insights pointing at renamed events in PostHog?

Extract the events each saved insight filters on via execute-sql over system.insights, then measure recent volume with query-trends. An insight whose primary event has zero firings in 7 days while a similarly named event fires actively indicates drift from a rename.

What volume threshold makes an observability gap worth reporting?

The skill requires at least 100 events per day sustained across 7 complete days in the project timezone, plus meaningful distinct-user reach. Below that bar, candidates are parked in a watch scratchpad entry rather than reported.

Does this skill recommend insights for builtin PostHog events?

No. Builtin events like $pageview, $autocapture, and $identify are already surfaced through PostHog product views such as Web Analytics and Feature Flags, so recommending custom insights for them is explicitly disqualified.

Why did the observability scan close out with no recommendations?

An empty run is a valid outcome. The scout closes out when the project has too few active events, when coverage is already saturated, or when every candidate matches a prior report, an addressed entry, or a disqualifier such as backfill spikes or internal test traffic.

Can this skill modify my PostHog insights or dashboards directly?

No. It operates with read-only analytics access and only writes to its scratchpad and the report channel. It files recommendations with suggested actions and reviewer routing; a human decides whether to create the insight, dashboard, or alert.