data-health-monitor

You can monitor data pipeline health by running a single command that aggregates status signals across streams, jobs, schema, and quotas into one actionable report. It verifies data flow, detects stalled jobs, and flags stale schema fields.

A data health check includes stream health verification for data flow timeliness, job status monitoring to detect stalled or failed processes, and schema insights covering identity, PII, and stale fields, plus quota awareness.

Yes, you need an API token to check data health. The monitor reads streams, jobs, and schema health endpoints via the API using this token to compile a unified report for your pipelines.

You can use this for both ongoing data pipelines and periodic health reviews. It is applicable to continuously checking data flow across multiple streams, jobs, and schema definitions.

The best way to consolidate schema health and quota signals is to run a health monitor that aggregates identity, PII, stale fields, and quota awareness into one unified report for quick validation of data flow.

A data health report shows stalled jobs and stale schema fields because it actively monitors job status to detect failed processes and evaluates schema definitions to flag stale fields for pipeline maintenance.