observability-testing-patterns

What problem does it solve?

This Skill addresses the critical need to validate the accuracy, reliability, and performance of observability systems, ensuring that monitoring infrastructure provides trustworthy insights into system health.

Core Features & Use Cases

• Dashboard Validation: Verifies that dashboards accurately reflect source data and render correctly.
• Alert Rule Testing: Ensures alerts fire as expected at defined thresholds and recover appropriately.
• Log Aggregation Completeness: Confirms that logs from all services are captured and searchable.
• APM Trace Validation: Checks that distributed traces capture the full request path and errors.
• SLA/SLO Verification: Measures and validates adherence to service level objectives.
• Use Case: A DevOps team needs to ensure their Grafana dashboards are showing correct metrics, their PagerDuty alerts are configured properly, and their distributed traces in Jaeger are complete before a major release.

Quick Start

Use the observability-testing-patterns skill to validate dashboard accuracy and test alert rules.