What problem does it solve?
This Skill addresses the critical need to validate the accuracy, reliability, and performance of observability and monitoring systems, ensuring that dashboards, alerts, and data pipelines provide trustworthy insights.
Core Features & Use Cases
- Dashboard Validation: Verifies that data displayed on dashboards (e.g., Kibana, Grafana) accurately reflects the source data.
- Alerting Rule Testing: Ensures that alert rules trigger correctly at defined thresholds and recover as expected.
- Log Aggregation Completeness: Confirms that logs from all services are captured and searchable in a centralized system.
- APM Trace Validation: Checks that distributed traces capture the full request path and error information.
- SLA/SLO Verification: Validates that key performance indicators meet defined Service Level Objectives.
- Use Case: When a new dashboard is deployed, use this Skill to automatically verify that its key metrics match direct database queries and that its alert rules fire appropriately under simulated failure conditions.
Quick Start
Use the observability-testing-patterns skill to validate the accuracy of the 'operations-overview' dashboard and test its associated alert rules.