observability-driven-testing

Convert production traces, logs, and telemetry into actionable tests.

64|12|Updated Mar 23, 2026
One-click install
npx skills add https://github.com/petrkindlmann/qa-skills --skill observability-driven-testing
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: observability-driven-testing
Source: https://github.com/petrkindlmann/qa-skills/tree/main/skills/observability-driven-testing
Command: npx skills add https://github.com/petrkindlmann/qa-skills --skill observability-driven-testing

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Production observability data is underutilized for test design; this skill turns traces, logs, and telemetry into actionable tests to prevent regressions.

Core Features & Use Cases

  • Trace-based test design and telemetry-driven prioritization.
  • OpenTelemetry integration with test infrastructure and correlation of traces, logs, and metrics.
  • Production error analysis to generate, validate, and prioritize tests that cover real user journeys.
  • Telemetry-guided risk assessment and test prioritization for hot paths.

Quick Start

Identify production error signals from your observability platform and model the first trace-based tests to cover critical paths.

Frequently Asked Questions about observability-driven-testing

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I use OpenTelemetry traces to generate regression tests?

Trace-based test design maps OpenTelemetry traces, logs, and telemetry from real user journeys into actionable tests. You identify production error signals and model trace-based assertions to cover critical microservice paths.

What is telemetry-driven test prioritization for microservices?

Telemetry-driven prioritization analyzes production traces, logs, and metrics to identify hot paths and coverage gaps. It assesses risk in end-to-end microservice flows to guide which user journeys need tests most.

Do I need OpenTelemetry instrumentation to create trace-based assertions?

Yes, trace-based assertions require OpenTelemetry instrumentation in your services. You also need telemetry correlation built into your test infrastructure to map production signals to concrete tests.

Can I turn production error analysis into automated tests?

Production error analysis extracts real user journey failures from observability platforms to generate, validate, and prioritize tests. This prevents regressions by covering the exact microservice flows that failed in production.

What's the best way to correlate production logs and metrics with test infrastructure?

Correlating production logs and metrics with test infrastructure requires OpenTelemetry integration. This maps telemetry signals across microservice flows directly to trace-based assertions, validating real user journeys.

When should I avoid using observability data for test design?

Avoid telemetry-driven test design if your services lack OpenTelemetry instrumentation or if your test infrastructure cannot perform trace correlation. Without production signals, you cannot map real user journeys to concrete tests.