defining-instrumentation

Define signals, thresholds, and evidence artifacts for feature validation.

Updated Aug 27, 2026
One-click install
npx skills add https://github.com/aufrank/agent-skills --skill defining-instrumentation
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: defining-instrumentation
Source: https://github.com/aufrank/agent-skills/tree/main/skills/defining-instrumentation
Command: npx skills add https://github.com/aufrank/agent-skills --skill defining-instrumentation

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes references (resource) and templates (resource) components.

What problem does it solve?

This Skill helps you define clear, measurable criteria to prove that a feature or milestone has been successfully met, ensuring objective validation.

Core Features & Use Cases

  • Instrumentation Strategy: Develop plans to generate falsifiable evidence for success.
  • Validation Criteria: Define specific signals, thresholds, and artifacts to prove functionality.
  • Use Case: When launching a new search algorithm, use this skill to define tests that prove relevance improvements and ensure no regressions are introduced.

Quick Start

Use the defining-instrumentation skill to create an instrumentation plan for verifying the successful deployment of a new API endpoint.

Frequently Asked Questions about defining-instrumentation

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I define validation criteria to prove a feature is successfully deployed?

To define validation criteria, you develop an instrumentation strategy that yields falsifiable evidence by specifying clear signals, thresholds, and evidence artifacts for objective verification of feature completion.

What is falsifiable evidence in software observability and testing?

Falsifiable evidence in observability uses deterministic signals and defined thresholds to validate success, ensuring that feature or milestone completion is proven objectively rather than assumed through subjective metrics.

How do I set up instrumentation for local-first execution environments?

Setting up instrumentation for local-first execution involves defining deterministic signals and evidence artifacts that validate success locally, ensuring observability and proof of functionality without relying on external infrastructure.

When do I need to define an instrumentation strategy for milestone validation?

You need an instrumentation strategy for milestone validation when launching complex updates like a new search algorithm, ensuring you can prove relevance improvements and verify no regressions are introduced.

What is the best way to prove a new API endpoint deployment works as expected?

The best way to prove a new API endpoint deployment is to create an instrumentation plan that defines specific tests, signals, and thresholds to generate falsifiable evidence of successful operation.

Can I use this instrumentation approach to prevent regressions in search algorithms?

Yes, you can use this instrumentation approach to define tests that prove relevance improvements and establish deterministic signals, ensuring no regressions are introduced when updating search algorithms.