aws-observability

Design CloudWatch Log Insights queries, alarms, dashboards, and custom metrics for AWS observability.

Updated May 12, 2026
One-click install
npx skills add https://github.com/mreferre/aws-agent-toolkit-skills --skill aws-observability-mreferre
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: aws-observability
Source: https://github.com/mreferre/aws-agent-toolkit-skills/tree/main/.kiro/skills/aws-observability
Command: npx skills add https://github.com/mreferre/aws-agent-toolkit-skills --skill aws-observability-mreferre

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes references (resource) and assets (resource) components.

What problem does it solve?

AWS observability issues are hard to diagnose because problems can appear as missing log evidence, misleading alarm behavior, incorrect metric publishing, or absent/incorrect tracing correlation across services.

Core Features & Use Cases

  • CloudWatch Log Insights query authoring: Build correct filters, parsing, joins, and subqueries to pinpoint failures in logs.
  • CloudWatch alarms you can trust: Configure metric, composite, and anomaly detection alarms with correct evaluation mechanics and missing-data treatment (including INSUFFICIENT_DATA).
  • Metrics + EMF publishing and troubleshooting: Use custom metrics patterns (EMF vs PutMetricData), dimension/retention guidance, and diagnostic steps when metrics do not appear.
  • X-Ray/ADOT distributed tracing: Understand sampling rules, annotation vs metadata tradeoffs, and ADOT collector configuration to ensure traces show up and remain searchable.
  • CloudTrail operational auditing: Identify who changed what and when using operational (non-threat-detection) CloudTrail event analysis.
  • CloudWatch Synthetics canary debugging: Diagnose canary failures, alarms driven by success metrics, and VPC/network pitfalls.

Quick Start

Use this skill when you need to troubleshoot why CloudWatch alarms show INSUFFICIENT_DATA or do not fire, especially while correlating the behavior with CloudWatch Logs Insights, custom metrics/EMF, and X-Ray/ADOT traces.

Frequently Asked Questions about aws-observability

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
Why does my CloudWatch alarm show INSUFFICIENT_DATA instead of firing when metrics are missing?

CloudWatch alarms show INSUFFICIENT_DATA when evaluation periods lack sufficient metric data points. You can configure missing-data treatment settings to specify whether the alarm should treat missing data as breaching, not breaching, or ignore it during evaluation.

How do I write CloudWatch Logs Insights queries to correlate failures across multiple log groups?

CloudWatch Logs Insights supports using the `parse`, `filter`, and `sort` commands alongside subqueries to correlate log patterns across log groups. You can pinpoint failures by structuring queries with correct filtering syntax and performance constraints to join related log entries.

What is the difference between using EMF and PutMetricData for publishing custom metrics?

Embedded Metric Format (EMF) allows you to output structured JSON in logs to asynchronously create custom metrics without API calls, whereas PutMetricData is a direct synchronous API invocation. EMF avoids throttling and higher costs but requires specific JSON schema adherence for metrics to appear.

How do I configure X-Ray distributed tracing with ADOT to ensure traces show up and remain searchable?

Configuring X-Ray distributed tracing with ADOT requires setting up the ADOT collector and defining sampling rules. You must use annotations for searchable trace data and metadata for non-searchable contextual information to ensure proper request flow tracing and analysis.

Can I use CloudTrail operational auditing queries to identify who changed what AWS resources?

Yes, CloudTrail operational auditing queries allow you to identify who changed what and when using non-threat-detection event analysis. You can run CloudWatch Logs Insights queries against CloudTrail logs to filter specific API calls and attribute resource changes to specific identities.

How do I diagnose CloudWatch Synthetics canary failures driven by success metrics and VPC network pitfalls?

Diagnosing CloudWatch Synthetics canary failures involves analyzing canary success metrics and checking VPC configurations. You must verify network access paths, validate alarm thresholds tied to success rates, and troubleshoot VPC settings that might block the canary endpoint connectivity.