aiops-infrastructure-anomaly-detection

Detect infrastructure and data pipeline anomalies using statistical baselines and ML scoring.

14|1|Updated May 5, 2026
One-click install
npx skills add https://github.com/ivanshamaev/de-agent-skills --skill aiops-infrastructure-anomaly-detection
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: aiops-infrastructure-anomaly-detection
Source: https://github.com/ivanshamaev/de-agent-skills/tree/main/group_skills/infra_dataops_group_skills/aiops_infrastructure_anomaly_detection
Command: npx skills add https://github.com/ivanshamaev/de-agent-skills --skill aiops-infrastructure-anomaly-detection

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

It helps you detect unusual infrastructure and data-pipeline behavior using statistical baselines and machine learning, reducing alert fatigue from hard-coded thresholds.

Core Features & Use Cases

  • Prometheus statistical anomaly rules: build rolling baseline alerts (z-score, MAD/IQR, and seasonal-aware signals) for metrics like CPU/memory/disk/network and pipeline throughput/lag.
  • Python anomaly detection models: score multivariate anomalies with robust statistics (z-score/IQR/MAD) and Isolation Forest, plus seasonal forecasting with Prophet.
  • Alert threshold auto-tuning: generate warning/critical thresholds from historical distributions to target a desired false-positive rate.
  • Data pipeline anomaly signals: identify row-count drops, freshness drift, and throughput anomalies using historical windows and z-score style scoring.
  • Use Case: When Kafka consumer lag or container memory behavior drifts from its typical pattern, automatically flag the event and route it with severity based on how far it deviates from the learned baseline.

Quick Start

Use the aiops-infrastructure-anomaly-detection skill to generate Prometheus alert rules and Python detection code for a selected metrics set, then review detected anomalies in a Grafana dashboard.

Frequently Asked Questions about aiops-infrastructure-anomaly-detection

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I detect infrastructure anomalies without static thresholds in Prometheus?

To detect infrastructure anomalies without static thresholds, apply statistical baseline rules like z-score, MAD, and IQR to your Prometheus metrics. This method dynamically flags CPU, memory, disk, and network spikes based on learned historical deviations rather than hard-coded values.

What is the best way to monitor Kafka consumer lag anomalies using machine learning?

The best way to monitor Kafka consumer lag anomalies is by applying machine learning scoring and seasonal forecasting to time-series throughput metrics. Models like Isolation Forest and Prophet identify lag deviations by learning typical behavioral patterns from historical data windows.

Can I use Isolation Forest and Prophet for time-series anomaly detection in Kubernetes?

Yes, you can use Isolation Forest and Prophet for time-series anomaly detection in Kubernetes. These Python models score multivariate anomalies and apply seasonal forecasting to metrics like container memory behavior, identifying drifts from typical baseline patterns.

How do I auto-tune alert thresholds to reduce false positives in Grafana?

Auto-tune alert thresholds to reduce false positives by generating warning and critical levels from historical metric distributions. This targets a desired false-positive rate by analyzing past time-series samples and adjusting deviation sensitivity dynamically.

How does statistical baseline anomaly detection work for data pipelines?

Statistical baseline anomaly detection for data pipelines works by learning historical windows to establish normal behavior. It identifies row-count drops, freshness drift, and throughput anomalies using z-score style scoring to flag significant deviations from the learned baseline.