incident-diagnosis-review

Evaluates AI agent incident diagnoses for latency degradation events using predefined rubrics and artifact files.

40|39|Updated Apr 1, 2026
One-click install
npx skills add https://github.com/Architekt-Jutra/architekt-jutra-code --skill incident-diagnosis-review
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: incident-diagnosis-review
Source: https://github.com/Architekt-Jutra/architekt-jutra-code/tree/main/tools/kg-incidents/evaluator_skills/incident-diagnosis-review
Command: npx skills add https://github.com/Architekt-Jutra/architekt-jutra-code --skill incident-diagnosis-review

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

This Skill solves the problem of inconsistent, unvalidated AI-generated incident diagnoses that often miss root causes, mis-scope fixes, or fail to escalate to the correct teams, leading to prolonged production outages and misallocated engineering effort.

Core Features & Use Cases

  • Evidence-Based Scoring: Evaluates agent outputs using strict, rubric-aligned criteria that require direct quotes from trajectory or workspace artifacts, eliminating subjective judgment.
  • Multi-Dimension Assessment: Measures root cause accuracy, diagnostic path efficiency, fix scoping, and escalation awareness to give a complete picture of diagnostic quality.
  • Use Case: SREs and platform engineering leads can use this Skill to audit AI-generated incident response reports for production latency issues, ensuring diagnoses meet senior SRE standards before implementing fixes.

Quick Start

Use the incident-diagnosis-review skill to score the AI agent's incident diagnosis output for the ai-description latency degradation using the provided trajectory and workspace artifacts.

Frequently Asked Questions about incident-diagnosis-review

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I evaluate AI incident diagnoses for production latency degradation?

You can evaluate AI incident diagnoses by scoring agent outputs against a rubric to measure root cause accuracy, diagnostic efficiency, fix scoping, and escalation awareness using trajectory and workspace artifacts.

What is evidence-based scoring for AI agent incident response audits?

Evidence-based scoring for incident response audits evaluates AI agent diagnoses by requiring direct quotes from trajectory or workspace artifacts, eliminating subjective judgment when validating root cause accuracy and escalation compliance.

How do I audit AI-generated root cause analysis reports for SRE workflows?

You audit AI-generated root cause analysis reports by scoring agent incident diagnosis outputs against strict rubric-aligned criteria, ensuring the diagnoses meet senior SRE standards before implementing fixes for production latency issues.

What files do I need to review AI incident diagnosis outputs?

To review AI incident diagnosis outputs you need agent trajectory JSON files, workspace diff artifacts, ground truth decision files, and feature gate state files to perform evidence-based scoring against the rubric.

Can I measure diagnostic path efficiency and escalation awareness for AI agents?

Yes, you can measure diagnostic path efficiency and escalation awareness through multi-dimension assessment, which evaluates AI agent incident diagnoses to validate diagnostic quality and compliance with escalation protocols.

Why does my AI incident diagnosis miss root causes and mis-scope fixes?

AI incident diagnoses miss root causes and mis-scope fixes due to inconsistent, unvalidated generation processes that fail to escalate to the correct teams, leading to prolonged production outages and misallocated engineering effort.