ai-incident-response

Classify and respond to AI model failures with severity runbooks.

5|2|Updated Mar 27, 2026
One-click install
npx skills add https://github.com/tarunccet/pm-skills --skill ai-incident-response
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: ai-incident-response
Source: https://github.com/tarunccet/pm-skills/tree/main/pm-ai-product-management/skills/ai-incident-response
Command: npx skills add https://github.com/tarunccet/pm-skills --skill ai-incident-response

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

This Skill helps teams rapidly classify, mitigate, and learn from AI-specific incidents such as model degradation, hallucination spikes, bias detections, safety bypasses, prompt injection, and data poisoning, reducing user harm and legal exposure.

Core Features & Use Cases

  • Context confirmation & triage: Guided questions to confirm affected feature, blast radius, and whether the incident is active or preparatory.
  • Incident taxonomy & severity: Clear classification of incident types and severity levels (P0–P3) with SLAs for response.
  • Response runbooks: Step-by-step mitigations per incident type (rollback, input filters, grounding, human review), rollback procedures, and communication templates.
  • Post-incident analysis & monitoring: 5-whys adapted for AI, post-mortem deliverables, and recommended real-time and near-real-time metrics for early warning.
  • Use Cases: Responding to an active hallucination spike in production, preparing an AI safety incident playbook for a new feature, or drafting a P0 bias communication and remediation plan.

Quick Start

Respond to an active hallucination spike in the recommendations feature affecting 10% of users by classifying severity, proposing immediate mitigations (rollback or grounding), and outlining a post-incident action plan.

Frequently Asked Questions about ai-incident-response

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I respond to an active AI model hallucination spike in production?

To respond to an AI model hallucination spike, use incident response runbooks to classify severity, propose immediate mitigations like rollback or grounding, and outline a post-incident remediation action plan.

What's the best way to classify AI safety incidents like prompt injection and bias events?

Classify AI safety incidents like prompt injection and bias events using incident taxonomy and severity levels from P0 to P3, which establishes clear SLAs for response and guides the appropriate triage procedure.

How do I prepare a post-mortem analysis for AI model degradation and data poisoning?

Prepare a post-mortem analysis for AI model degradation and data poisoning by applying a 5-whys framework adapted for AI, generating post-mortem deliverables, and recommending real-time metrics for early warning.

Does this incident response runbook handle rollback procedures for retrieval-augmented generation systems?

Yes, this incident response runbook handles rollback procedures for retrieval-augmented systems by providing step-by-step mitigations, input filter configurations, and human review protocols across model-serving environments.

When do I need a dedicated AI incident response playbook for production features?

You need a dedicated AI incident response playbook for production features when preparing mitigations for safety bypasses, data attacks, or bias detections to reduce user harm and legal exposure before active incidents occur.

Can I use this to draft customer communication templates for a P0 bias incident?

Yes, you can draft customer communication templates for a P0 bias incident by following the response runbooks, which provide structured communication outputs alongside immediate remediation and rollback steps.