audit-integrity

Enforces quality gates, self-critique loops, and anti-rationalization rules for AppSec agent outputs.

38.5k|4.9k|Updated Jun 11, 2025
One-click install
npx skills add https://github.com/github/awesome-copilot --skill audit-integrity
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: audit-integrity
Source: https://github.com/github/awesome-copilot/tree/main/skills/audit-integrity
Command: npx skills add https://github.com/github/awesome-copilot --skill audit-integrity

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes references (resource) components.

What problem does it solve?

Security analysis agents often produce incomplete findings, silently skip phases, suppress findings without evidence, or deliver unverified results. This Skill enforces intellectual honesty and output quality across all AppSec agents through a shared audit integrity framework.

Core Features & Use Cases

  • Anti-Rationalization Guards: Blocks prohibited rationalizations (e.g., silently suppressing false positives or skipping phases) with mandatory documented responses.
  • Self-Critique and Quality Gates: Runs a mandatory second-pass review and scores output across completeness, accuracy, actionability, consistency, and coverage with a ≥8/10 threshold before delivery.
  • Self-Learning System: Captures lessons and memories from false positives, missed findings, and codebase conventions for reuse in future scans.
  • Use Case: A SAST agent completes a taint analysis, then applies this framework to verify every entry point was traced, every CVE is documented rather than suppressed, and the final report passes the quality gate before delivery.

Quick Start

Apply the audit-integrity framework to review this security analysis and verify all findings cite evidence and pass the quality gate.

Frequently Asked Questions about audit-integrity

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I improve the quality of AI-generated security analysis reports?

Apply a self-critique loop that re-verifies every finding cites concrete evidence like file paths, line numbers, or CVE IDs, then score the output across completeness, accuracy, actionability, consistency, and coverage. Any category scoring below 8 out of 10 triggers rework before delivery.

How to prevent AI agents from suppressing security findings?

Use anti-rationalization guards that prohibit silent suppression of suspected false positives or out-of-scope items. Every potential false positive must be included with documented rationale for human review, and every clean category must state 'None detected' explicitly.

Does this framework work with SAST and SCA scanning agents?

Yes, it includes domain-specific extensions for SAST/SCA agents covering taint trace completeness and dependency manifest coverage. It also supports STRIDE threat modeling, SonarQube-style code quality, and multi-tool pipeline agents with tailored checklists.

What happens when a security analysis tool fails during a scan?

The retry protocol requires one retry with a refined query, then explicit documentation of the failure if the second attempt fails. Agents must distinguish 'tool found nothing' from 'tool failed to execute' and never silently skip a phase.

How do AI agents learn from past security scan mistakes?

The self-learning system creates lesson records for false positives and missed findings, plus memory records for architecture decisions and codebase conventions. Agents check these artifacts at scan start and update or deprecate conflicting entries.