arize-compliance-audit

Audits AI agent codebases for regulatory compliance gaps across EU, US, and ISO frameworks.

1|Updated Nov 9, 2025
One-click install
npx skills add https://github.com/akashjpal/question-generator --skill arize-compliance-audit-akashjpal
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: arize-compliance-audit
Source: https://github.com/akashjpal/question-generator/tree/main/.agents/skills/arize-compliance-audit
Command: npx skills add https://github.com/akashjpal/question-generator --skill arize-compliance-audit-akashjpal

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes references (resource) components.

What problem does it solve? AI and LLM applications face a growing patchwork of regulations (EU AI Act, GDPR, NIST AI RMF, Colorado AI Act, HIPAA, ISO 42001), and engineering teams struggle to know whether their codebase meets technical compliance requirements. This Skill scans a codebase for compliance gaps, cross-references Arize tracing instrumentation for audit-trail coverage, and produces a prioritized remediation checklist. ## Core Features & Use Cases - Framework-tailored audits: Asks the user which frameworks apply (EU, US, ISO 42001) and the use case category, then classifies risk tier before scanning. - Seven-domain codebase scan: Inspects transparency, data protection, security, testing, documentation, monitoring, and vendor management, quoting exact file paths and code snippets for every gap. - Instrumentation cross-reference: Verifies Arize/OpenTelemetry tracing captures the audit trails regulators require (user IDs, PII redaction, error spans, retention). - Use Case: A team shipping an LLM chatbot in the EU runs the audit, learns their traces leak unredacted PII and no AI disclosure exists in the UI, and receives a prioritized checklist with concrete fixes. ## Quick Start Ask the assistant to audit this AI application for EU AI Act and GDPR compliance and produce a remediation checklist.

Frequently Asked Questions about arize-compliance-audit

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I audit my LLM application for EU AI Act compliance?

Run the audit and select the EU frameworks option when prompted. The skill classifies your risk tier, scans the codebase across seven domains including transparency, logging, and human oversight, then generates a checklist mapped to specific EU AI Act articles.

What compliance frameworks does this AI audit cover?

The audit covers the EU AI Act, GPAI Code of Practice, GDPR, NIST AI RMF, Colorado AI Act, NYC Local Law 144, HIPAA, and ISO/IEC 42001. You select which frameworks apply, and only relevant checklist sections are included in the report.

Does the compliance audit check Arize tracing instrumentation?

Yes. The audit cross-references Arize and OpenTelemetry tracing setup against regulatory logging requirements such as EU AI Act Article 12 and NIST MAN-2.1. It checks LLM call coverage, user ID span attributes, PII redaction, error spans, and trace retention.

Can the audit fix the compliance gaps it finds?

Yes, remediation is an optional final phase. The skill offers discrete fixes such as adding guardrail libraries, PII redaction filters, AI disclosure strings, and model card templates, but it always asks for explicit confirmation before modifying any code.

Is the compliance audit report legal advice?

No. The skill presents a mandatory disclaimer stating the audit is guidance only and does not constitute legal advice. It identifies technical patterns and gaps, and binding compliance determinations require qualified legal counsel.