ethics-ai-analysis

Audit machine learning models for algorithmic fairness violations across sensitive groups.

33|6|Updated Mar 17, 2026
One-click install
npx skills add https://github.com/xjtulyc/awesome-rosetta-skills --skill ethics-ai-analysis
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: ethics-ai-analysis
Source: https://github.com/xjtulyc/awesome-rosetta-skills/tree/main/skills/14-philosophy/ethics-ai-analysis
Command: npx skills add https://github.com/xjtulyc/awesome-rosetta-skills --skill ethics-ai-analysis

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires pandas, numpy, scikit-learn, scipy, matplotlib, fairlearn.

What problem does it solve?

This Skill helps you detect and explain unfair or biased behavior in AI models and decide how to respond using established ethical and moral reasoning, especially when different fairness metrics conflict.

Core Features & Use Cases

  • Algorithmic Fairness Auditing: Compute demographic parity, equalized odds (TPR/FPR), calibration gaps, and selection rate differences across protected groups.
  • Disparate Impact Assessment: Evaluate the 80% / 4-5ths rule to flag potential EEOC-style disparate impact concerns in automated decision-making.
  • Value Alignment via Moral Frameworks: Apply utilitarian, deontological, and virtue ethics lenses to a concrete AI ethics scenario (e.g., parole, hiring, lending) and produce a defensible “what should be done” conclusion.

Quick Start

Use the ethics-ai-analysis skill to audit a classifier’s demographic parity, equalized odds, and calibration gaps for your protected groups from your evaluation dataset.

Frequently Asked Questions about ethics-ai-analysis

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I audit machine learning models for algorithmic fairness and demographic parity?

Algorithmic fairness auditing measures demographic parity, equalized odds, and calibration gaps across sensitive groups using y_true, y_pred, and protected labels. It evaluates binary classification workflows to detect selection-rate disparities and disparate impact in automated decisions.

What is disparate impact assessment and how does the 80% rule apply to AI models?

Disparate impact assessment evaluates the 80% or 4/5ths rule to flag potential EEOC-style concerns in automated decision-making. It measures whether selection rates for protected groups fall below 80% of the highest-selected group's rate, indicating algorithmic bias.

How do I resolve conflicts between equalized odds and demographic parity metrics?

When equalized odds and demographic parity metrics conflict, you apply utilitarian, deontological, and virtue ethics frameworks to the AI ethics scenario. This value alignment approach produces a defensible conclusion for what should be done.

Can I use fairlearn with pandas and scikit-learn to measure bias in credit scoring models?

Yes, fairlearn integrates with pandas and scikit-learn to measure bias in credit scoring models. This skill requires these dependencies to compute fairness metrics over y_true, y_pred, and sensitive group labels for binary classification workflows.

What is the best way to check value alignment for AI hiring screening or parole risk assessment?

The best way to check value alignment for hiring screening or parole risk assessment is applying utilitarian, deontological, and virtue ethics lenses to fairness audit results. This generates moral framework reasoning for alignment-focused decision guidance.

Why does my binary classification model show calibration gaps across different demographic groups?

Calibration gaps occur when prediction probabilities do not match actual outcome rates uniformly across sensitive demographic groups. This skill measures these differences alongside demographic parity and equalized odds to identify algorithmic fairness violations.