fairness-auditing

Audit allocation mechanisms for group and intersectional disparities.

7|2|Updated Mar 5, 2026
One-click install
npx skills add https://github.com/AndurilCode/craftwork --skill fairness-auditing
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: fairness-auditing
Source: https://github.com/AndurilCode/craftwork/tree/main/skills/fairness-auditing
Command: npx skills add https://github.com/AndurilCode/craftwork --skill fairness-auditing

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

It helps you determine whether a system that allocates outcomes across groups is equitable by selecting explicit fairness definitions, measuring disparities, and identifying where bias enters.

Core Features & Use Cases

  • Fairness-definition scoping: Chooses and documents the fairness criteria (e.g., demographic parity, equal opportunity, predictive parity) and clarifies value trade-offs.
  • Data and proxy investigation: Checks for historical bias, label bias, representation gaps, and proxy variables that reconstruct protected attributes.
  • Disparity measurement and intersectional analysis: Computes group-level and intersectional disparities, including significance and calibration considerations.
  • Mitigation planning: Recommends pre-, in-, and post-processing interventions and assesses likely fairness gains versus accuracy trade-offs.

Quick Start

Ask the AI to perform a fairness audit for your allocation system by stating the decision type, affected groups, relevant protected attributes, and the fairness definition(s) you want to test.

Frequently Asked Questions about fairness-auditing

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I audit algorithmic bias in a scoring model?

Auditing algorithmic bias involves selecting fairness definitions like demographic parity, measuring intersectional disparities with significance checks, and identifying historical bias or proxy variables that reconstruct protected attributes.

What is disparate impact and how is it measured in algorithmic fairness?

Disparate impact is measured by computing group-level and intersectional outcome rate ratios, then applying statistical significance checks to quantify disparities across protected demographic groups.

What's the best way to check for proxy variables in machine learning models?

Check for proxy variables by auditing training data for representation gaps and features that reconstruct protected attributes, identifying where historical bias enters the allocation mechanism.

How do I mitigate algorithmic bias after detecting disparate impact?

Mitigate algorithmic bias by applying pre-, in-, or post-processing interventions, then assess fairness gains versus accuracy trade-offs and document residual-risk recommendations for the allocation system.

Can I evaluate intersectional fairness for algorithmic hiring or lending models?

Yes, evaluate intersectional fairness by computing disparities across overlapping demographic groups and applying significance checks to ensure equitable outcomes in algorithmic hiring, lending, or triage models.

When do I need to define fairness criteria for an allocation mechanism?

Define fairness criteria when outcome rates differ by group membership, clarifying value trade-offs between definitions like demographic parity, equal opportunity, and predictive parity before measuring disparities.