by-failure-diagnosis

Run Mann-Whitney U tests on PASS/FAIL designs to diagnose failure modes.

104|10|Updated Mar 23, 2026
One-click install
npx skills add https://github.com/001TMF/blatant-why --skill by-failure-diagnosis
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: by-failure-diagnosis
Source: https://github.com/001TMF/blatant-why/tree/main/templates/.claude/skills/by-failure-diagnosis
Command: npx skills add https://github.com/001TMF/blatant-why --skill by-failure-diagnosis

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires scipy, numpy, pandas, matplotlib, and includes scripts (resource) and references (resource) components.

What problem does it solve?

Diagnose failure modes by testing whether PASS designs differ from FAIL designs on key numeric features using Mann-Whitney U tests.

Core Features & Use Cases

  • Runs Mann-Whitney U tests between PASS and FAIL groups for canonical metrics (ipsae, ipsae_min, iptm, plddt, rmsd, liabilities, cdr3_length, hydrophobic_fraction, net_charge) with Benjamini-Hochberg correction.
  • Produces a structured diagnosis containing discriminating features, effect sizes, and q-values, plus a human-readable table and top recommendations.
  • Provides CLI scripts (diagnose_from_csv.py, plot_distributions.py) to generate dashboards, plots, and exportable results for downstream optimization.

Quick Start

Run the diagnosis tool on your campaign's screening output to obtain a feature-discrimination report and recommended next actions.

Frequently Asked Questions about by-failure-diagnosis

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I diagnose why some designs fail and others pass using screening data?

You can diagnose failure modes by running Mann-Whitney U tests on PASS and FAIL design groups to identify statistically significant numeric feature differences. The tool applies Benjamini-Hochberg correction and reports p-values, q-values, and effect sizes to pinpoint discriminating metrics.

What statistical analysis is needed to compare PASS versus FAIL design groups?

Statistical comparison of PASS versus FAIL groups requires Mann-Whitney U tests on numeric feature columns. This non-parametric approach detects distributional differences between successful and failed designs without assuming normal data distribution.

Can I use pandas and scipy to identify discriminating metrics in a design campaign?

Yes, the diagnosis tool uses pandas and scipy to process your CSV data and calculate feature discrimination. It requires a PASS/FAIL status column alongside numeric feature columns to run the tests and generate actionable optimization recommendations.

What input data format is required for statistical failure post-mortem of designs?

Statistical failure post-mortem requires input CSV data containing a PASS/FAIL status column and numeric feature columns for canonical metrics like ipsae, iptm, plddt, rmsd, and cdr3_length. The scripts parse this tabular data to generate dashboards and exportable results.

When should I shift from threshold tuning to hypothesis debate in design iterations?

You should shift to hypothesis debate when the diagnosis report shows no statistically significant discriminating features between PASS and FAIL groups. If Benjamini-Hochberg corrected q-values indicate no meaningful feature separation, simple parameter changes and threshold tuning will likely be insufficient.

Does Benjamini-Hochberg correction work for multiple feature comparisons in failure diagnosis?

Yes, Benjamini-Hochberg correction is applied during failure diagnosis to control the false discovery rate across multiple Mann-Whitney U tests. It adjusts p-values into q-values, ensuring reported discriminating features between PASS and FAIL designs are statistically reliable.