decision-curve-analysis

Performs Decision Curve Analysis to evaluate clinical utility of health AI models.

Updated Aug 23, 2026
One-click install
npx skills add https://github.com/EvidenceOS/awesome-health-ai-skills --skill decision-curve-analysis
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: decision-curve-analysis
Source: https://github.com/EvidenceOS/awesome-health-ai-skills/tree/main/skills/ai-evaluation/decision-curve-analysis
Command: npx skills add https://github.com/EvidenceOS/awesome-health-ai-skills --skill decision-curve-analysis

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires dcurves, pandas, numpy, and includes scripts (resource) and references (resource) components.

What problem does it solve?

This Skill addresses the critical gap in evaluating health AI models by determining if they lead to better clinical decisions, beyond just discrimination or calibration.

Core Features & Use Cases

  • Net Benefit Calculation: Quantifies the clinical utility of a model across various risk thresholds.
  • Decision Curve Visualization: Plots net benefit against threshold probability to identify where a model adds value compared to standard strategies.
  • Use Case: Evaluating a new AI model that predicts sepsis risk. DCA helps determine if using the model to guide treatment decisions (e.g., initiating antibiotics) is more beneficial than treating all patients or treating none, across different patient risk levels.

Quick Start

Run the decision-curve-analysis skill to generate a DCA plot for your model predictions and true outcomes.

Frequently Asked Questions about decision-curve-analysis

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
What is decision curve analysis and how does it evaluate clinical utility?

Decision curve analysis evaluates clinical utility by comparing a model's net benefit against threshold probabilities to determine if it improves clinical decisions. It plots net benefit across risk thresholds to show where the model adds value over treat-all or treat-none strategies.

How do I calculate net benefit for a diagnostic AI model in Python?

You calculate net benefit for a diagnostic AI model in Python using the `dcurves` library to process true outcomes and model predictions. This computes clinical utility across various risk thresholds, quantifying the model's decision-making value.

Can I use pandas and numpy dataframes to perform DCA on health AI predictions?

Yes, you can use pandas and numpy dataframes to perform DCA on health AI predictions. The Skill requires these dependencies alongside `dcurves` to structure your prediction data and compute net benefit curves for clinical evaluation.

What is the best way to visualize net benefit against treat-all and treat-none strategies?

The best way to visualize net benefit against treat-all and treat-none strategies is by generating a DCA plot. This visualizes the model's clinical utility across threshold probabilities, identifying exactly where AI-guided treatment decisions provide value.

When do I need decision curve analysis for evaluating prognostic models?

You need decision curve analysis for evaluating prognostic models when assessing their clinical utility in decision-making. DCA determines if model-guided interventions, like sepsis treatment, yield higher net benefit than treating all or no patients across risk thresholds.

Does decision curve analysis measure model discrimination or calibration?

Decision curve analysis does not measure model discrimination or calibration. It evaluates clinical utility by calculating net benefit, filling the critical gap of determining whether AI models actually lead to better clinical decisions across threshold probabilities.