healthcare-eval-harness

Detect patient-safety and PHI failures to block healthcare deployments in CI/CD.

Updated Aug 23, 2026
One-click install
npx skills add https://github.com/Maelwalser/claude-config --skill healthcare-eval-harness-maelwalser
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: healthcare-eval-harness
Source: https://github.com/Maelwalser/claude-config/tree/main/skills/healthcare-eval-harness
Command: npx skills add https://github.com/Maelwalser/claude-config --skill healthcare-eval-harness-maelwalser

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

This Skill enforces patient-safety and PHI protection checks in CI/CD so that deployments that could harm patients or leak sensitive health information are automatically blocked before release.

Core Features & Use Cases

  • Critical Safety Gates: Executes CDSS Accuracy, PHI Exposure, and Data Integrity suites with 100% pass requirements; any failure blocks deployment.
  • High-Confidence Checks: Runs Clinical Workflow and Integration suites with 95%+ pass thresholds and surfaces warnings for human review.
  • CI Integration & Reporting: Produces CI-friendly JSON results, supports bail behavior and coverage thresholds, and integrates into GitHub Actions or other pipelines.
  • Use Cases: Pre-deployment EMR/EHR release validation, post-CDSS logic changes, schema migrations touching patient records, and automated compliance gating.

Quick Start

Run the eval harness in your CI to stop deploys when any critical patient-safety or PHI test fails.

Frequently Asked Questions about healthcare-eval-harness

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I block unsafe healthcare deployments in a CI/CD pipeline?

Block unsafe healthcare deployments by running an automated eval harness in your CI/CD pipeline that detects patient-safety failures and PHI exposure issues. It enforces strict pass thresholds and emits CI-readable JSON results to automatically halt releases.

What pass thresholds are required for CDSS updates and PHI data integrity tests?

CDSS accuracy, PHI exposure, and data integrity tests require a 100% pass threshold to prevent deployment. Clinical workflow and integration tests require a 95% or higher pass threshold, surfacing warnings for human review.

Can I use this safety gate for EMR and EHR schema migrations?

Yes, you can apply this safety gate to EMR and EHR schema migrations touching patient records. The harness validates pre-deployment compliance and clinical workflow integrity, automatically blocking releases when critical tests fail.

How does the harness report test results for automated compliance gating?

The harness reports test results by emitting CI-friendly JSON files for automated compliance gating. It supports bail behavior and coverage thresholds, integrating seamlessly into GitHub Actions or other CI platforms.

When do I need automated patient-safety checks in healthcare software releases?

You need automated patient-safety checks when deploying CDSS logic updates, migrating patient record schemas, or validating EMR releases. The harness enforces compliance gates to prevent deployments that could harm patients or leak sensitive health data.

What happens if a clinical workflow test falls below the 95% threshold?

If a clinical workflow test falls below the 95% threshold, the harness surfaces warnings for human review instead of hard-blocking the deployment. Only critical CDSS, PHI, and data integrity failures enforce a hard deployment block.