healthcare-eval-harness

Runs patient safety test gates that block healthcare application deployments on failures.

1|Updated Oct 11, 2025
One-click install
npx skills add https://github.com/ibytechaos/claude --skill healthcare-eval-harness-ibytechaos
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: healthcare-eval-harness
Source: https://github.com/ibytechaos/claude/tree/main/plugins/everything-claude-code/skills/healthcare-eval-harness
Command: npx skills add https://github.com/ibytechaos/claude --skill healthcare-eval-harness-ibytechaos

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve? Deploying healthcare applications without verifying clinical decision support accuracy, PHI protection, and data integrity risks patient safety and regulatory violations. This Skill enforces automated safety gates that block unsafe deployments. ## Core Features & Use Cases - Five-Category Safety Gates: Runs CDSS Accuracy, PHI Exposure, Data Integrity (100% pass required), plus Clinical Workflow and Integration Compliance (95%+ required) test suites. - Deployment Blocking: A single CRITICAL failure halts the deployment pipeline, with CI/CD integration via GitHub Actions using Jest with --bail and coverage thresholds. - Use Case: After modifying drug interaction logic in an EMR system, run the harness to verify all CDSS tests pass at 100% before merging, and generate an eval report confirming the build is safe to deploy. ## Quick Start Run the healthcare safety gate on my EMR project and tell me whether it is safe to deploy based on the CDSS, PHI, and data integrity test results.

Frequently Asked Questions about healthcare-eval-harness

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I test clinical decision support logic before deployment?

Run the CDSS Accuracy test suite with npx jest --testPathPattern='tests/cdss' --bail --ci --coverage. This validates drug interaction pairs, dose validation rules, and clinical scoring against published specs, requiring a 100% pass rate.

How to check for PHI leaks in a healthcare application?

Run the PHI Exposure suite with npx jest --testPathPattern='tests/security/phi' --bail --ci. It tests API error responses, console output, URL parameters, browser storage, cross-facility isolation, and unauthenticated access for protected health information leaks.

Can I use this safety gate with Vitest or pytest instead of Jest?

Yes, the test categories and pass thresholds are framework-agnostic. Jest is the reference runner in the examples, but you can adapt the commands to Vitest, pytest, PHPUnit, or other frameworks while keeping the same gating logic.

What happens when a critical healthcare test fails in CI?

Any failure in the three CRITICAL gates (CDSS Accuracy, PHI Exposure, Data Integrity) blocks deployment entirely. The pipeline uses --bail to stop on the first failure, and the safety gate must be green before release.

Why does the clinical workflow gate allow 95% instead of 100%?

Clinical Workflow and Integration are HIGH gates, not CRITICAL, so they tolerate a 95% pass rate with a warning and manual review. Patient-safety-critical categories like CDSS and PHI always require 100%.