healthcare-eval-harness

Runs patient safety test gates that block healthcare application deployments on failures.

Updated Mar 18, 2026
One-click install
npx skills add https://github.com/freedom909/real-estate-saas --skill healthcare-eval-harness-freedom909
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: healthcare-eval-harness
Source: https://github.com/freedom909/real-estate-saas/tree/main/.trae/skills/healthcare-eval-harness
Command: npx skills add https://github.com/freedom909/real-estate-saas --skill healthcare-eval-harness-freedom909

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve? Deploying healthcare applications without verifying clinical decision support accuracy, PHI exposure, and data integrity risks patient safety and regulatory violations. This Skill enforces automated safety gates that block deployments when critical tests fail. ## Core Features & Use Cases - Five Eval Categories: Runs CDSS Accuracy, PHI Exposure, Data Integrity (CRITICAL, 100% pass required), plus Clinical Workflow and Integration Compliance (HIGH, 95%+ required). - CI/CD Safety Gate: Provides a ready GitHub Actions workflow that runs Jest suites with --bail on critical gates and jq-based pass-rate checks on high gates. - Use Case: After modifying drug interaction logic in an EMR system, run the harness locally or in CI to verify all 39 CDSS tests pass at 100% before allowing the deployment to proceed. ## Quick Start Run the healthcare eval harness on this repository and report whether it is safe to deploy based on the critical and high gate results.

Frequently Asked Questions about healthcare-eval-harness

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I add a patient safety gate to a healthcare CI/CD pipeline?▼

Add Jest test steps for CDSS, PHI, and data integrity suites with --bail --ci flags so any failure blocks the pipeline. Then add clinical and integration suites with jq-based pass-rate checks that warn below 95%.

How to test clinical decision support logic before deployment?▼

Run the CDSS test suite covering drug interaction pairs in both directions, dose validation rules, and clinical scoring against published specs. Use npx jest --testPathPattern='tests/cdss' --bail --ci --coverage and require 100% pass rate.

Can I use this eval harness with pytest or Vitest instead of Jest?▼

Yes, the test categories and pass thresholds are framework-agnostic. Jest is only the reference runner; adapt the commands to Vitest, pytest, or PHPUnit while keeping the same CRITICAL and HIGH gate structure.

What PHI exposure checks should healthcare apps run?▼

Test API error responses, console output, URL parameters, and browser storage for protected health information leaks. Also verify cross-facility data isolation, unauthenticated access rejection, and absence of service role keys in client code.

Why does the safety gate block deployment on a single test failure?▼

CDSS accuracy, PHI exposure, and data integrity are CRITICAL gates where one failure can directly harm patients or violate regulations. The harness uses --bail to stop on first failure and requires 100% pass rate with no exceptions.