What problem does it solve?
This skill helps deploy OpenMed clinical NLP and language models locally, avoiding network exposure and keeping sensitive patient data on hardware you control.
Core Features & Use Cases
- Backend Selection: Choose MLX for Apple Silicon, CoreML for iOS/macOS Neural Engine deployments, or ONNX/WebGPU for cross-platform and browser inference.
- Model Conversion and Quantization: Convert Hugging Face token-classification models into MLX, CoreML, or ONNX artifacts and optimize them with 4-bit, 8-bit, int8, or fp16 quantization.
- Local Clinical Inference: Run NER, de-identification, and MLX language generation entirely offline, including local artifact loading through the standard OpenMed API.
- Validation and Safety: Benchmark quantized models against full-precision versions, verify ONNX exports, account for platform limitations, and protect cached PHI and model outputs.
- Use Case: Deploy a de-identification model in an iPad application or run privacy-preserving clinical text analysis on an Apple Silicon workstation without uploading patient data.
Quick Start
Use this skill to choose an on-device backend, convert and optionally quantize an OpenMed model, then run and validate it locally for clinical NER or de-identification.