digital-health-clinical-asr-finetune

Fine-tune clinical ASR models with NeMo SFT on Parakeet TDT 0.6B.

Updated Apr 16, 2026
One-click install
npx skills add https://github.com/sayalinvidia/sayali-skills-test --skill digital-health-clinical-asr-finetune
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: digital-health-clinical-asr-finetune
Source: https://github.com/sayalinvidia/sayali-skills-test/tree/main/skills/digital-health-clinical-asr-finetune
Command: npx skills add https://github.com/sayalinvidia/sayali-skills-test --skill digital-health-clinical-asr-finetune

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes references (resource) components.

What problem does it solve?

Stage 4 fine-tunes clinical ASR using stock NeMo SFT on Parakeet TDT v2, with offline cycle N+1 evaluation to confirm loop closure.

Core Features & Use Cases

  • Stratified term-aware train/validation split; 3-epoch bf16-mixed SFT; offline evaluation; optional deployment via Riva NIM.
  • Applies to healthcare vocabulary tuning including drug names, conditions, and procedures, with measurable KER improvements.
  • Supports end-to-end workflow from data prep to evaluation, deploying to serving if needed.

Quick Start

Prepare a GPU-enabled environment, split your manifest into train/validation, run the stock NeMo SFT on Parakeet TDT 0.6B, and perform the offline cycle N+1 evaluation.

Frequently Asked Questions about digital-health-clinical-asr-finetune

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I fine-tune ASR for clinical vocabulary and medical terms?

Fine-tuning clinical ASR requires applying stock NeMo speech_to_text_finetune on Parakeet TDT 0.6B. This process reduces Key Error Rate (KER) for healthcare vocabulary like drug names, conditions, and procedures using supervised training.

What is the minimum data needed to fine-tune speech recognition for medical terms?

Fine-tuning speech recognition for medical terms requires a sizable manifest of roughly 100 or more rows. The data must be split into stratified term-aware train and validation sets before running the NeMo SFT workflow.

How does offline cycle N+1 evaluation work for clinical ASR models?

Offline cycle N+1 evaluation confirms loop closure by testing the fine-tuned clinical ASR model after training. It measures KER improvements on healthcare vocabulary to verify the Parakeet TDT base model adapted correctly.

Can I deploy fine-tuned NeMo ASR models to Riva for production serving?

Yes, you can deploy fine-tuned NeMo ASR models to Riva NIM for production serving. This optional step follows the 3-epoch bf16-mixed SFT and offline evaluation phases in the end-to-end workflow.

Why does my ASR model misrecognize drug names and medical conditions?

ASR models misrecognize drug names and medical conditions due to limited clinical vocabulary in the base model. Fine-tuning Parakeet TDT 0.6B with NeMo SFT on domain-specific manifests reduces these Key Error Rate (KER) issues.