nvidia-audio-asr

Evaluates SenseVoice speech recognition inference performance on NVIDIA GPUs with CER and WER metrics.

7|1|Updated Apr 17, 2026
One-click install
npx skills add https://github.com/DeepLink-org/DeepEval-Skills --skill nvidia-audio-asr-deeplink-org
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: nvidia-audio-asr
Source: https://github.com/DeepLink-org/DeepEval-Skills/tree/main/skills/NVIDIA/audio/nvidia-audio-asr
Command: npx skills add https://github.com/DeepLink-org/DeepEval-Skills --skill nvidia-audio-asr-deeplink-org

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve? Benchmarking automatic speech recognition models on NVIDIA GPUs requires manual container setup, dataset mounting, inference execution, and metric collection. This Skill automates the full evaluation workflow for the SenseVoiceSmall multilingual ASR model, producing standardized accuracy and throughput reports. ## Core Features & Use Cases - Containerized Evaluation Workflow: Guides Docker container startup with GPU mounting, volume mapping for model weights, datasets, and configs, then runs inference via infer_runner.py. - Multi-Dataset ASR Benchmarking: Supports 28 speech recognition datasets including Aishell-1, LibriSpeech, FLEURS, and KeSpeech across Chinese, English, Japanese, Cantonese, and Korean. - Automated Metric Collection: Extracts CER (character error rate), WER (word error rate), average inference time, and success rate from acc_report.json into a structured result.json. - Use Case: A hardware evaluation engineer needs to measure SenseVoiceSmall recognition accuracy and per-sample latency on an NVIDIA H200 across the KeSpeech dialect datasets; the Skill drives container launch, inference, and metric aggregation end to end. ## Quick Start Ask the agent to test SenseVoiceSmall speech recognition inference performance on NVIDIA GPU using the Aishell-1 dataset and collect the CER metrics.

Frequently Asked Questions about nvidia-audio-asr

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I benchmark SenseVoice speech recognition on NVIDIA GPU?

Launch the provided Docker image with GPU access, mount the model weights, datasets, and config directories, then run infer_runner.py with the model directory and dataset config. Results including CER and average inference time are written to acc_report.json.

How to test ASR model accuracy with CER and WER metrics?

Run the inference script against a supported dataset and read the metrics from acc_report.json. Chinese datasets report CER (character error rate) while English datasets report WER (word error rate), along with per-sample inference time.

What datasets are supported for SenseVoiceSmall evaluation?

The evaluation supports 28 speech recognition datasets including aishell1, librispeech-test-clean, librispeech-test-other, multiple FLEURS language subsets, and eight KeSpeech Chinese dialect datasets, all in LMDB format.

Why does the ASR evaluation fail with CUDA out of memory?

CUDA out of memory occurs when the selected GPU's VRAM is occupied by other processes. Check usage with nvidia-smi, then set CUDA_VISIBLE_DEVICES to a free GPU and rerun the inference script.

Can I run this ASR benchmark without Docker?

No, the workflow is designed around the prebuilt Docker image containing Python 3.10, PyTorch 2.6, and the infer_runner.py entrypoint. You must mount model, dataset, and config volumes into the container for evaluation to run.