nvidia-audio-au

Benchmarks language identification model inference accuracy and latency on NVIDIA GPUs.

7|1|Updated Apr 17, 2026
One-click install
npx skills add https://github.com/DeepLink-org/DeepEval-Skills --skill nvidia-audio-au-deeplink-org
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: nvidia-audio-au
Source: https://github.com/DeepLink-org/DeepEval-Skills/tree/main/skills/NVIDIA/audio/nvidia-audio-au
Command: npx skills add https://github.com/DeepLink-org/DeepEval-Skills --skill nvidia-audio-au-deeplink-org

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve? Evaluating speech understanding models on NVIDIA GPUs requires manual container setup, dataset mounting, inference execution, and metric collection. This Skill automates the full evaluation workflow for the lang-id-voxlingua107-ecapa language identification model, producing standardized ACC and latency reports. ## Core Features & Use Cases - Automated Container Orchestration: Launches a prebuilt Docker evaluation environment with correct GPU, shared memory, and volume mount configurations. - Standardized Inference Evaluation: Runs the infer_runner.py pipeline against the foundation-lid LMDB dataset and collects predictions and logs. - Metric Extraction: Parses acc_report.json to produce ACC (accuracy), avg_inference_time, success_rate, and total_samples in a structured result.json. - Use Case: An engineer needs to verify that the VoxLingua107 ECAPA-TDNN model meets accuracy targets on an NVIDIA H200. The Skill starts the container, runs inference on 1000 samples, and outputs a JSON report with accuracy and per-sample inference time. ## Quick Start Ask the agent to test the lang-id-voxlingua107-ecapa language identification model inference performance on NVIDIA GPU with the foundation-lid dataset.

Frequently Asked Questions about nvidia-audio-au

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I benchmark language identification model inference on NVIDIA GPU?

Run the evaluation in the provided Docker container by mounting model checkpoints, the foundation-lid dataset, and config directory, then execute infer_runner.py with the model and dataset paths. The script outputs ACC accuracy and average inference time per sample.

What metrics does audio model inference evaluation report?

The evaluation reports ACC (language identification accuracy) as the primary metric, plus avg_inference_time per sample, success_rate, and total_samples. Results are written to acc_report.json and aggregated into result.json.

What datasets and models are supported for speech understanding evaluation?

Currently the lang-id-voxlingua107-ecapa model, an ECAPA-TDNN trained on VoxLingua107 covering 107 languages, is supported. The supported dataset is foundation-lid, stored as LMDB shards with a meta.json file.

Why does the evaluation fail with CUDA out of memory?

CUDA out of memory occurs when the selected GPU's VRAM is occupied by other processes. Run nvidia-smi to check usage, then set CUDA_VISIBLE_DEVICES to a free GPU and rerun the inference script.

Can I run this evaluation without Docker?

No, the workflow is designed around the prebuilt Docker image containing Python 3.10, PyTorch 2.6.0, SpeechBrain, and the infer_runner.py entrypoint. You must mount model weights, datasets, and config into the container volumes.