k2-training-pipeline

Train ASR and TTS models with k2, icefall, and lhotse pipelines.

17|3|Updated Apr 3, 2026
One-click install
npx skills add https://github.com/jayll1303/AIEKit --skill k2-training-pipeline
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: k2-training-pipeline
Source: https://github.com/jayll1303/AIEKit/tree/main/.kiro/skills/k2-training-pipeline
Command: npx skills add https://github.com/jayll1303/AIEKit --skill k2-training-pipeline

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes references (resource) components.

What problem does it solve?

This skill removes the complexity of building end-to-end speech training pipelines by orchestrating data preparation, model training, fine-tuning, and export for ASR and TTS systems so you can produce deployment-ready models with predictable steps and validations.

Core Features & Use Cases

  • Data preparation with lhotse: create manifests, cuts, and features for common corpora and custom datasets.
  • Training recipes via icefall: run Zipformer, Conformer, and VITS training and fine-tuning with k2 loss (CTC, LF-MMI, pruned RNN-T).
  • Model export & deployment: export encoder/decoder/joiner to ONNX or torchscript and validate for sherpa-onnx deployment.
  • Use Case: prepare LibriSpeech with lhotse, train a Zipformer transducer with icefall, fine-tune on custom data, then export ONNX models for real-time inference.

Quick Start

Prepare data with lhotse, run icefall training for your chosen recipe, then export the trained model to ONNX and validate it with the recipe's ONNX test script.

Frequently Asked Questions about k2-training-pipeline

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I train a speech recognition model using k2 and icefall?

To train speech recognition models with k2 and icefall, you prepare data manifests using lhotse, run icefall training recipes for architectures like Zipformer or Conformer with k2 loss computation, then export the trained model to ONNX for deployment.

Can I fine-tune a Zipformer model on my own custom speech corpus?

Yes, you can fine-tune Zipformer transducer models on custom corpora by applying the icefall training pipeline, which supports fine-tuning workflows alongside standard k2 loss functions like CTC, LF-MMI, and pruned RNN-T.

How do I export an ASR model to ONNX for sherpa-onnx deployment?

You export ASR models to ONNX by following ONNX export conventions within the icefall pipeline, separating encoder, decoder, and joiner components, then validating the exported files using the recipe's ONNX test script for sherpa-onnx compatibility.

What is the best way to prepare speech datasets for icefall training recipes?

The best way to prepare speech datasets for icefall training is using lhotse to create manifests, cuts, and extract features, ensuring your audio data meets the required manifest formats for both common corpora and custom datasets.

Does the k2 training pipeline support TTS models like VITS?

Yes, the k2 training pipeline supports TTS models including VITS, allowing you to handle data preparation, training, and ONNX export for both automatic speech recognition and text-to-speech projects within the same workflow.

What loss functions are available when training Conformer models with k2?

When training Conformer models with k2, available loss functions include Connectionist Temporal Classification (CTC), Lattice-Free Maximum Mutual Information (LF-MMI), and pruned RNN-T loss computation integrated through icefall recipes.