speech-recognition

Transcribe live microphone or pre-recorded audio into text using Apple's Speech framework.

Updated Jun 5, 2026
One-click install
npx skills add https://github.com/harshav167/build-ios-apps --skill speech-recognition-harshav167
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: speech-recognition
Source: https://github.com/harshav167/build-ios-apps/tree/main/skills/speech-recognition
Command: npx skills add https://github.com/harshav167/build-ios-apps --skill speech-recognition-harshav167

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Transcribe speech to text from live microphone input or pre-recorded audio using Apple's Speech framework, covering modern iOS 26+ workflows with SpeechAnalyzer, SpeechTranscriber, DictationTranscriber, AssetInventory, and async result streams.

Core Features & Use Cases

  • Live transcription via AVAudioEngine and SFSpeechRecognizer or SpeechAnalyzer, supporting progressive and time-indexed results.
  • Transcription of pre-recorded audio files with configurable locale handling and optional alternatives.
  • Robust authorization handling for speech recognition and microphone access, plus model asset management for SpeechAnalyzer workflows.
  • Guidance on choosing on-device vs server-backed recognition and appropriate fallbacks for different devices/locales.

Quick Start

Transcribe live microphone input or a pre-recorded audio file and return the transcript for immediate use.

Frequently Asked Questions about speech-recognition

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I transcribe live microphone audio to text on iOS?

Transcribe live microphone audio to text on iOS by routing AVAudioEngine buffers to SpeechAnalyzer or SFSpeechRecognizer. This streams asynchronous, progressive results with time-indexed transcripts while managing microphone and speech authorization.

Can I use on-device speech recognition instead of server-backed recognition on iOS?

On-device speech recognition works on iOS using SpeechAnalyzer or SFSpeechRecognizer, providing offline transcription without server dependency. Server-backed recognition offers broader locale support, while on-device processing ensures privacy and consistent availability.

What is the best way to transcribe pre-recorded audio files using Apple's Speech framework?

Transcribe pre-recorded audio files using SpeechTranscriber or SFSpeechRecognizer to process the audio asset. The framework supports configurable locale handling and optional alternatives, returning the finalized text transcript for immediate use.

How do I handle microphone and speech recognition authorization for iOS transcription?

Handle microphone and speech recognition authorization by explicitly requesting user permissions before starting iOS transcription. Robust authorization management ensures speech access is granted, allowing SpeechAnalyzer to capture live audio buffers without interruption.

Do I need to install model assets before using SpeechAnalyzer for speech to text?

Install required model assets using AssetInventory before using SpeechAnalyzer for speech to text. Managing these assets ensures the necessary on-device recognition models are downloaded and available before initiating analyzer sessions.

Why does my iOS speech recognition session need explicit finalization or cancellation?

iOS speech recognition sessions require explicit finalization or cancellation to properly conclude analyzer input streams. Finalizing returns the complete transcription result, while canceling halts processing and releases the active session resources.