assemblyai-streaming

Stream audio via WebSocket for low-latency AssemblyAI speech-to-text transcription.

49|9|Updated Dec 18, 2025
One-click install
npx skills add https://github.com/ratacat/claude-skills --skill assemblyai-streaming
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: assemblyai-streaming
Source: https://github.com/ratacat/claude-skills/tree/main/skills/assembly-ai-streaming
Command: npx skills add https://github.com/ratacat/claude-skills --skill assemblyai-streaming

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Use AssemblyAI's Streaming STT and LLM Gateway APIs for low-latency transcripts, meeting notes, and voice agents.

Core Features & Use Cases

  • Streaming Speech-to-Text via WebSockets
  • Async/pre-recorded STT via REST
  • LLM Gateway for applying Claude/GPT/Gemini-style models to transcripts

Quick Start

  1. Set ASSEMBLYAI_API_KEY in the environment
  2. Connect to the streaming endpoint and begin streaming audio
  3. Use the LLM gateway for transcript-based Q&A or summaries

Frequently Asked Questions about assemblyai-streaming

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I set up real-time speech-to-text transcription with WebSocket streaming?

Speech-to-text streaming connects to AssemblyAI's WebSocket endpoint at wss://streaming.assemblyai.com/v3/ws using your API key. Stream audio in real time to receive low-latency transcripts as words are spoken, ideal for live meetings, voice agents, and microphone input without waiting for recording completion.

Can I transcribe pre-recorded audio files asynchronously?

Yes, AssemblyAI's REST API at https://api.assemblyai.com/v2/transcript handles async transcription for pre-recorded files. Submit audio, poll for completion, and retrieve full transcripts—useful when immediate processing isn't required and batch workflows are preferred.

What's the difference between WebSocket streaming and REST transcription?

WebSocket streaming delivers transcript events in real time as audio arrives, meeting ultra-low-latency needs for live interaction. REST async transcription processes uploaded or batched audio without live streaming, trading immediacy for simpler integration and fire-and-forget workflows.

How do I apply LLM models like Claude or GPT to transcripts?

Use AssemblyAI's LLM Gateway at https://llm-gateway.assemblyai.com to route transcripts to Claude, GPT, or Gemini for Q&A, summarization, or analysis. Combine streaming STT output with LLM processing for voice agents and meeting-note automation in one workflow.

What environments and languages does this support?

The Skill runs in Python and Bash environments with API-key authentication. Python and shell scripts can manage WebSocket and REST connections, making it portable across Linux, macOS, and cloud platforms without language-specific SDKs required.

What audio sources can I transcribe in real time?

Streaming STT supports live microphone input, telephony feeds, and continuous audio streams via WebSocket. Each source streams audio frames to AssemblyAI, returning transcript events for meeting notetakers, voice-activated applications, and call-center monitoring.