skills.rest
pascalvanderheiden
pascalvanderheidenCOMMUNITY
Explore all skills by this author →
GitHub

voice-live

Connect to Azure Voice Live via WebSocket for real-time voice agent orchestration.

Updated Aug 23, 2026
Search Tags:#text-to-speech#real-time#WebSocket#Azure#speech-to-text#voice-live
One-click install
npx skills add https://github.com/pascalvanderheiden/my-agent-skills --skill voice-live
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: voice-live
Source: https://github.com/pascalvanderheiden/my-agent-skills/tree/main/skills/voice-live
Command: npx skills add https://github.com/pascalvanderheiden/my-agent-skills --skill voice-live

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires websockets, azure-identity, pyaudio, and includes scripts (resource) and references (resource) components.

What problem does it solve?

This Skill enables developers to create real-time voice-enabled agents by connecting to Azure Voice Live via WebSocket, providing low-latency audio streaming, speech-to-text, text-to-speech, avatars, and tool integration.

Core Features & Use Cases

  • Real-time bidirectional audio with WebSocket for seamless conversations across languages.
  • Broad STT/TTS capabilities (140+ locales for STT and 600+ voices across locales) and avatar integration for engaging user experiences.
  • Function calling (VoiceRAG) and tool integration to perform live actions, queries, and knowledge access.
  • Session management, turn detection, noise suppression, and echo cancellation to ensure natural, robust interactions.
  • Use Cases: build voice assistants, customer support bots, voice-enabled tutorials, and hands-free workflows.

Quick Start

Prerequisites: Azure Voice Live resource, Python 3.9+, authentication via Entra ID or API key.

Installation: pip install -r requirements.txt

Run minimally: export AZURE_SPEECH_RESOURCE_NAME=your-resource-name python examples/minimal_example.py

Frequently Asked Questions about voice-live

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I build a real-time voice agent with Azure Voice Live and WebSocket?▼

Build a real-time voice agent by connecting to Azure Voice Live via WebSocket for low-latency bidirectional audio streaming. You orchestrate live conversations using session management, audio I/O configuration, and turn detection for seamless interactions.

Can I use Python to manage real-time speech-to-text and text-to-speech streaming?▼

Yes, you can manage real-time speech-to-text and text-to-speech streaming in Python using the websockets and pyaudio libraries. This enables live audio I/O, supporting 140+ locales for STT and 600+ voices for TTS.

Does Azure Voice Live support function calling and tool integration for voice bots?▼

Azure Voice Live supports function calling and tool integration for voice bots through VoiceRAG. This allows your real-time voice agents to perform live actions, execute queries, and access external knowledge during conversations.

How do I handle background noise and echo cancellation in a real-time voice bot?▼

Handle background noise and echo cancellation in a real-time voice bot by utilizing Azure Voice Live's built-in session management features. These capabilities ensure natural, robust voice interactions by automatically suppressing noise and managing turn detection.

What are the prerequisites for running a real-time voice agent with Azure Voice Live?▼

Prerequisites for running a real-time voice agent include an Azure Voice Live resource, Python 3.9 or higher, and authentication via Entra ID or API key. You also need to install the required Python dependencies like azure-identity and pyaudio.

What is the best way to integrate multilingual STT and TTS into a live voice assistant?▼

The best way to integrate multilingual STT and TTS into a live voice assistant is using Azure Voice Live via WebSocket. It provides broad capabilities across 140+ locales for STT and 600+ voices, enabling seamless multilingual conversations.

Related Skills

Explore More Software Engineering Skills→
microsoftmicrosoft
2.9k

azure-ai-voicelive-dotnet

Build real-time bidirectional voice AI applications with the Azure Voice Live SDK for .NET.

Official
Advanced
Folken2Folken2
2

claude-sdk-mcp-integration

Integrate external Model Context Protocol servers into Claude Agent SDK agents.

Community
Intermediate
davidrrowleydavidrrowley

azure-ai-voicelive-dotnet

Enable bidirectional AI voice sessions in .NET using WebSockets and Azure authentication.

Community
Intermediate
TikTzukiTikTzuki

AI Integration Skill

Integrate LLMs, STT, and TTS services with WebSocket audio streaming.

Community
Advanced