voice

Orchestrate real-time voice conversations with Deepgram STT, OpenAI GPT-4.1-mini, and Fish Audio TTS.

14|2|Updated Mar 13, 2026
One-click install
npx skills add https://github.com/seanchiuai/openclaude --skill voice-seanchiuai
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: voice
Source: https://github.com/seanchiuai/openclaude/tree/main/.claude/skills/voice
Command: npx skills add https://github.com/seanchiuai/openclaude --skill voice-seanchiuai

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill includes references (resource) components.

What problem does it solve?

Real-time voice conversations require seamless orchestration of speech recognition, language understanding, and speech synthesis across multiple transport paths and voice personas.

Core Features & Use Cases

  • Real-time browser WebSocket and Twilio voice support with unified orchestrator pipeline.
  • Voice cloning and voice pool to match archetype, gender, and speed for consistent personas.
  • End-to-end workflow including Deepgram STT, OpenAI LLM, and Fish Audio TTS with robust error handling.

Quick Start

Start a voice session by clicking the Connect button in the UI to launch real-time STT, LLM, and TTS with a selected voice.

Frequently Asked Questions about voice

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I build a real-time voice conversation pipeline with STT, LLM, and TTS?

Real-time voice conversations require coordinating speech-to-text, language understanding, and text-to-speech. This pipeline combines Deepgram STT, OpenAI GPT-4.1-mini orchestration, and Fish Audio TTS to handle live audio streams, transcripts, and seamless AI response playback.

Can I use voice cloning to maintain consistent personas across browser WebSocket and Twilio calls?

Voice cloning and a mapped voice pool maintain consistent personas across both browser WebSocket sessions and Twilio phone calls. The system matches archetype, gender, and speed to ensure uniform voice profiles throughout real-time interactions.

What's the best way to orchestrate live audio streams for AI voice mode?

Orchestrating live audio streams for voice mode requires a unified pipeline managing real-time speech recognition, LLM processing, and text-to-speech synthesis. It handles user and AI transcripts while ensuring seamless playback of AI responses during active sessions.

Does this voice orchestration pipeline support phone calls via Twilio?

Yes, the voice orchestration pipeline supports Twilio phone calls alongside browser WebSocket sessions. It handles live audio streams, user and AI transcripts, and seamless playback of AI responses across both transport paths with robust error handling.

How do I start a real-time voice session using a selected voice profile?

Start a real-time voice session by clicking the Connect button in the UI to launch STT, LLM, and TTS with a selected voice. This initiates the full orchestration pipeline using your mapped voice pool.

What limitations should I consider when cloning voices for real-time conversations?

Voice cloning for real-time conversations requires robust error handling across STT, LLM, and TTS components. Consider latency management in live audio streams and ensuring voice profile consistency when matching archetype, gender, and speed attributes.