voice-ai

Build production voice AI agents with streaming STT, LLM, and TTS.

28|3|Updated Dec 10, 2025
One-click install
npx skills add https://github.com/ScientiaCapital/skills --skill voice-ai
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: voice-ai
Source: https://github.com/ScientiaCapital/skills/tree/main/active/voice-ai-skill
Command: npx skills add https://github.com/ScientiaCapital/skills --skill voice-ai

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Production-ready voice AI pipelines enable real-time, end-to-end voice conversations in telephony contexts with sub-500ms latency, bridging STT, LLM, and TTS.

Core Features & Use Cases

  • Streaming STT (Deepgram Nova-3) for near real-time transcription
  • Streaming LLM (Groq llama-3.1-8b-instant) for fast responses
  • Streaming TTS (Cartesia Sonic) with emotion controls and bilingual support
  • Twilio Media Streams integration for low-latency audio transport
  • Bilingual English/Spanish support for IVR and call-centers

Quick Start

Run the quick-start to deploy a production voice pipeline with streaming STT, LLM, and TTS.

Frequently Asked Questions about voice-ai

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I build a voice AI agent with sub-500ms latency for telephony?

To build a voice AI agent with sub-500ms latency, you need a streaming pipeline combining Deepgram for STT, Groq for LLM generation, Cartesia for TTS, and Twilio for real-time media transport. This achieves production-grade, real-time voice conversations.

What is the best way to integrate real-time STT and TTS for IVR call centers?

The best way to integrate real-time STT and TTS for IVR call centers is using a streaming pipeline with Deepgram Nova-3 for transcription and Cartesia Sonic for voice synthesis, ensuring near real-time responses with bilingual support.

Can I use Groq and Twilio Media Streams for low-latency phone bots?

Yes, you can use Groq with Twilio Media Streams for low-latency phone bots. Groq's llama-3.1-8b-instant provides fast LLM responses, while Twilio handles real-time audio transport to maintain sub-500ms end-to-end latency.

Does this voice AI pipeline support bilingual English and Spanish interactions?

Yes, the voice AI pipeline supports bilingual English and Spanish interactions. It uses Cartesia Sonic for streaming TTS with emotion controls, enabling bilingual real-time voice responses for telephony and call center use cases.

Why avoid OpenAI when building low-latency real-time voice agents?

Avoiding OpenAI for low-latency real-time voice agents is necessary because Groq provides faster LLM generation with llama-3.1-8b-instant. This streaming approach ensures the pipeline maintains sub-500ms end-to-end latency for telephony.

Do I need Deepgram and Cartesia for streaming voice AI transcription and synthesis?

Yes, you need Deepgram and Cartesia for streaming voice AI transcription and synthesis. Deepgram Nova-3 handles near real-time STT, while Cartesia Sonic manages streaming TTS with emotion controls to achieve sub-500ms latency.