ax-audio

Generate Ax audio code for transcription, speech synthesis, and realtime chat audio.

2.9k|186|Updated Feb 23, 2023
One-click install
npx skills add https://github.com/ax-llm/ax --skill ax-audio
Or copy as Structured Prompt for Agent
Please help me install this Agent Skill.
Skill: ax-audio
Source: https://github.com/ax-llm/ax/tree/main/website/static/typescript/.well-known/agent-skills/ax-audio
Command: npx skills add https://github.com/ax-llm/ax --skill ax-audio

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

This Skill helps you choose and implement the correct Ax audio workflow so you can move between transcription, speech generation, structured audio outputs, and realtime conversation without mixing up incompatible APIs or configuration shapes.

Core Features & Use Cases

  • Batch speech workflows: Use ai.transcribe for speech to text and ai.speak for text to speech with the right provider settings.
  • Structured audio generation: Return synthesized audio as part of typed signatures when a program needs both text and spoken output.
  • Conversational and realtime audio: Configure chat-based audio for OpenAI, Gemini Live, and Grok Voice with provider-specific defaults and audio turn handling.
  • Agent audio behavior: Handle audio inputs in agents by transcribing them before internal reasoning stages so downstream logic works on text.
  • Use case: Build a voice assistant that accepts recorded audio, produces a transcript, and returns a spoken response in a single Ax flow.

Quick Start

Use the ax-audio skill to help me implement the correct Ax audio pattern for my app, whether I need transcription, speech synthesis, structured audio output, or realtime chat audio.

Frequently Asked Questions about ax-audio

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I configure realtime conversational audio for OpenAI and Gemini Live?

Configure realtime conversational audio by applying provider-specific defaults for OpenAI Realtime, Gemini Live, and Grok Voice, ensuring audio formats, sample rates, and chat turns are correctly matched for streaming workflows.

What is the best way to generate structured audio outputs alongside text in a single flow?

Generate structured audio outputs by returning synthesized speech as part of typed signatures, allowing your program to produce both text and spoken responses simultaneously within one workflow configuration.

How do I handle audio inputs in agents before reasoning stages?

Handle audio inputs in agents by transcribing them into text before internal reasoning stages, ensuring downstream logic processes the transcript correctly without dealing with raw audio formats.

Can I use batch transcription and text to speech with OpenAI-compatible providers?

Yes, you can use batch transcription and text to speech with OpenAI-compatible providers by applying the correct provider settings for speech-to-text and text-to-speech operations in batch workflows.

Why does my audio workflow fail when mixing incompatible APIs and configuration shapes?

Audio workflows fail when mixing incompatible APIs because transcription, speech generation, and realtime conversation require distinct configuration shapes and provider-specific constraints for batch and streaming formats.