voice-ai-engine-development

# Voice AI Engine Development ## Overview This skill guides you through building production-ready voice AI engines with real-time conversation capabilities. Voice AI engines enable natural, bidirectional conversations between users and AI agents through streaming audio processing, speech-to-text transcription, LLM-powered responses, and text-to-speech synthesis. The core architecture uses an async queue-based worker pipeline where each component runs independently and communicates via `asyncio.Queue` objects, enabling concurrent processing, interrupt handling, and real-time streaming at every stage. ## When to Use This Skill Use this skill when: - Building real-time voice conversation systems - Implementing voice assistants or chatbots - Creating voice-enabled customer service agents - Developing voice AI applications with interrupt capabilities - Integrating multiple transcription, LLM, or TTS providers - Working with streaming audio processing pipelines - The user mentions Vocode, voice engines, or conversational AI ## Core Architecture Principles ### The Worker Pipeline Pattern Every voice AI engine follows this pipeline: ``` Audio In → Transcriber → Agent → Synthesizer → Audio Out (Worker 1) (Worker 2) (Worker 3) ``` **Key Benefits:** - **Decoupling**: Workers only know about their input/output queues - **Concurrency**: All workers run simultaneously via asyncio - **Backpressure**: Queues automatically handle rate differences - **Interruptibility**...