voice-ai

Build production voice AI agents with streaming STT, LLM, and TTS.

28|3|Updated Dec 10, 2025
One-click install
npx skills add https://github.com/ScientiaCapital/skills --skill voice-ai
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: voice-ai
Source: https://github.com/ScientiaCapital/skills/tree/main/active/voice-ai-skill
Command: npx skills add https://github.com/ScientiaCapital/skills --skill voice-ai

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Production-ready voice AI pipelines enable real-time, end-to-end voice conversations in telephony contexts with sub-500ms latency, bridging STT, LLM, and TTS.

Core Features & Use Cases

  • Streaming STT (Deepgram Nova-3) for near real-time transcription
  • Streaming LLM (Groq llama-3.1-8b-instant) for fast responses
  • Streaming TTS (Cartesia Sonic) with emotion controls and bilingual support
  • Twilio Media Streams integration for low-latency audio transport
  • Bilingual English/Spanish support for IVR and call-centers

Quick Start

Run the quick-start to deploy a production voice pipeline with streaming STT, LLM, and TTS.

Frequently Asked Questions about voice-ai

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I build a voice AI agent with sub-500ms latency for telephony?▼

To build a voice AI agent with sub-500ms latency, you need a streaming pipeline combining Deepgram for STT, Groq for LLM generation, Cartesia for TTS, and Twilio for real-time media transport. This achieves production-grade, real-time voice conversations.

What is the best way to integrate real-time STT and TTS for IVR call centers?▼

The best way to integrate real-time STT and TTS for IVR call centers is using a streaming pipeline with Deepgram Nova-3 for transcription and Cartesia Sonic for voice synthesis, ensuring near real-time responses with bilingual support.

Can I use Groq and Twilio Media Streams for low-latency phone bots?▼

Yes, you can use Groq with Twilio Media Streams for low-latency phone bots. Groq's llama-3.1-8b-instant provides fast LLM responses, while Twilio handles real-time audio transport to maintain sub-500ms end-to-end latency.

Does this voice AI pipeline support bilingual English and Spanish interactions?▼

Yes, the voice AI pipeline supports bilingual English and Spanish interactions. It uses Cartesia Sonic for streaming TTS with emotion controls, enabling bilingual real-time voice responses for telephony and call center use cases.

Why avoid OpenAI when building low-latency real-time voice agents?▼

Avoiding OpenAI for low-latency real-time voice agents is necessary because Groq provides faster LLM generation with llama-3.1-8b-instant. This streaming approach ensures the pipeline maintains sub-500ms end-to-end latency for telephony.

Do I need Deepgram and Cartesia for streaming voice AI transcription and synthesis?▼

Yes, you need Deepgram and Cartesia for streaming voice AI transcription and synthesis. Deepgram Nova-3 handles near real-time STT, while Cartesia Sonic manages streaming TTS with emotion controls to achieve sub-500ms latency.