assemblyai-streaming

Stream audio via WebSocket for low-latency AssemblyAI speech-to-text transcription.

49|9|Updated Dec 18, 2025
One-click install
npx skills add https://github.com/ratacat/claude-skills --skill assemblyai-streaming
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: assemblyai-streaming
Source: https://github.com/ratacat/claude-skills/tree/main/skills/assembly-ai-streaming
Command: npx skills add https://github.com/ratacat/claude-skills --skill assemblyai-streaming

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve?

Use AssemblyAI's Streaming STT and LLM Gateway APIs for low-latency transcripts, meeting notes, and voice agents.

Core Features & Use Cases

  • Streaming Speech-to-Text via WebSockets
  • Async/pre-recorded STT via REST
  • LLM Gateway for applying Claude/GPT/Gemini-style models to transcripts

Quick Start

  1. Set ASSEMBLYAI_API_KEY in the environment
  2. Connect to the streaming endpoint and begin streaming audio
  3. Use the LLM gateway for transcript-based Q&A or summaries

Frequently Asked Questions about assemblyai-streaming

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I set up real-time speech-to-text transcription with WebSocket streaming?▼

Speech-to-text streaming connects to AssemblyAI's WebSocket endpoint at wss://streaming.assemblyai.com/v3/ws using your API key. Stream audio in real time to receive low-latency transcripts as words are spoken, ideal for live meetings, voice agents, and microphone input without waiting for recording completion.

Can I transcribe pre-recorded audio files asynchronously?▼

Yes, AssemblyAI's REST API at https://api.assemblyai.com/v2/transcript handles async transcription for pre-recorded files. Submit audio, poll for completion, and retrieve full transcripts—useful when immediate processing isn't required and batch workflows are preferred.

What's the difference between WebSocket streaming and REST transcription?▼

WebSocket streaming delivers transcript events in real time as audio arrives, meeting ultra-low-latency needs for live interaction. REST async transcription processes uploaded or batched audio without live streaming, trading immediacy for simpler integration and fire-and-forget workflows.

How do I apply LLM models like Claude or GPT to transcripts?▼

Use AssemblyAI's LLM Gateway at https://llm-gateway.assemblyai.com to route transcripts to Claude, GPT, or Gemini for Q&A, summarization, or analysis. Combine streaming STT output with LLM processing for voice agents and meeting-note automation in one workflow.

What environments and languages does this support?▼

The Skill runs in Python and Bash environments with API-key authentication. Python and shell scripts can manage WebSocket and REST connections, making it portable across Linux, macOS, and cloud platforms without language-specific SDKs required.

What audio sources can I transcribe in real time?▼

Streaming STT supports live microphone input, telephony feeds, and continuous audio streams via WebSocket. Each source streams audio frames to AssemblyAI, returning transcript events for meeting notetakers, voice-activated applications, and call-center monitoring.