skills.rest
Orchestra-Research
Orchestra-ResearchOFFICIAL
Explore all skills by this author →
GitHub

whisper

Transcribe and translate multilingual audio into text using OpenAI's Whisper speech recognition models.

13.0k|930|Updated Nov 3, 2025
Search Tags:#translation#speech recognition#transcription#whisper#audio processing#multilingual#asr
One-click install
npx skills add https://github.com/Orchestra-Research/AI-research-SKILLs --skill whisper-orchestra-research
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: whisper
Source: https://github.com/Orchestra-Research/AI-research-SKILLs/tree/main/18-multimodal/whisper
Command: npx skills add https://github.com/Orchestra-Research/AI-research-SKILLs --skill whisper-orchestra-research

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires openai-whisper, transformers, torch, and includes references (resource) components.

What problem does it solve? Converting spoken audio into accurate text manually is slow and impractical at scale, especially across multiple languages, noisy recordings, or long podcast and meeting files. ## Core Features & Use Cases - Multilingual Transcription: Transcribe speech in 99 languages with six model sizes from tiny (39M) to large (1550M parameters), balancing speed and accuracy. - Translation to English: Convert audio in any supported language directly into English text using the translate task. - Flexible Output Formats: Generate plain text, SRT/VTT subtitles, or JSON with word-level timestamps via CLI or Python API. - Use Case: Transcribe a batch of recorded podcast episodes into timestamped subtitle files, then feed the text into a LangChain RAG pipeline for searchable show notes. ## Quick Start Transcribe the attached audio file 'podcast-episode.mp3' into text with timestamps using the turbo model.

Frequently Asked Questions about whisper

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I transcribe audio to text with Whisper in Python?▼

Install openai-whisper and ffmpeg, then load a model with whisper.load_model("base") and call model.transcribe("audio.mp3"). The result dictionary contains the full text plus timestamped segments.

Which Whisper model size should I use for transcription?▼

Use turbo for the best speed-to-quality balance and base for quick prototyping. The large model (1550M parameters) gives highest accuracy but needs about 10 GB of VRAM, while tiny runs fastest with lower accuracy.

Can Whisper translate foreign language audio to English?▼

Yes, pass task="translate" to model.transcribe and Whisper converts speech in any of its 99 supported languages directly into English text. Translation quality is best for top-tier languages like Spanish, French, and German.

Does Whisper support real-time streaming transcription?▼

The standard openai-whisper package is not designed for live captioning due to latency. For streaming or faster inference, use faster-whisper, which runs roughly 4x faster with CTranslate2 optimization.

What are the limitations of Whisper speech recognition?▼

Whisper can hallucinate or repeat text, accuracy degrades on audio longer than 30 minutes, and it provides no speaker diarization. Background noise and strong accents also reduce transcription quality.

Related Skills

Explore More Software Engineering Skills→
buda-aibuda-ai
25

audio-extractor

Extract and enhance audio from video files for MP3/WAV/AAC output.

Official
Intermediate
christian-bromannchristian-bromann
3

langchain-knowledge-base

Build a searchable knowledge base from documents using LangChain.

Community
Advanced
kendreadityakendreaditya

assemblyai

Transcribe audio and video files into text using AssemblyAI's CLI.

Community
Advanced
framerslabframerslab

voice-telephony

Route voice calls via Twilio, Telnyx, and Plivo with streaming STT/TTS.

Official
Advanced