embedded-captions

Composite WhisperX-derived captions behind speakers in videos using ffmpeg matte occlusion.

255|42|Updated Nov 16, 2023
One-click install
npx skills add https://github.com/chmonitor/chmonitor --skill embedded-captions
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: embedded-captions
Source: https://github.com/chmonitor/chmonitor/tree/main/.agents/skills/embedded-captions
Command: npx skills add https://github.com/chmonitor/chmonitor --skill embedded-captions

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires ffmpeg, sharp, puppeteer, gsap, and includes scripts (resource) and references (resource) components.

What problem does it solve?

Talking-head videos require professional, readable captions that integrate with the scene rather than obscure it, but manual motion graphics editing is time-consuming and demands specialized design skills.

Core Features & Use Cases

  • 32 Visual Identities: Choose from cinematic column-flow styles (cream, ink, neon, glitch) or themed constitutions (anchor, ordnance, terminal, arcade) to match any tone from poetic to cyberpunk.
  • Matte Occlusion Pipeline: Uses hyperframes remove-background to composite captions behind the subject, so the speaker's body naturally occludes text for a diegetic, embedded look.
  • Deterministic Rendering: Transcribes audio via WhisperX, validates timing and occlusion gates, and composites via ffmpeg for reproducible outputs.
  • Use Case: A YouTube educator records a 10-minute explainer and uses the 'anchor' identity to add clean verbatim lower-thirds with a single emphasized climax, or a music video director uses the 'neon' identity to make captions glow like signage behind the artist.

Quick Start

Use the embedded-captions skill to add cinematic captions to the video file 'monologue.mp4', choosing the 'cream' identity for a warm poetic look.

Frequently Asked Questions about embedded-captions

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I add captions to a talking-head video that appear behind the subject?▼

Matte occlusion composites captions behind the subject by using the hyperframes remove-background pipeline, so the speaker's body naturally occludes text for a diegetic, embedded look in talking-head videos.

Can I automate motion graphics typography for YouTube monologues using ffmpeg?▼

Yes, deterministic rendering transcribes audio via WhisperX, validates timing and occlusion gates, and composites cinematic captions via ffmpeg for reproducible outputs on YouTube monologues.

Do I need a single-subject video file to apply embedded captions?▼

Yes, applying embedded captions requires a single-subject video file to correctly execute the hyperframes matting pipeline and achieve accurate matte occlusion of the text.

What visual styles are available for cinematic scene-embedded captions?▼

You can choose from 32 visual identities, including cinematic column-flow styles like cream, ink, neon, and glitch, or themed constitutions like anchor, ordnance, terminal, and arcade.

When should I not use matte occlusion for video captioning?▼

Matte occlusion for video captioning is not suitable for multi-subject videos or complex scenes where the hyperframes matting pipeline cannot isolate a single subject to composite text behind.

How does Whisper transcription integrate with motion graphics compositing?▼

Whisper transcription provides the timing and text data for deterministic rendering, validating occlusion gates before ffmpeg composites the motion graphics captions into the final video.