video-ai-v2-pipeline

Plans local video production pipelines with TTS, ASR, captioning, and reframing via sidecar tools.

5|2|Updated Jul 12, 2026
One-click install
npx skills add https://github.com/LongLeo287/seosona-flow --skill video-ai-v2-pipeline-longleo287
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: video-ai-v2-pipeline
Source: https://github.com/LongLeo287/seosona-flow/tree/main/.claude/skills/video-ai-v2-pipeline
Command: npx skills add https://github.com/LongLeo287/seosona-flow --skill video-ai-v2-pipeline-longleo287

SYSTEM DOCUMENTATION & REQUIREMENTS

What problem does it solve? Building a complete video (voiceover, word-level captions, 9:16 reframing, mixing, muxing) requires coordinating many separate tools, and it is unclear which components belong in the browser extension versus a local sidecar. This Skill defines the architecture, the script.json contract, and the tool choices so the heavy video work runs locally outside the extension. ## Core Features & Use Cases - script.json contract: A single source of truth defining version, renderer, aspect, voice settings, and 3-12 scenes with voiceText, templateId, and inputs. - Sidecar tool selection: Maps each pipeline stage to a tool — audio.cpp for TTS and mixing, whisperX for ASR with word-level timestamps, PySceneDetect/MediaPipe patterns for 9:16 reframe, ffmpeg for concat and mux. - Flow MCP integration: Pulls images and b-roll from the SEOSONA Flow extension through a local MCP server with a validated FlowAsset/SceneInput contract, degrading gracefully when MCP is absent. - Use Case: When planning a Vietnamese short-form video product, use this Skill to define the scene contract, choose offline TTS/ASR binaries, and wire per-scene idempotent regeneration before building the sidecar CLI. ## Quick Start Ask the assistant to design the Video AI V2 pipeline for a 9:16 video with Vietnamese TTS, word-level captions, and b-roll sourced from the Flow MCP server.

Frequently Asked Questions about video-ai-v2-pipeline

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I structure a local video pipeline with TTS, captions, and reframing?▼

Define a script.json contract with voice settings and 3-12 scenes, then map each stage to a sidecar tool: audio.cpp for TTS and mixing, whisperX for word-level ASR, PySceneDetect with tracking for 9:16 reframe, and ffmpeg for concat and mux.

What tools generate word-level timestamps for karaoke captions?▼

whisperX provides ASR with word-level timestamps and runs on CPU under a BSD-2 license. audio.cpp forced alignment is an alternative when you want a single offline binary instead of a Python dependency.

Can the video pipeline run without the Flow extension MCP server?▼

Yes. The MCP integration is optional: when the Flow MCP server is available the pipeline pulls generated images and b-roll from it, but the V2 pipeline still runs standalone in degraded mode without it.

Does this Skill include the actual TTS or ASR binaries?▼

No. This Skill is a plan and interface definition only. The audio.cpp and whisperX binaries are built in a separate sidecar repository, not inside the extension codebase.

How does per-scene regeneration work in the pipeline?▼

The pipeline is idempotent per scene: deleting the intermediate files of one scene lets you regenerate only that scene instead of rebuilding the entire video, which speeds up iteration on individual segments.