music-to-video

Convert a music track into a beat-synced video using audio analysis and HTML compositions.

Updated Sep 11, 2026
One-click install
npx skills add https://github.com/celeroncoder/skills --skill music-to-video-celeroncoder
Or copy as Structured Prompt for Agent▼
Please help me install this Agent Skill.
Skill: music-to-video
Source: https://github.com/celeroncoder/skills/tree/main/music-to-video
Command: npx skills add https://github.com/celeroncoder/skills --skill music-to-video-celeroncoder

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires librosa, numpy, soundfile, and includes scripts (resource) and references (resource) components.

What problem does it solve? Creating a video that stays synchronized to a music track requires manual beat detection, timeline editing, and frame-by-frame alignment. This Skill automates that pipeline: it analyzes the audio once, cuts the track into frames at real musical changes, and builds each frame as an HTML composition rendered to an MP4. ## Core Features & Use Cases - Deterministic beat analysis: A Python script (librosa-based) produces a canonical audiomap.json with beat grid, onsets, drum classification, rolls, energy phases, and key moments. - Storyboard-driven workflow: A six-step gated pipeline (setup, analyze, skeleton, plan, build, assemble, render) with user approval checkpoints and validation scripts. - Template and motion-primitive catalogs: Per-frame groups are realized from reusable HTML templates or free-composed motion primitives, with optional user images/videos cut onto the same beat grid. - Use Case: Turn a 30-second high-energy track into a kinetic lyric promo: the analyzer finds the drops and rolls, the planner assigns templates per section, and the renderer outputs a 1920x1080 MP4 with every cut on the beat. ## Quick Start Ask the agent to turn your music file into a beat-synced video, for example: create a lyric video from assets/bgm.mp4 using the music-to-video skill.

Frequently Asked Questions about music-to-video

High-intent search queries and answers about installing and using this skill.

FAQPage Schema
How do I make a beat-synced video from a music file?▼

Run the music-to-video workflow: it analyzes the track with analyze-beatgrid.py to produce an audiomap.json, cuts the track into frames at musical changes, builds each frame as an HTML composition, and renders the assembled project to an MP4 with the hyperframes CLI.

What audio analysis does the beat grid analyzer perform?▼

The analyzer uses librosa to detect tempo, beats, and downbeats, classifies onsets as kick, snare, hihat, or glitch via band-split flux, and detects rolls, silences, hard stops, and energy phases. Output is a deterministic audiomap.json that drives all visual timing.

Can I use my own images or videos in the generated video?▼

Yes. Stage user media with stage-assets.mjs, then the planner assigns asset treatments such as beat_cut, ken_burns, or bg_under_text on the same beat grid. Assets are optional; typography templates alone can produce a complete video.

Does beat-synced cutting work with calm or ambient music?▼

On calm music the detected beat grid is unreliable, so frames are marked phrase_flow and paced by phrases and energy envelopes instead of hard beat cuts. The pacing decision is made per frame from onset density and roll presence, not from BPM alone.

What dependencies are required to run the audio analyzer?▼

The analyzer requires Python 3 with librosa, numpy, and soundfile installed, plus ffmpeg on PATH for decoding audio to WAV. The assembly and validation scripts require Node.js, and rendering uses the hyperframes CLI.