music-to-video
๐ฏSkillfrom heygen-com/hyperframes
|A HyperFrames skill that turns a music track into a beat-synced video by analyzing the audio, laying out frames on the beat grid, and building each frame as a composition with typography and optional user-supplied media.
Overview
The music-to-video skill provides a structured pipeline for turning any music track into a beat-synced HyperFrames video. It analyzes the audio once using a canonical beat analyzer, then lays out frames on the resulting beat grid and dispatches parallel sub-agents to build each frame as a composition. The music drives everything: typography and templates serve as the baseline (a complete video needs zero external assets), while any user-supplied images or videos are cut into frames on the same beat grid. The genre (lyric video, slideshow, kinetic promo) emerges from per-frame design choices rather than being declared upfront.
Key Features
- Single-Source Beat Analysis: Uses one canonical analyzer (analyze-beatgrid.py) that reads the track once and produces energy, density, rolls, onsets, and silence data, which the entire pipeline trusts without re-measurement
- Frame-Based Architecture: Each frame becomes one composition file built by a dedicated sub-agent, with frames tracking distinct visual treatments rather than individual beats, keeping the pipeline scalable even for fast tracks
- Gated 7-Step Workflow: Progresses through setup, analysis, skeleton, plan approval, parallel frame building, assembly, and render, with explicit gates and two user checkpoints (plan approval and render approval)
- Zero-Asset Capability: Typography and built-in templates are sufficient for a complete video, while user-supplied images and videos are optional additions that get beat-cut into the frame grid
- Adaptive Pacing: Automatically distinguishes between rhythmic tracks (where beats drive hard cuts) and calm tracks (where phrasing and energy guide gentler transitions)
Who is this for?
This skill is for creators and developers on the HyperFrames platform who want to produce music-driven video content without manual timeline editing. It suits anyone making lyric videos, kinetic typography promos, beat-synced slideshows, or visual accompaniments to music tracks where the audio should dictate the visual rhythm and transitions.
Same repository
heygen-com/hyperframes(48 items)
Installation
npx vibeindex add heygen-com/hyperframes --skill music-to-videonpx skills add heygen-com/hyperframes --skill music-to-video~/.claude/skills/music-to-video/SKILL.mdSKILL.md
More from this repository10
CLI tool for the Hyperframes video rendering framework that provides commands to create, preview, lint, and render HTML-based video compositions to MP4.
Skill for authoring HTML-based video compositions with the Hyperframes framework, covering captions, TTS, audio-reactive animation, and transitions for AI agent-driven video creation.
Skill for installing blocks and components into Hyperframes projects via the `hyperframes add` command, providing access to 50+ ready-to-use overlays, shader transitions, and data visualizations.
A skill for the HyperFrames open-source video rendering framework that teaches AI agents to write correct HTML-based video compositions and GSAP animations, enabling them to render video from HTML code.
The foundational technical contract for HyperFrames HTML video compositions, defining data attributes, clip/track structure, sub-compositions, variables, media playback, deterministic rendering rules, and project validation.
Comprehensive animation skill for HyperFrames providing atomic motion rules, multi-phase scene blueprints, scene transitions, motion-design techniques, and seven runtime adapters including GSAP, Lottie, Three.js, Anime.js, CSS keyframes, Web Animations API, and TypeGPU.
Non-animation creative direction for HyperFrames videos covering design specs, color palettes, typography, narration scripting, beat planning, audio-reactive visuals, composition patterns, and brand/style decisions.
Resolves media needs (background music, sound effects, images, icons) into frozen local files by searching the HeyGen catalog, downloading the best match, and registering it in a manifest. One resolve command handles the full cascade from cache lookup to provider search to file freezing.
A media framework by HeyGen for building interactive video experiences with composable frames and real-time rendering capabilities.
A fallback HyperFrames composition authoring skill for custom video creation when no specialized workflow fits. Handles multi-scene pieces, brand reels, montages, title cards, motion posters, static loops, and freeform compositions at any length or format.