sync-captions-to-music

What problem does it solve?

This Skill generates beat-synced captions for music-video ads, ensuring that captions match the rhythm and timing of the music.

Core Features & Use Cases

• Beat-Synced Captions: Captions are synchronized with the music's rhythm and timing.
• Timestamp Alignment: Uses word-level timestamps from music metadata or transcriptions.
• Chunking and Placement: Lyric chunks are optimized for readability and timing, with customizable font and placement.
• Use Case: Before a music-video ad goes live, use this Skill to add captions that enhance the viewer experience by matching the song's rhythm.

Quick Start

Run the sync-captions-to-music skill with the following command:

python3 scripts/sync.py \
  --video <path_to_video> \
  --lyrics <path_to_lyrics> \
  --timestamps <path_to_timestamps> \
  --output <path_to_output_video> \
  --accent-words "word1,word2" \
  --chunk-size 3 \
  --placement mid \
  --preview-strip <path_to_preview_strip>