piano-video-to-sheet

Transcribe piano videos into MIDI, sheet music, MP3, and GP5 files.

12|2|Updated Feb 2, 2020

Search Tags:#computer vision #sheet music #MIDI #piano transcription #GP5

Ready to run

npx skills add https://github.com/servitola/dotfiles --skill piano-video-to-sheet

💬 Prompt for ChatGPT / Claude Chat▼

Please help me install this Agent Skill.
Skill: piano-video-to-sheet
Source: https://github.com/servitola/dotfiles/tree/main/claude-code/detached_skills/piano-video-to-sheet
Command: npx skills add https://github.com/servitola/dotfiles --skill piano-video-to-sheet

SYSTEM DOCUMENTATION & REQUIREMENTS

💡 This Skill requires numpy, pretty_midi, opencv-python-headless, librosa, music21, verovio, cairosvg, pypdf, pymupdf, PyGuitarPro, basic-pitch, ffmpeg, fluidsynth, and includes scripts (resource) and references (resource) components.

What problem does it solve?

Transcribes piano videos with falling-note visuals into machine-readable artifacts, reducing manual transcription time and errors.

Core Features & Use Cases

Phase-based transcription that combines audio pitches with computer-vision bar timing.
Produces MIDI, real-piano MP3, sheet music (PDF + MusicXML), and Guitar Pro GP5, with cross-checks.
Use case: converting Synthesia-style YouTube videos into ready-to-distribute scores and practice materials.

Quick Start

Place a piano video in the directory and run the full pipeline to generate MIDI, MP3, sheet music, and GP5 outputs.

Frequently Asked Questions about piano-video-to-sheet

High-intent search queries and answers about installing and using this skill.

FAQPage Schema

How do I convert Synthesia piano videos to sheet music and MIDI?▼

To convert Synthesia piano videos to sheet music and MIDI, use a transcription pipeline that extracts audio pitches and applies computer vision to bar timing, generating PDF scores, MusicXML, and MIDI files from the video input.

Can I extract MIDI from falling-note piano videos automatically?▼

Yes, you can extract MIDI from falling-note piano videos by using audio transcription combined with computer-vision timing fusion, which detects the falling notes to accurately map pitch and timing into a machine-readable MIDI file.

Does piano video transcription support Guitar Pro GP5 export?▼

Piano video transcription supports Guitar Pro GP5 export by cross-checking the transcribed MIDI data and engraving results, producing a GP5 file alongside the PDF sheet music and MP3 audio outputs.

What is the best way to transcribe piano audio to sheet music with accurate timing?▼

The best way to transcribe piano audio to sheet music with accurate timing is combining audio pitch extraction with computer-vision bar detection, fusing both signals to correct timing errors and produce engraved PDF scores.

How to generate real-piano MP3 from a Synthesia video?▼

To generate a real-piano MP3 from a Synthesia video, run a multi-phase transcription pipeline that converts the video into MIDI data, then synthesizes the MIDI into an audio MP3 file using soundfont rendering.

Are there limitations when using computer vision for piano sheet music transcription?▼

Computer vision for piano sheet music transcription is limited by video quality and requires clear falling-note visuals; it is designed for Synthesia-style videos and may fail with standard live performances lacking visual note cues.