Score Following: Aligning Sheet Music to Audio Recordings

By: Gyanendra Sharma '13

Advising Faculty: Ozgur Izmirli

The aim of the project is to build software that will align the printed music score with an audio recording of a performance. Most existing audio to score mapping systems employ an intermediate MIDI (Musical Instrument Digital Interface) representation to carry out this alignment. The current research tries to achieve the same goal without using the intermediate MIDI format. We apply a number of image processing techniques on the score image and perform signal processing on the audio to produce compatible representations in order to align the two different media. The alignment is performed using a dynamic programming approach. Our ultimate goal is to create a new system that aligns the music sheet with any of its renditions in real time.

Related Fields: Computer Science