Optical Music Recognition              with Python                Andrew Hankinson
Optical Music Recogntion              isOptical Character Recognition     for Music Notation                              ...
Building “Google Books”   for music notation                          3
Our Task:  Tell a computer how tounderstand music notation                            4
Our Task: Teach a computer how tounderstand music notation                            5
timepitch               6
timepitch         clefs     durations   articulations        barlines                               key signature         ...
6
6
Neume Notation  Liturgical Use ~1100 to 1600 CE                    7
Gamera Python/C++ Framework fordocument image analysis and     shape recognition      (not just for music...)             ...
Tasks...❖ Binarisation:   Colour -> Black & White❖ Staff   Removal: Removing connected components❖ Shapeidentification: Aut...
Demo       10
11
Recap❖ “Clean   up” images -- binarization, etc.❖ Remove     staff lines❖ Connected    component analysis❖ Classify   shap...
Thank you.    github.com/DDMALgithub.com/ahankinson                        13
Upcoming SlideShare
Loading in …5
×

Mp25: Optical Music Recognition with Python

1,440 views

Published on

0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
1,440
On SlideShare
0
From Embeds
0
Number of Embeds
1
Actions
Shares
0
Downloads
9
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

Mp25: Optical Music Recognition with Python

  1. 1. Optical Music Recognition with Python Andrew Hankinson
  2. 2. Optical Music Recogntion isOptical Character Recognition for Music Notation 2
  3. 3. Building “Google Books” for music notation 3
  4. 4. Our Task: Tell a computer how tounderstand music notation 4
  5. 5. Our Task: Teach a computer how tounderstand music notation 5
  6. 6. timepitch 6
  7. 7. timepitch clefs durations articulations barlines key signature dynamics (“loudness”) implicit knowledge 6
  8. 8. 6
  9. 9. 6
  10. 10. Neume Notation Liturgical Use ~1100 to 1600 CE 7
  11. 11. Gamera Python/C++ Framework fordocument image analysis and shape recognition (not just for music...) 8
  12. 12. Tasks...❖ Binarisation: Colour -> Black & White❖ Staff Removal: Removing connected components❖ Shapeidentification: Automatically classifying shapes❖ Correction: Fixing machine errors❖ Exporting: Encoding recognized music notation in XML 9
  13. 13. Demo 10
  14. 14. 11
  15. 15. Recap❖ “Clean up” images -- binarization, etc.❖ Remove staff lines❖ Connected component analysis❖ Classify shapes❖ Recombine with staff lines for pitch finding❖ Save image + musical data to a musical representation format (e.g., the Music Encoding Initiative XML schema) 12
  16. 16. Thank you. github.com/DDMALgithub.com/ahankinson 13

×