Your SlideShare is downloading. ×
Music accessibility for visual impaired
Upcoming SlideShare
Loading in...5
×

Thanks for flagging this SlideShare!

Oops! An error has occurred.

×

Saving this for later?

Get the SlideShare app to save on your phone or tablet. Read anywhere, anytime - even offline.

Text the download link to your phone

Standard text messaging rates apply

Music accessibility for visual impaired

177
views

Published on

Music Accessibility for Visual Impaired, …

Music Accessibility for Visual Impaired,
at Workshop ABF Challenges, Pisa, 2012,
Workshop of Andrea Bocelli Foundation


0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total Views
177
On Slideshare
0
From Embeds
0
Number of Embeds
0
Actions
Shares
0
Downloads
5
Comments
0
Likes
0
Embeds 0
No embeds

Report content
Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
No notes for slide

Transcript

  • 1. Workshop ABF Challenges, Pisa, 2012 Music Accessibility for Visual Impaired Paolo Nesi, Giuseppe Nicotra University of Florence Department of Systems and InformaticsDistributed Systems and Internet Technology Lab, DISIT Lab Paolo.nesi@unifi.it tel: 0039-335-5668674 http://www.disit.dsi.unifi.it 06-July-2012, Pisa, Italy 1
  • 2. Music Domains Music is a multifaceted and multidomain space Audible Space is the effective valuable result of a long and heavy work of the artists: composers and performers  intepreting a representation / description (the original work) with the aim of transmitting the intentions and emotions of the composer  Almost «visual representation» The transmission of music as sound is quite recent since the recording technology is recent. On the other hand the music representations on physical «visual» support is quite old. Workshop ABF Challenges, Pisa, 2012 2
  • 3. Music Coding Workshop ABF Challenges, Pisa, 2012 3
  • 4. Braille Music Notation from the Valentin Haüy work of coding for music reading, in 1925 Louis Braille placed the basis for coding/writing music on dots rather than on lines Brailles music notation (and not only music) allows a visually impaired teacher to teach at sighted and visually impaired students Workshop ABF Challenges, Pisa, 2012 4
  • 5. Esempio nota brailleThe same music in print and in Braille Workshop ABF Challenges, Pisa, 2012 5
  • 6. ICT as Enabling Technology  Symbolic Music coding can be rendered in:  Classical notation  Braille notation  Spoken Musicscorepart1 part2 … part nmeas1 meas2 … measure nvoice1 voice2 … voice nevent1 event2 … event3 note chord rest Measure change … … note note 1 … note n Workshop ABF Challenges, Pisa, 2012 6
  • 7. . Paolo Nesi – DSI - DISIT- 2011 7
  • 8. Paolo Nesi – DSI - DISIT- 2011 8
  • 9. The Coding Problem European Commission extablished the MUSICNETWORK NOE chaired by University of Florence, Italy (2000) Study and development of international standard for music coding supporting different rendering and multimedia on the basis of several activities as:  WEDELMUSIC ICT project  MUSIC XML coding  BRAILLE XML coding  Finale coding  Sibelius coding  … Workshop ABF Challenges, Pisa, 2012 9
  • 10. Symbolic Music Representation MPEG SMR as MPEG-4 part 23 WEDELMUSIC format from EC project of European Commission Workshop ABF Challenges, Pisa, 2012 10
  • 11. MPEG SMR as MPEG-4 Distribution School Server Archive Distributor Producer … For music education at home, at school For entertainment in theaters, archives, Fruition at home, at school Devices Applications 11
  • 12. Optical Music Recognition, OMR I-Maestro project of the European Commission: http://www.i-maestro.org  OMR: generating Symbolic Music coding from music scores in different paper based “visual” notations to symbolic music representation coding!  Technologies developed: Image and Video processing, augmented violin  Collaborative work for music teaching and learning, heterogeneous pupils  Technologies developed: distributed systems, music coding, competitive work Workshop ABF Challenges, Pisa, 2012 12
  • 13. Transcoding Problem Challenge Passing from sounds (monophonic and polyphonic ) to a symbolic music representation coding via Signal Processing  Technologies developed: Polyphonic Transcoding, instrument independent….  Developed algorithms: winner for piano and in the firsts three for generic at the MIREX international research competition among algorithms for transcoding of polyphonic music Workshop ABF Challenges, Pisa, 2012 13
  • 14. BMML (Braille Music Markup Language) Aligned with MPEG SMR model Contrapunctus EC project to develop tools and to draw benefit from this new format Resonare Tool help to:  navigate on notation, rendered on Braille devices  memorize and understand  personalize / bookmark  play… Workshop ABF Challenges, Pisa, 2012 14
  • 15. Braille Music Markup Language and toolsThe Contrapunctus multidisciplinary team produced:• conversion modules (back and forward), aimed at facilitating access to existing music in digital formats Workshop ABF Challenges, Pisa, 2012 15
  • 16. ECLAP performing arts European Libraryhttp://www.eclap.eu Automated Back office -PC, MACos, linux, … -iPhone, iPod, Windows Mobile, ….… ANY content Agg. Content ANY content Content Content archive Content ServicesLibrary archive Content Library archive partner Library partner 16
  • 17. ECLAP is a best practice collaborative network onperforming arts:• distributing over 90 thousand content objects• 35 prestigious European institutions,• Traditional music, Braille Music, video, audio, etc.• Access via PC and mobile devices. Workshop ABF Challenges, Pisa, 2012 17
  • 18. Conclusions & Future Work  Research activity on MUSICNETWORK, WEDELMUSIC, IMUTUS, CONTRAPUNTUS, MIREX R&D projects opened the doors to social inclusion, thus reducing not only technological barriers, but also cultural ones.  Enabling technologies such music coding and signal processing, etc., allowed to create specific Braille coding models and new tools, thus:  reducing the gap for accessing to music,  Increasing the access to music for visually impaired  increasing the amount of accessible music  Increasing the number of possible tools for producing correctly coded music  New generation of solutions and tools has been provoked by MPEG SMR work  Additional work is needed on:  Collaborative tools for music training and composition, annotations  Making MPEG SMR & BMML more accessible on multiple devices  ….. Workshop ABF Challenges, Pisa, 2012 18
  • 19. References F. Argenti, P. Nesi, G. Pantaleo, "Automatic Transcription of Polyphonic Music Based on The Constant-Q Bispectral Analysis", IEEE Transactions on Audio, Speech and Language Processing, IEEE Computer Society press, Vol.19, n.6, pp.1610-1630, Aug. 2011. P. Bellini, I. Bruno, P. Nesi, ``Assessing Optical Music Recognition Tools, Computer Music Journal, MIT Press, Boston, USA, Vol.31, N.1, pp.68-94, Spring 2007 P. Bellini, P. Nesi, G. Zoia, ``Symbolic Music Representation in MPEG, IEEE Multimedia, IEEE Computer Society press, ISSN 1070-986X, Vol.12, N.4, pp.42-29, October-December 2005 P. Bellini, I. Bruno, P. Nesi, ``Automatic formatting of music sheets through MILLA rule-based language and engine, Journal of New Music Research, Routledge, Vol.34, N.3, ISSN 0929-8215, pp.237-257, September 2005 P. Bellini, P. Nesi, ``Automatic Justification and Line Breaking of Music Sheets, International Journal of Human Computer Studies (IJHCS), Harcourt press, ISSN 1071-5819, Vol.61, Issue 1, pp.104-137, July 2004. P. Bellini, F. Fioravanti, P. Nesi, ``Managing Music in Orchestras, IEEE Computer, IEEE Press, pp.26-34, Settembre 1999. ….. …. Workshop ABF Challenges, Pisa, 2012 19
  • 20. Projects and Links MOODS: http://www.dsi.unifi.it/~moods/ WEDELMUSIC: http://www.wedelmusic.org/ IMAESTRO: http://www.i-maestro.org/ MUSICNETWORK MPEG SMR: http://www.interactivemusicnetwork.org/mpeg-ahg/ CONTRAPUCTUS: http://www.punctus.org/ BMML ArchiBraille: http://braillemusic.eu/ ECLAP: http://www.eclap.eu Other projects: IMUTUS, VARIAZIONI Workshop ABF Challenges, Pisa, 2012 20
  • 21. Workshop ABF Challenges, Pisa, 2012 Music Accessibility for Visual ImpairedPaolo NesiUniversity of FlorenceDepartment of Systems and InformaticsDistributed Systems and Internet Technology Lab, DISIT LabTel: 0039-3355668674Paolo.nesi@unifi.ithttp://www.disit.dsi.unifi.it 21