Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

10 Years of Tunepal: Reflections & Future Directions

65 views

Published on

Tunepal is a query-by-playing search engine for
traditional music that handles around 60K music searches each month.

Published in: Education
  • Be the first to comment

  • Be the first to like this

10 Years of Tunepal: Reflections & Future Directions

  1. 1. 10 Years of Tunepal: Reflections & Future Directions Dr Bryan Duggan School of Computer Science Technological University of Dublin Ireland bryan.duggan@dit.ie http://bryanduggan.org http://github.com/skooter500 @skooter500
  2. 2. Tunepal • A search-by-playing app & website for Android and IOS • 20K App users • 23K music scores • Around 1K music searches per day • 2,322,682 tap-to-record searches • 2,042,877 title searches • 3,619,592 tunes downloaded • Links to Comhaltas archive • MIDI Playback & music score • Links to youtube, thesession
  3. 3. • Show a demo!
  4. 4. Way back in 1993…
  5. 5. The First Tunepals
  6. 6. Duggan, Bryan: Learning traditional Irish music using a PDA. IADIS Mobile Learning Conference, Trinity College Dublin, Dublin, Ireland, July 26, 2006.
  7. 7. How does it work?
  8. 8. Levenshtein Distance
  9. 9. 2010 • Grant from the Dept of Culture Sport and Tourism • Had to complete all the work in 10 weeks – App available in Irish and English – New professionally designed UX – Music score display – Add additional tunebooks – iPad version Tunepal HD – Tune editing & composition
  10. 10. In the media • Irish Times • Irish Daily mail • Sunday Times - Top twenty cultural apps • John Creedon’s Fleadh program • Foinse • Top 25 grossing apps on iTunes (2 days)
  11. 11. Sunday Times - February 2012
  12. 12. • Duggan, B., Gainza, M. & Cunningham, P. Machine annotation of sets of traditional Irish dance tunes. Paper presented at the Ninth International Conference on Music Information Retrieval (ISMIR), Drexel University, Philadelphia, USA, 2008. http://www.audioresearchgroup.com/ • Bryan Duggan, Brendan O'Shea, (2011) "Tunepal: searching a digital library of traditional music scores", OCLC Systems & Services, Vol. 27 Iss: 4, pp.284 - 297
  13. 13. TuneTracker • Dynamically track and publish records of folk music playing • Deployed for five months in Dublin, Ireland at The Cobblestone pub • Proceedings of the 2014 conference on Designing interactive systems • Norman Makato Su, Indiana University Bloomington
  14. 14. 2015 Europeanna Collaboration • Replace the Java applet with record and transcription functionality implemented in HTML5 • Return recordings of music, not just music scores. • Make all the functionality of the Tunepal, including query-by-playing work similarly across all devices including smartphones. • Open-source Tunepal and make an API server available to other projects. • Magical to explore!
  15. 15. Technology • MySql • Jersey for Java API server • HTML5 Audio • Node, npm • ABC2MIDI • ABCJS • Emscripten • Materialize with Angular.JS • Europeana APIs • Works on Chrome, Firefox, Edge • Show another demo!!
  16. 16. Transcription Accuracy Study • Tony software 30 pieces of audio • https://github.com/pierrebeauguitte/tuneset • Variety of instruments, solo and ensemble • Midi format • Used as ground truth to evaluate 4 different algorithms – pYIN, Melodia, MATT, Silvet • Frame-Level Evaluation: Melody Extraction Task • Note-Level Evaluation: Note Tracking Task • Beauguitte, P., Duggan, B., Kelleher, J. (2016). A Corpus of Annotated Irish Traditional Dance Music Recordings: Design and Benchmark Evaluations. 17th ISMIR 2016.
  17. 17. Key Inference Beauguitte, P., Duggan, B. and Kelleher, J. (2017) Key inference from Irish traditional music scores and recordings.14th Sound and Music Computing Conference, July 5-8, 2017, Espoo, Finland.
  18. 18. Errors
  19. 19. Rhythm Inference • Categorised into – simple duple: 4 4 (reel, hornpipe, fling, barndance) and 2 4 (polka) – simple triple: 3 4 (waltz, mazurka) – compound duple: 6 8 (jigs) and 12 8 (slides) – compound triple: 9 8 (slip jigs) • Infer rhythmic information from audio recordings of Irish traditional tunes • Beauguitte, P., Duggan, B. & Kelleher, J. D. (2018). Rhythm inference from audio recordings of Irish traditional music. Proceedings of the 8th International Workshop on Folk Music Analysis, 26-29 June 2018, Thessaloniki (Greece)
  20. 20. Rhythm Inference • Relies on the repetitive nature of this musical genre
  21. 21. Key-invariant tune recognition
  22. 22. Pitch Class histograms
  23. 23. Keeping the apps up to date • Example from this year • Android 9 – Rebuild – Switch from Eclipse to Android Studio – Switch to Gradle from ad hock build system – Remove ActionBarSherlock library – A lot of time spent fixing UX bugs and crashes on certain phones in certain conditions – Gmail sending bug – Still random crashes • Europeanna searches failing – Lots of tracking down and dead ends trying to find what the problem was – Trying to build a 3 year old web app with a complex toolchain, java scriot, ecs6, node, npm, bower, git
  24. 24. • Show the map! • Show the visualisation!
  25. 25. Monthly usage over 10 years
  26. 26. Listening to ClareFM.ie this morning. Heard a great tune…..interrupted by the Galway Races Used Tunepal……..it’s called The Parting………got it from The Session.org. So much fun……….. listening and learning Irish Trad. Thank you so much for the good you have done and are doing! It is ironic, but one of my mates has proudly proclaimed she has never had a cell phone, computer, nor opened an email account. She is utterly fascinated with Tunepal “I’m sure you’re getting emails every day saying how much folks love your tunepal site and iphone app. I have the app and LOVVVVVVVVVE it! I use it every day. Awesome awesome awesome! Getting a lot of use out of this app now. Everybody I have told so far is very impressed.” It’s pure magic. Thanks a million for having made this diamond and share it with everyone. If there was a God, I’m quite sure that he would have you blessed ! I just wanted to thank you for the great idea and the great job you’ve done with Tunepal. It’s an excellent and very useful tool. Just what I whished for quite often. I am really impressed with the app. It was 100% correct in identifying tunes when I played them on flute or whistle. Having worked in a previous life in ultrasonic testing of materials, I can appreciate some of the problems involved. Thank you, Tunepal!!! You’ve saved lives!!!!!! Fair play to Bryan it’s a wonderful App I have learned lots of tunes from it and Names of Tunes as well Amazing! Congrats! I must be at least 30k of the tune searches 🤔☺ I use it so much. I love it
  27. 27. Conclusions • Technology has transformed the playing and learning of traditional music • Tunepal is beloved by its users – “It changed my life” • 10 years of data on usage • The future – Tune synchronisation – Better transcription accuracy – Key invariant matching – Modern Tunepal app – Redevelop the server – Get involved!
  28. 28. Contribute! • Get the code and contribute: – http://github.com/skooter500 – https://github.com/pierrebeauguitte/tunes_annot ations – https://github.com/pierrebeauguitte/tuneset • Contact me – @skooter50 – bryan.duggan@dit.ie – bryanduggan.org

×