Multimedia: Music
Upcoming SlideShare
Loading in...5
×
 

Like this? Share it with your network

Share

Multimedia: Music

on

  • 1,034 views

The slides of the multimedia course I thought at Al Qudz University for Jad Najjar.

The slides of the multimedia course I thought at Al Qudz University for Jad Najjar.

Statistics

Views

Total Views
1,034
Views on SlideShare
1,034
Embed Views
0

Actions

Likes
0
Downloads
37
Comments
0

0 Embeds 0

No embeds

Accessibility

Categories

Upload Details

Uploaded via as Adobe PDF

Usage Rights

© All Rights Reserved

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Processing…
Post Comment
Edit your comment

Multimedia: Music Presentation Transcript

  • 1. MULTIMEDIA COURSE: MUSIC Sten GovaertsSaturday 26 February 2011
  • 2. Saturday 26 February 2011
  • 3. Saturday 26 February 2011
  • 4. Saturday 26 February 2011
  • 5. Saturday 26 February 2011
  • 6. Katholieke Universiteit LeuvenSaturday 26 February 2011
  • 7. LeuvenSaturday 26 February 2011
  • 8. ...NOW LET’S GET TO BUSINESS!Saturday 26 February 2011
  • 9. Without music life would be a mistake. T Friedrich Wilhelm NietzscheSaturday 26 February 2011
  • 10. YET ANOTHER PROBLEM? Bartender DJ CustomersSaturday 26 February 2011
  • 11. YET ANOTHER PROBLEM? Bartender DJ CustomersSaturday 26 February 2011
  • 12. YET ANOTHER PROBLEM? Bartender DJ CustomersSaturday 26 February 2011
  • 13. YET ANOTHER PROBLEM? Bartender DJ CustomersSaturday 26 February 2011
  • 14. YET ANOTHER PROBLEM? Bartender DJ CustomersSaturday 26 February 2011
  • 15. YET ANOTHER PROBLEM? Bartender DJ CustomersSaturday 26 February 2011
  • 16. YET ANOTHER PROBLEM? Bartender DJ CustomersSaturday 26 February 2011
  • 17. YET ANOTHER PROBLEM? Bartender DJ CustomersSaturday 26 February 2011
  • 18. YET ANOTHER PROBLEM? Bartender DJ CustomersSaturday 26 February 2011
  • 19. YET ANOTHER PROBLEM? Bartender DJ Customers what we do!Saturday 26 February 2011
  • 20. YET ANOTHER PROBLEM? Bartender DJ Customers what we do! HAPPY!Saturday 26 February 2011
  • 21. YET ANOTHER PROBLEM? Bartender DJ Customers business what we do! HAPPY! is goodSaturday 26 February 2011
  • 22. WHY LIKE THIS?Saturday 26 February 2011
  • 23. WHY LIKE THIS? • how does an expert select his music?Saturday 26 February 2011
  • 24. WHY LIKE THIS? • how does an expert select his music? • how does a bartender select his music?Saturday 26 February 2011
  • 25. WHY LIKE THIS? • how does an expert select his music? • how does a bartender select his music? • making the expert data accessible in a usable way for a bartenderSaturday 26 February 2011
  • 26. WHY LIKE THIS? • how does an expert select his music? • how does a bartender select his music? • making the expert data accessible in a usable way for a bartender A musical context is a musical description for situations based on atmospheres and musical properties.Saturday 26 February 2011
  • 27. EXPERTS @ WORK songs param. value matchesSaturday 26 February 2011
  • 28. EXPERTS @ WORK songs param. value matchesSaturday 26 February 2011
  • 29. EXPERTS @ WORK songs param. value matchesSaturday 26 February 2011
  • 30. EXPERTS @ WORK songs param. value matchesSaturday 26 February 2011
  • 31. EXPERTS @ WORK songs param. value matchesSaturday 26 February 2011
  • 32. THE SCHEMESaturday 26 February 2011
  • 33. THE SCHEMESaturday 26 February 2011
  • 34. THE SCHEMESaturday 26 February 2011
  • 35. TROUBLE IN EXPERT LANDSaturday 26 February 2011
  • 36. TROUBLE IN EXPERT LANDSaturday 26 February 2011
  • 37. TROUBLE IN EXPERT LANDSaturday 26 February 2011
  • 38. LET’S CREATE A CONTEXT!Saturday 26 February 2011
  • 39. LET’S CREATE A CONTEXT! subgenre: easy listening, pop café popularity: 5, 6, 7 mood: relax, tasteful, stylishSaturday 26 February 2011
  • 40. contextSaturday 26 February 2011
  • 41. context subcontext ASaturday 26 February 2011
  • 42. context subcontext A songs with subgenre(easy listening OR pop café)Saturday 26 February 2011
  • 43. context subcontext A songs with subgenre(easy listening OR pop café) + songs with mood(relax OR tasteful OR stylish)Saturday 26 February 2011
  • 44. context subcontext A songs with subgenre(easy listening OR pop café) + songs with mood(relax OR tasteful OR stylish) + songs with popularity(5 UNTIL 7)Saturday 26 February 2011
  • 45. context subcontext A subcontext B songs with subgenre(easy listening OR pop café) + songs with mood(relax OR tasteful OR stylish) + + songs with popularity(5 UNTIL 7)Saturday 26 February 2011
  • 46. context subcontext A subcontext B songs with songs with subgenre(easy listening genre(pop) OR pop café) + songs with mood(relax OR tasteful OR stylish) + + songs with popularity(5 UNTIL 7)Saturday 26 February 2011
  • 47. context subcontext A subcontext B songs with songs with subgenre(easy listening genre(pop) OR pop café) + + songs with songs with mood(intimate OR mood(relax OR tasteful OR stylish) + romantic OR sensual) + songs with popularity(5 UNTIL 7)Saturday 26 February 2011
  • 48. context subcontext A subcontext B songs with songs with subgenre(easy listening genre(pop) OR pop café) + + songs with songs with mood(intimate OR mood(relax OR tasteful OR stylish) + romantic OR sensual) + + songs with songs with popularity(5 UNTIL 7) popularity(6 UNTIL 7)Saturday 26 February 2011
  • 49. context subcontext A subcontext B songs with songs with subgenre(easy listening genre(pop) OR pop café) + 75% 25% + songs with songs with mood(intimate OR mood(relax OR tasteful OR stylish) + romantic OR sensual) + + songs with songs with popularity(5 UNTIL 7) popularity(6 UNTIL 7)Saturday 26 February 2011
  • 50. WHAT’S UNDER THE HOOD?Saturday 26 February 2011
  • 51. WHAT’S UNDER THE HOOD?Saturday 26 February 2011
  • 52. WHAT’S UNDER THE HOOD?Saturday 26 February 2011
  • 53. WHAT’S UNDER THE HOOD?Saturday 26 February 2011
  • 54. WHAT’S UNDER THE HOOD?Saturday 26 February 2011
  • 55. HTTP://WWW.TUNIFY.COMSaturday 26 February 2011
  • 56. HTTP://WWW.TUNIFY.COMSaturday 26 February 2011
  • 57. HTTP://WWW.TUNIFY.COMSaturday 26 February 2011
  • 58. WHAT’S NEXT?... • manually annotated metadata •5 music experts at Aristo Music and different consultants • about 200,000 songs • but, not enough...Saturday 26 February 2011
  • 59. THE LONG TAIL http://en.wikipedia.org/wiki/Long_TailSaturday 26 February 2011
  • 60. THE LONG TAIL http://en.wikipedia.org/wiki/Long_TailSaturday 26 February 2011
  • 61. THE LONG TAIL http://en.wikipedia.org/wiki/Long_TailSaturday 26 February 2011
  • 62. OTHER PROBLEMS... • satisfyingthe music choice of all customers • retail and catering differ from you and me! • new markets • react fast on emerging music trends • adding the full Belgian library catalogSaturday 26 February 2011
  • 63. GENERATE THE METADATA • from different sources: • the audio signal • web sources • the Aristo database • attention metadata • using our metadata generation framework: SamgISaturday 26 February 2011
  • 64. Saturday 26 February 2011
  • 65. TWO TECHNIQUES • Genre • Country of OriginSaturday 26 February 2011
  • 66. GENRE... http://techno.org/electronic-music-guide/ • our master thesis looked at different ways to generate genre...Saturday 26 February 2011
  • 67. GENRESaturday 26 February 2011
  • 68. GENRESaturday 26 February 2011
  • 69. GENRESaturday 26 February 2011
  • 70. GENRESaturday 26 February 2011
  • 71. CLASSIFICATION WITH SEARCH ENGINES using co-occurrenceSaturday 26 February 2011
  • 72. CLASSIFICATION WITH SEARCH ENGINES using co-occurrenceSaturday 26 February 2011
  • 73. CLASSIFICATION WITH SEARCH ENGINES using co-occurrence Artist + Genre + SchemaSaturday 26 February 2011
  • 74. CLASSIFICATION WITH SEARCH ENGINES using co-occurrence Artist + Genre + SchemaSaturday 26 February 2011
  • 75. CLASSIFICATION WITH SEARCH ENGINES using co-occurrence Artist + Genre + SchemaSaturday 26 February 2011
  • 76. CLASSIFICATION WITH SEARCH ENGINES using co-occurrence Artist + Genre + SchemaSaturday 26 February 2011
  • 77. Saturday 26 February 2011
  • 78. Rock: Jazz: Blues: Pop: Country: Metal:Saturday 26 February 2011
  • 79. Rock: Jazz: 0,013 0,013 Blues: Pop: 0,009 0,015 Country: Metal: 0,009 0,005Saturday 26 February 2011
  • 80. HOW TO EVALUATE THIS? • run an experiment • evaluate on 1995 artists and 9 genres. • different search engines: Google,Yahoo! and Live! Search. • over time: 8 times over a period of 36 days.Saturday 26 February 2011
  • 81. THE DATA SET Blues Country Electronic Folk Jazz Metal Rap Reggae RnBSaturday 26 February 2011
  • 82. THE DATA SET Blues Country Electronic Folk Jazz Metal Rap Reggae RnB 10% 9% 3% 2% 12% 13% 5% 4% 41%Saturday 26 February 2011
  • 83. THE DATA SET Blues Country Electronic Folk Jazz Metal Rap Reggae RnBSaturday 26 February 2011
  • 84. Saturday 26 February 2011
  • 85. MOTION CHART • http://hmdb.cs.kuleuven.be/muzik/gapminder.htmlSaturday 26 February 2011
  • 86. Saturday 26 February 2011
  • 87. Saturday 26 February 2011
  • 88. MORE FINE-GRAINED... • 18 artists • more search engines: Google.co.uk/.fr/.be, uk/ fr.search.yahoo.com • twice a day for 53 days • 250,000 queries!Saturday 26 February 2011
  • 89. 2 Pac Rap Alan Lomax Folk Art Pepper Jazz Cradle of Filth Metal David Parsons Electronic Desmond Dekker Reggae Downpour Metal IceT Rap Jerry Butler RnB Joy Lynn White Country Louisiana Red Blues Lou Rawls RnB LTJ Bukem Electronic Peter Tosh Reggae Pinetop Smith Jazz Robert Johnson Blues Roy Rogers Country Steeleye Span FolkSaturday 26 February 2011
  • 90. Saturday 26 February 2011
  • 91. MAIN SEARCH ENGINE RESULTSSaturday 26 February 2011
  • 92. REGIONAL GOOGLESSaturday 26 February 2011
  • 93. Saturday 26 February 2011
  • 94. WHAT TO USE? • use Google when it’s stable else rely on Yahoo! • when is it stable? test with a small set • some artists get classified incorrectly on bad days • compare the accuracy achieved with the test set to the average.Saturday 26 February 2011
  • 95. DEMO METADATA GENERATION • http://ariadne.cs.kuleuven.be/samgi-service/Saturday 26 February 2011
  • 96. COUNTRY OF ORIGINSaturday 26 February 2011
  • 97. MASHUPSSaturday 26 February 2011
  • 98. MASHUPS • mashups in music: re-mixing multiple existing songs to create a new one.Saturday 26 February 2011
  • 99. MASHUPS • mashups in music: re-mixing multiple existing songs to create a new one. •a mashup is an application that combines data from multiple online sources to create a new result which was not the original intend of the data.Saturday 26 February 2011
  • 100. MASHUPS • mashups in music: re-mixing multiple existing songs to create a new one. •a mashup is an application that combines data from multiple online sources to create a new result which was not the original intend of the data. • data is key! • tweaking and enriching data is important • interesting data makes an interesting mashupSaturday 26 February 2011
  • 101. MY MUSIC MASHUP. • http://www.cs.kuleuven.be/~sten/lastonamfm/Saturday 26 February 2011
  • 102. COUNTRY & CONTINENT • why is it useful? • subgenres • popularity • recommendations • expensive to annotate • very few existing research • very hard with signal processingSaturday 26 February 2011
  • 103. COUNTRY & CONTINENT • why is it useful? • subgenres • popularity • recommendations • expensive to annotate • very few existing research • very hard with signal processingSaturday 26 February 2011
  • 104. COUNTRY & CONTINENT • why is it useful? • subgenres • popularity • recommendations • expensive to annotate • very few existing research ! • very hard with signal processingSaturday 26 February 2011
  • 105. IN THE BACKGROUND... google maps freebase last.fm google app engine twitter last.fm last.fm yahoo! pipes last on am/fm website dapper youtubeSaturday 26 February 2011
  • 106. YAHOO! PIPESSaturday 26 February 2011
  • 107. LAST.FMSaturday 26 February 2011
  • 108. LAST.FMSaturday 26 February 2011
  • 109. LAST.FM APISaturday 26 February 2011
  • 110. FREEBASE http://www.freebase.com/view/m/01mdm7pSaturday 26 February 2011
  • 111. FREEBASE http://www.freebase.com/view/m/01mdm7pSaturday 26 February 2011
  • 112. FREEBASE MQL { "type" : "/music/album", "name" : "Synchronicity", "artist" : "The Police", "track" : [{ "name":null, "length":null }] }Saturday 26 February 2011
  • 113. FREEBASE MQL { "type" : "/music/album", "name" : "Synchronicity", "artist" : "The Police", "track" : [ {"name":"Synchronicity II", "length":305.066}, {"name":"Every Breath You Take", "length":254.066}, {"name":"King of Pain", "length":299.066}, {"name":"Wrapped Around Your Finger", "length":313.733}, {"name":"Tea in the Sahara", "length":255.44}, {"name":"Walking in Your Footsteps", "length":216.773}, {"name":"Miss Gradenko", "length":120}, {"name":"Murder by Numbers", "length":276.8}, {"name":"O My God", "length":242.226}, {"name":"Synchronicity I", "length":202.866}, {"name":"Mother", "length":185.64} ] }Saturday 26 February 2011
  • 114. BIOGRAPHIES • from Last.fm (most of them are coming from Wikipedia) • using demonyms. • “Anders Trentemøller is a Danish electronic musician.” • List of demonyms from Wikipedia http://en.wikipedia.org/wiki/ List_of_adjectival_and_demonymic_forms_of_place_namesSaturday 26 February 2011
  • 115. computerSaturday 26 February 2011
  • 116. The Beatles computerSaturday 26 February 2011
  • 117. The Beatles Michael Jackson computerSaturday 26 February 2011
  • 118. ABBA The Beatles Michael Jackson computerSaturday 26 February 2011
  • 119. ABBA The Beatles 1 Michael Jackson computerSaturday 26 February 2011
  • 120. ABBA The Beatles 1 Michael Jackson 2 computerSaturday 26 February 2011
  • 121. ABBA The Beatles 3 1 Michael Jackson 2 computerSaturday 26 February 2011
  • 122. RESULTS • with country we also know continent • Last.fm and Freebase only contains data for small part • accuracy: • Last.fm: 91% • Freebase: 90% • Bio: 66% • Combination: 77% • more advanced possibilitiesSaturday 26 February 2011
  • 123. THANK YOU! QUESTIONS? slides will appear on http://www.slideshare.net/stengovaertsSaturday 26 February 2011