Multimedia: Music

MULTIMEDIA COURSE: MUSIC Sten GovaertsSaturday 26 February 2011

Saturday 26 February 2011

Katholieke Universiteit LeuvenSaturday 26 February 2011

LeuvenSaturday 26 February 2011

...NOW LET’S GET TO BUSINESS!Saturday 26 February 2011

Without music life would be a mistake. T Friedrich Wilhelm NietzscheSaturday 26 February 2011

YET ANOTHER PROBLEM? Bartender DJ CustomersSaturday 26 February 2011

YET ANOTHER PROBLEM? Bartender DJ Customers what we do!Saturday 26 February 2011

YET ANOTHER PROBLEM? Bartender DJ Customers what we do! HAPPY!Saturday 26 February 2011

YET ANOTHER PROBLEM? Bartender DJ Customers business what we do! HAPPY! is goodSaturday 26 February 2011

WHY LIKE THIS?Saturday 26 February 2011

WHY LIKE THIS? • how does an expert select his music?Saturday 26 February 2011

WHY LIKE THIS? • how does an expert select his music? • how does a bartender select his music?Saturday 26 February 2011

WHY LIKE THIS? • how does an expert select his music? • how does a bartender select his music? • making the expert data accessible in a usable way for a bartenderSaturday 26 February 2011

WHY LIKE THIS? • how does an expert select his music? • how does a bartender select his music? • making the expert data accessible in a usable way for a bartender A musical context is a musical description for situations based on atmospheres and musical properties.Saturday 26 February 2011

EXPERTS @ WORK songs param. value matchesSaturday 26 February 2011

THE SCHEMESaturday 26 February 2011

TROUBLE IN EXPERT LANDSaturday 26 February 2011

LET’S CREATE A CONTEXT!Saturday 26 February 2011

LET’S CREATE A CONTEXT! subgenre: easy listening, pop café popularity: 5, 6, 7 mood: relax, tasteful, stylishSaturday 26 February 2011

contextSaturday 26 February 2011

context subcontext ASaturday 26 February 2011

context subcontext A songs with subgenre(easy listening OR pop café)Saturday 26 February 2011

context subcontext A songs with subgenre(easy listening OR pop café) + songs with mood(relax OR tasteful OR stylish)Saturday 26 February 2011

context subcontext A songs with subgenre(easy listening OR pop café) + songs with mood(relax OR tasteful OR stylish) + songs with popularity(5 UNTIL 7)Saturday 26 February 2011

context subcontext A subcontext B songs with subgenre(easy listening OR pop café) + songs with mood(relax OR tasteful OR stylish) + + songs with popularity(5 UNTIL 7)Saturday 26 February 2011

context subcontext A subcontext B songs with songs with subgenre(easy listening genre(pop) OR pop café) + songs with mood(relax OR tasteful OR stylish) + + songs with popularity(5 UNTIL 7)Saturday 26 February 2011

context subcontext A subcontext B songs with songs with subgenre(easy listening genre(pop) OR pop café) + + songs with songs with mood(intimate OR mood(relax OR tasteful OR stylish) + romantic OR sensual) + songs with popularity(5 UNTIL 7)Saturday 26 February 2011

context subcontext A subcontext B songs with songs with subgenre(easy listening genre(pop) OR pop café) + + songs with songs with mood(intimate OR mood(relax OR tasteful OR stylish) + romantic OR sensual) + + songs with songs with popularity(5 UNTIL 7) popularity(6 UNTIL 7)Saturday 26 February 2011

context subcontext A subcontext B songs with songs with subgenre(easy listening genre(pop) OR pop café) + 75% 25% + songs with songs with mood(intimate OR mood(relax OR tasteful OR stylish) + romantic OR sensual) + + songs with songs with popularity(5 UNTIL 7) popularity(6 UNTIL 7)Saturday 26 February 2011

WHAT’S UNDER THE HOOD?Saturday 26 February 2011

HTTP://WWW.TUNIFY.COMSaturday 26 February 2011

WHAT’S NEXT?... • manually annotated metadata •5 music experts at Aristo Music and different consultants • about 200,000 songs • but, not enough...Saturday 26 February 2011

THE LONG TAIL http://en.wikipedia.org/wiki/Long_TailSaturday 26 February 2011

OTHER PROBLEMS... • satisfyingthe music choice of all customers • retail and catering differ from you and me! • new markets • react fast on emerging music trends • adding the full Belgian library catalogSaturday 26 February 2011

GENERATE THE METADATA • from different sources: • the audio signal • web sources • the Aristo database • attention metadata • using our metadata generation framework: SamgISaturday 26 February 2011

TWO TECHNIQUES • Genre • Country of OriginSaturday 26 February 2011

GENRE... http://techno.org/electronic-music-guide/ • our master thesis looked at different ways to generate genre...Saturday 26 February 2011

GENRESaturday 26 February 2011

CLASSIFICATION WITH SEARCH ENGINES using co-occurrenceSaturday 26 February 2011

CLASSIFICATION WITH SEARCH ENGINES using co-occurrence Artist + Genre + SchemaSaturday 26 February 2011

Rock: Jazz: Blues: Pop: Country: Metal:Saturday 26 February 2011

Rock: Jazz: 0,013 0,013 Blues: Pop: 0,009 0,015 Country: Metal: 0,009 0,005Saturday 26 February 2011

HOW TO EVALUATE THIS? • run an experiment • evaluate on 1995 artists and 9 genres. • different search engines: Google,Yahoo! and Live! Search. • over time: 8 times over a period of 36 days.Saturday 26 February 2011

THE DATA SET Blues Country Electronic Folk Jazz Metal Rap Reggae RnBSaturday 26 February 2011

THE DATA SET Blues Country Electronic Folk Jazz Metal Rap Reggae RnB 10% 9% 3% 2% 12% 13% 5% 4% 41%Saturday 26 February 2011

THE DATA SET Blues Country Electronic Folk Jazz Metal Rap Reggae RnBSaturday 26 February 2011

MOTION CHART • http://hmdb.cs.kuleuven.be/muzik/gapminder.htmlSaturday 26 February 2011

MORE FINE-GRAINED... • 18 artists • more search engines: Google.co.uk/.fr/.be, uk/ fr.search.yahoo.com • twice a day for 53 days • 250,000 queries!Saturday 26 February 2011

2 Pac Rap Alan Lomax Folk Art Pepper Jazz Cradle of Filth Metal David Parsons Electronic Desmond Dekker Reggae Downpour Metal IceT Rap Jerry Butler RnB Joy Lynn White Country Louisiana Red Blues Lou Rawls RnB LTJ Bukem Electronic Peter Tosh Reggae Pinetop Smith Jazz Robert Johnson Blues Roy Rogers Country Steeleye Span FolkSaturday 26 February 2011

MAIN SEARCH ENGINE RESULTSSaturday 26 February 2011

REGIONAL GOOGLESSaturday 26 February 2011

WHAT TO USE? • use Google when it’s stable else rely on Yahoo! • when is it stable? test with a small set • some artists get classiﬁed incorrectly on bad days • compare the accuracy achieved with the test set to the average.Saturday 26 February 2011

DEMO METADATA GENERATION • http://ariadne.cs.kuleuven.be/samgi-service/Saturday 26 February 2011

COUNTRY OF ORIGINSaturday 26 February 2011

MASHUPSSaturday 26 February 2011

MASHUPS • mashups in music: re-mixing multiple existing songs to create a new one.Saturday 26 February 2011

MASHUPS • mashups in music: re-mixing multiple existing songs to create a new one. •a mashup is an application that combines data from multiple online sources to create a new result which was not the original intend of the data.Saturday 26 February 2011

MASHUPS • mashups in music: re-mixing multiple existing songs to create a new one. •a mashup is an application that combines data from multiple online sources to create a new result which was not the original intend of the data. • data is key! • tweaking and enriching data is important • interesting data makes an interesting mashupSaturday 26 February 2011

MY MUSIC MASHUP. • http://www.cs.kuleuven.be/~sten/lastonamfm/Saturday 26 February 2011

COUNTRY & CONTINENT • why is it useful? • subgenres • popularity • recommendations • expensive to annotate • very few existing research • very hard with signal processingSaturday 26 February 2011

COUNTRY & CONTINENT • why is it useful? • subgenres • popularity • recommendations • expensive to annotate • very few existing research ! • very hard with signal processingSaturday 26 February 2011

IN THE BACKGROUND... google maps freebase last.fm google app engine twitter last.fm last.fm yahoo! pipes last on am/fm website dapper youtubeSaturday 26 February 2011

YAHOO! PIPESSaturday 26 February 2011

LAST.FMSaturday 26 February 2011

LAST.FM APISaturday 26 February 2011

FREEBASE http://www.freebase.com/view/m/01mdm7pSaturday 26 February 2011

FREEBASE MQL { "type" : "/music/album", "name" : "Synchronicity", "artist" : "The Police", "track" : [{ "name":null, "length":null }] }Saturday 26 February 2011

FREEBASE MQL { "type" : "/music/album", "name" : "Synchronicity", "artist" : "The Police", "track" : [ {"name":"Synchronicity II", "length":305.066}, {"name":"Every Breath You Take", "length":254.066}, {"name":"King of Pain", "length":299.066}, {"name":"Wrapped Around Your Finger", "length":313.733}, {"name":"Tea in the Sahara", "length":255.44}, {"name":"Walking in Your Footsteps", "length":216.773}, {"name":"Miss Gradenko", "length":120}, {"name":"Murder by Numbers", "length":276.8}, {"name":"O My God", "length":242.226}, {"name":"Synchronicity I", "length":202.866}, {"name":"Mother", "length":185.64} ] }Saturday 26 February 2011

BIOGRAPHIES • from Last.fm (most of them are coming from Wikipedia) • using demonyms. • “Anders Trentemøller is a Danish electronic musician.” • List of demonyms from Wikipedia http://en.wikipedia.org/wiki/ List_of_adjectival_and_demonymic_forms_of_place_namesSaturday 26 February 2011

computerSaturday 26 February 2011

The Beatles computerSaturday 26 February 2011

The Beatles Michael Jackson computerSaturday 26 February 2011

ABBA The Beatles Michael Jackson computerSaturday 26 February 2011

ABBA The Beatles 1 Michael Jackson computerSaturday 26 February 2011

ABBA The Beatles 1 Michael Jackson 2 computerSaturday 26 February 2011

ABBA The Beatles 3 1 Michael Jackson 2 computerSaturday 26 February 2011

RESULTS • with country we also know continent • Last.fm and Freebase only contains data for small part • accuracy: • Last.fm: 91% • Freebase: 90% • Bio: 66% • Combination: 77% • more advanced possibilitiesSaturday 26 February 2011

THANK YOU! QUESTIONS? slides will appear on http://www.slideshare.net/stengovaertsSaturday 26 February 2011

Multimedia: Music

by Sten Govaerts

Accessibility

Upload Details

Usage Rights

Statistics