Social Tags and  Music Information Retrieval Part I <ul><li>ISMIR 2008 </li></ul><ul><ul><li>Paul Lamere – Sun Microsystem...
Speaker – Paul Lamere
Speaker – Elias Pampalk
Audience Poll <ul><li>Have you ever tagged something? </li></ul><ul><li>Have you ever tagged music? </li></ul><ul><li>Have...
What are social tags? Word Clouds created with Wordle.net
Social Tags - Delicious.com
Social Tags - Flickr.com
Social Tags - LibraryThing
What is Deerhoof? Flickr photo by graciepoo
What is Deerhoof?
The Fear – It's  just Graffiti <ul><li>Folksonomies are notoriously imprecise, full of tags that are   &quot;often   ambig...
Outline <ul><li>What are social tags? </li></ul><ul><li>Why do people tag? </li></ul><ul><li>Issues with social tags </li>...
Outline <ul><li>What are social tags? </li></ul><ul><li>Why do people tag? </li></ul><ul><li>Issues with social tags </li>...
What are social tags? <ul><li>Tags </li></ul><ul><ul><li>Short, free text labels applied to content </li></ul></ul><ul><ul...
What are social tags? Taxonomy vs. Folksonomy <ul><li>Taxonomy </li></ul><ul><ul><li>Strong labeling </li></ul></ul><ul><u...
What are social tags? Some characteristics of social tags J. Furner, M. Smith, and M. Winget.  Collaborative indexing of c...
What are social tags? Social Tagging System Attributes <ul><li>Tagging Rights  </li></ul><ul><ul><li>owner, group, anyone ...
What are social tags? What can we learn from social tags? <ul><li>Insights to user behavior and language usage </li></ul><...
What are social tags? Example:  MusicBrainz <ul><li>Some MusicBrainz Tag Stats </li></ul><ul><ul><li>Artist tags:  37,875 ...
What are social tags? Example:  Amazon
What are social tags? Example: MyStrands
What are social tags? Example:  imeem
What are social tags? Example:  Freesound
What are social tags? Last.fm – Case Study <ul><li>History  </li></ul><ul><li>Tagging stats </li></ul><ul><li>Integration ...
<ul><li>July 2005: Felix Miller (CEO) on internal wiki: </li></ul><ul><ul><li>Why use tags: </li></ul></ul><ul><ul><ul><li...
<ul><li>Tags: > 50M </li></ul><ul><ul><ul><li>Tracks  > 50% </li></ul></ul></ul><ul><ul><ul><li>Artists  > 40% </li></ul><...
What are social tags? Integration into Last.fm experience <ul><li>Where are tags visible? </li></ul><ul><ul><li>Music land...
 
 
 
 
 
 
 
 
<ul><li>How can users tag something? </li></ul><ul><ul><li>Desktop software (Last.fm Player & Scrobbler) </li></ul></ul><u...
 
 
 
<ul><li>Tags are visible almost everywhere </li></ul><ul><li>It is very easy to tag something </li></ul>What are social ta...
What are social tags? Tag Popularity: Examples <ul><li>rock   >190k  >2M  </li></ul><ul><li>seen live   >75k  >1M  </li></...
What are social tags? Tag Popularity: More Examples <ul><li>Favorites   > 18k  > 200k  </li></ul><ul><li>officially sh*t  ...
What are social tags? Tag Categories beyond Genre   by Babs_05 (Last.fm user) <ul><li>personal meaning </li></ul><ul><li>p...
[Paul Lamere, JNMR 2008] What are social tags? Tagging Frequencies by Category
[Paul Lamere, JNMR 2008] [Klaas Bosteels et al., ISMIR 2008] Multi-tag search queries 51%   7%   4%   2%   5%   26% Time  ...
What are social tags? Obscure  Tags <ul><li>if you fall in love with me you should know these songs by heart </li></ul><ul...
What are social tags? Number of words per tag [Levy & Sandler, JNMR 2008]
What are social tags? Popular tag radio stations <ul><li>Pop,  rock,  jazz,  chillout,  80s,  indie,  dance,  hip-hop,  al...
What are social tags? Most frequently applied tags <ul><li>Rock,  seen live ,  alternative,  indie,  electronic, pop,  met...
[Paul Lamere, JNMR 2008] Artist rank (wrt number of tags applied, 1-1000) Number of tags applied What are social tags? Dis...
What are social tags? Age vs. Tagging Behaviour <ul><li>Under 19   Average age of users (years) </li></ul><ul><ul><li>lame...
<ul><li>Over 35   Average age of users (years) </li></ul><ul><ul><li>zydeco  37.3 </li></ul></ul><ul><ul><li>soukous  36.6...
What are social tags? Age vs. Tagging Behaviour   Preliminary results! http://mir-research.blogspot.com/2008/06/lastfms-ap...
Outline <ul><li>What are social tags? </li></ul><ul><li>Why do people tag? </li></ul><ul><li>Issues with social tags </li>...
Why do people tag? <ul><li>Pew Study: </li></ul><ul><ul><li>28% of Internet users have tagged or categorized online conten...
Why do people tag? Traditional categorization is hard R. Sinha.  Tagging – From Personal to Social   http://rashmisinha.co...
Why do people tag? Tagging is simpler R. Sinha.  Tagging – From Personal to Social   http://rashmisinha.com/2006/03/12/my-...
Why do people tag? Memory and Context
Why do people tag? Task Organization
Why do people tag? Opinion Expression / Social Signaling
Why do people tag? Social Contribution <ul><li>The  defectivebydesign  tag  is used by anti-DRM advocates to mark items th...
Why do people tag? Play and Competition Squared Circle by shutterBRI by plamere
Last.fm: Why do people tag? <ul><li>Tag radio </li></ul><ul><ul><li>global: collaborative playlist </li></ul></ul><ul><ul>...
 
<ul><li>drsaunde : male, 33, Canada </li></ul><ul><ul><li>12,599 unique tags, up to 1,540 times each </li></ul></ul>Why do...
<ul><li>spacefish : female, 44, Denmark </li></ul><ul><ul><li>782 unique tags, up to 3,336 times each </li></ul></ul>Why d...
<ul><li>fionapinkstars:  female, 22, UK (staff) </li></ul><ul><ul><li>43 unique tags, up to 67 times </li></ul></ul>Why do...
<ul><li>martind:  UK (staff) </li></ul><ul><ul><li>41 unique tags, up to 23 times </li></ul></ul>tags are a channel for na...
<ul><li>E1i45:  male, 30, UK (staff) </li></ul><ul><ul><li>413 unique tags, up to 51 times </li></ul></ul>Why do people ta...
<ul><li>Average Tagger:  male, 24, USA </li></ul><ul><ul><li>applied around 50 tags </li></ul></ul>Why do people tag? Last...
<ul><li>hm_hallo:  female, 25, Germany </li></ul><ul><ul><li>156 unique tags, up to 357 times </li></ul></ul>Why do people...
 
Why do people tag? Last.fm groups focusing on tags <ul><li>Group: The Special Interest Tag Radio Collective   >100 members...
<ul><li>Group: Subscribers and their tag radio stations  </li></ul><ul><ul><li>>100 members </li></ul></ul><ul><li>This gr...
<ul><li>Group: Genre-free tags!  </li></ul><ul><ul><li>>100 members </li></ul></ul><ul><li>&quot;That's right; there's mor...
<ul><li>Group: Thursday Night Party Hat Party  </li></ul><ul><ul><li>>70 members </li></ul></ul><ul><li>“OK, I've started ...
<ul><li>Group: WoopWoop  </li></ul><ul><ul><li>>30 members </li></ul></ul><ul><li>&quot;Listening to a track you're desper...
<ul><li>More Groups: </li></ul><ul><ul><li>Pure Track-Taggers </li></ul></ul><ul><ul><li>Track-Tag Bitches </li></ul></ul>...
Why do people tag? <ul><li>Motivations </li></ul><ul><ul><li>Simplicity </li></ul></ul><ul><ul><li>Memory and context </li...
Outline <ul><li>What are social tags? </li></ul><ul><li>Why do people tag? </li></ul><ul><li>Issues with social tags </li>...
Issues with social tags Cold start and obscure content <ul><li>Tagging something requires: </li></ul><ul><ul><li>Knowing i...
<ul><li>Radiohead </li></ul>Issues with social tags Cold start and obscure content Tagged by 24k listeners on Last.fm
<ul><li>Jersey Budd </li></ul>Issues with social tags Cold start and obscure content
<ul><li>Weak labeling </li></ul><ul><ul><li>E.g. “male vocalist” is sometimes considered a default </li></ul></ul><ul><ul>...
<ul><li>Kids having fun </li></ul><ul><ul><li>Barney, Paris Hilton, ... </li></ul></ul><ul><ul><li>Can be very offensive <...
Issues with social tags Abuse example:  Paris Hilton
<ul><li>Do taggers like what they are tagging? </li></ul><ul><li>Correlations between taggers </li></ul><ul><li>Bot-like p...
<ul><li>Examples </li></ul><ul><ul><li>that one song </li></ul></ul><ul><ul><li>lazy eye </li></ul></ul><ul><li>Problem sc...
<ul><li>Examples </li></ul><ul><ul><li>Polysemy: love </li></ul></ul><ul><ul><ul><li>music I love </li></ul></ul></ul><ul>...
<ul><li>89277  female vocalists </li></ul><ul><li>15874  female </li></ul><ul><li>7150  female vocalist </li></ul><ul><li>...
<ul><li>Last.fm community is not an unbiased sample of music listeners worldwide </li></ul><ul><ul><li>On average a relati...
<ul><li>Last.fm community is not an unbiased sample of music listeners worldwide </li></ul><ul><ul><li>Electronic music </...
Issues with Social Tags <ul><li>Not enough tags </li></ul><ul><ul><li>Cold start  </li></ul></ul><ul><ul><li>Obscure conte...
Outline <ul><li>What are social tags? </li></ul><ul><li>Why do people tag? </li></ul><ul><li>Issues with social tags </li>...
Other sources of tags Games (with a purpose) <ul><li>Idea: </li></ul><ul><ul><li>Humans are best at solving some types of ...
Other sources of tags Games – Tag a Tune http://www.gwap.com/gwap/gamesPreview/tagatune/
<ul><li>Statistics for 3 months of game play </li></ul><ul><ul><li>Total tags: ~260,000 </li></ul></ul><ul><ul><li>Total s...
Other sources of tags Games – Major Miner http://majorminer.com/
<ul><li>Unique asynchronous scoring </li></ul><ul><li>Statistics </li></ul><ul><ul><li>530 Users </li></ul></ul><ul><ul><l...
http://majorminer.com/search/ Other sources of tags Games – Major Miner
Other sources of tags Games – The Listen Game http://www.listengame.org/
<ul><li>Statistics from 2 week pilot study </li></ul><ul><ul><li>Listen250 dataset </li></ul></ul><ul><ul><ul><li>26,000 a...
Other sources of tags Games – MoodSwings Y. E. Kim, E. Schmidt, and L. Emelle. MoodSwings:  A collaborative game for music...
Other sources of tags Games – Herd It &quot;Herd It connects players in real-time and they listen to the same music clip. ...
Other sources of tags Games – Moose6 – A BBC Prototype
<ul><li>Pros: </li></ul><ul><ul><li>Can tag at the phrase/clip level </li></ul></ul><ul><ul><li>Potentially can tag into t...
Other sources of tags Experts/Surveys <ul><li>Hire experts to hand label content </li></ul><ul><li>Advantages </li></ul><u...
Other sources of tags Experts/Surveys – All Music Guide
<ul><li>Pop Tracks: ~13 million </li></ul><ul><li>Pop Albums: ~1.4 million </li></ul><ul><li>Classical Compositions: ~300 ...
Other sources of tags Experts/Surveys – All Music Guide
<ul><li>Music labeled by paid professional musicians </li></ul><ul><li>Fixed vocabulary: ~500 weighted attributes </li></u...
<ul><li>66 undergrads – paid $10 per hour to label music </li></ul><ul><li>1,700 annotations </li></ul><ul><li>500 'wester...
Other sources of tags Web mining <ul><li>Internet: the largest digital archive of music </li></ul><ul><ul><li>Music blogs,...
<ul><li>Whitman & Lawrence (ICMC 2002) </li></ul><ul><ul><li>Google: “<artist name>” +music +review </li></ul></ul><ul><ul...
<ul><li>ABBA </li></ul><ul><ul><li>100 pop </li></ul></ul><ul><ul><li>56 song </li></ul></ul><ul><ul><li>50 musical </li><...
<ul><li>Britney Spears </li></ul><ul><ul><li>100 pop </li></ul></ul><ul><ul><li>99 song </li></ul></ul><ul><ul><li>52 girl...
<ul><li>Metallica </li></ul><ul><ul><li>100 metal </li></ul></ul><ul><ul><li>43 band </li></ul></ul><ul><ul><li>38 concert...
<ul><li>Ludwig van Beethoven </li></ul><ul><ul><li>100 piano </li></ul></ul><ul><ul><li>67 symphony </li></ul></ul><ul><ul...
<ul><ul><li>[Knees et al., ACM MM 2006] </li></ul></ul>Other sources of tags Using Web Mined Tags: nepTune
<ul><ul><li>[Pampalk & Goto, ISMIR 2006] </li></ul></ul>Other sources of tags Using Web Mined Tags: MusicRainbow
<ul><ul><li>[Pampalk & Goto, ISMIR 2007] </li></ul></ul>Other sources of tags Using Web Mined Tags: MusicSun
Upcoming SlideShare
Loading in...5
×

Social Tags and Music Information Retrieval (Part I)

8,074
-1

Published on

Part 1 of the Social Tags and Music Information Retrieval Tutorial. Abstract: Social Tags are free text labels that are applied to items such as artists, playlists and songs. These tags have the potential to have a positive impact on music information retrieval research. In this tutorial we describe the state of the art in commercial and research social tagging systems for music. We explore some of the motivations for tagging. We describe the factors that affect the quantity and quality of collected tags. We present a toolkit that MIR researchers can use to harvest and process tags. We look at how tags are collected and used in current commercial and research systems. We explore some of the issues and problems that are encountered when using tags. We present current MIR-related research centered on social tags and suggest possible areas of exploration for future resear

Published in: Technology
3 Comments
38 Likes
Statistics
Notes
No Downloads
Views
Total Views
8,074
On Slideshare
0
From Embeds
0
Number of Embeds
3
Actions
Shares
0
Downloads
386
Comments
3
Likes
38
Embeds 0
No embeds

No notes for slide
  • Social Tags and Music Information Retrieval (Part I)

    1. 1. Social Tags and Music Information Retrieval Part I <ul><li>ISMIR 2008 </li></ul><ul><ul><li>Paul Lamere – Sun Microsystems Inc. </li></ul></ul><ul><ul><ul><li>Elias Pampalk – Last.fm </li></ul></ul></ul>
    2. 2. Speaker – Paul Lamere
    3. 3. Speaker – Elias Pampalk
    4. 4. Audience Poll <ul><li>Have you ever tagged something? </li></ul><ul><li>Have you ever tagged music? </li></ul><ul><li>Have you ever heard of Last.fm? </li></ul><ul><li>Have you ever used tags to help find something? </li></ul><ul><li>Do you think social tags are just a web 2.0 fad? </li></ul><ul><li>Are you using social tags in your research? </li></ul><ul><li>Are you a tag skeptic? </li></ul>
    5. 5. What are social tags? Word Clouds created with Wordle.net
    6. 6. Social Tags - Delicious.com
    7. 7. Social Tags - Flickr.com
    8. 8. Social Tags - LibraryThing
    9. 9. What is Deerhoof? Flickr photo by graciepoo
    10. 10. What is Deerhoof?
    11. 11. The Fear – It's just Graffiti <ul><li>Folksonomies are notoriously imprecise, full of tags that are &quot;often ambiguous , overly personalized and inexact &quot; resulting in an &quot; uncontrolled and chaotic set of tagging terms that do not support searching as effectively as more controlled vocabularies do&quot; </li></ul><ul><li>Guy & Tonkin, 2006 </li></ul><ul><li>... if users can continuously add tags to items, at some point it is likely that the whole system will become unusable . A folksonomic system threatens to undermine its own usefulness. </li></ul><ul><li>Elaine Peterson, 2006 </li></ul>Flickr Photo by funkandjazz Abbey E.Thompson. Playing Tag: An Analysis of Vocabulary Patterns and Relationships Within a Popular Music Folksonomy
    12. 12. Outline <ul><li>What are social tags? </li></ul><ul><li>Why do people tag? </li></ul><ul><li>Issues with social tags </li></ul><ul><li>Other sources of tags </li></ul><ul><li>Search, Discovery & Recommendation </li></ul><ul><li>Data & Tools </li></ul><ul><li>Future Research </li></ul><ul><li>Conclusion </li></ul><ul><li>Discussion </li></ul>
    13. 13. Outline <ul><li>What are social tags? </li></ul><ul><li>Why do people tag? </li></ul><ul><li>Issues with social tags </li></ul><ul><li>Other sources of tags </li></ul><ul><li>Search, Discovery & Recommendation </li></ul><ul><li>Data & Tools </li></ul><ul><li>Future Research </li></ul><ul><li>Conclusion </li></ul><ul><li>Discussion </li></ul>
    14. 14. What are social tags? <ul><li>Tags </li></ul><ul><ul><li>Short, free text labels applied to content </li></ul></ul><ul><ul><li>No structure, no vocabulary limits </li></ul></ul><ul><ul><li>Typically applied by the generator or the consumer of the item being tagged </li></ul></ul><ul><li>Social Tags </li></ul><ul><ul><li>The aggregation of individual sets of tags </li></ul></ul><ul><ul><li>Sometimes called a Folksonomy - A user-created bottom-up categorical structure development with an emergent thesaurus </li></ul></ul>
    15. 15. What are social tags? Taxonomy vs. Folksonomy <ul><li>Taxonomy </li></ul><ul><ul><li>Strong labeling </li></ul></ul><ul><ul><li>Structured vocabulary </li></ul></ul><ul><ul><li>Fixed vocabulary </li></ul></ul><ul><li>Folksonomy </li></ul><ul><ul><li>Weak labeling </li></ul></ul><ul><ul><li>Unstructured vocabulary </li></ul></ul><ul><ul><li>Free-for-all vocabulary </li></ul></ul>D. Turnbull, L. Barrington, G. Lanckriet. Five Approaches to Collecting Tags for Music. ISMIR 2008.
    16. 16. What are social tags? Some characteristics of social tags J. Furner, M. Smith, and M. Winget. Collaborative indexing of cultural resources: Some outstanding issues.
    17. 17. What are social tags? Social Tagging System Attributes <ul><li>Tagging Rights </li></ul><ul><ul><li>owner, group, anyone </li></ul></ul><ul><li>Tagging Support </li></ul><ul><ul><li>blind tagging, suggestive tagging </li></ul></ul><ul><li>Aggregation </li></ul><ul><ul><li>bag model, set model </li></ul></ul><ul><li>Type of object being tagged </li></ul><ul><ul><li>artists, tracks, albums, labels, playlists, clips </li></ul></ul>
    18. 18. What are social tags? What can we learn from social tags? <ul><li>Insights to user behavior and language usage </li></ul><ul><ul><li>how different is rap from hip-hop ? </li></ul></ul><ul><li>Grouping of items based on tags or taggers </li></ul><ul><ul><li>cheese on toast, hooves and paws </li></ul></ul><ul><li>Finding social groups with shared interests </li></ul><ul><ul><li>people that tag the same items or use the same tags </li></ul></ul><ul><li>Generating user profiles from tagging behavior </li></ul><ul><ul><li>tag clouds based on tags applied by the user </li></ul></ul><ul><ul><li>Representation of taste and/or expertise </li></ul></ul><ul><li>Information on how items change over time </li></ul><ul><ul><li>track changes to item tags over time </li></ul></ul>K. Weller. Folksonomies and Ontologies. Two New Players in Indexing and Knowledge Representation.
    19. 19. What are social tags? Example: MusicBrainz <ul><li>Some MusicBrainz Tag Stats </li></ul><ul><ul><li>Artist tags: 37,875 </li></ul></ul><ul><ul><li>Album tags: 21,423 </li></ul></ul><ul><ul><li>Track tags: 10,818 </li></ul></ul><ul><ul><li>Label tags: 1,250 </li></ul></ul>
    20. 20. What are social tags? Example: Amazon
    21. 21. What are social tags? Example: MyStrands
    22. 22. What are social tags? Example: imeem
    23. 23. What are social tags? Example: Freesound
    24. 24. What are social tags? Last.fm – Case Study <ul><li>History </li></ul><ul><li>Tagging stats </li></ul><ul><li>Integration </li></ul><ul><li>Tags and their popularity </li></ul><ul><li>More stats </li></ul>
    25. 25. <ul><li>July 2005: Felix Miller (CEO) on internal wiki: </li></ul><ul><ul><li>Why use tags: </li></ul></ul><ul><ul><ul><li>To build playlists by tagging tracks </li></ul></ul></ul><ul><ul><ul><li>Categorise your profile and the global music catalogue </li></ul></ul></ul><ul><ul><ul><li>Get recommendations based on tags </li></ul></ul></ul><ul><ul><ul><li>Summarize your profile </li></ul></ul></ul><ul><li>August 2005: launched </li></ul><ul><ul><li>Inspired by delicious and flickr </li></ul></ul><ul><ul><li>At the same time audioscrobbler merged with Last.fm </li></ul></ul>What are social tags? History of tagging at Last.fm
    26. 26. <ul><li>Tags: > 50M </li></ul><ul><ul><ul><li>Tracks > 50% </li></ul></ul></ul><ul><ul><ul><li>Artists > 40% </li></ul></ul></ul><ul><ul><ul><li>Albums < 5% </li></ul></ul></ul><ul><ul><ul><li>Labels < 1% </li></ul></ul></ul><ul><li>Unique tags: > 1.2M </li></ul><ul><li>Unique tags applied to more than 10 items: > 130k </li></ul><ul><li>Items tagged: > 3.8M </li></ul><ul><li>Tags per month: > 2.5M </li></ul><ul><li>Taggers per month: > 300k </li></ul>What are social tags? Last.fm tagging stats
    27. 27. What are social tags? Integration into Last.fm experience <ul><li>Where are tags visible? </li></ul><ul><ul><li>Music landing page </li></ul></ul><ul><ul><li>Tag pages </li></ul></ul><ul><ul><li>Tag radio </li></ul></ul><ul><ul><li>Artist, album, track, label summaries </li></ul></ul><ul><ul><li>Tag clouds </li></ul></ul><ul><ul><li>User library, ... </li></ul></ul>
    28. 36. <ul><li>How can users tag something? </li></ul><ul><ul><li>Desktop software (Last.fm Player & Scrobbler) </li></ul></ul><ul><ul><li>Web site </li></ul></ul><ul><ul><ul><li>Add to library dialog </li></ul></ul></ul><ul><ul><ul><li>Add tag button on item pages (artist, album, track) </li></ul></ul></ul><ul><ul><ul><li>Every listed item (charts etc) has multi-function button </li></ul></ul></ul><ul><ul><ul><li>Flash player </li></ul></ul></ul>What are social tags? Integration into Last.fm experience
    29. 40. <ul><li>Tags are visible almost everywhere </li></ul><ul><li>It is very easy to tag something </li></ul>What are social tags? Integration into Last.fm experience
    30. 41. What are social tags? Tag Popularity: Examples <ul><li>rock >190k >2M </li></ul><ul><li>seen live >75k >1M </li></ul><ul><li>female vocalists >60k > 500k </li></ul><ul><li>chillout >40k > 250k </li></ul><ul><li>guitar >20k >90k </li></ul><ul><li>happy >9k >40k </li></ul><ul><li>icelandic >8k >20k </li></ul><ul><li>brazil >4k >15k </li></ul><ul><li>inspirational 1.2k >5k </li></ul><ul><li>hammond organ >200 >700 </li></ul><ul><li>berimbau <50 < 90 </li></ul>people # times applied
    31. 42. What are social tags? Tag Popularity: More Examples <ul><li>Favorites > 18k > 200k </li></ul><ul><li>officially sh*t > 2k > 12k </li></ul><ul><li>i am a party girl here is my soundtrack > 350 > 5.9k </li></ul><ul><li>tv themes > 250 > 680 </li></ul><ul><li>songs that i sing along to but i always forget the words so i say duh duh while trying to sound like i do know the words and no one is falling for it but they keep quiet because they are embarrassed for me > 60 > 300 </li></ul><ul><li>gtasa tracks < 30 > 700 </li></ul><ul><li>artists with disco in their name 2 49 </li></ul><ul><li>wherein i compile a comprehensive list of songs about zombies 7 36 </li></ul>people # times applied
    32. 43. What are social tags? Tag Categories beyond Genre by Babs_05 (Last.fm user) <ul><li>personal meaning </li></ul><ul><li>playlists with unusual names </li></ul><ul><li>regional </li></ul><ul><li>decade </li></ul><ul><li>group-specific </li></ul><ul><li>descriptive </li></ul><ul><ul><li>http://www.last.fm/group/Track-Tag+Bitches/forum/24779/_/319957/1#f4621887 </li></ul></ul><ul><ul><li>tempo </li></ul></ul><ul><ul><li>mood </li></ul></ul><ul><ul><li>instruments </li></ul></ul><ul><ul><li>films </li></ul></ul><ul><ul><li>music to... </li></ul></ul><ul><ul><li>album labels </li></ul></ul><ul><ul><li>based on radio shows or nightclubs </li></ul></ul>
    33. 44. [Paul Lamere, JNMR 2008] What are social tags? Tagging Frequencies by Category
    34. 45. [Paul Lamere, JNMR 2008] [Klaas Bosteels et al., ISMIR 2008] Multi-tag search queries 51% 7% 4% 2% 5% 26% Time 3% Other 2% What are social tags? Tagging vs. Search Frequencies
    35. 46. What are social tags? Obscure Tags <ul><li>if you fall in love with me you should know these songs by heart </li></ul><ul><li>sure go ahead and depress the hell outta me what do I care </li></ul><ul><li>that one song </li></ul><ul><li>and finally laughing like a maniac saying I am the ruler of this stupid little world called me </li></ul><ul><li>I woke up this morning and the sun was gone </li></ul><ul><li>I used to suck blood with gothic dogs but now I wear bermuda shorts and [...] </li></ul><ul><li>I was never a Swedish teenager with swedish teen angst so now I will attempt at having it </li></ul>
    36. 47. What are social tags? Number of words per tag [Levy & Sandler, JNMR 2008]
    37. 48. What are social tags? Popular tag radio stations <ul><li>Pop, rock, jazz, chillout, 80s, indie, dance, hip-hop, alternative, house, pop rock, reggae, electronic , oldies, metal, blues, schlager, ambient, trance, classical </li></ul>Measured on a day in July 2008. Almost all of the most popular radio stations are genres! Surprise?
    38. 49. What are social tags? Most frequently applied tags <ul><li>Rock, seen live , alternative, indie, electronic, pop, metal , female vocalists , alternative rock, classic, rock, punk, jazz, indie rock, electronic, singer-songwriter, folk, hip-hop, ambient, dance, experimental </li></ul>Metal fans are some of the best taggers ever.
    39. 50. [Paul Lamere, JNMR 2008] Artist rank (wrt number of tags applied, 1-1000) Number of tags applied What are social tags? Distribution of tags
    40. 51. What are social tags? Age vs. Tagging Behaviour <ul><li>Under 19 Average age of users (years) </li></ul><ul><ul><li>lame lame lame lame 18.2 </li></ul></ul><ul><ul><li>tokio hotel 18.5 </li></ul></ul><ul><ul><li>xd 18.7 </li></ul></ul><ul><ul><li><3 18.7 </li></ul></ul><ul><ul><li>tr00 satanic black metal 18.8 </li></ul></ul>
    41. 52. <ul><li>Over 35 Average age of users (years) </li></ul><ul><ul><li>zydeco 37.3 </li></ul></ul><ul><ul><li>soukous 36.6 </li></ul></ul><ul><ul><li>cajun 35.9 </li></ul></ul><ul><ul><li>zimbabwe 35.3 </li></ul></ul><ul><ul><li>jazz saxophone 35.1 </li></ul></ul>What are social tags? Age vs. Tagging Behaviour
    42. 53. What are social tags? Age vs. Tagging Behaviour Preliminary results! http://mir-research.blogspot.com/2008/06/lastfms-api-python-and-tagging_29.html
    43. 54. Outline <ul><li>What are social tags? </li></ul><ul><li>Why do people tag? </li></ul><ul><li>Issues with social tags </li></ul><ul><li>Other sources of tags </li></ul><ul><li>Search, Discovery & Recommendation </li></ul><ul><li>Data & Tools </li></ul><ul><li>Future Research </li></ul><ul><li>Conclusion </li></ul><ul><li>Discussion </li></ul>
    44. 55. Why do people tag? <ul><li>Pew Study: </li></ul><ul><ul><li>28% of Internet users have tagged or categorized online content </li></ul></ul><ul><ul><li>Everyday 7% of internet users tag or categorize online content </li></ul></ul><ul><li>Why are people tagging? </li></ul><ul><ul><li>Tagging is personal but benefits everyone </li></ul></ul><ul><ul><li>Tagging is easy </li></ul></ul><ul><ul><li>Tagging is fun </li></ul></ul>D. Weinberger. How tagging changes peoples relationship to information and each other. Pew Internet & American Life Project . (2007)
    45. 56. Why do people tag? Traditional categorization is hard R. Sinha. Tagging – From Personal to Social http://rashmisinha.com/2006/03/12/my-slides-for-tagging-20-panel-at-sxsw/
    46. 57. Why do people tag? Tagging is simpler R. Sinha. Tagging – From Personal to Social http://rashmisinha.com/2006/03/12/my-slides-for-tagging-20-panel-at-sxsw/
    47. 58. Why do people tag? Memory and Context
    48. 59. Why do people tag? Task Organization
    49. 60. Why do people tag? Opinion Expression / Social Signaling
    50. 61. Why do people tag? Social Contribution <ul><li>The defectivebydesign tag is used by anti-DRM advocates to mark items that use DRM </li></ul><ul><li>http://www.defectivebydesign.org/ </li></ul>
    51. 62. Why do people tag? Play and Competition Squared Circle by shutterBRI by plamere
    52. 63. Last.fm: Why do people tag? <ul><li>Tag radio </li></ul><ul><ul><li>global: collaborative playlist </li></ul></ul><ul><ul><li>personal: playlist </li></ul></ul><ul><li>Example taggers </li></ul><ul><li>Last.fm groups focusing on tags </li></ul><ul><li>Bookmarking, organizing, sharing knowledge, communicating, ... </li></ul>
    53. 65. <ul><li>drsaunde : male, 33, Canada </li></ul><ul><ul><li>12,599 unique tags, up to 1,540 times each </li></ul></ul>Why do people tag? Last.fm taggers
    54. 66. <ul><li>spacefish : female, 44, Denmark </li></ul><ul><ul><li>782 unique tags, up to 3,336 times each </li></ul></ul>Why do people tag? Last.fm taggers
    55. 67. <ul><li>fionapinkstars: female, 22, UK (staff) </li></ul><ul><ul><li>43 unique tags, up to 67 times </li></ul></ul>Why do people tag? Last.fm taggers
    56. 68. <ul><li>martind: UK (staff) </li></ul><ul><ul><li>41 unique tags, up to 23 times </li></ul></ul>tags are a channel for narrative and social interaction personal tags allow you to draw a circle around stuff you care about Why do people tag? Last.fm taggers
    57. 69. <ul><li>E1i45: male, 30, UK (staff) </li></ul><ul><ul><li>413 unique tags, up to 51 times </li></ul></ul>Why do people tag? Last.fm taggers
    58. 70. <ul><li>Average Tagger: male, 24, USA </li></ul><ul><ul><li>applied around 50 tags </li></ul></ul>Why do people tag? Last.fm taggers
    59. 71. <ul><li>hm_hallo: female, 25, Germany </li></ul><ul><ul><li>156 unique tags, up to 357 times </li></ul></ul>Why do people tag? Last.fm taggers
    60. 73. Why do people tag? Last.fm groups focusing on tags <ul><li>Group: The Special Interest Tag Radio Collective >100 members </li></ul><ul><li>“ We have the radio you want! :-D If not, join and help us grow musically... YAY!” </li></ul><ul><li>Tag radio stations listed: </li></ul><ul><ul><li>Cheese on Toast, The Ladies Room, Tambourine, Xylophone & Vibraphone, Forests and Woodland, Insects and Arachnids, They Said Shoes!, Under the Influence..., Awesome Guitar Jams, ... </li></ul></ul>
    61. 74. <ul><li>Group: Subscribers and their tag radio stations </li></ul><ul><ul><li>>100 members </li></ul></ul><ul><li>This group is to bring together subscribers who have taken the time to tag and share the music they like. No specific genre or participation needed. This is just a way to find and listen to... </li></ul>Why do people tag? Last.fm groups focusing on tags
    62. 75. <ul><li>Group: Genre-free tags! </li></ul><ul><ul><li>>100 members </li></ul></ul><ul><li>&quot;That's right; there's more to tags than silly genres.&quot; </li></ul><ul><li>lesser known yet streamable artists </li></ul><ul><li>cover track </li></ul><ul><li>first album </li></ul><ul><li>i am a spy here is my soundtrack </li></ul>Why do people tag? Last.fm groups focusing on tags
    63. 76. <ul><li>Group: Thursday Night Party Hat Party </li></ul><ul><ul><li>>70 members </li></ul></ul><ul><li>“OK, I've started tagging weird country music, in anticipation of Frippgamesh's party on August 21. Right now, I'm the only one who's done any tagging, but I was able to tag 11 artists without working up a sweat, starting with the band Rebel Meets Rebel that I had afflicted aniaki with in a recent double-dare.” </li></ul>Why do people tag? Last.fm groups focusing on tags
    64. 77. <ul><li>Group: WoopWoop </li></ul><ul><ul><li>>30 members </li></ul></ul><ul><li>&quot;Listening to a track you're desperate to share with the world? Want to listen to music that others feel the same about?&quot; </li></ul>Why do people tag? Last.fm groups focusing on tags
    65. 78. <ul><li>More Groups: </li></ul><ul><ul><li>Pure Track-Taggers </li></ul></ul><ul><ul><li>Track-Tag Bitches </li></ul></ul><ul><ul><li>Tag Top </li></ul></ul><ul><ul><li>Tags are a Joke </li></ul></ul><ul><ul><li>We use tags that have never been used before </li></ul></ul><ul><ul><li>... </li></ul></ul>Why do people tag? Last.fm groups focusing on tags
    66. 79. Why do people tag? <ul><li>Motivations </li></ul><ul><ul><li>Simplicity </li></ul></ul><ul><ul><li>Memory and context </li></ul></ul><ul><ul><li>Task organization </li></ul></ul><ul><ul><li>Opinion expression & social signaling </li></ul></ul><ul><ul><li>Social contribution </li></ul></ul><ul><ul><li>Play and competition </li></ul></ul><ul><li>Last.fm specific </li></ul><ul><ul><li>Collaborative/personal playlists (tag radio) </li></ul></ul><ul><ul><li>Tag groups </li></ul></ul>
    67. 80. Outline <ul><li>What are social tags? </li></ul><ul><li>Why do people tag? </li></ul><ul><li>Issues with social tags </li></ul><ul><li>Other sources of tags </li></ul><ul><li>Search, Discovery & Recommendation </li></ul><ul><li>Data & Tools </li></ul><ul><li>Future Research </li></ul><ul><li>Conclusion </li></ul><ul><li>Discussion </li></ul>
    68. 81. Issues with social tags Cold start and obscure content <ul><li>Tagging something requires: </li></ul><ul><ul><li>Knowing it exists (new releases, cold start) </li></ul></ul><ul><ul><li>Caring enough to bother (obscure content, long tail) </li></ul></ul><ul><li>Problem scope </li></ul><ul><ul><li>Many artists, albums, tracks affected </li></ul></ul><ul><li>Solution: alternative sources of tags </li></ul><ul><ul><ul><li>Autotagging, tag games, ... </li></ul></ul></ul>
    69. 82. <ul><li>Radiohead </li></ul>Issues with social tags Cold start and obscure content Tagged by 24k listeners on Last.fm
    70. 83. <ul><li>Jersey Budd </li></ul>Issues with social tags Cold start and obscure content
    71. 84. <ul><li>Weak labeling </li></ul><ul><ul><li>E.g. “male vocalist” is sometimes considered a default </li></ul></ul><ul><ul><li>Problem scope: </li></ul></ul><ul><ul><ul><li>sparsely tagged items are affected most </li></ul></ul></ul><ul><li>Popularity & noise </li></ul><ul><ul><li>The Beatles: </li></ul></ul><ul><ul><ul><li>tagged emo 68 times on Last.fm </li></ul></ul></ul><ul><ul><li>These Silhouettes: </li></ul></ul><ul><ul><ul><li>tagged emo 11 times on Last.fm </li></ul></ul></ul><ul><ul><li>Solution: normalization </li></ul></ul>Issues with social tags Precision and Recall
    72. 85. <ul><li>Kids having fun </li></ul><ul><ul><li>Barney, Paris Hilton, ... </li></ul></ul><ul><ul><li>Can be very offensive </li></ul></ul><ul><li>Labels/artists trying to “help” </li></ul><ul><li>Problem scope: </li></ul><ul><ul><li>Limited to very few artists </li></ul></ul>Issues with social tags Abuse
    73. 86. Issues with social tags Abuse example: Paris Hilton
    74. 87. <ul><li>Do taggers like what they are tagging? </li></ul><ul><li>Correlations between taggers </li></ul><ul><li>Bot-like patterns </li></ul><ul><li>Tag Karma </li></ul><ul><ul><li>How “useful” are contributions of a tagger? </li></ul></ul><ul><ul><ul><li>E.g. if artist X is tagged metal, but everyone listening to metal radio skips that artist... </li></ul></ul></ul>Issues with social tags Abuse detection
    75. 88. <ul><li>Examples </li></ul><ul><ul><li>that one song </li></ul></ul><ul><ul><li>lazy eye </li></ul></ul><ul><li>Problem scope </li></ul><ul><ul><li>Sparsely tagged items affected most </li></ul></ul>Issues with social tags Noise
    76. 89. <ul><li>Examples </li></ul><ul><ul><li>Polysemy: love </li></ul></ul><ul><ul><ul><li>music I love </li></ul></ul></ul><ul><ul><ul><li>music about love </li></ul></ul></ul><ul><ul><li>Synonym: female vocalists </li></ul></ul><ul><li>Problem scope </li></ul><ul><ul><li>Sparsely tagged items </li></ul></ul>Issues with social tags Ambiguity and Synonyms
    77. 90. <ul><li>89277 female vocalists </li></ul><ul><li>15874 female </li></ul><ul><li>7150 female vocalist </li></ul><ul><li>2716 female vocals </li></ul><ul><li>2180 female voices </li></ul><ul><li>1424 female artists </li></ul><ul><li>955 female vocal </li></ul><ul><li>698 female singers </li></ul>http://blogs.sun.com/plamere/entry/determining_synonyms_from_tags Issues with social tags Synonyms Example
    78. 91. <ul><li>Last.fm community is not an unbiased sample of music listeners worldwide </li></ul><ul><ul><li>On average a relatively young audience </li></ul></ul><ul><ul><li>Tech-savvy </li></ul></ul><ul><ul><li>Tastemakers </li></ul></ul><ul><ul><li>Eclectic tastes, interested in discovering new music </li></ul></ul><ul><ul><li>Non-mainstream </li></ul></ul><ul><ul><li>Some regions are underrepresented (e.g. Africa) </li></ul></ul><ul><ul><li>Some styles of music are represented stronger than others. E.g. classical music vs. indie/alternative </li></ul></ul>Issues with social tags Tagger bias
    79. 92. <ul><li>Last.fm community is not an unbiased sample of music listeners worldwide </li></ul><ul><ul><li>Electronic music </li></ul></ul><ul><ul><ul><li>Nielsen: 3% of total album sales in US </li></ul></ul></ul><ul><ul><ul><li>Last.fm: 107k taggers </li></ul></ul></ul><ul><ul><li>Country music </li></ul></ul><ul><ul><ul><li>Nielsen: 11% of total album sales in US </li></ul></ul></ul><ul><ul><ul><li>Last.fm: 23k taggers </li></ul></ul></ul>Issues with social tags Tagger bias in numbers [Nielsen Report 2007]
    80. 93. Issues with Social Tags <ul><li>Not enough tags </li></ul><ul><ul><li>Cold start </li></ul></ul><ul><ul><li>Obscure content (long tail) </li></ul></ul><ul><ul><li>Weak labeling </li></ul></ul><ul><ul><li>Synonyms and ambiguous tags </li></ul></ul><ul><ul><li>Noise </li></ul></ul><ul><li>Abuse </li></ul><ul><li>Tagger bias </li></ul><ul><ul><li>Some styles of music are covered better than others </li></ul></ul><ul><ul><li>Not everyone is contributing equally </li></ul></ul>
    81. 94. Outline <ul><li>What are social tags? </li></ul><ul><li>Why do people tag? </li></ul><ul><li>Issues with social tags </li></ul><ul><li>Other sources of tags </li></ul><ul><li>Search, Discovery & Recommendation </li></ul><ul><li>Data & Tools </li></ul><ul><li>Future Research </li></ul><ul><li>Conclusion </li></ul><ul><li>Discussion </li></ul>
    82. 95. Other sources of tags Games (with a purpose) <ul><li>Idea: </li></ul><ul><ul><li>Humans are best at solving some types of problems </li></ul></ul><ul><ul><li>Humans like to play games </li></ul></ul><ul><ul><li>Build a game that is </li></ul></ul><ul><ul><ul><li>fun to play </li></ul></ul></ul><ul><ul><ul><li>Solves a hard problem </li></ul></ul></ul><ul><li>ESP Game – Image Labeling Game </li></ul><ul><ul><li>Users try to guess what labels partner will apply to an image </li></ul></ul><ul><ul><li>Collected 1.2 million image labels in 4 months </li></ul></ul><ul><ul><li>With 5K active gamers could label all 425 million in 1 month </li></ul></ul>L. von Ahn and L. Dabbish. Labeling images with a computer game . SIGCHI 2004.
    83. 96. Other sources of tags Games – Tag a Tune http://www.gwap.com/gwap/gamesPreview/tagatune/
    84. 97. <ul><li>Statistics for 3 months of game play </li></ul><ul><ul><li>Total tags: ~260,000 </li></ul></ul><ul><ul><li>Total songs: ~20,000 </li></ul></ul><ul><ul><li>High confidence tags: ~50,000 </li></ul></ul><ul><ul><li>Games played: ~23,000 </li></ul></ul><ul><ul><li>Unique players: ~6,900 </li></ul></ul><ul><ul><li>Tags per player per minute: ~4 </li></ul></ul>Other sources of tags Games – Tag a Tune
    85. 98. Other sources of tags Games – Major Miner http://majorminer.com/
    86. 99. <ul><li>Unique asynchronous scoring </li></ul><ul><li>Statistics </li></ul><ul><ul><li>530 Users </li></ul></ul><ul><ul><li>2,345 clips tagged </li></ul></ul><ul><ul><li>73,000 user, clip, tag triples </li></ul></ul><ul><ul><li>12,000 verified tags </li></ul></ul><ul><ul><li>900 unique, verified tags </li></ul></ul><ul><ul><li>12,000 </li></ul></ul><ul><ul><li>3-4 tags per minute per user </li></ul></ul><ul><ul><li>5-10 minutes of playtime per user </li></ul></ul><ul><li>Data used for the MIREX tagging task </li></ul>http://www.music-ir.org/mirex/2008/index.php/Audio_Tag_Classification Other sources of tags Games – Major Miner
    87. 100. http://majorminer.com/search/ Other sources of tags Games – Major Miner
    88. 101. Other sources of tags Games – The Listen Game http://www.listengame.org/
    89. 102. <ul><li>Statistics from 2 week pilot study </li></ul><ul><ul><li>Listen250 dataset </li></ul></ul><ul><ul><ul><li>26,000 annotations </li></ul></ul></ul><ul><ul><ul><li>1,558 High confidence positive associations </li></ul></ul></ul><ul><ul><ul><li>1,630 High confidence negative associations </li></ul></ul></ul><ul><ul><ul><li>250 songs </li></ul></ul></ul><ul><ul><ul><li>120 words </li></ul></ul></ul><ul><ul><ul><li>440 unique players </li></ul></ul></ul><ul><ul><ul><li>775 new words suggested (via freestyle round) </li></ul></ul></ul><ul><ul><ul><li>~ 5 Tags per user per minute </li></ul></ul></ul><ul><ul><li>Dataset available upon request from Doug Turnbull </li></ul></ul>Other sources of tags Games – The Listen Game
    90. 103. Other sources of tags Games – MoodSwings Y. E. Kim, E. Schmidt, and L. Emelle. MoodSwings: A collaborative game for music mood label collection. ISMIR 2008. <ul><li>Collects valence-arousal labels </li></ul><ul><li>1 week pilot </li></ul><ul><ul><li>100 Users </li></ul></ul><ul><ul><li>1K Songs </li></ul></ul><ul><ul><li>50K labels </li></ul></ul>
    91. 104. Other sources of tags Games – Herd It &quot;Herd It connects players in real-time and they listen to the same music clip.  While they listen, various fun minigames quiz the players on opinions and trivia about the music.  Players earn points based on the agreement of their answers with the group consensus.&quot; - Luke Barrington
    92. 105. Other sources of tags Games – Moose6 – A BBC Prototype
    93. 106. <ul><li>Pros: </li></ul><ul><ul><li>Can tag at the phrase/clip level </li></ul></ul><ul><ul><li>Potentially can tag into the long tail </li></ul></ul><ul><ul><li>Potentially very high tagging rates </li></ul></ul><ul><li>Issues: </li></ul><ul><ul><li>Challenge to make addictive/fun game </li></ul></ul><ul><ul><li>Tags may be more superficial than social tags </li></ul></ul><ul><ul><ul><li>Tags may be applied by non-fans </li></ul></ul></ul><ul><ul><ul><li>Lowest common denominator labels </li></ul></ul></ul><ul><ul><li>Potential for 'gaming' the system </li></ul></ul><ul><ul><li>Don't collect many types of useful labels: </li></ul></ul><ul><ul><ul><li>context ( jogging ), opinion ( favorite ), task organization ( check out ), social signaling ( seen live ) </li></ul></ul></ul>Other sources of tags Games (with a purpose)
    94. 107. Other sources of tags Experts/Surveys <ul><li>Hire experts to hand label content </li></ul><ul><li>Advantages </li></ul><ul><ul><li>Consistent labels </li></ul></ul><ul><ul><li>Strong labeling </li></ul></ul><ul><ul><li>Fixed, structured vocabulary </li></ul></ul><ul><li>Disadvantages </li></ul><ul><ul><li>Small pre-determined vocabulary </li></ul></ul><ul><ul><li>Very difficult to construct taxonomy </li></ul></ul><ul><ul><li>Human-labor intensive (expensive) </li></ul></ul><ul><ul><li>Doesn't scale to the long tail </li></ul></ul><ul><ul><li>Limited access to data </li></ul></ul>
    95. 108. Other sources of tags Experts/Surveys – All Music Guide
    96. 109. <ul><li>Pop Tracks: ~13 million </li></ul><ul><li>Pop Albums: ~1.4 million </li></ul><ul><li>Classical Compositions: ~300 thousand </li></ul><ul><li>Biographies: ~84 thousand </li></ul><ul><li>Styles: 917 </li></ul><ul><li>Themes: 86 </li></ul><ul><li>Moods: 184 </li></ul>Other sources of tags Experts/Surveys – All Music Guide
    97. 110. Other sources of tags Experts/Surveys – All Music Guide
    98. 111. <ul><li>Music labeled by paid professional musicians </li></ul><ul><li>Fixed vocabulary: ~500 weighted attributes </li></ul><ul><li>Structured vocabulary </li></ul>Other sources of tags Experts/Surveys – Pandora
    99. 112. <ul><li>66 undergrads – paid $10 per hour to label music </li></ul><ul><li>1,700 annotations </li></ul><ul><li>500 'western popular' songs </li></ul><ul><li>135 musically-relevant concepts </li></ul><ul><li>Six semantic categories: </li></ul><ul><ul><li>emotion – aggressive, weird, thrilling, mellow </li></ul></ul><ul><ul><li>genre - alternative, bebop, swing, rock, world </li></ul></ul><ul><ul><li>Instrument – guitar, organ, piano, harmonica </li></ul></ul><ul><ul><li>usage – at a party, at work, driving, exercising, sleeping </li></ul></ul><ul><ul><li>vocals – breathy, rapping, monotone, emotional </li></ul></ul><ul><ul><li>song – catchy, fast, danceable, texture acoustic </li></ul></ul>http://cosmal.ucsd.edu/cal Other sources of tags Experts/Surveys – CAL-500
    100. 113. Other sources of tags Web mining <ul><li>Internet: the largest digital archive of music </li></ul><ul><ul><li>Music blogs, reviews, forum discussions, official artist pages, MySpace, ... </li></ul></ul><ul><ul><li>Examples: (Google estimated number of results) </li></ul></ul><ul><ul><ul><li>Eminem 46M pages </li></ul></ul></ul><ul><ul><ul><li>“The Beatles” 29M pages </li></ul></ul></ul><ul><ul><ul><li>“Wolfgang Amadeus Mozart” 7M pages </li></ul></ul></ul><ul><ul><li>Unstructured data </li></ul></ul><ul><ul><li>Text information retrieval </li></ul></ul>
    101. 114. <ul><li>Whitman & Lawrence (ICMC 2002) </li></ul><ul><ul><li>Google: “<artist name>” +music +review </li></ul></ul><ul><ul><li>Retrieve text of top ranked pages </li></ul></ul><ul><ul><li>Text information retrieval techniques </li></ul></ul><ul><li>Issues </li></ul><ul><ul><li>Artist names are not unique identifiers </li></ul></ul><ul><ul><ul><li>“The War”, “The The”, “Chicago”, “Pink” (not “P!nk”) </li></ul></ul></ul><ul><ul><ul><li>Solution: add information to query (e.g. album names) </li></ul></ul></ul><ul><ul><li>Cold-start (needs at least one web-page) </li></ul></ul><ul><ul><li>Quality of “tags” </li></ul></ul><ul><ul><ul><li>Include other artist names, seemingly random noise </li></ul></ul></ul><ul><ul><ul><li>Solution: use dictionary </li></ul></ul></ul>Other sources of tags Web mining – Using Google et al.
    102. 115. <ul><li>ABBA </li></ul><ul><ul><li>100 pop </li></ul></ul><ul><ul><li>56 song </li></ul></ul><ul><ul><li>50 musical </li></ul></ul><ul><ul><li>46 swedish </li></ul></ul><ul><ul><li>43 uk </li></ul></ul><ul><ul><li>41 group </li></ul></ul><ul><ul><li>36 band </li></ul></ul><ul><ul><li>35 dance </li></ul></ul><ul><ul><li>31 world </li></ul></ul><ul><ul><li>29 disco </li></ul></ul>Pampalk et al. (ECDL 2005) http://www.ofai.at/~elias.pampalk/wa/ Other sources of tags Web mining – Examples
    103. 116. <ul><li>Britney Spears </li></ul><ul><ul><li>100 pop </li></ul></ul><ul><ul><li>99 song </li></ul></ul><ul><ul><li>52 girl </li></ul></ul><ul><ul><li>36 concert </li></ul></ul><ul><ul><li>33 dance </li></ul></ul><ul><ul><li>24 uk </li></ul></ul><ul><ul><li>20 sexy </li></ul></ul><ul><ul><li>18 jive </li></ul></ul><ul><ul><li>18 world </li></ul></ul><ul><ul><li>15 cool </li></ul></ul>Pampalk et al. (ECDL 2005) http://www.ofai.at/~elias.pampalk/wa/ Other sources of tags Web mining – Examples
    104. 117. <ul><li>Metallica </li></ul><ul><ul><li>100 metal </li></ul></ul><ul><ul><li>43 band </li></ul></ul><ul><ul><li>38 concert </li></ul></ul><ul><ul><li>22 heavy metal </li></ul></ul><ul><ul><li>20 world </li></ul></ul><ul><ul><li>20 song </li></ul></ul><ul><ul><li>18 dance </li></ul></ul><ul><ul><li>15 hard </li></ul></ul><ul><ul><li>11 black metal </li></ul></ul><ul><ul><li>9 guitar </li></ul></ul>Pampalk et al. (ECDL 2005) http://www.ofai.at/~elias.pampalk/wa/ Other sources of tags Web mining – Examples
    105. 118. <ul><li>Ludwig van Beethoven </li></ul><ul><ul><li>100 piano </li></ul></ul><ul><ul><li>67 symphony </li></ul></ul><ul><ul><li>53 classical </li></ul></ul><ul><ul><li>22 orchestra </li></ul></ul><ul><ul><li>20 movement </li></ul></ul><ul><ul><li>18 trio </li></ul></ul><ul><ul><li>18 solo </li></ul></ul><ul><ul><li>15 variations </li></ul></ul><ul><ul><li>15 musical </li></ul></ul><ul><ul><li>12 violin </li></ul></ul>Pampalk et al. (ECDL 2005) http://www.ofai.at/~elias.pampalk/wa/ Other sources of tags Web mining – Examples
    106. 119. <ul><ul><li>[Knees et al., ACM MM 2006] </li></ul></ul>Other sources of tags Using Web Mined Tags: nepTune
    107. 120. <ul><ul><li>[Pampalk & Goto, ISMIR 2006] </li></ul></ul>Other sources of tags Using Web Mined Tags: MusicRainbow
    108. 121. <ul><ul><li>[Pampalk & Goto, ISMIR 2007] </li></ul></ul>Other sources of tags Using Web Mined Tags: MusicSun
    1. A particular slide catching your eye?

      Clipping is a handy way to collect important slides you want to go back to later.

    ×