Music Video Redundancy and Half-Life in YouTube

708 views
649 views

Published on

Music Video Redundancy and Half-Life in YouTube
Matthias Prellwitz and Michael L. Nelson
Old Dominion University
TPDL 2011
Berlin, Germany
9/26/11

0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
708
On SlideShare
0
From Embeds
0
Number of Embeds
0
Actions
Shares
0
Downloads
1
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

Music Video Redundancy and Half-Life in YouTube

  1. 1. Music Video Redundancy and Half-Life in YouTubeMatthias Prellwitz and Michael L. Nelson matthias.prellwitz@googlemail.com mln@cs.odu.edu TPDL 2011 Berlin, Germany 9/26/11
  2. 2. Linking to a particular copy“Rolling Stones - Satisfaction”TPDL 2011 Music Video Redundancy and Half-Life in YouTube9/26/11 Matthias Prellwitz and Michael L. Nelson 2
  3. 3. Metadata lostwhen YouTube video disappears video title The Rolling Stones – Satisfaction url http://www.youtube.com/watch?v=214szPQBUYcTPDL 2011 Music Video Redundancy and Half-Life in YouTube9/26/11 Matthias Prellwitz and Michael L. Nelson 3
  4. 4. Metadata hard to recover fromSearch EnginesTPDL 2011 Music Video Redundancy and Half-Life in YouTube9/26/11 Matthias Prellwitz and Michael L. Nelson 4
  5. 5. But nearly 300 copies remain in YouTubeTPDL 2011 Music Video Redundancy and Half-Life in YouTube9/26/11 Matthias Prellwitz and Michael L. Nelson 5
  6. 6. Linking music-related URIs‣ Transparent URI semantics ‣ http://www.last.fm/music/John+Lennon/_/Imagine ‣ http://www.ilike.com/artist/The+Cribs/track/I%27m+A+Realist ‣ http://www.last.fm/music/Johnny+Cash/_/Highwayman‣ Opaque URI semantics ‣ http://vids.myspace.com/index.cfm?fuseaction=vids.individual&videoid=5168491 ‣ http://www.youtube.com/watch?v=VST2KKIYn50TPDL 2011 Music Video Redundancy and Half-Life in YouTube9/26/11 Matthias Prellwitz and Michael L. Nelson 6
  7. 7. Popular MusicUS T 40 Singles Charts of 9/25/10 opTPDL 2011 Music Video Redundancy and Half-Life in YouTube9/26/11 Matthias Prellwitz and Michael L. Nelson 7
  8. 8. Popular MusicSelected Music BlogsTPDL 2011 Music Video Redundancy and Half-Life in YouTube9/26/11 Matthias Prellwitz and Michael L. Nelson 8
  9. 9. Popular MusicThe 500 Greatest Songs of all TimeTPDL 2011 Music Video Redundancy and Half-Life in YouTube9/26/11 Matthias Prellwitz and Michael L. Nelson 9
  10. 10. Total Result Size RangeUS T 40 Singles Charts of 9/25/10 op 123,239 Lady Gaga 83,298 Alejandro 43,945 66 Selena Gomez & The 35 Scene 26 A Year Without RainTPDL 2011 Music Video Redundancy and Half-Life in YouTube9/26/11 Matthias Prellwitz and Michael L. Nelson 10
  11. 11. Total Result Size RangeSelected Music Blogs 264,753 Lady Gaga 256,205 Bad Romance 232,936 Mariah Carey featuring 0 Juelz Santana & Bone 0 Thugs-n-Harmony 0 Dont Forget About UsTPDL 2011 Music Video Redundancy and Half-Life in YouTube9/26/11 Matthias Prellwitz and Michael L. Nelson 11
  12. 12. Total Result Size RangeThe 500 Greatest Songs of all Time 174,088 Michael Jackson 162,937 Billie Jean 145,076 0 The Isley Brothers 0 That Lady (Part 1 and 2) 0TPDL 2011 Music Video Redundancy and Half-Life in YouTube9/26/11 Matthias Prellwitz and Michael L. Nelson 12
  13. 13. URI UnavailabilityRooted from a selected collectionTPDL 2011 Music Video Redundancy and Half-Life in YouTube9/26/11 Matthias Prellwitz and Michael L. Nelson 13
  14. 14. URI UnavailabilityExpected Half-lifeTPDL 2011 Music Video Redundancy and Half-Life in YouTube9/26/11 Matthias Prellwitz and Michael L. Nelson 14
  15. 15. URI Publication and Removal RateTPDL 2011 Music Video Redundancy and Half-Life in YouTube9/26/11 Matthias Prellwitz and Michael L. Nelson 15
  16. 16. Lifetimes of unavailable videos Years MonthTPDL 2011 Music Video Redundancy and Half-Life in YouTube9/26/11 Matthias Prellwitz and Michael L. Nelson 16
  17. 17. Reasons for no unavailable videosTPDL 2011 Music Video Redundancy and Half-Life in YouTube9/26/11 Matthias Prellwitz and Michael L. Nelson 17
  18. 18. When a YouTube video disappears‣ video title The Rolling Stones - Satisfaction‣ url http://www.youtube.com/watch?v=214szPQBUYc‣ Published 2009-06-13 13:44 Removed 2010-04-09 (300 days online) HTTP/1.1 404 Not FoundContent-Type: text/html; charset=utf-8TPDL 2011 Music Video Redundancy and Half-Life in YouTube9/26/11 Matthias Prellwitz and Michael L. Nelson 18
  19. 19. Metadata purged from YouTube Databases‣ Video feed curl -I "http://gdata.youtube.com/feeds/api/videos/214szPQBUYc" HTTP/1.1 404 Not Found Content-Type: text/html; charset=UTF-8 Private video‣ Related videos curl -I "http://gdata.youtube.com/feeds/api/videos/214szPQBUYc/related" HTTP/1.1 404 Not Found Content-Type: text/html; charset=UTF-8 Parent Video not found‣ Video comments curl -I "http://gdata.youtube.com/feeds/api/videos/214szPQBUYc/comments" HTTP/1.1 200 OK Content-Type: application/atom+xml; charset=UTF-8TPDL 2011 Music Video Redundancy and Half-Life in YouTube9/26/11 Matthias Prellwitz and Michael L. Nelson 19
  20. 20. Metadata Normalization Dereferencing ASIN via amazon.com Webservice: Artist: Michael Jackson Title: Billie Jean (Single Version)TPDL 2011 Music Video Redundancy and Half-Life in YouTube9/26/11 Matthias Prellwitz and Michael L. Nelson 20
  21. 21. Availability of music-related metadata‣ parsed out only at the first time a URI showed up in the result list for the first time ‣ YouTube crawling restrictions‣ Remaining portion ‣ query video title against music related services via search engines ‣ Google/Yahoo! with site parameter www.last.fm/musicTPDL 2011 Music Video Redundancy and Half-Life in YouTube9/26/11 Matthias Prellwitz and Michael L. Nelson 21
  22. 22. Retrieving and preservinga video’s metadata‣ Active preservation attempt once a video copy is available ‣ Parse HTML out for structured music-related metadata ‣ YouTube generated meta data ‣ AmazonMP3 affiliate link ‣ search engines with free-form video title against music-related websites‣ Preserving metadata into the public web infrastructureTPDL 2011 Music Video Redundancy and Half-Life in YouTube9/26/11 Matthias Prellwitz and Michael L. Nelson 22
  23. 23. Preservation PrototypeTPDL 2011 Music Video Redundancy and Half-Life in YouTube9/26/11 Matthias Prellwitz and Michael L. Nelson 23
  24. 24. Metadata preservationExample: twitterTPDL 2011 Music Video Redundancy and Half-Life in YouTube9/26/11 Matthias Prellwitz and Michael L. Nelson 24
  25. 25. Pointing to a Resolver service‣ http://ytresolve.cs.odu.edu/r/http://www.youtube.com/watch? v=214szPQBUYc/‣ Author-side approach ‣ content creator points directly to a resolver service‣ Server-side approach ‣ Plugin/Renderer class automatically rewrites YouTube video watch URIs to resolver service‣ Client-side approach ‣ Web-Browser plugin intercepts click on Youtube video watch URIs and redirects to resolver serviceTPDL 2011 Music Video Redundancy and Half-Life in YouTube9/26/11 Matthias Prellwitz and Michael L. Nelson 25
  26. 26. YouTube Resolver service http://www.youtube.com/watch?v=214szPQBUYc http://www.youtube.com/v/214szPQBUYc h http://www.youtu.be/214szPQBUYc http://www.youtube.com/user/WEASELxLOVER#p/a/u/2/214szPQBUYc HTTP/1.1 200 OK HTTP/1.1 404 Not Found HTTP/1.1 303 See Others * HTTP redirect Status Codesearch for preserved metadata‣ in list of designated accountsexact best available granularity query YouTube API with those *) http://www.youtube.com/verify_controversy... Provided (and evaluate) http://www.youtube.com/verify_age... https://www.google.com/accounts/ServiceLogin... alternative copies http://www.youtube.com/das_captcha..TPDL 2011 Music Video Redundancy and Half-Life in YouTube9/26/11 Matthias Prellwitz and Michael L. Nelson 26
  27. 27. Future Work‣ Evaluation of preservation and retrieval quality of chosen services ‣ exchange services‣ additional automation of preservation process ‣ once YT URI was passed for resolving‣ Evaluation of retrieved available copies ‣ redirect to best copy instead of returning a list to choose‣ Consider international requesters ‣ taking requester’s location (country) into accountTPDL 2011 Music Video Redundancy and Half-Life in YouTube9/26/11 Matthias Prellwitz and Michael L. Nelson 27
  28. 28. Summary ‣ Pointing to a specific YouTube video copy by its URI has a risk of disappearance ‣ alternative copies over time available ‣ YouTube URIs unlikely to be cached once gone ‣ YouTube metadata only reliable for available URIs ‣ active preservation attempt ‣ Introducing a level of indirection: Resolver service ‣ check URI status and location header ‣ search the public web for injected metadata ‣ query for alternative copiesTPDL 2011 Music Video Redundancy and Half-Life in YouTube9/26/11 Matthias Prellwitz and Michael L. Nelson 28

×