Music Video Redundancy and Half-Life in YouTube

  • 424 views
Uploaded on

Music Video Redundancy and Half-Life in YouTube …

Music Video Redundancy and Half-Life in YouTube
Matthias Prellwitz and Michael L. Nelson
Old Dominion University
TPDL 2011
Berlin, Germany
9/26/11

  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Be the first to comment
    Be the first to like this
No Downloads

Views

Total Views
424
On Slideshare
0
From Embeds
0
Number of Embeds
0

Actions

Shares
Downloads
1
Comments
0
Likes
0

Embeds 0

No embeds

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
    No notes for slide

Transcript

  • 1. Music Video Redundancy and Half-Life in YouTubeMatthias Prellwitz and Michael L. Nelson matthias.prellwitz@googlemail.com mln@cs.odu.edu TPDL 2011 Berlin, Germany 9/26/11
  • 2. Linking to a particular copy“Rolling Stones - Satisfaction”TPDL 2011 Music Video Redundancy and Half-Life in YouTube9/26/11 Matthias Prellwitz and Michael L. Nelson 2
  • 3. Metadata lostwhen YouTube video disappears video title The Rolling Stones – Satisfaction url http://www.youtube.com/watch?v=214szPQBUYcTPDL 2011 Music Video Redundancy and Half-Life in YouTube9/26/11 Matthias Prellwitz and Michael L. Nelson 3
  • 4. Metadata hard to recover fromSearch EnginesTPDL 2011 Music Video Redundancy and Half-Life in YouTube9/26/11 Matthias Prellwitz and Michael L. Nelson 4
  • 5. But nearly 300 copies remain in YouTubeTPDL 2011 Music Video Redundancy and Half-Life in YouTube9/26/11 Matthias Prellwitz and Michael L. Nelson 5
  • 6. Linking music-related URIs‣ Transparent URI semantics ‣ http://www.last.fm/music/John+Lennon/_/Imagine ‣ http://www.ilike.com/artist/The+Cribs/track/I%27m+A+Realist ‣ http://www.last.fm/music/Johnny+Cash/_/Highwayman‣ Opaque URI semantics ‣ http://vids.myspace.com/index.cfm?fuseaction=vids.individual&videoid=5168491 ‣ http://www.youtube.com/watch?v=VST2KKIYn50TPDL 2011 Music Video Redundancy and Half-Life in YouTube9/26/11 Matthias Prellwitz and Michael L. Nelson 6
  • 7. Popular MusicUS T 40 Singles Charts of 9/25/10 opTPDL 2011 Music Video Redundancy and Half-Life in YouTube9/26/11 Matthias Prellwitz and Michael L. Nelson 7
  • 8. Popular MusicSelected Music BlogsTPDL 2011 Music Video Redundancy and Half-Life in YouTube9/26/11 Matthias Prellwitz and Michael L. Nelson 8
  • 9. Popular MusicThe 500 Greatest Songs of all TimeTPDL 2011 Music Video Redundancy and Half-Life in YouTube9/26/11 Matthias Prellwitz and Michael L. Nelson 9
  • 10. Total Result Size RangeUS T 40 Singles Charts of 9/25/10 op 123,239 Lady Gaga 83,298 Alejandro 43,945 66 Selena Gomez & The 35 Scene 26 A Year Without RainTPDL 2011 Music Video Redundancy and Half-Life in YouTube9/26/11 Matthias Prellwitz and Michael L. Nelson 10
  • 11. Total Result Size RangeSelected Music Blogs 264,753 Lady Gaga 256,205 Bad Romance 232,936 Mariah Carey featuring 0 Juelz Santana & Bone 0 Thugs-n-Harmony 0 Dont Forget About UsTPDL 2011 Music Video Redundancy and Half-Life in YouTube9/26/11 Matthias Prellwitz and Michael L. Nelson 11
  • 12. Total Result Size RangeThe 500 Greatest Songs of all Time 174,088 Michael Jackson 162,937 Billie Jean 145,076 0 The Isley Brothers 0 That Lady (Part 1 and 2) 0TPDL 2011 Music Video Redundancy and Half-Life in YouTube9/26/11 Matthias Prellwitz and Michael L. Nelson 12
  • 13. URI UnavailabilityRooted from a selected collectionTPDL 2011 Music Video Redundancy and Half-Life in YouTube9/26/11 Matthias Prellwitz and Michael L. Nelson 13
  • 14. URI UnavailabilityExpected Half-lifeTPDL 2011 Music Video Redundancy and Half-Life in YouTube9/26/11 Matthias Prellwitz and Michael L. Nelson 14
  • 15. URI Publication and Removal RateTPDL 2011 Music Video Redundancy and Half-Life in YouTube9/26/11 Matthias Prellwitz and Michael L. Nelson 15
  • 16. Lifetimes of unavailable videos Years MonthTPDL 2011 Music Video Redundancy and Half-Life in YouTube9/26/11 Matthias Prellwitz and Michael L. Nelson 16
  • 17. Reasons for no unavailable videosTPDL 2011 Music Video Redundancy and Half-Life in YouTube9/26/11 Matthias Prellwitz and Michael L. Nelson 17
  • 18. When a YouTube video disappears‣ video title The Rolling Stones - Satisfaction‣ url http://www.youtube.com/watch?v=214szPQBUYc‣ Published 2009-06-13 13:44 Removed 2010-04-09 (300 days online) HTTP/1.1 404 Not FoundContent-Type: text/html; charset=utf-8TPDL 2011 Music Video Redundancy and Half-Life in YouTube9/26/11 Matthias Prellwitz and Michael L. Nelson 18
  • 19. Metadata purged from YouTube Databases‣ Video feed curl -I "http://gdata.youtube.com/feeds/api/videos/214szPQBUYc" HTTP/1.1 404 Not Found Content-Type: text/html; charset=UTF-8 Private video‣ Related videos curl -I "http://gdata.youtube.com/feeds/api/videos/214szPQBUYc/related" HTTP/1.1 404 Not Found Content-Type: text/html; charset=UTF-8 Parent Video not found‣ Video comments curl -I "http://gdata.youtube.com/feeds/api/videos/214szPQBUYc/comments" HTTP/1.1 200 OK Content-Type: application/atom+xml; charset=UTF-8TPDL 2011 Music Video Redundancy and Half-Life in YouTube9/26/11 Matthias Prellwitz and Michael L. Nelson 19
  • 20. Metadata Normalization Dereferencing ASIN via amazon.com Webservice: Artist: Michael Jackson Title: Billie Jean (Single Version)TPDL 2011 Music Video Redundancy and Half-Life in YouTube9/26/11 Matthias Prellwitz and Michael L. Nelson 20
  • 21. Availability of music-related metadata‣ parsed out only at the first time a URI showed up in the result list for the first time ‣ YouTube crawling restrictions‣ Remaining portion ‣ query video title against music related services via search engines ‣ Google/Yahoo! with site parameter www.last.fm/musicTPDL 2011 Music Video Redundancy and Half-Life in YouTube9/26/11 Matthias Prellwitz and Michael L. Nelson 21
  • 22. Retrieving and preservinga video’s metadata‣ Active preservation attempt once a video copy is available ‣ Parse HTML out for structured music-related metadata ‣ YouTube generated meta data ‣ AmazonMP3 affiliate link ‣ search engines with free-form video title against music-related websites‣ Preserving metadata into the public web infrastructureTPDL 2011 Music Video Redundancy and Half-Life in YouTube9/26/11 Matthias Prellwitz and Michael L. Nelson 22
  • 23. Preservation PrototypeTPDL 2011 Music Video Redundancy and Half-Life in YouTube9/26/11 Matthias Prellwitz and Michael L. Nelson 23
  • 24. Metadata preservationExample: twitterTPDL 2011 Music Video Redundancy and Half-Life in YouTube9/26/11 Matthias Prellwitz and Michael L. Nelson 24
  • 25. Pointing to a Resolver service‣ http://ytresolve.cs.odu.edu/r/http://www.youtube.com/watch? v=214szPQBUYc/‣ Author-side approach ‣ content creator points directly to a resolver service‣ Server-side approach ‣ Plugin/Renderer class automatically rewrites YouTube video watch URIs to resolver service‣ Client-side approach ‣ Web-Browser plugin intercepts click on Youtube video watch URIs and redirects to resolver serviceTPDL 2011 Music Video Redundancy and Half-Life in YouTube9/26/11 Matthias Prellwitz and Michael L. Nelson 25
  • 26. YouTube Resolver service http://www.youtube.com/watch?v=214szPQBUYc http://www.youtube.com/v/214szPQBUYc h http://www.youtu.be/214szPQBUYc http://www.youtube.com/user/WEASELxLOVER#p/a/u/2/214szPQBUYc HTTP/1.1 200 OK HTTP/1.1 404 Not Found HTTP/1.1 303 See Others * HTTP redirect Status Codesearch for preserved metadata‣ in list of designated accountsexact best available granularity query YouTube API with those *) http://www.youtube.com/verify_controversy... Provided (and evaluate) http://www.youtube.com/verify_age... https://www.google.com/accounts/ServiceLogin... alternative copies http://www.youtube.com/das_captcha..TPDL 2011 Music Video Redundancy and Half-Life in YouTube9/26/11 Matthias Prellwitz and Michael L. Nelson 26
  • 27. Future Work‣ Evaluation of preservation and retrieval quality of chosen services ‣ exchange services‣ additional automation of preservation process ‣ once YT URI was passed for resolving‣ Evaluation of retrieved available copies ‣ redirect to best copy instead of returning a list to choose‣ Consider international requesters ‣ taking requester’s location (country) into accountTPDL 2011 Music Video Redundancy and Half-Life in YouTube9/26/11 Matthias Prellwitz and Michael L. Nelson 27
  • 28. Summary ‣ Pointing to a specific YouTube video copy by its URI has a risk of disappearance ‣ alternative copies over time available ‣ YouTube URIs unlikely to be cached once gone ‣ YouTube metadata only reliable for available URIs ‣ active preservation attempt ‣ Introducing a level of indirection: Resolver service ‣ check URI status and location header ‣ search the public web for injected metadata ‣ query for alternative copiesTPDL 2011 Music Video Redundancy and Half-Life in YouTube9/26/11 Matthias Prellwitz and Michael L. Nelson 28