• Like
Understanding Near-Duplicate Videos: A User-Centric Approach
Upcoming SlideShare
Loading in...5
×

Thanks for flagging this SlideShare!

Oops! An error has occurred.

Understanding Near-Duplicate Videos: A User-Centric Approach

  • 1,434 views
Published

Popular content in video sharing web sites (e.g., YouTube) is usually duplicated. Most scholars define near-duplicate video clips (NDVC) based on non-semantic features (e.g., different image/audio …

Popular content in video sharing web sites (e.g., YouTube) is usually duplicated. Most scholars define near-duplicate video clips (NDVC) based on non-semantic features (e.g., different image/audio quality), while a few also include semantic features (different videos of similar content). However, it is unclear what features contribute to the human perception of similar videos. Findings of two large scale online surveys (N = 1003) confirm the relevance of both types of features. While some of our findings confirm the adopted definitions of NDVC, other findings are surprising. For example, videos that vary in visual content –by overlaying or inserting additional information– may not be perceived as near-duplicate versions of the original videos. Conversely, two different videos with distinct sounds, people, and scenarios were considered to be NDVC because they shared the same semantics (none of the pairs had additional information). Furthermore, the exact role played by semantics in relation to the features that make videos alike is still an open question. In most cases, participants preferred to see only one of the NDVC in the search results of a video search query and they were more tolerant to changes in the audio than in the video tracks. Finally, we propose a user-centric NDVC definition and present implications for how duplicate content should be dealt with by video sharing websites.

Published in Technology , Business
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Be the first to comment
No Downloads

Views

Total Views
1,434
On SlideShare
0
From Embeds
0
Number of Embeds
0

Actions

Shares
Downloads
38
Comments
0
Likes
2

Embeds 0

No embeds

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
    No notes for slide

Transcript

  • 1. Near-Duplicate Videos
  • 2. Let’s say you’re looking for the Bush attack video…
  • 3. … and you get 11,100 results.
  • 4. … after 40 minutes... watching the videos listed on the first page you notice > 50% are similar, i.e. NDVC 27% in average [Wu et al., 2007]
  • 5. NDVC technical definition
    • Identical or approximately identical videos, that differ in some feature:
      • file formats, encoding parameters
      • photometric variations (color, lighting changes )
      • overlays ( caption, logo, audio commentary )
      • editing operations ( frames add/remove )
      • semantic similarity
    NDVC are videos that are “ essentially the same ”
  • 6. … like this
  • 7. Two challenges:
    • There is no agreement on a single definition of NDVC
    • NDVC are mostly considered as redundant content that has to be removed from the system
  • 8. Human Perception of Mauro Cherubini Rodrigo de Oliveira Nuria Oliver Near Duplicate Videos
  • 9. What kind of NDVC? Malicious (i.e., spam produced by a single user) Copyright infringement (e.g., pirated music videos) User-edited content : videos that complement the original material with additional information
  • 10. Recently NDVC detection algorithm
  • 11. Recently NDVC detection algorithm
  • 12. Why not? NDVC detection algorithm ?
  • 13. Methodology
    • 2 large-scale online surveys ( n= 1003)
    • 7 pairs of NDVC (differing in 1 feature)
    • Subjects were asked about:
      • Similarity
      • Preference
  • 14. NDVC technical definition
    • Identical or approximately identical videos, that differ in some features:
      • photometric variations (color, lighting changes )
      • overlays ( caption, logo, audio commentary )
      • editing operations ( frames add/remove )
      • And …
      • semantic similarity
      • (e.g., two deer grazing grass in two different forests)
  • 15. Audio Quality NDVC Preference Stereo, 44 Khz Mono, 11 Khz
  • 16. Image Quality NDVC Preference
  • 17. Audio content (overlay) Preference NDVC
  • 18. Visual + audio content (length) Preference Not NDVC
  • 19. Visual content (editing) Not NDVC Want both
  • 20. Similar semantics , different videos (similar visual info) NDVC Want both
  • 21. Similar semantics , different videos (similar audio info) Not NDVC Preference
  • 22. Implications for Design
    • User-centric NDVC definition
    NDVC are approximately identical videos that might differ in audio/image quality , or overlays . Conversely, identical videos with relevant complementary information (changing clip length or scenes) are not considered as NDVC. Furthermore, users perceive as near-duplicate videos that are not alike but that are visually similar and semantically related .
  • 23. Implications for Design
    • Clustering
      • Groups sharing video, audio, semantic content
      • Ranking based on user-submitted query
      • Highlight the most representative
  • 24. Implications for Design
    • Feature and user adaptation
      • Boost ranking based on general observations
        • More content
        • Better image/audio quality
      • Boost ranking based on personalization
        • Abilities (e.g., auditory skills)
        • Task (e.g., video producer vs. movie enthusiastic)
        • Search query
  • 25. Future Work
    • NDVC’s differing in more than 1 low-level feature
    • Propose ways to visualize the NDVCs
    • Study effects of user’s goals while searching videos
  • 26. A Human-Centric stance in Multimedia research Biomimetics Crowdsourcing Psychophysical experiments
  • 27. Thank you! Mauro Cherubini Rodrigo de Oliveira Nuria Oliver [email_address] [email_address] [email_address]