"I see eyes in my soup": How Delivery Hero implemented the safety system for ...
Linking inside a video collection
1. Linking inside a video collection
- what and how to measure
First User Trials @ BBC
5/13/13 LIME workshop - WWW2013
Robin Aly University of Twente, The Netherlands
Maria Eskevich Dublin City University, Ireland
Gareth Jones Dublin City University, Ireland
Roeland Ordelman Netherlands Institute for Sound and Vision
University of Twente, The Netherlands
Shu Chen Dublin City University, Ireland
3. CAN VIDEO HYPERLINKING PLAY A ROLE
IN AUDIOVISUAL ARCHIVE ACCESS?
Huge amounts of audiovisual content
Daily ingest of professional productions
Large investments in digitization of older materials
5/13/13 LIME workshop - WWW2013
4. Instead of …
Search for: “Things to do in London”
Relevant clip Alternative clips
5. We could do better …
LINK
ANCHORS or
SEGMENTS
LINK TARGETS
6.
7. Video linking scenario
• Archival viewing scenario (+1 week after broadcast)
• Detail-on-demand perspective
• Video-to-video linking
• Start-off with archive search
• Assuming an information need
• Potentially search may go into more serendipitous or
exploratory types of behavior
• Create meaningful cross-sections through archive
• Audiovisual archive interlinked on the fragment level
• “Storytelling” type of approaches
5/13/13 LIME workshop - WWW2013
8. VIDEO LINKING: USER PERSPECTIVE
Linked video is not yet analyzed on a fundamental level with users in real-
life scenarios
5/13/13 LIME workshop - WWW2013
9. Main research questions
• Do users understand the concept of video linking?
• Do users think video linking is useful?
• What elements in a video a user would see as a
potential video hyperlink
– What are potential link anchors?
– Can we classify these anchors?
• What users would expect as the endpoint (target) of
such a hyperlink
• Understanding this is important to be able to build
technology for automatic link generation in video
(feature selection, avoid “link explosion”)
11. Researchers &
Educators
AXES Research
system
Journalists Research
Academic
researchers &
students
Investigate
Academic
educators
Educate
Home users
AXES Home system
Home users Entertainment,
Edutainment
Main group User Target
Media
Professionals
AXES Pro system
Broadcast
Professionals
Reuse
Media Archivists Annotate
User group definitions
12. Experimental set-up
• Three parts:
1. First user trials:
– Explain concept of video hyperlinking
– Let users define anchors in archival data
2. Find link targets in the collection
3. Second user trials:
– Users assess link targets
5/13/13 LIME workshop - WWW2013
13. HOW TO GET THE LINK TARGETS?
5/13/13 LIME workshop - WWW2013
14. Automatic link generation
• MediaEval benchmark evaluation
– Searching & Linking task
– Data set: BBC
• Task: find relevant links on the basis of
– Anchors on their own (cond.1)
– Anchors in context of the video segment they are
defined in (cond.2)
• Systems use available archival
metadata, subtitles, speech transcripts, self-
derived features
5/13/13 LIME workshop - WWW2013
15. Data set
• Anchor selection:
– 270h of BBC archival data
• One complete week
• Material not owned by BBC (e.g., Dr. Who) excluded
• For link target selection we could add:
– One month before, one month after
– Quasi-random selection of archival data
• All data have:
– Archival metadata
– EPG data
– Subtitles
– Speech transcripts
– Shot segmentation
5/13/13 LIME workshop - WWW2013
16. Participants
• Recruitment Agency
• In anticipation on a rather complex task:
public users with computer & online
experience
• 30 Public Users
– Nationality: UK
– Age group: 16-30
– Computer familiarity: high
– Online activity: high
5/13/13 LIME workshop - WWW2013
26. Overall
• Most participants understood the task
• Not difficult
• Technology would be a very nice-to-have
mentioning the “serendipitous” type of
browsing behavior
• Data set too small for searching
• Participants take music as link anchors (which
we did not anticipate!)
5/13/13 LIME workshop - WWW2013
27. Manual assessment of user data
• Check validity of
– selected clips and descriptions
– selected anchors and description of anchor
– description of expected link target
– segmentation
• Classification of
– Selected clips according to google-categories
– Selected anchors:
• Whole scene
• Speech
• Object, moving
• Object, static
• Other (=Music)
5/13/13 LIME workshop - WWW2013
32. 5/13/13 LIME workshop - WWW2013
BBC ARCHIVE
potentially interesting video
interesting clip
interesting segment for linking
related video clip
video hyperlink
SEARCH
LINK
33. 5/13/13 LIME workshop - WWW2013
BBC ARCHIVE
potentially interesting video
interesting clip
interesting segment for linking
related video clip
video hyperlink
SEARCH
LINK
Relevance
Assessment
35. Wrap up
• Description of experimental set-up to have better
understanding of user behavior in video hyperlinking in
archival, video2video scenario
• In spite of complexity, participants understood the task
• First results indicate that
– Public users are focused on edutainment and
entertainment
– Prefer linking based on whole scenes
– Are interested as well in music links
• Coming months: automatic link generation in
MediaEval followed by link target assessment with
same users at BBC
5/13/13 LIME workshop - WWW2013
36. The authors:
Robin Aly University of Twente, The Netherlands
Roeland Ordelman Netherlands Institute for Sound and Vision
University of Twente, The Netherlands
Maria Eskevich Dublin City University, Ireland
Gareth Jones Dublin City University, Ireland
Shu Chen Dublin City University, Ireland
Editor's Notes
.
Typical results
Although linking seems a sensible approach intuitively, using linkedvideo to satisfy information needs of users is not yet analysedon a fundamental level with users in real-life scenarios
home usersmay prefer to explore collections by following links insteadof entering queries. This is for example in contrast withbroadcast professionals that use audiovisual search systemstypically to search for reusable material and not interestedin links.
Anchor length rather long, only few anchors per clip
