My talk on "The Event-based Browsing Of Linked Historical Media" @EUScreenXL 2014 Conference http://dive.beeldengeluid.nl http://blog.euscreen.eu/archives/5607

1. Lora
Aroyo
VU
University
Amsterdam
lora-­‐aroyo.org
@laroyo
In
Digital
Hermeneu3cs:
The
Event-­‐based
Browsing
Of
Linked
Historical
Media

2. Informa(on:
Museums
&
Archives
as
Inventories
of
the
World
André
Malraux,
The
Imaginary
Museum
of
World
Sculpture,
1953
http://lora-aroyo.org ! http://slideshare.net/laroyo ! @laroyo

3. Interpreta(on:
Museums
&
Archives
as
a
Place
to
Engage
with
the
World

4. Digital
Hermeneu(cs
• a
theory
of
interpreta<on
of
informa<on
• bringing
people
and
technology
together
to
explore:
– how
to
model
and
represent
informa=on
– how
to
provide
engaging
interac=on
– how
to
support
interpreta=on
“Digital
Hermeneu<cs:
Agora
and
the
online
understanding
of
cultural
heritage”
In
proceedings
of
Web
Science
Conference,
(ACM:
New
York,
2011)
http://lora-aroyo.org ! http://slideshare.net/laroyo ! @laroyo

5. “The
Gallery
of
Cornelis
van
der
Geest”
(Willem
van
Haecht)

6. explore
topics,
e.g
hun3ng,
dogs
http://lora-aroyo.org ! http://slideshare.net/laroyo ! @laroyo

7. Quen3n
Metsys
The
Madonna
and
Child
explore
ar3sts,
e.g.
their
pain3ngs,
biographies,
links

8. explore
events,
e.g
types,
par3cipants,
links
http://lora-aroyo.org ! http://slideshare.net/laroyo ! @laroyo

9. explore
perspecives,
e.g
opinions,
interpreta3ons

10. … also Digital Humanities researchers
http://lora-aroyo.org ! http://slideshare.net/laroyo ! @laroyo

11. … often don’t find
what they were searching for

12. HOW
DO
WE
BRIDGE
THE
GAP?
http://lora-aroyo.org ! http://slideshare.net/laroyo ! @laroyo

13. Simple
Event
Model
(SEM)
OpenAnnota=on
(OA)
&
SKOS
DIVE:MEDIA
OBJECT
SEM:EVEN
T
SEM:PLACE
SEM:TIME
SKOS:CONCEP
T
SEM:ACTOR
OA:ANNOTATIO
N
• Links
to
EUROPEANA
(mul=lingual)
• Links
to
DBPedia,
other
vocabularies

14. Erp,
M.
van;
Oomen,
J.;
Segers,
R.;
Akker,
C.
van
de;
Aroyo,
L.;
Jacobs,
G.;
Legêne,
S;
Meij,
L.
van
der;O
ssenbruggen,
J.R.
van;
Schreiber,
G.
Automa=c
Heritage
Metadata
Enrichment
with
Historic
Events
Museums
and
the
Web
2011
h[p://www.museumsandtheweb.com/mw2011/
papers/automa=c_heritage_metadata_enrichment_with_hi
http://lora-aroyo.org ! http://slideshare.net/laroyo ! @laroyo

15. engaging
users
through
event
narratives

16. Crowdsourcing
Events,
En33es
&
Perspec3ves
http://lora-aroyo.org ! http://slideshare.net/laroyo ! @laroyo

17. Entities & Events Extraction with CrowdTruth.org
ENTITY EXTRACTION
EVENTS CROWDSOURCING AND LINKING TO
CONCEPTS THROUGH CROWDTRUTH.ORG
LINKING EVENTS AND
CONCEPTS TO KEYFRAMES
SEGMENTATION & KEYFRAMES

18. CrowdTruth.org
A
novel
approach
to
gather
diversity
of
perspec=ves
&
opinions
from
the
crowd,
expand
expert
vocabularies
with
these
and
gather
new
type
of
gold
standard
for
machines
L.
Aroyo,
C.
Welty:
Crowd
Truth:
Harnessing
disagreement
in
crowdsourcing
a
rela=on
extrac=on
gold
standard.
ACM
WebSci
2013.
http://lora-aroyo.org ! http://slideshare.net/laroyo ! @laroyo

19. Video
Event
Extrac=on
Following the grandeur of Baroque, Rococo art is
often dismissed as frivolous and unserious, but
Waldemar Januszczak disagrees. […] The first
episode is about travel in the 18th century and how
it impacted greatly on some of the finest art ever
made. The world was getting smaller and took on
new influences shown in the glorious Bavarian
pilgrimage architecture, Canaletto's romantic
Venice and the blossoming of exotic designs and
tastes all over Europe.
Rococo:
Travel,
pleasure,
madness
h]p://dive.beeldengeluid.nl
h]p://vista-­‐tv.eu
A
boarding
school
where
boys
from
the
Dutch
East
Indies
receive
a
voca=onal
educa=on
has
been
set
up
by
the
ministry
of
Social
Affairs
near
Batavia.
Trumpeter
sounds
the
reveille;
-­‐
the
boys
get
out
of
bed;
-­‐
the
muster
is
held
in
front
of
the
building;
a`erwards
the
boys
stand
in
line
with
a
food
bowl;
they
get
rice
pudding
and
eat
this
around
long
tables
in
the
open
air;
-­‐
the
boys
get
instruc=ons
and
prac=ce
a.o.
drawing
shapes,
forging,
metalworking,
filing
and
woodworking;
News
from
Indonesia:
youth
care

20. Video
Analysis
&
Crowdsourcing
CrowdTruth.org
IBM
Faculty
Award
2013
&
2014:
CrowdTruth
1st
Prize:
EuroITV2010
Compe33on
Grand
Challenge:
Waisda?
Video
Tagging
Game
http://lora-aroyo.org ! http://slideshare.net/laroyo ! @laroyo

21. OPENIMAGES.EU
• 3000
videos
• NL
Ins=tute
for
Sound
&
Vision
• mostly
news
broadcasts
DELPHER.NL
• 1.5
Million
Scans
of
• Radio
bulle=ns
• (hand
annotated)
• 1937
–
1984

22. dive.beeldengeluid.nl
3rd
Price
at
the
Seman=c
Web
Challenge
2014

23. Digital
Submarine
UI
Infinity
of
Explora3on
Linked
(Open)
Data
Events
Linking
Objects
Crowd
Bringing
in
the
Human
Perspec3ves

24. DIVE
Team:
Victor
de
Boer,
Oana
Inel,
Lora
Aroyo,
Johan
Oomen,
Elco
Van
Staveren,
Werner
Helmich
&
Dennis
De
Beurs
CrowdTruth.org
dive.beeldengeluid.nl
http://lora-aroyo.org
http://slideshare.net/laroyo
@laroyo

25. Credits
&
Acknowledgements
CrowdTruth
Team
• Chris
http://lora-aroyo.org ! http://slideshare.net/laroyo ! @laroyo
Welty
• Robert-­‐Jan
Sips
• Wing-­‐Yan
Man
• Lin-­‐En
Wu
• Anca
Dumitrache
• Oana
Inel
• Jelle
v.d.
Ploeg
• Ta=ana
Cristea
• Khalid
Khamkham
• Harrië[e
Smook
• Benjamin
Timmermans
• Rens
van
Honschooten
• Susanna
van
de
Ven
• Merel
van
Empel
• Arne
Rutjes
•
Agora
Team
• Chiel
van
den
Akker
• Marieke
van
Erp
• Lourens
v.d.
Meij
• Susan
Legene
• Geertje
Jackobs
• Guus
Schreiber
PrestoPrime
Team
• Riste
Gligorov
• Marteen
Brinkerink
• Lo[e
Belice
Baltussen
• Johan
Oomen
• Michiel
Hildebrand
• Jacco
van
Ossenbruggen
On
the
Web
• http://waida.nl
• http://prestoprime.org
• http://agora.cs.vu.nl
• http://sealincmedia.wordpress.com
• http://notube.tv
• http://vista-tv.eu
• http://dive.beeldengeluid.nl
• http://wm.cs.vu.nl
On
Twi]er
@waisda
@agora-­‐project
@sealincmedia
@prestocenter
@notubeproject
@vistatv
#CrowdTruth