Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

DIVE+ and Events at EVENTS2017

323 views

Published on

Presentation for the EVENTS2017 workshop colocated with SEMANTICS2017

Published in: Education
  • Be the first to comment

  • Be the first to like this

DIVE+ and Events at EVENTS2017

  1. 1. DIVE+ INTO THE EVENT-ENRICHED LINKED OPEN CULTURAL HERITAGE Victor de Boer
  2. 2. Support Event-centric browsing for Media Scholars
  3. 3. Access to Integrated Online Multimedia collections using Linked Open Data to integrate metadata of various heritage collections Interactive Exploration & Discovery in Context linking objects to events and entities building automatic storylines (narratives) DIVE+
  4. 4. OPENIMAGES.EU 3,220 news broadcasts Netherlands Institute for Sound & Vision GTAA thesaurus DELPHER.NL 197,199 Scans of Radio bulletins 1937 – 1984 AMSTERDAM MUSEUM 73,447 cultural heritage objects AM Thesaurus TROPENMUSEUM 78,270 cultural heritage objects SVNC thesaurus Collections and Vocabularies
  5. 5. Van Hage, W. R., Malaisé, V., Segers, R., Hollink, L., & Schreiber, G. (2011). Design and use of the Simple Event Model (SEM). Web Semantics: Science, Services and Agents on the World Wide Web, 9(2), 128-136.
  6. 6. sem:Event sem:Actordive:MediaO bject dive:depictedBy rdfs:label dive:source dive:placeholder dc:identifier dc:description etc. oa:Annotation oa:hasBodyoa:hasTarget sem:Place sem:Time skos:Concept sem:hasActor, sem:hasPlace sem:hasTime dive:isRelated To skos:broader, skos:narrower etc. dive:isRelatedTo DIVE+ data model
  7. 7. Original Metadata Interpretation of content Named Entity Recognition Human computation Hybrid pipeline Where do we get events from - LIDO, CIDOC, EDM - creationDateStart - - Interpretation of object - FROG, other pipelines - - Crowdsourcing - -Nichesourcing,
  8. 8. Original Metadata am:Belgische opstand am:besnijdenis am:Beurs de Keyser am:bevrijding am:bezoekerscentrum am:bibliotheken am:Bijlmerramp am:Boulevard of Broken Dreams am:brand am:brand van het oude stadhuis op de Dam am:burgeroorlog am:capitulatie am:christendom geboorte van Christus am:christendom kruisiging am:christendom opstanding van Christus am:christus aan het kruis am:Christus schrijft op de grond am:concert "Fayence bord”
  9. 9. ENTITY EXTRACTION CROWDTRUTH.ORG ENTITY EXTRACTION EVENTS CROWDSOURCING AND LINKING TO CONCEPTS THROUGH CROWDTRUTH.ORG SEGMENTATION & KEYFRAMES LINKING EVENTS AND CONCEPTS TO KEYFRAMES
  10. 10. Crowdsourcing for Events in Texts & Videos CrowdTruth.org
  11. 11. Description Event "Foto is genomen tijdens de Tweede Zuid Nieuw-Guinea Expeditie" Tweede Zuid Nieuw-Guinea Expeditie Foto is genomen tijdens de Eerste Zuid Nieuw-Guinea Expeditie Eerste Zuid Nieuw-Guinea Expeditie "Foto is genomen tijdens de Eerste- of de Tweede Zuid Nieuw-Guinea Expeditie" Tweede Zuid Nieuw-Guinea Expeditie "Masker gedragen tijdens oogstfeesten. Het feest in kwestie is het Sokari spel dat eenmaal per jaar wordt opgevoerd gedurende zeven opeenvolgende nachten na Nieuwjaar, medio april. …” Nieuwjaar FROG NER Event extraction Victor Kramer
  12. 12. Radio news bulletins: Every object 1 event
  13. 13. DIVE+ Enrichments Enrichment method Media Objects Actors Places Events Other Alignments OI hybrid pipeline 3,204 1,249 1,412 1,916 185,846 623 NB Interpreted + NER 197,200 194,890 54,571 197,200 6,736 6,353 AM original thesaurus 73,447 66,966 5,973 148 28,047 6,865 TM original thesaurus + FROG NER 78,226 27,829 3,896 23* 13,269 - Total 352,077 290,934 65,852 199,264 233,898 - *) more to come
  14. 14. DIVE:MediaObject Nieuws uit Indonesië: opheffing van het KNIL dive:depictedBy sem:hasTimestamp sem:Event ANP:1950-08-11:50 dive:isRelatedTo dive:relatedPlace sem:hasPlace dive:isRelatedTo dive:relatedActor sem:hasActor dive:isRelatedTo dive:relatedPlace sem:hasPlace sem:Time 25 Juli 1950 dive:depictedBy sem:hasTimestamp DIVE:MediaObject Mannen bij het huis van Paul Spies aan de Parapattan 42, Djakarta dive:depictedBy dive:depictedBy dive:depictedBy DIVE:MediaObject ANP:1950-08-11:50 DIVE:MediaObject Schaal sem:Time 11 Augustus 1950 sem:Event ontbindingsceremonie sem:Place Djakarta sem:Place Indonesië sem:Actor Mohammad Hatta Linking via common actors, places, objects
  15. 15. CLIOPATRIA TRIPLE STORE 2M TRIPLES (FOR NOW) SPARQL ENDPOINT DATA.DIVE.BEELDENGELUID.NL
  16. 16. (Common) Event thesaurus? Februaristaking WOII Februaristaking “De oproep 'Staakt!' voor deelname aan de februaristaking te Amsterdam op 25 en 26 februari 1941. “ stakingen Eduard Hellendoorn "Joseph Eijl Eduard Hellendoorn Hermanus Coenradi 13 maart 1941 gefusilleerd Waalsdorpervlakte" Waalsdorpervlakte Jessie Both & Didi de hooge
  17. 17. DIVE+ UI: INFINITY OF EXPLORATION / Support exploration and serendipity / / Visual inspection of media objects and entities / / Lets user build, save and share Proto-Narratives/
  18. 18. filters results ordering
  19. 19. filter on media objects order media objects by date
  20. 20. filter on events
  21. 21. explore event related entities
  22. 22. explore event event related entities
  23. 23. place entity exploration
  24. 24. narrative
  25. 25. bookmarking
  26. 26. / Events as backbone for for deep exploration of interconnected media collections by DH experts / Various data enrichment strategies to construct explorable knowledge graphs DIVE+
  27. 27. / http://diveproject.beeldengeluid.nl / http://diveplus.beeldengeluid.nl / v.de.boer@vu.nl DIVE+
  28. 28. DIVE+

×