Indexing German Audiovisual Heritage
- SKOSification Made Easy

Johannes Hercher & Dr. Harald Sack
Hasso-Plattner-Institute...
Approach - Table of Contents
2


     1. Problem Statement & mediaglobe Project
     2. Why Do We Need (SKOSified) Controll...
What's the Problem?
1.1 Introducing the Problem
4
         Cultural heritage taped on film (Germany)
         > 1.200 film collections*
        ...
1.1 Introducing the Problem
4
         Cultural heritage taped on film (Germany)
         > 1.200 film collections*
        ...
1.1 Introducing the Problem
4
         Cultural heritage taped on film (Germany)
         > 1.200 film collections*
        ...
1.1 Introducing the Problem
4
         Cultural heritage taped on film (Germany)                                           ...
1.1 Introducing the Problem
4
         Cultural heritage taped on film (Germany)                                           ...
1.1 Introducing the Problem
4
         Cultural heritage taped on film (Germany)                                           ...
1.2 The mediaglobe Project
5   mediaglobe - the Digital Archive




                                                      ...
The Need for Vocabularies
2.1 Why Do We Need Controlled Vocabularies
7

     ■ AV-media needs descriptions
          □ content topics
          □ ty...
2.2 Why Do We Need SKOS
8




                                                                                            ...
2.2 Why Do We Need SKOS
8




                                                                                            ...
Backing Problem Statement
3.1 How to Find Vocabularies
10    ■ Catalogues
           □ http://www.w3.org/2001/sw/wiki/SKOS/Datasets
           □ htt...
3.2 Vocabularies Related to AV-Media
11    ■ Results
           □ AV-related Vocabularies are mainly in english language.
...
3.2 Lack of SKOSified Vocabolaries - Discovering Reasons
12    ■ appropriate vocabularies exist…




      ■ But we can not...
3.2 Lack of SKOSified Vocabolaries - Discovering Reasons
12    ■ appropriate vocabularies exist…




      ■ But we can not...
Our Proposal
4.1) A Webservice for SKOSification
14    ■ Idea =>
                        »SKOSify existing vocabularies (even more) easi...
4.1) A Webservice for SKOSification
14    ■ Idea =>
                        »SKOSify existing vocabularies (even more) easi...
4.2) SKOSification - How Does it Work?
15




     Johannes Hercher & Harald Sack : Indexing German Audiovisual Heritage - ...
4.2) SKOSification - How Does it Work?
15
     Scan
     paper based
     thesauri




     Johannes Hercher & Harald Sack ...
4.2) SKOSification - How Does it Work?
15
     Scan
     paper based
     thesauri

                        (OCR) &
       ...
4.2) SKOSification - How Does it Work?
15
     Scan
     paper based
     thesauri

                        (OCR) &
       ...
4.2) SKOSification - How Does it Work?
15
     Scan
     paper based
     thesauri

                        (OCR) &
       ...
4.2) SKOSification - How Does it Work?
15
     Scan
     paper based
     thesauri

                        (OCR) &
       ...
4.2) SKOSification - How Does it Work?
15
     Scan
     paper based
     thesauri

                        (OCR) &
       ...
16




     Johannes Hercher & Harald Sack : Indexing German Audiovisual Heritage - SKOSification Made Easy.
     Hasso-Pla...
16




     Johannes Hercher & Harald Sack : Indexing German Audiovisual Heritage - SKOSification Made Easy.
     Hasso-Pla...
16




     Johannes Hercher & Harald Sack : Indexing German Audiovisual Heritage - SKOSification Made Easy.
     Hasso-Pla...
16




     Johannes Hercher & Harald Sack : Indexing German Audiovisual Heritage - SKOSification Made Easy.
     Hasso-Pla...
16




     Johannes Hercher & Harald Sack : Indexing German Audiovisual Heritage - SKOSification Made Easy.
     Hasso-Pla...
Questions
                    Comments

                                    Discussion


                    Thank You!

J...
Upcoming SlideShare
Loading in …5
×

Indexing German Audiovisual Heritage -- SKOSification Made Easy

1,515 views

Published on

Controlled vocabularies are appropriate for collection-alignment of video-content by providing fine-grained collections of terms. In fact, there already exist classifications and thesauri dedicated for indexing audiovisual material, but they are hardly available in interoperable formats (as e.g. RDF/SKOS), are hidden in private or public media archives or ain't use german language. Though, there is an increasing demand for audiovisual related vocabularies. We have encouraged major film archives in Germany, as e.g., German National Archive (BA), National Broadcasting Archive (DRA)
and German Broadcasting Compound to make their controlled vocabularies available for public use, but encountered a bottleneck in human- and technical resources. Therefore we plan to provide a skosification and hosting service for small and mid-sized archives. This contributions to the scientific- and film-industry community, was motivated by:
* Reuse of controlled vocabulary on films and film related material for indexing, facetted browsing, and retrieval issues.
* Interlinking and alignment of heterogeneous collections on the content-layer by using thesauri and classifications with semantic web technology such as RDF, SKOS and LOD.
* Promotion of open standards for knowledge exchange and adding value for small and middle-size archives by providing a conversion and hosting service. We plan to support the public funded media archives with manpower to make their vocabularies available in SKOS-format.

Johannes Hercher & Dr. Harald Sack
Hasso-Plattner-Institute for IT Systems Engineering
Potsdam, Germany

Published in: Technology
  • Be the first to comment

Indexing German Audiovisual Heritage -- SKOSification Made Easy

  1. 1. Indexing German Audiovisual Heritage - SKOSification Made Easy Johannes Hercher & Dr. Harald Sack Hasso-Plattner-Institute for IT Systems Engineering Potsdam, Germany Parts of this work were funded by the German Federal Ministry of Economics and Technology (Promotional Reference No. 01MQ09031)
  2. 2. Approach - Table of Contents 2 1. Problem Statement & mediaglobe Project 2. Why Do We Need (SKOSified) Controlled Vocabularies 3. Update on the Current State of Controlled Vocabularies □ vocabularies for AV-related content □ results of a survey on usage of controlled vocabularies □ why is there a problem? 4. Solution: an Easy Webservice to Publish Vocabularies □ how does it work? □ recommended features □ wireframe modell Johannes Hercher & Harald Sack : Indexing German Audiovisual Heritage - SKOSification Made Easy. Hasso-Plattner-Institute, University Potsdam - 10th Sept. 2010
  3. 3. What's the Problem?
  4. 4. 1.1 Introducing the Problem 4 Cultural heritage taped on film (Germany) > 1.200 film collections* > 200 institutions with more than 100 h of film** ~ 83% of film archives plan to digitise their collections** > 1000 film collections in Germany* Johannes Hercher & Harald Sack : Indexing German Audiovisual Heritage - SKOSification Made Easy. *) Bockhorn, V; Morsbach; Ronneburg, S; Schmidt, W. (1996). Topographie audiovisueller Quellenüberlieferung - Film- und Videobestände in Archiven und archivischen Einrichtungen in der Bundesrepublik Deutschland. Koblen Hasso-Plattner-Institute, University Potsdam - 10 Sept. 2010 **) Mediaglobe, Deliverable-1.1 Report 2010. th
  5. 5. 1.1 Introducing the Problem 4 Cultural heritage taped on film (Germany) > 1.200 film collections* > 200 institutions with more than 100 h of film** ~ 83% of film archives plan to digitise their collections** > 1000 filmcollections in > 1000 collections need connections Germany* Johannes Hercher & Harald Sack : Indexing German Audiovisual Heritage - SKOSification Made Easy. *) Bockhorn, V; Morsbach; Ronneburg, S; Schmidt, W. (1996). Topographie audiovisueller Quellenüberlieferung - Film- und Videobestände in Archiven und archivischen Einrichtungen in der Bundesrepublik Deutschland. Koblen Hasso-Plattner-Institute, University Potsdam - 10 Sept. 2010 **) Mediaglobe, Deliverable-1.1 Report 2010. th
  6. 6. 1.1 Introducing the Problem 4 Cultural heritage taped on film (Germany) > 1.200 film collections* > 200 institutions with more than 100 h of film** ~ 83% of film archives plan to digitise their collections** > 1000 filmcollections in > 1000 collections need connections Germany* Semantic glue Classifications and Thesauri Johannes Hercher & Harald Sack : Indexing German Audiovisual Heritage - SKOSification Made Easy. *) Bockhorn, V; Morsbach; Ronneburg, S; Schmidt, W. (1996). Topographie audiovisueller Quellenüberlieferung - Film- und Videobestände in Archiven und archivischen Einrichtungen in der Bundesrepublik Deutschland. Koblen Hasso-Plattner-Institute, University Potsdam - 10 Sept. 2010 **) Mediaglobe, Deliverable-1.1 Report 2010. th
  7. 7. 1.1 Introducing the Problem 4 Cultural heritage taped on film (Germany) Classification & Thesauri needed: > 1.200 film collections* > 200 institutions with more than 100 h of film** □ integrate various collections ~ 83% of film archives plan to digitise their collections** } □ harness semantic relations > 1000 filmcollections in > 1000 collections need connections Germany* □ align content Semantic glue Classifications and Thesauri Johannes Hercher & Harald Sack : Indexing German Audiovisual Heritage - SKOSification Made Easy. *) Bockhorn, V; Morsbach; Ronneburg, S; Schmidt, W. (1996). Topographie audiovisueller Quellenüberlieferung - Film- und Videobestände in Archiven und archivischen Einrichtungen in der Bundesrepublik Deutschland. Koblen Hasso-Plattner-Institute, University Potsdam - 10 Sept. 2010 **) Mediaglobe, Deliverable-1.1 Report 2010. th
  8. 8. 1.1 Introducing the Problem 4 Cultural heritage taped on film (Germany) Classification & Thesauri needed: > 1.200 film collections* > 200 institutions with more than 100 h of film** □ integrate various collections ~ 83% of film archives plan to digitise their collections** } □ harness semantic relations > 1000 filmcollections in > 1000 collections need connections Germany* □ align content Semantic glue but… ! Classifications and Thesauri Johannes Hercher & Harald Sack : Indexing German Audiovisual Heritage - SKOSification Made Easy. *) Bockhorn, V; Morsbach; Ronneburg, S; Schmidt, W. (1996). Topographie audiovisueller Quellenüberlieferung - Film- und Videobestände in Archiven und archivischen Einrichtungen in der Bundesrepublik Deutschland. Koblen Hasso-Plattner-Institute, University Potsdam - 10 Sept. 2010 **) Mediaglobe, Deliverable-1.1 Report 2010. th
  9. 9. 1.1 Introducing the Problem 4 Cultural heritage taped on film (Germany) Classification & Thesauri needed: > 1.200 film collections* > 200 institutions with more than 100 h of film** □ integrate various collections ~ 83% of film archives plan to digitise their collections** } □ harness semantic relations > 1000 filmcollections in > 1000 collections need connections Germany* □ align content Semantic glue but… ! Classifications and Thesauri vocabularies missing Johannes Hercher & Harald Sack : Indexing German Audiovisual Heritage - SKOSification Made Easy. *) Bockhorn, V; Morsbach; Ronneburg, S; Schmidt, W. (1996). Topographie audiovisueller Quellenüberlieferung - Film- und Videobestände in Archiven und archivischen Einrichtungen in der Bundesrepublik Deutschland. Koblen Hasso-Plattner-Institute, University Potsdam - 10 Sept. 2010 **) Mediaglobe, Deliverable-1.1 Report 2010. th
  10. 10. 1.2 The mediaglobe Project 5 mediaglobe - the Digital Archive <•••• narrower •••••••••••••••••••• broader ••••> makes cultural heritage accessible & tangible ■ augmenting workflows in media-archives □ efficient multimedia-analysis □ (semi-)automated semantic indexing □ retrieval of AV-content ■ covers □ >1.000h of AV-data (defa-spektrum Archive) □ newsreels, interviews, factual recordings, … Johannes Hercher & Harald Sack : Indexing German Audiovisual Heritage - SKOSification Made Easy. Hasso-Plattner-Institute, University Potsdam - 10th Sept. 2010
  11. 11. The Need for Vocabularies
  12. 12. 2.1 Why Do We Need Controlled Vocabularies 7 ■ AV-media needs descriptions □ content topics □ types of broadcast □ genres □… tagclouds VS thesauri TT Films ■ tags are not sufficient… UF Motion picture NT Nonfiction films □ variant, ambiguous, flat (...) NT Documentary films □ => inconsistent, uncontrolled SN A heading used for ... UF Documentaries, Motion picture UF Factual films UF Motion pictures documentaries ■ controlled vocabulary is suited BT Nonfiction films RT Actualities (Motion pictures) due to term-relations Johannes Hercher & Harald Sack : Indexing German Audiovisual Heritage - SKOSification Made Easy. Hasso-Plattner-Institute, University Potsdam - 10th Sept. 2010
  13. 13. 2.2 Why Do We Need SKOS 8 http://www.w3.org/TR/2005/WD-swbp-skos-core-guide-20051102/ http://www.jenitennison.com/visualisation/offences.html http://www.jigs4owl.com/demos/treemap Johannes Hercher & Harald Sack : Indexing German Audiovisual Heritage - SKOSification Made Easy. Hasso-Plattner-Institute, University Potsdam - 10th Sept. 2010
  14. 14. 2.2 Why Do We Need SKOS 8 http://www.w3.org/TR/2005/WD-swbp-skos-core-guide-20051102/ Because: □ simple □ interoperable standard □ widely used in Semantic Web □ appropriate for mapping http://www.jenitennison.com/visualisation/offences.html http://www.jigs4owl.com/demos/treemap Johannes Hercher & Harald Sack : Indexing German Audiovisual Heritage - SKOSification Made Easy. Hasso-Plattner-Institute, University Potsdam - 10th Sept. 2010
  15. 15. Backing Problem Statement
  16. 16. 3.1 How to Find Vocabularies 10 ■ Catalogues □ http://www.w3.org/2001/sw/wiki/SKOS/Datasets □ http://www.vocabularyserver.com □ http://www.taxonomywarehouse.com/ □… ■ Specialised search engines ■ Major associations Johannes Hercher & Harald Sack : Indexing German Audiovisual Heritage - SKOSification Made Easy. Hasso-Plattner-Institute, University Potsdam - 10th Sept. 2010
  17. 17. 3.2 Vocabularies Related to AV-Media 11 ■ Results □ AV-related Vocabularies are mainly in english language. □ German broadcasters do NOT publish vocabularies ! □ Many small and mid-sized archives have own vocabularies. □ Low availability of vocabularies (in german language). □ Name SKOS IPTC Thesaurus International Press Telecommunication Council x TGM Thesaurus for Graphic Materials (Library of Congress) X FIAF GSH FIAF General Subject Headings X MIM Moving Image Materials X LCGFT Moving Image Genre-Form Headings (Library of Congress) (X) T-POL Thesaurus Politics of (former) GDR-Filmarchive (~12.000 Terms) - REM ~6 co-existing thesauri of German broadcasting compound. - Small >200 Collections with custom classification. Only a few use thesauri- - Archives terms of the public broadcasting compound. Johannes Hercher & Harald Sack : Indexing German Audiovisual Heritage - SKOSification Made Easy. Hasso-Plattner-Institute, University Potsdam - 10th Sept. 2010
  18. 18. 3.2 Lack of SKOSified Vocabolaries - Discovering Reasons 12 ■ appropriate vocabularies exist… ■ But we can not use them, because □ they are not encoded in RDF □ they are not published □ (some) are not up to date Johannes Hercher & Harald Sack : Indexing German Audiovisual Heritage - SKOSification Made Easy. Hasso-Plattner-Institute, University Potsdam - 10th Sept. 2010
  19. 19. 3.2 Lack of SKOSified Vocabolaries - Discovering Reasons 12 ■ appropriate vocabularies exist… ■ But we can not use them, because □ they are not encoded in RDF some answers from □ they are not published telephone interviews □ (some) are not up to date "… our vocabulary needs review and revision first…" "… ownership and copyrights not clear at the moment…" "… we are interested but have no resources…" Johannes Hercher & Harald Sack : Indexing German Audiovisual Heritage - SKOSification Made Easy. Hasso-Plattner-Institute, University Potsdam - 10th Sept. 2010
  20. 20. Our Proposal
  21. 21. 4.1) A Webservice for SKOSification 14 ■ Idea => »SKOSify existing vocabularies (even more) easily ■ Main requirements □ simple ingest (example follows) □ download/publish an SKOS/RDF encoded vocabulary □ low learning curve (simple) □ no installation required ■ Need more features? □ indexing assistance & term search □ mapping & collaborative development □ management & visualisation Johannes Hercher & Harald Sack : Indexing German Audiovisual Heritage - SKOSification Made Easy. Hasso-Plattner-Institute, University Potsdam - 10th Sept. 2010
  22. 22. 4.1) A Webservice for SKOSification 14 ■ Idea => »SKOSify existing vocabularies (even more) easily ■ Main requirements □ simple ingest (example follows) □ download/publish an SKOS/RDF encoded vocabulary □ low learning curve (simple) □ no installation required } ■ Need more features? □ indexing assistance & term search □ mapping & collaborative development xTree □ management & visualisation (digicult) Johannes Hercher & Harald Sack : Indexing German Audiovisual Heritage - SKOSification Made Easy. Hasso-Plattner-Institute, University Potsdam - 10th Sept. 2010
  23. 23. 4.2) SKOSification - How Does it Work? 15 Johannes Hercher & Harald Sack : Indexing German Audiovisual Heritage - SKOSification Made Easy. Hasso-Plattner-Institute, University Potsdam - 10th Sept. 2010
  24. 24. 4.2) SKOSification - How Does it Work? 15 Scan paper based thesauri Johannes Hercher & Harald Sack : Indexing German Audiovisual Heritage - SKOSification Made Easy. Hasso-Plattner-Institute, University Potsdam - 10th Sept. 2010
  25. 25. 4.2) SKOSification - How Does it Work? 15 Scan paper based thesauri (OCR) & cleanup Johannes Hercher & Harald Sack : Indexing German Audiovisual Heritage - SKOSification Made Easy. Hasso-Plattner-Institute, University Potsdam - 10th Sept. 2010
  26. 26. 4.2) SKOSification - How Does it Work? 15 Scan paper based thesauri (OCR) & cleanup TT Documentary films SN A heading used for… UF Documentaries NT Factual films BT Nonfiction films RT Actualities Johannes Hercher & Harald Sack : Indexing German Audiovisual Heritage - SKOSification Made Easy. Hasso-Plattner-Institute, University Potsdam - 10th Sept. 2010
  27. 27. 4.2) SKOSification - How Does it Work? 15 Scan paper based thesauri (OCR) & cleanup TT Documentary films SN A heading used for… UF Documentaries NT Factual films BT Nonfiction films RT Actualities Preprocess Assign Relation Label for each Term per line Johannes Hercher & Harald Sack : Indexing German Audiovisual Heritage - SKOSification Made Easy. Hasso-Plattner-Institute, University Potsdam - 10th Sept. 2010
  28. 28. 4.2) SKOSification - How Does it Work? 15 Scan paper based thesauri (OCR) & cleanup TT Documentary films SN A heading used for… UF Documentaries NT Factual films BT Nonfiction films SKOSify RT Actualities Processing deduces relations from Preprocess indention level and Assign Relation Label labels for each Term per line Johannes Hercher & Harald Sack : Indexing German Audiovisual Heritage - SKOSification Made Easy. Hasso-Plattner-Institute, University Potsdam - 10th Sept. 2010
  29. 29. 4.2) SKOSification - How Does it Work? 15 Scan paper based thesauri (OCR) & cleanup TT Documentary films Output SN A heading used for… UF Documentaries RDF/SKOS Document NT Factual films BT Nonfiction films SKOSify RT Actualities Processing deduces relations from Preprocess indention level and Assign Relation Label labels for each Term per line Johannes Hercher & Harald Sack : Indexing German Audiovisual Heritage - SKOSification Made Easy. Hasso-Plattner-Institute, University Potsdam - 10th Sept. 2010
  30. 30. 16 Johannes Hercher & Harald Sack : Indexing German Audiovisual Heritage - SKOSification Made Easy. Hasso-Plattner-Institute, University Potsdam - 10th Sept. 2010
  31. 31. 16 Johannes Hercher & Harald Sack : Indexing German Audiovisual Heritage - SKOSification Made Easy. Hasso-Plattner-Institute, University Potsdam - 10th Sept. 2010
  32. 32. 16 Johannes Hercher & Harald Sack : Indexing German Audiovisual Heritage - SKOSification Made Easy. Hasso-Plattner-Institute, University Potsdam - 10th Sept. 2010
  33. 33. 16 Johannes Hercher & Harald Sack : Indexing German Audiovisual Heritage - SKOSification Made Easy. Hasso-Plattner-Institute, University Potsdam - 10th Sept. 2010
  34. 34. 16 Johannes Hercher & Harald Sack : Indexing German Audiovisual Heritage - SKOSification Made Easy. Hasso-Plattner-Institute, University Potsdam - 10th Sept. 2010
  35. 35. Questions Comments Discussion Thank You! Johannes Hercher Dr. Harald Sack phone: +49 (0)331-5509-547 phone: +49 (0)331-5509-527 email: Johannes.Hercher@hpi.uni-potsdam.de email: Harald.Sack@hpi.uni-potsdam.de http://www.hpi.uni-potsdam.de/meinel/forschung/future_internet/semantic_technologies.html http://www.projekt-mediaglobe.de/

×