1.
Indexing German Audiovisual Heritage
- SKOSification Made Easy
Johannes Hercher & Dr. Harald Sack
Hasso-Plattner-Institute for IT Systems Engineering
Potsdam, Germany
Parts of this work were funded by the German Federal Ministry of Economics and Technology
(Promotional Reference No. 01MQ09031)

2.
Approach - Table of Contents
2
1. Problem Statement & mediaglobe Project
2. Why Do We Need (SKOSified) Controlled Vocabularies
3. Update on the Current State of Controlled Vocabularies
□ vocabularies for AV-related content
□ results of a survey on usage of controlled vocabularies
□ why is there a problem?
4. Solution: an Easy Webservice to Publish Vocabularies
□ how does it work?
□ recommended features
□ wireframe modell
Johannes Hercher & Harald Sack : Indexing German Audiovisual Heritage - SKOSification Made Easy.
Hasso-Plattner-Institute, University Potsdam - 10th Sept. 2010

3.
What's the Problem?

4.
1.1 Introducing the Problem
4
Cultural heritage taped on film (Germany)
> 1.200 film collections*
> 200 institutions with more than 100 h of film**
~ 83% of film archives plan to digitise their collections**
> 1000 film collections in
Germany*
Johannes Hercher & Harald Sack : Indexing German Audiovisual Heritage - SKOSification Made Easy.
*) Bockhorn, V; Morsbach; Ronneburg, S; Schmidt, W. (1996). Topographie audiovisueller Quellenüberlieferung - Film- und Videobestände in Archiven und archivischen
Einrichtungen in der Bundesrepublik Deutschland. Koblen
Hasso-Plattner-Institute, University Potsdam - 10 Sept. 2010
**) Mediaglobe, Deliverable-1.1 Report 2010.
th

5.
1.1 Introducing the Problem
4
Cultural heritage taped on film (Germany)
> 1.200 film collections*
> 200 institutions with more than 100 h of film**
~ 83% of film archives plan to digitise their collections**
> 1000 filmcollections in
> 1000 collections
need connections
Germany*
Johannes Hercher & Harald Sack : Indexing German Audiovisual Heritage - SKOSification Made Easy.
*) Bockhorn, V; Morsbach; Ronneburg, S; Schmidt, W. (1996). Topographie audiovisueller Quellenüberlieferung - Film- und Videobestände in Archiven und archivischen
Einrichtungen in der Bundesrepublik Deutschland. Koblen
Hasso-Plattner-Institute, University Potsdam - 10 Sept. 2010
**) Mediaglobe, Deliverable-1.1 Report 2010.
th

6.
1.1 Introducing the Problem
4
Cultural heritage taped on film (Germany)
> 1.200 film collections*
> 200 institutions with more than 100 h of film**
~ 83% of film archives plan to digitise their collections**
> 1000 filmcollections in
> 1000 collections
need connections
Germany*
Semantic glue
Classifications and Thesauri
Johannes Hercher & Harald Sack : Indexing German Audiovisual Heritage - SKOSification Made Easy.
*) Bockhorn, V; Morsbach; Ronneburg, S; Schmidt, W. (1996). Topographie audiovisueller Quellenüberlieferung - Film- und Videobestände in Archiven und archivischen
Einrichtungen in der Bundesrepublik Deutschland. Koblen
Hasso-Plattner-Institute, University Potsdam - 10 Sept. 2010
**) Mediaglobe, Deliverable-1.1 Report 2010.
th

7.
1.1 Introducing the Problem
4
Cultural heritage taped on film (Germany) Classification &
Thesauri needed:
> 1.200 film collections*
> 200 institutions with more than 100 h of film** □ integrate various
collections
~ 83% of film archives plan to digitise their collections**
}
□ harness semantic
relations
> 1000 filmcollections in
> 1000 collections
need connections
Germany*
□ align content
Semantic glue
Classifications and Thesauri
Johannes Hercher & Harald Sack : Indexing German Audiovisual Heritage - SKOSification Made Easy.
*) Bockhorn, V; Morsbach; Ronneburg, S; Schmidt, W. (1996). Topographie audiovisueller Quellenüberlieferung - Film- und Videobestände in Archiven und archivischen
Einrichtungen in der Bundesrepublik Deutschland. Koblen
Hasso-Plattner-Institute, University Potsdam - 10 Sept. 2010
**) Mediaglobe, Deliverable-1.1 Report 2010.
th

8.
1.1 Introducing the Problem
4
Cultural heritage taped on film (Germany) Classification &
Thesauri needed:
> 1.200 film collections*
> 200 institutions with more than 100 h of film** □ integrate various
collections
~ 83% of film archives plan to digitise their collections**
}
□ harness semantic
relations
> 1000 filmcollections in
> 1000 collections
need connections
Germany*
□ align content
Semantic glue but… !
Classifications and Thesauri
Johannes Hercher & Harald Sack : Indexing German Audiovisual Heritage - SKOSification Made Easy.
*) Bockhorn, V; Morsbach; Ronneburg, S; Schmidt, W. (1996). Topographie audiovisueller Quellenüberlieferung - Film- und Videobestände in Archiven und archivischen
Einrichtungen in der Bundesrepublik Deutschland. Koblen
Hasso-Plattner-Institute, University Potsdam - 10 Sept. 2010
**) Mediaglobe, Deliverable-1.1 Report 2010.
th

9.
1.1 Introducing the Problem
4
Cultural heritage taped on film (Germany) Classification &
Thesauri needed:
> 1.200 film collections*
> 200 institutions with more than 100 h of film** □ integrate various
collections
~ 83% of film archives plan to digitise their collections**
}
□ harness semantic
relations
> 1000 filmcollections in
> 1000 collections
need connections
Germany*
□ align content
Semantic glue but… !
Classifications and Thesauri
vocabularies missing
Johannes Hercher & Harald Sack : Indexing German Audiovisual Heritage - SKOSification Made Easy.
*) Bockhorn, V; Morsbach; Ronneburg, S; Schmidt, W. (1996). Topographie audiovisueller Quellenüberlieferung - Film- und Videobestände in Archiven und archivischen
Einrichtungen in der Bundesrepublik Deutschland. Koblen
Hasso-Plattner-Institute, University Potsdam - 10 Sept. 2010
**) Mediaglobe, Deliverable-1.1 Report 2010.
th

10.
1.2 The mediaglobe Project
5 mediaglobe - the Digital Archive
<•••• narrower •••••••••••••••••••• broader ••••>
makes cultural heritage
accessible & tangible
■ augmenting workflows in media-archives
□ efficient multimedia-analysis
□ (semi-)automated semantic indexing
□ retrieval of AV-content
■ covers
□ >1.000h of AV-data (defa-spektrum Archive)
□ newsreels, interviews, factual recordings, …
Johannes Hercher & Harald Sack : Indexing German Audiovisual Heritage - SKOSification Made Easy.
Hasso-Plattner-Institute, University Potsdam - 10th Sept. 2010

11.
The Need for Vocabularies

12.
2.1 Why Do We Need Controlled Vocabularies
7
■ AV-media needs descriptions
□ content topics
□ types of broadcast
□ genres
□… tagclouds VS thesauri
TT Films
■ tags are not sufficient…
UF Motion picture
NT Nonfiction films
□ variant, ambiguous, flat (...)
NT Documentary films
□ => inconsistent, uncontrolled
SN A heading used for ...
UF Documentaries, Motion picture
UF Factual films
UF Motion pictures documentaries
■ controlled vocabulary is suited
BT Nonfiction films
RT Actualities (Motion pictures)
due to term-relations
Johannes Hercher & Harald Sack : Indexing German Audiovisual Heritage - SKOSification Made Easy.
Hasso-Plattner-Institute, University Potsdam - 10th Sept. 2010

13.
2.2 Why Do We Need SKOS
8
http://www.w3.org/TR/2005/WD-swbp-skos-core-guide-20051102/
http://www.jenitennison.com/visualisation/offences.html http://www.jigs4owl.com/demos/treemap
Johannes Hercher & Harald Sack : Indexing German Audiovisual Heritage - SKOSification Made Easy.
Hasso-Plattner-Institute, University Potsdam - 10th Sept. 2010

14.
2.2 Why Do We Need SKOS
8
http://www.w3.org/TR/2005/WD-swbp-skos-core-guide-20051102/
Because:
□ simple
□ interoperable standard
□ widely used in Semantic Web
□ appropriate for mapping
http://www.jenitennison.com/visualisation/offences.html http://www.jigs4owl.com/demos/treemap
Johannes Hercher & Harald Sack : Indexing German Audiovisual Heritage - SKOSification Made Easy.
Hasso-Plattner-Institute, University Potsdam - 10th Sept. 2010

15.
Backing Problem Statement

16.
3.1 How to Find Vocabularies
10 ■ Catalogues
□ http://www.w3.org/2001/sw/wiki/SKOS/Datasets
□ http://www.vocabularyserver.com
□ http://www.taxonomywarehouse.com/
□…
■ Specialised search engines
■ Major associations
Johannes Hercher & Harald Sack : Indexing German Audiovisual Heritage - SKOSification Made Easy.
Hasso-Plattner-Institute, University Potsdam - 10th Sept. 2010

17.
3.2 Vocabularies Related to AV-Media
11 ■ Results
□ AV-related Vocabularies are mainly in english language.
□ German broadcasters do NOT publish vocabularies !
□ Many small and mid-sized archives have own vocabularies.
□ Low availability of vocabularies (in german language).
□ Name SKOS
IPTC Thesaurus International Press Telecommunication Council x
TGM Thesaurus for Graphic Materials (Library of Congress) X
FIAF GSH FIAF General Subject Headings X
MIM Moving Image Materials X
LCGFT Moving Image Genre-Form Headings (Library of Congress) (X)
T-POL Thesaurus Politics of (former) GDR-Filmarchive (~12.000 Terms) -
REM ~6 co-existing thesauri of German broadcasting compound. -
Small >200 Collections with custom classification. Only a few use thesauri-
-
Archives terms of the public broadcasting compound.
Johannes Hercher & Harald Sack : Indexing German Audiovisual Heritage - SKOSification Made Easy.
Hasso-Plattner-Institute, University Potsdam - 10th Sept. 2010

18.
3.2 Lack of SKOSified Vocabolaries - Discovering Reasons
12 ■ appropriate vocabularies exist…
■ But we can not use them, because
□ they are not encoded in RDF
□ they are not published
□ (some) are not up to date
Johannes Hercher & Harald Sack : Indexing German Audiovisual Heritage - SKOSification Made Easy.
Hasso-Plattner-Institute, University Potsdam - 10th Sept. 2010

19.
3.2 Lack of SKOSified Vocabolaries - Discovering Reasons
12 ■ appropriate vocabularies exist…
■ But we can not use them, because
□ they are not encoded in RDF
some answers from
□ they are not published telephone interviews
□ (some) are not up to date
"… our vocabulary needs review and revision first…"
"… ownership and copyrights not clear at the moment…"
"… we are interested but have no resources…"
Johannes Hercher & Harald Sack : Indexing German Audiovisual Heritage - SKOSification Made Easy.
Hasso-Plattner-Institute, University Potsdam - 10th Sept. 2010

20.
Our Proposal

21.
4.1) A Webservice for SKOSification
14 ■ Idea =>
»SKOSify existing vocabularies (even more) easily
■ Main requirements
□ simple ingest (example follows)
□ download/publish an SKOS/RDF encoded vocabulary
□ low learning curve (simple)
□ no installation required
■ Need more features?
□ indexing assistance & term search
□ mapping & collaborative development
□ management & visualisation
Johannes Hercher & Harald Sack : Indexing German Audiovisual Heritage - SKOSification Made Easy.
Hasso-Plattner-Institute, University Potsdam - 10th Sept. 2010

22.
4.1) A Webservice for SKOSification
14 ■ Idea =>
»SKOSify existing vocabularies (even more) easily
■ Main requirements
□ simple ingest (example follows)
□ download/publish an SKOS/RDF encoded vocabulary
□ low learning curve (simple)
□ no installation required
}
■ Need more features?
□ indexing assistance & term search
□ mapping & collaborative development
xTree
□ management & visualisation (digicult)
Johannes Hercher & Harald Sack : Indexing German Audiovisual Heritage - SKOSification Made Easy.
Hasso-Plattner-Institute, University Potsdam - 10th Sept. 2010

23.
4.2) SKOSification - How Does it Work?
15
Johannes Hercher & Harald Sack : Indexing German Audiovisual Heritage - SKOSification Made Easy.
Hasso-Plattner-Institute, University Potsdam - 10th Sept. 2010

24.
4.2) SKOSification - How Does it Work?
15
Scan
paper based
thesauri
Johannes Hercher & Harald Sack : Indexing German Audiovisual Heritage - SKOSification Made Easy.
Hasso-Plattner-Institute, University Potsdam - 10th Sept. 2010

25.
4.2) SKOSification - How Does it Work?
15
Scan
paper based
thesauri
(OCR) &
cleanup
Johannes Hercher & Harald Sack : Indexing German Audiovisual Heritage - SKOSification Made Easy.
Hasso-Plattner-Institute, University Potsdam - 10th Sept. 2010

26.
4.2) SKOSification - How Does it Work?
15
Scan
paper based
thesauri
(OCR) &
cleanup
TT Documentary films
SN A heading used for…
UF Documentaries
NT Factual films
BT Nonfiction films
RT Actualities
Johannes Hercher & Harald Sack : Indexing German Audiovisual Heritage - SKOSification Made Easy.
Hasso-Plattner-Institute, University Potsdam - 10th Sept. 2010

27.
4.2) SKOSification - How Does it Work?
15
Scan
paper based
thesauri
(OCR) &
cleanup
TT Documentary films
SN A heading used for…
UF Documentaries
NT Factual films
BT Nonfiction films
RT Actualities
Preprocess
Assign Relation Label
for each Term per line
Johannes Hercher & Harald Sack : Indexing German Audiovisual Heritage - SKOSification Made Easy.
Hasso-Plattner-Institute, University Potsdam - 10th Sept. 2010

28.
4.2) SKOSification - How Does it Work?
15
Scan
paper based
thesauri
(OCR) &
cleanup
TT Documentary films
SN A heading used for…
UF Documentaries
NT Factual films
BT Nonfiction films SKOSify
RT Actualities
Processing
deduces relations from
Preprocess
indention level and
Assign Relation Label
labels
for each Term per line
Johannes Hercher & Harald Sack : Indexing German Audiovisual Heritage - SKOSification Made Easy.
Hasso-Plattner-Institute, University Potsdam - 10th Sept. 2010

29.
4.2) SKOSification - How Does it Work?
15
Scan
paper based
thesauri
(OCR) &
cleanup
TT Documentary films
Output
SN A heading used for…
UF Documentaries RDF/SKOS Document
NT Factual films
BT Nonfiction films SKOSify
RT Actualities
Processing
deduces relations from
Preprocess
indention level and
Assign Relation Label
labels
for each Term per line
Johannes Hercher & Harald Sack : Indexing German Audiovisual Heritage - SKOSification Made Easy.
Hasso-Plattner-Institute, University Potsdam - 10th Sept. 2010

30.
16
Johannes Hercher & Harald Sack : Indexing German Audiovisual Heritage - SKOSification Made Easy.
Hasso-Plattner-Institute, University Potsdam - 10th Sept. 2010

31.
16
Johannes Hercher & Harald Sack : Indexing German Audiovisual Heritage - SKOSification Made Easy.
Hasso-Plattner-Institute, University Potsdam - 10th Sept. 2010

32.
16
Johannes Hercher & Harald Sack : Indexing German Audiovisual Heritage - SKOSification Made Easy.
Hasso-Plattner-Institute, University Potsdam - 10th Sept. 2010

33.
16
Johannes Hercher & Harald Sack : Indexing German Audiovisual Heritage - SKOSification Made Easy.
Hasso-Plattner-Institute, University Potsdam - 10th Sept. 2010

34.
16
Johannes Hercher & Harald Sack : Indexing German Audiovisual Heritage - SKOSification Made Easy.
Hasso-Plattner-Institute, University Potsdam - 10th Sept. 2010

35.
Questions
Comments
Discussion
Thank You!
Johannes Hercher Dr. Harald Sack
phone: +49 (0)331-5509-547 phone: +49 (0)331-5509-527
email: Johannes.Hercher@hpi.uni-potsdam.de email: Harald.Sack@hpi.uni-potsdam.de
http://www.hpi.uni-potsdam.de/meinel/forschung/future_internet/semantic_technologies.html
http://www.projekt-mediaglobe.de/