This document discusses using linked open data to cluster and search cultural heritage collections. It describes how the Rijksmuseum annotates its collection of over 1 million objects using crowdsourcing. Experts in niche topics help annotate items. Linked data is used to connect objects by properties like creator, subject, and related terms. This enriched data powers a graph search algorithm to cluster related objects and find paths between them. The system was demonstrated in a touch interface app for exploring the collection.

1. Clustering Cultural Heritage Objects
Using Linked Data
Chris Dijkshoorn, Lora Aroyo and Guus Schreiber

2. Improve Access
to Collections
Rijksmuseum Amsterdam
-
Collection of ~1.000.000 items
-
Print collection of ~600.000 prints
-
Artworks on display ~8.000

3. Digitising Artworks
Print Room Online Project
-
Make artworks accessible online
-
Professional catalogers
-
Process
•
Register artwork
•
Provide annotations
•
Digitise artwork

4. Annotating Artworks
Annotation Problems
-
Focus on art-historical information
-
Occasional lack of expertise regarding
subject matter annotations
SEALINCMedia Project
-
Crowdsource annotation process
-
Find niche groups with required
expertise

5. SEALINCMedia Niche Sourcing
Crowd
Niche
Niche
Experts
Experts
Niche
Experts
Annotations
Cultural
Heritage
Collection
User
Modelling
Cluster
Search
Trust

6. Nichesourcing Annotations
Niche
Expert
Japanese
Redstart
Goal
-
Find clusters of artworks
-
Find related artworks

7. Cluster Search Linked Data
User Tags
Union List
Of Artist
Names
Art &
Architecture
Thesaurus
Iconclass
1. URIs are used to name
resources
2. HTTP URIs are used so
the resource can be
looked up
3. On looking up the URI
useful information is
returned according to
the standards
4. Links to other URIs are
included

8. Data Rijksmuseum
maker
title
material
Rembrandt van Rijn
“Jeremiah Lamenting the Destruction of Jerusalem”
oil paint

9. Linked Data Iconclass
maker
title
material
content
Rembrandt van Rijn
“Jeremiah Lamenting the Destruction of Jerusalem”
oil paint
71O77
label
has broader
“Jeremiah lamenting over the
destruction of Jerusalem“
71
label
“Old Testament”

10. Linked Data Art & Architecture Thesaurus
maker
title
material
content
Rembrandt van Rijn
“Jeremiah Lamenting the Destruction of Jerusalem”
oil paint
71O77
distinguished
from
label
has broader
oil pastels
“Jeremiah lamenting over the
destruction of Jerusalem“
71
label
“Old Testament”

11. Linked Data Union List of Artist Names
influenced
maker
title
material
content
Rembrandt van Rijn
Koninck, Salomon
teacher of
Bol, Ferdinand
“Jeremiah Lamenting the Destruction of Jerusalem”
oil paint
71O77
distinguished
from
label
has broader
oil pastels
“Jeremiah lamenting over the
destruction of Jerusalem“
71
label
“Old Testament”

12. Enriched Rijksmuseum Collection
influenced
maker
title
material
content
Rembrandt van Rijn
Koninck, Salomon
teacher of
Bol, Ferdinand
“Jeremiah Lamenting the Destruction of Jerusalem”
oil paint
71O77
distinguished
from
label
has broader
oil pastels
“Jeremiah lamenting over the
destruction of Jerusalem“
71
label
“Old Testament”

13. Cluster Search System
Based on MultimediaN Eculture Demonstrator
!
Prolog Backend — JavaScript Frontend
!
Graph Search Algorithm
!
!

14. Cluster Search Algorithm
• Match query with literal
• Find paths to artwork
• Use paths to create clusters
Query: Vermeer
“Vermeer and Exhibition
the Delft Style” Title
Type
Exhibition
Place
Tokyo
Place
ExhibitionDelft Style
Exhibition
Vrouw met
Kind
Type
Work

15. Cluster Challenge Ranking Clusters

16. Cluster Challenge Abstraction Level

17. Cluster Challenge Abstraction Level

18. Cluster Challenge Ranking Items Based on Trust

19. Cluster Search Touch Interface
Demo http://signpainter.herokuapp.com/

20. Cluster Search Touch Interface
Demo signpainter.herokuapp.com
• Explore collection using tablet
• Relevance feedback through
swipe gestures

21. Cluster Search Wrap Up
Demo
Github
Email
Poster
semanticweb.cs.vu.nl/clustersearch
github.com/rasvaan/cluster_search
c.r.dijkshoorn@vu.nl
73