Talk about conversion of Amsterdam Museum metadata to Europeana Data Model, linking it to other data sources and publishing it as Linked Open Data

1. www.europeanaconnect.eu
Amsterdam Museum as EDM LOD
Victor de Boer -- VU University Amsterdam
With input from Antoine Isaac, Jan Wielemaker, Jacco van
Ossenbruggen and Guus Schreiber

2. www.europeanaconnect.eu
Amsterdam Museum
• Formerly Amsterdam Historic Museum
• “The rich collection of works of art, objects and
archaeological finds brings to life the fortunes of
Amsterdammers of days gone by and today.”
• In March 2010 published their entire
collection online
• 70.000 objects
• CC license
• We converted their data to EDM / RDF and
published it as Linked Open Data
Amsterdam Museum as EDM LOD
Victor de Boer
Europeana v.1 WP3 Meeting
Vienna 28-29 March 2011

3. www.europeanaconnect.eu
Amsterdam Museum as EDM LOD
Victor de Boer
Europeana v.1 WP3 Meeting
Vienna 28-29 March 2011

4. www.europeanaconnect.eu
AM metadata
<record priref="10541“ >
<acquisition.date>1997</acquisition.date>
• Adlib database XML API <dimension>
<dimension.type>hoogte</dimension.type>
• Object metadata <dimension.unit>cm</dimension.unit>
<dimension.value>6</dimension.value>
</dimension>
• 73.000 objects, 256MB …
</record>
• Nested XML
• Concept Thesaurus <record priref="28024“ >
<term>Kalverstraat 124</term>
• 27.000, 9MB <broader_term>Kalverstraat</broader_term>
<term.type>GEOKEYW </term.type>
• Different types (geo,motif, event) </record>
• Person „Thesaurus‟ <record priref="6" >
<biography>boekverkoper en uitgever van
• 67.000 persons, 10MB cartografie</biography>
<birth.date.start>1659</birth.date.start>
• Consolidated from object metadata fields <death.date.start>1733</death.date.start>
<name>Aa, Pieter van der</name>
• Creators, annotators, reproduction creators, <nationality>Nederlands</nationality>
<use>Aa, Pieter van der (I)</use>
</record>
institutions
Amsterdam Museum as EDM LOD
Victor de Boer
Europeana v.1 WP3 Meeting
Vienna 28-29 March 2011

5. www.europeanaconnect.eu
Conversion and alignment process
1. pure syntactic transformation to RDF
Cliopatria
2. map to EDM classes/properties
(mapping table -> schema file)
3. conversion rules to restructure, XMLRDF
generate uris and do complex stuff
(XMLRDF tool)
4. align with Europeana and external Amalgame
sources
5. publish as LOD
Amsterdam Museum as EDM LOD
Victor de Boer
Europeana v.1 WP3 Meeting
Vienna 28-29 March 2011

6. www.europeanaconnect.eu
Direct RDF conversion
<record priref="10541“ >
<acq.date>1997</acqdate>
<dimension>
<dimension.type>hoogte</dimension.type>
<dimension.unit>cm</dimension.unit>
<dimension.value>6</dimension.value>
</dimension>
…
</record>
am:priref “10541”
am:acq.date “1997” am:dim.type “hoogte”
am:dim.value
am:Record “6”
am:dimension
_:bn1
am:Dimension
_:bn2
Amsterdam Museum as EDM LOD
Victor de Boer
Europeana v.1 WP3 Meeting
Vienna 28-29 March 2011

7. www.europeanaconnect.eu
Mapping schema file
am:creditLine a rdf:Property ;
• Turtle schema files rdfs:subPropertyOf dcterms:rights .
• rdfs:subClassOf + rdfs:subPropertyOf: Keep am:dimension a rdf:Property ;
rdfs:subPropertyOf dcterms:extent .
original (specific) data, interoperability on EDM
am:documentation a rdf:Property ;
level rdfs:subPropertyOf dcterms:description.
• For object metadata am:objectCategory a rdf:Property ;
rdfs:subPropertyOf dcterms:description.
• Dcterms: creator, date, description
• EDM-specific properties: event, agent am:scopeNote a rdf:Property ;
rdfs:subPropertyOf skos:scopeNote.
• Thesaurus concepts am:priref a rdf:Property ;
rdfs:subPropertyOf dcterms:identifier.
• SKOS + some dcterms
• Persons am:Person a rdfs:Class ;
rdfs:subClassOf ens:Agent.
• RDA Group 2 elements
am:equivalentName a rdf:Property ;
• http://metadataregistry.org/schema/show/id/1 rdfs:subPropertyOf rda:variantNameForThePerson.
am:name a rdf:Property ;
5.html rdfs:subPropertyOf rda:preferredNameForThePerson.
Amsterdam Museum as EDM LOD
Victor de Boer
Europeana v.1 WP3 Meeting
Vienna 28-29 March 2011

8. www.europeanaconnect.eu
XMLRDF Conversion
• RDF interpretation of the data. Minimal enrichment
• Refer to resources rather then to terms
• Identify the resource and replace literals by URIs
• Clean up (remove empty vals)
• Some blank node structures retained < am:proxy1, am:maker, _:bnode1>
< _:bnode1, am:creator, am:p-001>
• Mint URIs < _:bnode1, am:creatorRole, am:t-printer>
< _:bnode1, am: creatorQual, “copy after”>
• PURL basename: purl.org/collections/nl/am/
• Use prirefs, prefixed by “proxy-”, “aggregation-”,
“p-” or “t-”
• Make EDM dimensions @@
{ _S, am:dimension, B},
• Establish Proxy-Aggregation-PhysObject triangle { B, am:dimensionValue, literal(Val)},
{ B, am:dimensionUnit, literal(Unit)}?,
• Move predicates to appropriate resource { B, am:dimensionType, literal(Type)}?

• Images (ens:object) concat ([Type,Val,Unit], ConcatVal),
{B, rdfs:label, literal(ConcatVal)}.
Amsterdam Museum as EDM LOD
Victor de Boer
Europeana v.1 WP3 Meeting
Vienna 28-29 March 2011

9. www.europeanaconnect.eu
XMLRDF Conversion
• Conversion rules are simple for flat record structures but more
complex for richer data.
• APEnet
• Amsterdam Museum
• (Initial) rules can be generated from other visual ingestion
tools.
• Simple rules, but with the full expressivity of programming language
• ~ 6 Million Amsterdam Museum RDF triples
Amsterdam Museum as EDM LOD
Victor de Boer
Europeana v.1 WP3 Meeting
Vienna 28-29 March 2011

10. www.europeanaconnect.eu
Amalgame Alignment: Thesaurus
http://semanticweb.cs.vu.nl/amalgame/
• 143 links to
GeoNames NL
• 2498 AM concepts
linked to AATNed.
• 1322 links to be
checked
Amsterdam Museum as EDM LOD
Victor de Boer
Europeana v.1 WP3 Meeting
Vienna 28-29 March 2011

11. www.europeanaconnect.eu
Amalgame Alignment: Persons
• 1076 AM persons
matched to ULAN
(VIAF)
• 34 matched to
DBPedia
• More for human
check
Amsterdam Museum as EDM LOD
Victor de Boer
Europeana v.1 WP3 Meeting
Vienna 28-29 March 2011

12. www.europeanaconnect.eu
Serving the Data
• PURL redirects to semantic layer
• http://purl.org/collections/nl/am/proxy-63432 
• http://semanticweb.cs.vu.nl/europeana/browse/list_resource?r=htt
p://purl.org/collections/nl/am/proxy-63432
• HTTP request HTML:
• Condensed Local view
• Full Local view
• HTTP request RDF/XML
• rdf/xml “describe”
• SPARQL endpoint
Amsterdam Museum as EDM LOD
Victor de Boer
Europeana v.1 WP3 Meeting
Vienna 28-29 March 2011

13. www.europeanaconnect.eu
Amsterdam Museum as EDM LOD
Victor de Boer
Europeana v.1 WP3 Meeting
Vienna 28-29 March 2011

14. www.europeanaconnect.eu
Amsterdam Museum as EDM LOD
Victor de Boer
Europeana v.1 WP3 Meeting
Vienna 28-29 March 2011

15. www.europeanaconnect.eu
http://semanticweb.cs.vu.nl/europeana/user/query
Amsterdam Museum as EDM LOD
Victor de Boer
Europeana v.1 WP3 Meeting
Vienna 28-29 March 2011

16. www.europeanaconnect.eu
Linked Open Data
• Registered on CKAN
• More links
• to Amsterdam Rijksmonumenten
• to Amsterdam Stadsarchief
• to DBPedia (SILK): LATC
• Used by external parties/projects
• Oneindig NH
• Apps for Amsterdam
• Europeana Hackathon this friday/saturday
Amsterdam Museum as EDM LOD
Victor de Boer
Europeana v.1 WP3 Meeting
Vienna 28-29 March 2011

17. www.europeanaconnect.eu
URL pointers
• Amsterdam Museum in EDM LOD
• http://semanticweb.cs.vu.nl/lod/am/
• http://ckan.net/package/amsterdam-museum-as-edm-lod
• Thoughtlab
• Semantic layer
• [Browse] http://semanticweb.cs.vu.nl/europeana/
• [SPARQL] http://semanticweb.cs.vu.nl/europeana/user/query
• Tools
• [ClioPatria] http://e-culture.multimedian.nl/software/ClioPatria.shtml
• [xmlrdf] http://semanticweb.cs.vu.nl/Connect/xmlrdf.pdf
• [Amalgame] http://semanticweb.cs.vu.nl/amalgame/
Amsterdam Museum as EDM LOD
Victor de Boer
Europeana v.1 WP3 Meeting
Vienna 28-29 March 2011