Linked Data and Images: Building Blocks for Digital Cultural Heritage
Information Access Seminar, UC Berkeley, 18th of April 2014
1
Linked Data and Images:
Building Blocks for Digital Cultural Heritage
Robert Sanderson
azaroth42@gmail.com
azaroth@stanford.edu
t: @azaroth42
Digital Library Systems and Services
Stanford University
http://iiif.io/
This research was primarily funded by the Andrew W. Mellon Foundation
Linked Data and Images: Building Blocks for Digital Cultural Heritage
Information Access Seminar, UC Berkeley, 18th of April 2014
2
Linked Data
Linked data is the super-structure over
which content is stretched and experiences
flow. We can move beyond classifying
content using just hierarchies and start
describing the real world richness that
connects our content together.
“ ”
-- Dan Ramsden, BBC
http://www.bbc.co.uk/academy/technology/article/art20130720153136618
Linked Data and Images: Building Blocks for Digital Cultural Heritage
Information Access Seminar, UC Berkeley, 18th of April 2014
3
Linked Data
Linked Data and Images: Building Blocks for Digital Cultural Heritage
Information Access Seminar, UC Berkeley, 18th of April 2014
4
Linked Data
Linked Data and Images: Building Blocks for Digital Cultural Heritage
Information Access Seminar, UC Berkeley, 18th of April 2014
5
Linked Data
Linked Data and Images: Building Blocks for Digital Cultural Heritage
Information Access Seminar, UC Berkeley, 18th of April 2014
6
Everything Needs an Identifier
Imagine the reader’s / listener’s surprise to have these two confused...
Audre Lorde
1934-1992 Civil Rights Activist
Lorde
2012- Kiwi Solo Artist
Linked Data and Images: Building Blocks for Digital Cultural Heritage
Information Access Seminar, UC Berkeley, 18th of April 2014
7
Everything Needs an Identifier
Or these two.
Lordi
1992- Finnish Heavy Metal
Lorde
2012- Kiwi Solo Artist
Linked Data and Images: Building Blocks for Digital Cultural Heritage
Information Access Seminar, UC Berkeley, 18th of April 2014
8
Identifiers: Building Blocks of Linked Data
Linked Data and Images: Building Blocks for Digital Cultural Heritage
Information Access Seminar, UC Berkeley, 18th of April 2014
9
Building Blocks of Linked Data
The ability to bring resources together,
regardless of where they are on the web,
is crucial for cultural heritage
Linked Data and Images: Building Blocks for Digital Cultural Heritage
Information Access Seminar, UC Berkeley, 18th of April 2014
10
Building Blocks of Linked Data
We can re-use blocks from different sets together
making new applications from existing data
Linked Data and Images: Building Blocks for Digital Cultural Heritage
Information Access Seminar, UC Berkeley, 18th of April 2014
11
Linked Data for Cultural Heritage
Dublin Core FOAF RDF/S
OAI-ORE
Europeana
Data Model
Digital Manuscripts
to Europeana
DPLA
Data Model
Linked Data and Images: Building Blocks for Digital Cultural Heritage
Information Access Seminar, UC Berkeley, 18th of April 2014
12
Linked Data for Cultural Heritage
Dublin Core FOAF RDF/S
OAI-ORE
Europeana
Data Model
Digital Manuscripts
to Europeana
DPLA
Data Model
Linked Data and Images: Building Blocks for Digital Cultural Heritage
Information Access Seminar, UC Berkeley, 18th of April 2014
13
Europeana
Linked Data and Images: Building Blocks for Digital Cultural Heritage
Information Access Seminar, UC Berkeley, 18th of April 2014
14
Europeana -> Manuscriptorium
Linked Data and Images: Building Blocks for Digital Cultural Heritage
Information Access Seminar, UC Berkeley, 18th of April 2014
15
Manuscriptorium
Linked Data and Images: Building Blocks for Digital Cultural Heritage
Information Access Seminar, UC Berkeley, 18th of April 2014
16
Linked Data for Cultural Heritage
Dublin Core FOAF RDF/S
OAI-ORE
Europeana
Data Model
Digital Manuscripts
to Europeana
DPLA
Data Model
Linked Data and Images: Building Blocks for Digital Cultural Heritage
Information Access Seminar, UC Berkeley, 18th of April 2014
17
DPLA
Linked Data and Images: Building Blocks for Digital Cultural Heritage
Information Access Seminar, UC Berkeley, 18th of April 2014
18
DPLA -> Harvard
Linked Data and Images: Building Blocks for Digital Cultural Heritage
Information Access Seminar, UC Berkeley, 18th of April 2014
19
Harvard
Linked Data and Images: Building Blocks for Digital Cultural Heritage
Information Access Seminar, UC Berkeley, 18th of April 2014
20
DPLA
Linked Data and Images: Building Blocks for Digital Cultural Heritage
Information Access Seminar, UC Berkeley, 18th of April 2014
21
DPLA -> South Carolina
Linked Data and Images: Building Blocks for Digital Cultural Heritage
Information Access Seminar, UC Berkeley, 18th of April 2014
22
Meet Otto and Ben
Otto Ege,
20th c. Biblioclast
Ben Albritton
21st c. Manuscript
Scholar
Linked Data and Images: Building Blocks for Digital Cultural Heritage
Information Access Seminar, UC Berkeley, 18th of April 2014
23
Meet Otto and Ben
Otto Ege,
20th c. Biblioclast
Ben Albritton
21st c. Manuscript
Scholar
Linked Data and Images: Building Blocks for Digital Cultural Heritage
Information Access Seminar, UC Berkeley, 18th of April 2014
24
Otto Ege MS 1, as of 1940
Linked Data and Images: Building Blocks for Digital Cultural Heritage
Information Access Seminar, UC Berkeley, 18th of April 2014
25
Remnants of Otto Ege MS 1, as of 2014
Linked Data and Images: Building Blocks for Digital Cultural Heritage
Information Access Seminar, UC Berkeley, 18th of April 2014
26
Remnants of Otto Ege MS 1, as of 2014
Linked Data and Images: Building Blocks for Digital Cultural Heritage
Information Access Seminar, UC Berkeley, 18th of April 2014
27
Stanford’s Leaves of Ege MS 1
Linked Data and Images: Building Blocks for Digital Cultural Heritage
Information Access Seminar, UC Berkeley, 18th of April 2014
28
Welcome to Silo-ville
Grain elevators, Caldwell, Idaho, by Lee Russell, 1941. http://www.loc.gov/pictures/resource/fsac.1a34206/
Linked Data and Images: Building Blocks for Digital Cultural Heritage
Information Access Seminar, UC Berkeley, 18th of April 2014
29
Welcome to Silo-ville
Grain elevators, Caldwell, Idaho, by Lee Russell, 1941. http://www.loc.gov/pictures/resource/fsac.1a34206/
?
Linked Data and Images: Building Blocks for Digital Cultural Heritage
Information Access Seminar, UC Berkeley, 18th of April 2014
30
Welcome to Silo-ville
•  Every repository a silo à no interoperability
•  Every app a one-off à massive overheads
•  Every user forced to cope à much frustration
Parker
Data Store
Parker App
Rose
Data Store
Rose App
BnF
Data Store
Gallica
St. Gall
Data Store
St. Gall App
X
Data Store
App X
Linked Data and Images: Building Blocks for Digital Cultural Heritage
Information Access Seminar, UC Berkeley, 18th of April 2014
31
Enter: IIIF
International Image Interoperability Framework
A global framework by which image-based resources
…from any participating institution can be
delivered in a standard way
…via any compatible image server
…for display, manipulation and
annotation in any application,
…to any user on the Web,
…in any combination of elements.
Linked Data and Images: Building Blocks for Digital Cultural Heritage
Information Access Seminar, UC Berkeley, 18th of April 2014
32
International Image Interoperability Framework
•  ARTstor
•  Bibliothèque Nationale de
France
•  Bodleian Libraries, Oxford
University
•  British Library
•  Cambridge University
•  Cornell University
•  DPLA
•  Europeana
•  e-codices
•  Harvard University
•  Johns Hopkins University
•  le Louvre
•  National Library of Denmark
•  National Library of New Zealand
•  National Library of Norway
•  National Library of Wales
•  Princeton University
•  St. Louis University, TPEN
•  Stanford University
•  Wellcome Trust
•  UK National Archives
•  Yale University
Linked Data and Images: Building Blocks for Digital Cultural Heritage
Information Access Seminar, UC Berkeley, 18th of April 2014
33
International Image Interoperability Framework
•  ARTstor
•  Bibliothèque Nationale de
France
•  Bodleian Libraries, Oxford
University
•  British Library
•  Cambridge University
•  Cornell University
•  DPLA
•  Europeana
•  e-codices
•  Harvard University
•  Johns Hopkins University
•  le Louvre
•  National Library of Denmark
•  National Library of New Zealand
•  National Library of Norway
•  National Library of Wales
•  Princeton University
•  St. Louis University, TPEN
•  Stanford University
•  Wellcome Trust
•  UK National Archives
•  Yale University
•  Bancroft Library, UC Berkeley?
Linked Data and Images: Building Blocks for Digital Cultural Heritage
Information Access Seminar, UC Berkeley, 18th of April 2014
34
Linked Data for Cultural Heritage
Dublin Core FOAF RDF/S
OAI-ORE
Europeana
Data Model
Digital Manuscripts
to Europeana
Open
Annotation
EXIF
IIIF
Image
Shared Canvas
IIIF Presentation API
Linked Data and Images: Building Blocks for Digital Cultural Heritage
Information Access Seminar, UC Berkeley, 18th of April 2014
35
Linked Data for Cultural Heritage
Dublin Core FOAF RDF/S
OAI-ORE
Europeana
Data Model
Digital Manuscripts
to Europeana
Shared Canvas
IIIF Presentation API
Open
Annotation
EXIF
IIIF
Image
Linked Data and Images: Building Blocks for Digital Cultural Heritage
Information Access Seminar, UC Berkeley, 18th of April 2014
36
Shared Canvas / IIIF Presentation API
Just enough metadata to support a client presenting the digital
Cultural Heritage Object for the user to understand what she is
interacting with
Why “Presentation API”?
•  NOT a[nother] full semantic, bibliographic metadata “standard”
•  NOT (necessarily) an internal format: transform into it
•  Linked Open Data (RDF)
•  Rationalization of (abstract) Shared Canvas data model
•  Full support for annotation via Open Annotation
•  http://iiif.io/api/metadata/1.0/
Linked Data and Images: Building Blocks for Digital Cultural Heritage
Information Access Seminar, UC Berkeley, 18th of April 2014
37
Shared Canvas
• A Canvas is an empty space in which to build up a display
Linked Data and Images: Building Blocks for Digital Cultural Heritage
Information Access Seminar, UC Berkeley, 18th of April 2014
38
Shared Canvas
• A Canvas is an empty space in which to build up a display
• A SharedCanvas's top left and bottom right corners correspond to
the equivalent corners of a page
Linked Data and Images: Building Blocks for Digital Cultural Heritage
Information Access Seminar, UC Berkeley, 18th of April 2014
39
Shared Canvas / Open Annotation
•  Annotation links Image with Canvas
Linked Data and Images: Building Blocks for Digital Cultural Heritage
Information Access Seminar, UC Berkeley, 18th of April 2014
40
Shared Canvas / Open Annotation
•  Annotation links Text with Canvas
Linked Data and Images: Building Blocks for Digital Cultural Heritage
Information Access Seminar, UC Berkeley, 18th of April 2014
41
Shared Canvas / Open Annotation
Linked Data and Images: Building Blocks for Digital Cultural Heritage
Information Access Seminar, UC Berkeley, 18th of April 2014
42
Benefits of Canvas Notion
Multiple Images of same page
•  Multi-spectral imaging, multiple digitizations, …
Archimedes Palimpsest Multi-Spectral Images
http://www.archimedespalimpsest.org/
Linked Data and Images: Building Blocks for Digital Cultural Heritage
Information Access Seminar, UC Berkeley, 18th of April 2014
43
Benefits of Canvas Notion
No image of the page
•  Hypothetical, lost, too fragile to digitize, …
This page intentionally,
but unfortunately,
left blank
Countless manuscripts, all around the world!
Linked Data and Images: Building Blocks for Digital Cultural Heritage
Information Access Seminar, UC Berkeley, 18th of April 2014
44
Benefits of Canvas Notion
Partial images
•  Fragments of page, details in high resolution, …
Linked Data and Images: Building Blocks for Digital Cultural Heritage
Information Access Seminar, UC Berkeley, 18th of April 2014
45
Benefits of Canvas Notion
Non Image and External content
•  Text – transcription, translation, edition, …
•  Non-text transcription: diagrams, music
•  Non text performance: audio, video
Linked Data and Images: Building Blocks for Digital Cultural Heritage
Information Access Seminar, UC Berkeley, 18th of April 2014
46
Benefits of Canvas Notion
Content for a single canvas can come from multiple “repositories”
•  Actually, all around the web…
Linked Data and Images: Building Blocks for Digital Cultural Heritage
Information Access Seminar, UC Berkeley, 18th of April 2014
47
Benefits of Canvas Notion
Content for a single canvas can come from multiple “repositories”
•  Actually, all around the web…
Linked Data and Images: Building Blocks for Digital Cultural Heritage
Information Access Seminar, UC Berkeley, 18th of April 2014
48
Shared Canvas: Primary Resources
Linked Data and Images: Building Blocks for Digital Cultural Heritage
Information Access Seminar, UC Berkeley, 18th of April 2014
49
Shared Canvas: Metadata
Linked Data and Images: Building Blocks for Digital Cultural Heritage
Information Access Seminar, UC Berkeley, 18th of April 2014
50
Shared Canvas: All Resources
Linked Data and Images: Building Blocks for Digital Cultural Heritage
Information Access Seminar, UC Berkeley, 18th of April 2014
51
IIIF Presentation API: URI Structure
Base URL: {scheme}://{host}{/prefix}/{identifier}!
!
Resources:
{base}/manifest.json!
{base}/sequence/{name}.json!
{base}/canvas/{name}.json!
{base}/annotation/{name}.json !
Linked Data and Images: Building Blocks for Digital Cultural Heritage
Information Access Seminar, UC Berkeley, 18th of April 2014
52
IIIF Presentation API: Response
Syntax: JSON-LD!
{ // Canvas example!
"@context":"http://www.shared-canvas.org/ns/context.json",!
"@id":"http://www.example.org/iiif/book1/canvas/p1.json",!
"@type":"sc:Canvas”,!
"label":"p. 1”,!
"height":1000,!
"width":750,!
"images": [!
{"@type":"oa:Annotation”,!
// annotation linking image to canvas …!
}],!
"otherContent": [!
{"@type":"sc:AnnotationList",!
// reference to list of non-image annotations …!
}]!
} !
!
!
Linked Data and Images: Building Blocks for Digital Cultural Heritage
Information Access Seminar, UC Berkeley, 18th of April 2014
53
Rant: RDF Serialization
“RDF/XML was the Semantic Web’s 3 Mile Island incident”
-- Manu Sporny, http://manu.sporny.org/2012/nuclear-rdf/
Or … RDF – Not in my back yard!
•  Serializing a graph is, admittedly, hard
•  RDF/XML is terrible, and too many others
•  Web currently uses JSON as convenient transfer syntax
•  JSON-LD allows transfer of RDF in syntax that does not require full
RDF stack, just a JSON implementation
•  … as available in every web browser
•  Conclusion: Require JSON-LD
•  http://json-ld.org/
Linked Data and Images: Building Blocks for Digital Cultural Heritage
Information Access Seminar, UC Berkeley, 18th of April 2014
54
JSON-LD Context Magic
{ // Canvas example!
"@context":"http://www.shared-canvas.org/ns/context.json",!
!
!
@context provides mapping for JSON keys into RDF.
!
"sc":"http://www.shared-canvas.org/ns/",!
"oa":"http://www.w3.org/ns/oa#",!
"service":{!
"@type":"@id", !
"@id":"sc:hasRelatedService"},!
"height":{!
"@type":"xsd:integer", !
"@id":"exif:height"},!
"sequences":{!
"@type":"@id",!
"@id":"sc:hasSequences",!
"@container":"@list"} !
Linked Data and Images: Building Blocks for Digital Cultural Heritage
Information Access Seminar, UC Berkeley, 18th of April 2014
55
Linked Data for Cultural Heritage
Dublin Core FOAF RDF/S
OAI-ORE
Europeana
Data Model
Digital Manuscripts
to Europeana
Open
Annotation
EXIF
IIIF
Image
Shared Canvas
IIIF Presentation API
Linked Data and Images: Building Blocks for Digital Cultural Heritage
Information Access Seminar, UC Berkeley, 18th of April 2014
56
Open Annotation: Community Group
Established W3C Community Group in 2011
Now 4th Largest of 174 groups: 125 participants
W3C in the process of starting an Annotation Working Group
http://www.w3.org/community/openannotation/
Interoperability between Annotation systems and platforms, by
…following the Architecture of the Web
…reusing existing web standards
…providing a single, coherent model to implement
…which is orthogonal to the domain of interest
…without requiring adoption of specific platforms
…while maintaining low implementation costs
Mission:
Linked Data and Images: Building Blocks for Digital Cultural Heritage
Information Access Seminar, UC Berkeley, 18th of April 2014
57
Open Annotation: Basic Data Model
http://www.openannotation.org/spec/core/
Linked Data and Images: Building Blocks for Digital Cultural Heritage
Information Access Seminar, UC Berkeley, 18th of April 2014
58
Open Annotation: Basic Data Model
Linked Data and Images: Building Blocks for Digital Cultural Heritage
Information Access Seminar, UC Berkeley, 18th of April 2014
59
Open Annotation: Specific Resources
Specific Body and Specific Target resources identify the region of
interest, and/or the state of the resource.
Need to be able to describe the state of the resource, the segment
of interest, and potentially styling hints for how to render it.
We introduce:
State Describes how to retrieve representation
Selector Describes how to select segment
Style Describes how to render/process segment
Scope Describes context of the resource
Linked Data and Images: Building Blocks for Digital Cultural Heritage
Information Access Seminar, UC Berkeley, 18th of April 2014
60
Open Annotation: Specific Resources
Linked Data and Images: Building Blocks for Digital Cultural Heritage
Information Access Seminar, UC Berkeley, 18th of April 2014
61
Linked Data for Cultural Heritage
Dublin Core FOAF RDF/S
OAI-ORE
Europeana
Data Model
Digital Manuscripts
to Europeana
Open
Annotation
EXIF
IIIF
Image
Shared Canvas
IIIF Presentation API
Linked Data and Images: Building Blocks for Digital Cultural Heritage
Information Access Seminar, UC Berkeley, 18th of April 2014
62
IIIF Image API
Base URL: {scheme}://{host}{/prefix}/{identifier}!
Image Resource:
{base}/{region}/{size}/{rotation}/{quality}.{format}!
!
Linked Data and Images: Building Blocks for Digital Cultural Heritage
Information Access Seminar, UC Berkeley, 18th of April 2014
63
IIIF Image API: Region
Image Resource:
{base}/{region}/{size}/{rotation}/{quality}.{format}!
!
!
•  Full Image:
{base}/full/full/0/native.jpg!
!
•  Area by Pixels:
{base}/100,100,640,480/full/0/native.jpg!
!
•  Area by Percentage:
{base}/pct:50,50,33,33/full/0/native.jpg!
Linked Data and Images: Building Blocks for Digital Cultural Heritage
Information Access Seminar, UC Berkeley, 18th of April 2014
64
IIIF Image API: Size
Image Resource:
{base}/{region}/{size}/{rotation}/{quality}.{format}!
!
•  Full Image:
{base}/full/full/0/native.jpg!
•  Size by Pixels, forced aspect:
{base}/full/640,480/0/native.jpg!
•  Size by Pixels, aspect preserved:
{base}/full/!640,480/0/native.jpg!
•  Size by Percentage:
{base}/full/pct:50/0/native.jpg!
•  Size by Width, or by Height: !
{base}/full/,480/0/native.jpg!
{base}/full/640,/0/native.jpg !
Linked Data and Images: Building Blocks for Digital Cultural Heritage
Information Access Seminar, UC Berkeley, 18th of April 2014
65
IIIF Image API: Rotation
Image Resource:
{base}/{region}/{size}/{rotation}/{quality}.{format}!
!
•  Full Image:
{base}/full/full/0/native.jpg!
!
•  90 degree Rotation:
{base}/full/full/90/native.jpg!
{base}/full/full/180/native.jpg!
{base}/full/full/270/native.jpg!
!
•  Arbitrary Rotation:
{base}/full/full/27.6/native.jpg!
!
!
!
Linked Data and Images: Building Blocks for Digital Cultural Heritage
Information Access Seminar, UC Berkeley, 18th of April 2014
66
IIIF Image API: Quality
Image Resource:
{base}/{region}/{size}/{rotation}/{quality}.{format}!
!
•  Full Image:
{base}/full/full/0/native.jpg!
!
•  Explicit Option:
{base}/full/full/0/color.jpg!
{base}/full/full/0/grey.jpg!
{base}/full/full/0/bitonal.jpg!
!
!
Linked Data and Images: Building Blocks for Digital Cultural Heritage
Information Access Seminar, UC Berkeley, 18th of April 2014
67
IIIF Image API: Format
Image Resource:
{base}/{region}/{size}/{rotation}/{quality}.{format}!
!
•  Full Image:
{base}/full/full/0/native.jpg!
!
•  Other Options:
{base}/full/full/0/native.png!
{base}/full/full/0/native.tif!
{base}/full/full/0/native.gif!
{base}/full/full/0/native.jp2!
{base}/full/full/0/native.pdf!
!
!
Linked Data and Images: Building Blocks for Digital Cultural Heritage
Information Access Seminar, UC Berkeley, 18th of April 2014
68
IIIF Image API: Technical Info
Information Resource, in JSON-LD:
{base}/info.json!
!
!
!
!
!
{!
"@context":"http://library.stanford.edu/iiif/image-api/1.1/context.json",!
"@id":"http://www.example.org/iiif/book1-p1",!
"height": 6000,!
"width": 4000,!
"scale_factors": [ 1, 2, 4, 8 ],!
"tile_height": 512,!
"tile_width": 512,!
"formats": ["jpg", "png", "gif" ],!
"qualities": ["native", "color", "grey", "bitonal"],!
"profile": "http://library.stanford.edu/iiif/image-api/1.1/

compliance.html#level1"!
} !
!
!
Linked Data and Images: Building Blocks for Digital Cultural Heritage
Information Access Seminar, UC Berkeley, 18th of April 2014
69
IIIF Application: Mise-en-Page
Linked Data and Images: Building Blocks for Digital Cultural Heritage
Information Access Seminar, UC Berkeley, 18th of April 2014
70
IIIF Application: Mirador
Linked Data and Images: Building Blocks for Digital Cultural Heritage
Information Access Seminar, UC Berkeley, 18th of April 2014
71
IIIF Application: Mirador (MeP fork)
Linked Data and Images: Building Blocks for Digital Cultural Heritage
Information Access Seminar, UC Berkeley, 18th of April 2014
72
Remnants of Otto Ege MS 1, as of 2014
Linked Data and Images: Building Blocks for Digital Cultural Heritage
Information Access Seminar, UC Berkeley, 18th of April 2014
73
Otto Ege MS 1, Reconstructed, in 2014
Linked Data and Images: Building Blocks for Digital Cultural Heritage
Information Access Seminar, UC Berkeley, 18th of April 2014
74
Otto Ege MS 1, Reconstructed, in 2014
Linked Data and Images: Building Blocks for Digital Cultural Heritage
Information Access Seminar, UC Berkeley, 18th of April 2014
75
Linked Data and Images: Building Blocks for Cultural Heritage
Linked Data and Images: Building Blocks for Digital Cultural Heritage
Information Access Seminar, UC Berkeley, 18th of April 2014
76
Thank You
Robert Sanderson
azaroth42@gmail.com
azaroth@stanford.edu
@azaroth42
Web: http://iiif.io/
http://www.shared-canvas.org/
http://www.openannotation.org/
Slides: http://slidesha.re/xxxyyy
Apologies for unattributed images!

Linked Data and Images: Building Blocks for Cultural Heritage

  • 1.
    Linked Data andImages: Building Blocks for Digital Cultural Heritage Information Access Seminar, UC Berkeley, 18th of April 2014 1 Linked Data and Images: Building Blocks for Digital Cultural Heritage Robert Sanderson azaroth42@gmail.com azaroth@stanford.edu t: @azaroth42 Digital Library Systems and Services Stanford University http://iiif.io/ This research was primarily funded by the Andrew W. Mellon Foundation
  • 2.
    Linked Data andImages: Building Blocks for Digital Cultural Heritage Information Access Seminar, UC Berkeley, 18th of April 2014 2 Linked Data Linked data is the super-structure over which content is stretched and experiences flow. We can move beyond classifying content using just hierarchies and start describing the real world richness that connects our content together. “ ” -- Dan Ramsden, BBC http://www.bbc.co.uk/academy/technology/article/art20130720153136618
  • 3.
    Linked Data andImages: Building Blocks for Digital Cultural Heritage Information Access Seminar, UC Berkeley, 18th of April 2014 3 Linked Data
  • 4.
    Linked Data andImages: Building Blocks for Digital Cultural Heritage Information Access Seminar, UC Berkeley, 18th of April 2014 4 Linked Data
  • 5.
    Linked Data andImages: Building Blocks for Digital Cultural Heritage Information Access Seminar, UC Berkeley, 18th of April 2014 5 Linked Data
  • 6.
    Linked Data andImages: Building Blocks for Digital Cultural Heritage Information Access Seminar, UC Berkeley, 18th of April 2014 6 Everything Needs an Identifier Imagine the reader’s / listener’s surprise to have these two confused... Audre Lorde 1934-1992 Civil Rights Activist Lorde 2012- Kiwi Solo Artist
  • 7.
    Linked Data andImages: Building Blocks for Digital Cultural Heritage Information Access Seminar, UC Berkeley, 18th of April 2014 7 Everything Needs an Identifier Or these two. Lordi 1992- Finnish Heavy Metal Lorde 2012- Kiwi Solo Artist
  • 8.
    Linked Data andImages: Building Blocks for Digital Cultural Heritage Information Access Seminar, UC Berkeley, 18th of April 2014 8 Identifiers: Building Blocks of Linked Data
  • 9.
    Linked Data andImages: Building Blocks for Digital Cultural Heritage Information Access Seminar, UC Berkeley, 18th of April 2014 9 Building Blocks of Linked Data The ability to bring resources together, regardless of where they are on the web, is crucial for cultural heritage
  • 10.
    Linked Data andImages: Building Blocks for Digital Cultural Heritage Information Access Seminar, UC Berkeley, 18th of April 2014 10 Building Blocks of Linked Data We can re-use blocks from different sets together making new applications from existing data
  • 11.
    Linked Data andImages: Building Blocks for Digital Cultural Heritage Information Access Seminar, UC Berkeley, 18th of April 2014 11 Linked Data for Cultural Heritage Dublin Core FOAF RDF/S OAI-ORE Europeana Data Model Digital Manuscripts to Europeana DPLA Data Model
  • 12.
    Linked Data andImages: Building Blocks for Digital Cultural Heritage Information Access Seminar, UC Berkeley, 18th of April 2014 12 Linked Data for Cultural Heritage Dublin Core FOAF RDF/S OAI-ORE Europeana Data Model Digital Manuscripts to Europeana DPLA Data Model
  • 13.
    Linked Data andImages: Building Blocks for Digital Cultural Heritage Information Access Seminar, UC Berkeley, 18th of April 2014 13 Europeana
  • 14.
    Linked Data andImages: Building Blocks for Digital Cultural Heritage Information Access Seminar, UC Berkeley, 18th of April 2014 14 Europeana -> Manuscriptorium
  • 15.
    Linked Data andImages: Building Blocks for Digital Cultural Heritage Information Access Seminar, UC Berkeley, 18th of April 2014 15 Manuscriptorium
  • 16.
    Linked Data andImages: Building Blocks for Digital Cultural Heritage Information Access Seminar, UC Berkeley, 18th of April 2014 16 Linked Data for Cultural Heritage Dublin Core FOAF RDF/S OAI-ORE Europeana Data Model Digital Manuscripts to Europeana DPLA Data Model
  • 17.
    Linked Data andImages: Building Blocks for Digital Cultural Heritage Information Access Seminar, UC Berkeley, 18th of April 2014 17 DPLA
  • 18.
    Linked Data andImages: Building Blocks for Digital Cultural Heritage Information Access Seminar, UC Berkeley, 18th of April 2014 18 DPLA -> Harvard
  • 19.
    Linked Data andImages: Building Blocks for Digital Cultural Heritage Information Access Seminar, UC Berkeley, 18th of April 2014 19 Harvard
  • 20.
    Linked Data andImages: Building Blocks for Digital Cultural Heritage Information Access Seminar, UC Berkeley, 18th of April 2014 20 DPLA
  • 21.
    Linked Data andImages: Building Blocks for Digital Cultural Heritage Information Access Seminar, UC Berkeley, 18th of April 2014 21 DPLA -> South Carolina
  • 22.
    Linked Data andImages: Building Blocks for Digital Cultural Heritage Information Access Seminar, UC Berkeley, 18th of April 2014 22 Meet Otto and Ben Otto Ege, 20th c. Biblioclast Ben Albritton 21st c. Manuscript Scholar
  • 23.
    Linked Data andImages: Building Blocks for Digital Cultural Heritage Information Access Seminar, UC Berkeley, 18th of April 2014 23 Meet Otto and Ben Otto Ege, 20th c. Biblioclast Ben Albritton 21st c. Manuscript Scholar
  • 24.
    Linked Data andImages: Building Blocks for Digital Cultural Heritage Information Access Seminar, UC Berkeley, 18th of April 2014 24 Otto Ege MS 1, as of 1940
  • 25.
    Linked Data andImages: Building Blocks for Digital Cultural Heritage Information Access Seminar, UC Berkeley, 18th of April 2014 25 Remnants of Otto Ege MS 1, as of 2014
  • 26.
    Linked Data andImages: Building Blocks for Digital Cultural Heritage Information Access Seminar, UC Berkeley, 18th of April 2014 26 Remnants of Otto Ege MS 1, as of 2014
  • 27.
    Linked Data andImages: Building Blocks for Digital Cultural Heritage Information Access Seminar, UC Berkeley, 18th of April 2014 27 Stanford’s Leaves of Ege MS 1
  • 28.
    Linked Data andImages: Building Blocks for Digital Cultural Heritage Information Access Seminar, UC Berkeley, 18th of April 2014 28 Welcome to Silo-ville Grain elevators, Caldwell, Idaho, by Lee Russell, 1941. http://www.loc.gov/pictures/resource/fsac.1a34206/
  • 29.
    Linked Data andImages: Building Blocks for Digital Cultural Heritage Information Access Seminar, UC Berkeley, 18th of April 2014 29 Welcome to Silo-ville Grain elevators, Caldwell, Idaho, by Lee Russell, 1941. http://www.loc.gov/pictures/resource/fsac.1a34206/ ?
  • 30.
    Linked Data andImages: Building Blocks for Digital Cultural Heritage Information Access Seminar, UC Berkeley, 18th of April 2014 30 Welcome to Silo-ville •  Every repository a silo à no interoperability •  Every app a one-off à massive overheads •  Every user forced to cope à much frustration Parker Data Store Parker App Rose Data Store Rose App BnF Data Store Gallica St. Gall Data Store St. Gall App X Data Store App X
  • 31.
    Linked Data andImages: Building Blocks for Digital Cultural Heritage Information Access Seminar, UC Berkeley, 18th of April 2014 31 Enter: IIIF International Image Interoperability Framework A global framework by which image-based resources …from any participating institution can be delivered in a standard way …via any compatible image server …for display, manipulation and annotation in any application, …to any user on the Web, …in any combination of elements.
  • 32.
    Linked Data andImages: Building Blocks for Digital Cultural Heritage Information Access Seminar, UC Berkeley, 18th of April 2014 32 International Image Interoperability Framework •  ARTstor •  Bibliothèque Nationale de France •  Bodleian Libraries, Oxford University •  British Library •  Cambridge University •  Cornell University •  DPLA •  Europeana •  e-codices •  Harvard University •  Johns Hopkins University •  le Louvre •  National Library of Denmark •  National Library of New Zealand •  National Library of Norway •  National Library of Wales •  Princeton University •  St. Louis University, TPEN •  Stanford University •  Wellcome Trust •  UK National Archives •  Yale University
  • 33.
    Linked Data andImages: Building Blocks for Digital Cultural Heritage Information Access Seminar, UC Berkeley, 18th of April 2014 33 International Image Interoperability Framework •  ARTstor •  Bibliothèque Nationale de France •  Bodleian Libraries, Oxford University •  British Library •  Cambridge University •  Cornell University •  DPLA •  Europeana •  e-codices •  Harvard University •  Johns Hopkins University •  le Louvre •  National Library of Denmark •  National Library of New Zealand •  National Library of Norway •  National Library of Wales •  Princeton University •  St. Louis University, TPEN •  Stanford University •  Wellcome Trust •  UK National Archives •  Yale University •  Bancroft Library, UC Berkeley?
  • 34.
    Linked Data andImages: Building Blocks for Digital Cultural Heritage Information Access Seminar, UC Berkeley, 18th of April 2014 34 Linked Data for Cultural Heritage Dublin Core FOAF RDF/S OAI-ORE Europeana Data Model Digital Manuscripts to Europeana Open Annotation EXIF IIIF Image Shared Canvas IIIF Presentation API
  • 35.
    Linked Data andImages: Building Blocks for Digital Cultural Heritage Information Access Seminar, UC Berkeley, 18th of April 2014 35 Linked Data for Cultural Heritage Dublin Core FOAF RDF/S OAI-ORE Europeana Data Model Digital Manuscripts to Europeana Shared Canvas IIIF Presentation API Open Annotation EXIF IIIF Image
  • 36.
    Linked Data andImages: Building Blocks for Digital Cultural Heritage Information Access Seminar, UC Berkeley, 18th of April 2014 36 Shared Canvas / IIIF Presentation API Just enough metadata to support a client presenting the digital Cultural Heritage Object for the user to understand what she is interacting with Why “Presentation API”? •  NOT a[nother] full semantic, bibliographic metadata “standard” •  NOT (necessarily) an internal format: transform into it •  Linked Open Data (RDF) •  Rationalization of (abstract) Shared Canvas data model •  Full support for annotation via Open Annotation •  http://iiif.io/api/metadata/1.0/
  • 37.
    Linked Data andImages: Building Blocks for Digital Cultural Heritage Information Access Seminar, UC Berkeley, 18th of April 2014 37 Shared Canvas • A Canvas is an empty space in which to build up a display
  • 38.
    Linked Data andImages: Building Blocks for Digital Cultural Heritage Information Access Seminar, UC Berkeley, 18th of April 2014 38 Shared Canvas • A Canvas is an empty space in which to build up a display • A SharedCanvas's top left and bottom right corners correspond to the equivalent corners of a page
  • 39.
    Linked Data andImages: Building Blocks for Digital Cultural Heritage Information Access Seminar, UC Berkeley, 18th of April 2014 39 Shared Canvas / Open Annotation •  Annotation links Image with Canvas
  • 40.
    Linked Data andImages: Building Blocks for Digital Cultural Heritage Information Access Seminar, UC Berkeley, 18th of April 2014 40 Shared Canvas / Open Annotation •  Annotation links Text with Canvas
  • 41.
    Linked Data andImages: Building Blocks for Digital Cultural Heritage Information Access Seminar, UC Berkeley, 18th of April 2014 41 Shared Canvas / Open Annotation
  • 42.
    Linked Data andImages: Building Blocks for Digital Cultural Heritage Information Access Seminar, UC Berkeley, 18th of April 2014 42 Benefits of Canvas Notion Multiple Images of same page •  Multi-spectral imaging, multiple digitizations, … Archimedes Palimpsest Multi-Spectral Images http://www.archimedespalimpsest.org/
  • 43.
    Linked Data andImages: Building Blocks for Digital Cultural Heritage Information Access Seminar, UC Berkeley, 18th of April 2014 43 Benefits of Canvas Notion No image of the page •  Hypothetical, lost, too fragile to digitize, … This page intentionally, but unfortunately, left blank Countless manuscripts, all around the world!
  • 44.
    Linked Data andImages: Building Blocks for Digital Cultural Heritage Information Access Seminar, UC Berkeley, 18th of April 2014 44 Benefits of Canvas Notion Partial images •  Fragments of page, details in high resolution, …
  • 45.
    Linked Data andImages: Building Blocks for Digital Cultural Heritage Information Access Seminar, UC Berkeley, 18th of April 2014 45 Benefits of Canvas Notion Non Image and External content •  Text – transcription, translation, edition, … •  Non-text transcription: diagrams, music •  Non text performance: audio, video
  • 46.
    Linked Data andImages: Building Blocks for Digital Cultural Heritage Information Access Seminar, UC Berkeley, 18th of April 2014 46 Benefits of Canvas Notion Content for a single canvas can come from multiple “repositories” •  Actually, all around the web…
  • 47.
    Linked Data andImages: Building Blocks for Digital Cultural Heritage Information Access Seminar, UC Berkeley, 18th of April 2014 47 Benefits of Canvas Notion Content for a single canvas can come from multiple “repositories” •  Actually, all around the web…
  • 48.
    Linked Data andImages: Building Blocks for Digital Cultural Heritage Information Access Seminar, UC Berkeley, 18th of April 2014 48 Shared Canvas: Primary Resources
  • 49.
    Linked Data andImages: Building Blocks for Digital Cultural Heritage Information Access Seminar, UC Berkeley, 18th of April 2014 49 Shared Canvas: Metadata
  • 50.
    Linked Data andImages: Building Blocks for Digital Cultural Heritage Information Access Seminar, UC Berkeley, 18th of April 2014 50 Shared Canvas: All Resources
  • 51.
    Linked Data andImages: Building Blocks for Digital Cultural Heritage Information Access Seminar, UC Berkeley, 18th of April 2014 51 IIIF Presentation API: URI Structure Base URL: {scheme}://{host}{/prefix}/{identifier}! ! Resources: {base}/manifest.json! {base}/sequence/{name}.json! {base}/canvas/{name}.json! {base}/annotation/{name}.json !
  • 52.
    Linked Data andImages: Building Blocks for Digital Cultural Heritage Information Access Seminar, UC Berkeley, 18th of April 2014 52 IIIF Presentation API: Response Syntax: JSON-LD! { // Canvas example! "@context":"http://www.shared-canvas.org/ns/context.json",! "@id":"http://www.example.org/iiif/book1/canvas/p1.json",! "@type":"sc:Canvas”,! "label":"p. 1”,! "height":1000,! "width":750,! "images": [! {"@type":"oa:Annotation”,! // annotation linking image to canvas …! }],! "otherContent": [! {"@type":"sc:AnnotationList",! // reference to list of non-image annotations …! }]! } ! ! !
  • 53.
    Linked Data andImages: Building Blocks for Digital Cultural Heritage Information Access Seminar, UC Berkeley, 18th of April 2014 53 Rant: RDF Serialization “RDF/XML was the Semantic Web’s 3 Mile Island incident” -- Manu Sporny, http://manu.sporny.org/2012/nuclear-rdf/ Or … RDF – Not in my back yard! •  Serializing a graph is, admittedly, hard •  RDF/XML is terrible, and too many others •  Web currently uses JSON as convenient transfer syntax •  JSON-LD allows transfer of RDF in syntax that does not require full RDF stack, just a JSON implementation •  … as available in every web browser •  Conclusion: Require JSON-LD •  http://json-ld.org/
  • 54.
    Linked Data andImages: Building Blocks for Digital Cultural Heritage Information Access Seminar, UC Berkeley, 18th of April 2014 54 JSON-LD Context Magic { // Canvas example! "@context":"http://www.shared-canvas.org/ns/context.json",! ! ! @context provides mapping for JSON keys into RDF. ! "sc":"http://www.shared-canvas.org/ns/",! "oa":"http://www.w3.org/ns/oa#",! "service":{! "@type":"@id", ! "@id":"sc:hasRelatedService"},! "height":{! "@type":"xsd:integer", ! "@id":"exif:height"},! "sequences":{! "@type":"@id",! "@id":"sc:hasSequences",! "@container":"@list"} !
  • 55.
    Linked Data andImages: Building Blocks for Digital Cultural Heritage Information Access Seminar, UC Berkeley, 18th of April 2014 55 Linked Data for Cultural Heritage Dublin Core FOAF RDF/S OAI-ORE Europeana Data Model Digital Manuscripts to Europeana Open Annotation EXIF IIIF Image Shared Canvas IIIF Presentation API
  • 56.
    Linked Data andImages: Building Blocks for Digital Cultural Heritage Information Access Seminar, UC Berkeley, 18th of April 2014 56 Open Annotation: Community Group Established W3C Community Group in 2011 Now 4th Largest of 174 groups: 125 participants W3C in the process of starting an Annotation Working Group http://www.w3.org/community/openannotation/ Interoperability between Annotation systems and platforms, by …following the Architecture of the Web …reusing existing web standards …providing a single, coherent model to implement …which is orthogonal to the domain of interest …without requiring adoption of specific platforms …while maintaining low implementation costs Mission:
  • 57.
    Linked Data andImages: Building Blocks for Digital Cultural Heritage Information Access Seminar, UC Berkeley, 18th of April 2014 57 Open Annotation: Basic Data Model http://www.openannotation.org/spec/core/
  • 58.
    Linked Data andImages: Building Blocks for Digital Cultural Heritage Information Access Seminar, UC Berkeley, 18th of April 2014 58 Open Annotation: Basic Data Model
  • 59.
    Linked Data andImages: Building Blocks for Digital Cultural Heritage Information Access Seminar, UC Berkeley, 18th of April 2014 59 Open Annotation: Specific Resources Specific Body and Specific Target resources identify the region of interest, and/or the state of the resource. Need to be able to describe the state of the resource, the segment of interest, and potentially styling hints for how to render it. We introduce: State Describes how to retrieve representation Selector Describes how to select segment Style Describes how to render/process segment Scope Describes context of the resource
  • 60.
    Linked Data andImages: Building Blocks for Digital Cultural Heritage Information Access Seminar, UC Berkeley, 18th of April 2014 60 Open Annotation: Specific Resources
  • 61.
    Linked Data andImages: Building Blocks for Digital Cultural Heritage Information Access Seminar, UC Berkeley, 18th of April 2014 61 Linked Data for Cultural Heritage Dublin Core FOAF RDF/S OAI-ORE Europeana Data Model Digital Manuscripts to Europeana Open Annotation EXIF IIIF Image Shared Canvas IIIF Presentation API
  • 62.
    Linked Data andImages: Building Blocks for Digital Cultural Heritage Information Access Seminar, UC Berkeley, 18th of April 2014 62 IIIF Image API Base URL: {scheme}://{host}{/prefix}/{identifier}! Image Resource: {base}/{region}/{size}/{rotation}/{quality}.{format}! !
  • 63.
    Linked Data andImages: Building Blocks for Digital Cultural Heritage Information Access Seminar, UC Berkeley, 18th of April 2014 63 IIIF Image API: Region Image Resource: {base}/{region}/{size}/{rotation}/{quality}.{format}! ! ! •  Full Image: {base}/full/full/0/native.jpg! ! •  Area by Pixels: {base}/100,100,640,480/full/0/native.jpg! ! •  Area by Percentage: {base}/pct:50,50,33,33/full/0/native.jpg!
  • 64.
    Linked Data andImages: Building Blocks for Digital Cultural Heritage Information Access Seminar, UC Berkeley, 18th of April 2014 64 IIIF Image API: Size Image Resource: {base}/{region}/{size}/{rotation}/{quality}.{format}! ! •  Full Image: {base}/full/full/0/native.jpg! •  Size by Pixels, forced aspect: {base}/full/640,480/0/native.jpg! •  Size by Pixels, aspect preserved: {base}/full/!640,480/0/native.jpg! •  Size by Percentage: {base}/full/pct:50/0/native.jpg! •  Size by Width, or by Height: ! {base}/full/,480/0/native.jpg! {base}/full/640,/0/native.jpg !
  • 65.
    Linked Data andImages: Building Blocks for Digital Cultural Heritage Information Access Seminar, UC Berkeley, 18th of April 2014 65 IIIF Image API: Rotation Image Resource: {base}/{region}/{size}/{rotation}/{quality}.{format}! ! •  Full Image: {base}/full/full/0/native.jpg! ! •  90 degree Rotation: {base}/full/full/90/native.jpg! {base}/full/full/180/native.jpg! {base}/full/full/270/native.jpg! ! •  Arbitrary Rotation: {base}/full/full/27.6/native.jpg! ! ! !
  • 66.
    Linked Data andImages: Building Blocks for Digital Cultural Heritage Information Access Seminar, UC Berkeley, 18th of April 2014 66 IIIF Image API: Quality Image Resource: {base}/{region}/{size}/{rotation}/{quality}.{format}! ! •  Full Image: {base}/full/full/0/native.jpg! ! •  Explicit Option: {base}/full/full/0/color.jpg! {base}/full/full/0/grey.jpg! {base}/full/full/0/bitonal.jpg! ! !
  • 67.
    Linked Data andImages: Building Blocks for Digital Cultural Heritage Information Access Seminar, UC Berkeley, 18th of April 2014 67 IIIF Image API: Format Image Resource: {base}/{region}/{size}/{rotation}/{quality}.{format}! ! •  Full Image: {base}/full/full/0/native.jpg! ! •  Other Options: {base}/full/full/0/native.png! {base}/full/full/0/native.tif! {base}/full/full/0/native.gif! {base}/full/full/0/native.jp2! {base}/full/full/0/native.pdf! ! !
  • 68.
    Linked Data andImages: Building Blocks for Digital Cultural Heritage Information Access Seminar, UC Berkeley, 18th of April 2014 68 IIIF Image API: Technical Info Information Resource, in JSON-LD: {base}/info.json! ! ! ! ! ! {! "@context":"http://library.stanford.edu/iiif/image-api/1.1/context.json",! "@id":"http://www.example.org/iiif/book1-p1",! "height": 6000,! "width": 4000,! "scale_factors": [ 1, 2, 4, 8 ],! "tile_height": 512,! "tile_width": 512,! "formats": ["jpg", "png", "gif" ],! "qualities": ["native", "color", "grey", "bitonal"],! "profile": "http://library.stanford.edu/iiif/image-api/1.1/
 compliance.html#level1"! } ! ! !
  • 69.
    Linked Data andImages: Building Blocks for Digital Cultural Heritage Information Access Seminar, UC Berkeley, 18th of April 2014 69 IIIF Application: Mise-en-Page
  • 70.
    Linked Data andImages: Building Blocks for Digital Cultural Heritage Information Access Seminar, UC Berkeley, 18th of April 2014 70 IIIF Application: Mirador
  • 71.
    Linked Data andImages: Building Blocks for Digital Cultural Heritage Information Access Seminar, UC Berkeley, 18th of April 2014 71 IIIF Application: Mirador (MeP fork)
  • 72.
    Linked Data andImages: Building Blocks for Digital Cultural Heritage Information Access Seminar, UC Berkeley, 18th of April 2014 72 Remnants of Otto Ege MS 1, as of 2014
  • 73.
    Linked Data andImages: Building Blocks for Digital Cultural Heritage Information Access Seminar, UC Berkeley, 18th of April 2014 73 Otto Ege MS 1, Reconstructed, in 2014
  • 74.
    Linked Data andImages: Building Blocks for Digital Cultural Heritage Information Access Seminar, UC Berkeley, 18th of April 2014 74 Otto Ege MS 1, Reconstructed, in 2014
  • 75.
    Linked Data andImages: Building Blocks for Digital Cultural Heritage Information Access Seminar, UC Berkeley, 18th of April 2014 75 Linked Data and Images: Building Blocks for Cultural Heritage
  • 76.
    Linked Data andImages: Building Blocks for Digital Cultural Heritage Information Access Seminar, UC Berkeley, 18th of April 2014 76 Thank You Robert Sanderson azaroth42@gmail.com azaroth@stanford.edu @azaroth42 Web: http://iiif.io/ http://www.shared-canvas.org/ http://www.openannotation.org/ Slides: http://slidesha.re/xxxyyy Apologies for unattributed images!