SlideShare a Scribd company logo
1 of 34
Download to read offline
Canvases as First Class Citizens
David Newbury, Head of Software, Getty
IIIF Working Session, Fall 2020
1
Background
The Getty is a multifaceted institution, but all of our
facets create and use images. We're:
— A Museum
— A Library
— An Archive
— A Publisher
— A Website
— A Conservator
2
Some facets deal with objects.
All of them deal with images.
3
Often the same image.
4
Getty is all-in on IIIF.
This means that we're
running into interesting
edge cases.
5
Everything I want to talk
about is possible in the spec.
It's a question of practice.
6
7
Manifests are proxies
for objects
Canvases are proxies
for views
8
A Book
The sequence of images is a proxy for the book.
9
A Painting
The "main" image can be a proxy, other images are
o!en documentation.
10
A Sculpture
Images are different representations of the object.
11
An Archival Folder
Images are proxies for the contents of a folder, but are
not a proxy for the objects within the folder.
12
Publication comp. figures
An aggregation of images that
are conceptually related
13
Search results
Images are proxies for web
pages that describe objects.
14
A Image Carousel
A carousel is a presentation of images that are
conceptually related, but not a proxy for a "real" object.
15
A website hero
A image that is not a proxy for any object: editorial
content.
16
Novel Experiences
Images used as "just images" or as collections of pixels.
17
IIIF can be used in all of these
use cases.
18
Manifests make sense for
some of these contexts.
19
We have the Image API and
the Presentation API.
20
The problem is annotations.
21
The problem is annotations
and reuse.
22
Observation #1
Manifests are o!en transient presentations:
objects presented in a specific context.
23
Shopping Cart interface
Use case: Select and order a
series of images for download
or view.
Manifests fit this role nicely—
but should include (some of?)
the annotations associated with
those images.
24
What we've heard is a desire
to collect images, not objects.
25
Observation #2
A given image may appear in many contexts, and may
be part of many objects—either "real" or "contextual".
Annotations (particularly computationally-generated
annotations) are o!en about the image, not the object.
26
27
28
Observation #3
Metadata is o!en related to the "View", and varies
across images within the context of an "Object"
— Visual description
— Photography Credit
— Alt Text
29
Observation #4
Some annotations are related to the image-in-context,
and other are intrinsic to the image-as-content.
— OCR
— Conservation Reporting
— CV Tagging
30
Canvases are a conceptual
space that contains
annotations that present a
specific collection of content.
31
My Questions:
How do we handle interactions with images +
annotations, not just manifests-as-object-proxies?
What's intrinsic to the object and what's to the image
or view?
Does a canvas change impacts several manifests?
Should we think about the Canvas a first-class resource
within the IIIF environment?
32
How do we manage this?:
— From an authorship perspective?
— From a technical perspective?
— From a UX perspective?
33
Discussion!
34

More Related Content

More from David Newbury

NDSR Learning Enrichment: Data Models and Linked Data
NDSR Learning Enrichment: Data Models and Linked DataNDSR Learning Enrichment: Data Models and Linked Data
NDSR Learning Enrichment: Data Models and Linked DataDavid Newbury
 
Fuzzy Dates & the Digital Humanities
Fuzzy Dates & the Digital HumanitiesFuzzy Dates & the Digital Humanities
Fuzzy Dates & the Digital HumanitiesDavid Newbury
 
Telling Stories with Data: Class Notes 2
Telling Stories with Data:  Class Notes 2Telling Stories with Data:  Class Notes 2
Telling Stories with Data: Class Notes 2David Newbury
 
Telling Stories With Data: Class 1
Telling Stories With Data: Class 1Telling Stories With Data: Class 1
Telling Stories With Data: Class 1David Newbury
 
21st Century Provenance: Lessons Learned Building Art Tracks
21st Century Provenance:  Lessons Learned Building Art Tracks21st Century Provenance:  Lessons Learned Building Art Tracks
21st Century Provenance: Lessons Learned Building Art TracksDavid Newbury
 
Art Tracks: From Provenance to Structured Data
Art Tracks: From Provenance to Structured DataArt Tracks: From Provenance to Structured Data
Art Tracks: From Provenance to Structured DataDavid Newbury
 
Linked Data: Worse is Better
Linked Data:  Worse is BetterLinked Data:  Worse is Better
Linked Data: Worse is BetterDavid Newbury
 
Art Tracks: A technical deep dive.
Art Tracks:  A technical deep dive.Art Tracks:  A technical deep dive.
Art Tracks: A technical deep dive.David Newbury
 
Using Linked Data: American Art Collaborative, Oct. 3, 2016
Using Linked Data:  American Art Collaborative, Oct. 3, 2016Using Linked Data:  American Art Collaborative, Oct. 3, 2016
Using Linked Data: American Art Collaborative, Oct. 3, 2016David Newbury
 
Data 101: Making Charts from Spreadsheets
Data 101: Making Charts from SpreadsheetsData 101: Making Charts from Spreadsheets
Data 101: Making Charts from SpreadsheetsDavid Newbury
 
IIIF For Small Projects
IIIF  For Small ProjectsIIIF  For Small Projects
IIIF For Small ProjectsDavid Newbury
 
Authority Cascades: A presentation strategy for Linked Open Data
Authority Cascades: A presentation strategy for Linked Open DataAuthority Cascades: A presentation strategy for Linked Open Data
Authority Cascades: A presentation strategy for Linked Open DataDavid Newbury
 
Data 101: Introduction to Data Visualization
Data 101:  Introduction to Data VisualizationData 101:  Introduction to Data Visualization
Data 101: Introduction to Data VisualizationDavid Newbury
 
Art Tracks: Presentation to the imProvenance Group
Art Tracks: Presentation to the imProvenance GroupArt Tracks: Presentation to the imProvenance Group
Art Tracks: Presentation to the imProvenance GroupDavid Newbury
 
How To Internet: The Magic Words
How To Internet:  The Magic WordsHow To Internet:  The Magic Words
How To Internet: The Magic WordsDavid Newbury
 
Data Visualization for Journalists and Media
Data Visualization for Journalists and MediaData Visualization for Journalists and Media
Data Visualization for Journalists and MediaDavid Newbury
 
Art Tracks: Museums & the Web 2015
Art Tracks: Museums & the Web 2015Art Tracks: Museums & the Web 2015
Art Tracks: Museums & the Web 2015David Newbury
 
The Gulf Tower project
The Gulf Tower projectThe Gulf Tower project
The Gulf Tower projectDavid Newbury
 

More from David Newbury (20)

Extending IIIF 3.0
Extending IIIF 3.0Extending IIIF 3.0
Extending IIIF 3.0
 
NDSR Learning Enrichment: Data Models and Linked Data
NDSR Learning Enrichment: Data Models and Linked DataNDSR Learning Enrichment: Data Models and Linked Data
NDSR Learning Enrichment: Data Models and Linked Data
 
Fuzzy Dates & the Digital Humanities
Fuzzy Dates & the Digital HumanitiesFuzzy Dates & the Digital Humanities
Fuzzy Dates & the Digital Humanities
 
Telling Stories with Data: Class Notes 2
Telling Stories with Data:  Class Notes 2Telling Stories with Data:  Class Notes 2
Telling Stories with Data: Class Notes 2
 
Telling Stories With Data: Class 1
Telling Stories With Data: Class 1Telling Stories With Data: Class 1
Telling Stories With Data: Class 1
 
21st Century Provenance: Lessons Learned Building Art Tracks
21st Century Provenance:  Lessons Learned Building Art Tracks21st Century Provenance:  Lessons Learned Building Art Tracks
21st Century Provenance: Lessons Learned Building Art Tracks
 
Art Tracks: From Provenance to Structured Data
Art Tracks: From Provenance to Structured DataArt Tracks: From Provenance to Structured Data
Art Tracks: From Provenance to Structured Data
 
Linked Data: Worse is Better
Linked Data:  Worse is BetterLinked Data:  Worse is Better
Linked Data: Worse is Better
 
Understanding D3
Understanding D3Understanding D3
Understanding D3
 
Art Tracks: A technical deep dive.
Art Tracks:  A technical deep dive.Art Tracks:  A technical deep dive.
Art Tracks: A technical deep dive.
 
Using Linked Data: American Art Collaborative, Oct. 3, 2016
Using Linked Data:  American Art Collaborative, Oct. 3, 2016Using Linked Data:  American Art Collaborative, Oct. 3, 2016
Using Linked Data: American Art Collaborative, Oct. 3, 2016
 
Data 101: Making Charts from Spreadsheets
Data 101: Making Charts from SpreadsheetsData 101: Making Charts from Spreadsheets
Data 101: Making Charts from Spreadsheets
 
IIIF For Small Projects
IIIF  For Small ProjectsIIIF  For Small Projects
IIIF For Small Projects
 
Authority Cascades: A presentation strategy for Linked Open Data
Authority Cascades: A presentation strategy for Linked Open DataAuthority Cascades: A presentation strategy for Linked Open Data
Authority Cascades: A presentation strategy for Linked Open Data
 
Data 101: Introduction to Data Visualization
Data 101:  Introduction to Data VisualizationData 101:  Introduction to Data Visualization
Data 101: Introduction to Data Visualization
 
Art Tracks: Presentation to the imProvenance Group
Art Tracks: Presentation to the imProvenance GroupArt Tracks: Presentation to the imProvenance Group
Art Tracks: Presentation to the imProvenance Group
 
How To Internet: The Magic Words
How To Internet:  The Magic WordsHow To Internet:  The Magic Words
How To Internet: The Magic Words
 
Data Visualization for Journalists and Media
Data Visualization for Journalists and MediaData Visualization for Journalists and Media
Data Visualization for Journalists and Media
 
Art Tracks: Museums & the Web 2015
Art Tracks: Museums & the Web 2015Art Tracks: Museums & the Web 2015
Art Tracks: Museums & the Web 2015
 
The Gulf Tower project
The Gulf Tower projectThe Gulf Tower project
The Gulf Tower project
 

Recently uploaded

Integration and Automation in Practice: CI/CD in Mule Integration and Automat...
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...Integration and Automation in Practice: CI/CD in Mule Integration and Automat...
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...Patryk Bandurski
 
Hyderabad Call Girls Khairatabad ✨ 7001305949 ✨ Cheap Price Your Budget
Hyderabad Call Girls Khairatabad ✨ 7001305949 ✨ Cheap Price Your BudgetHyderabad Call Girls Khairatabad ✨ 7001305949 ✨ Cheap Price Your Budget
Hyderabad Call Girls Khairatabad ✨ 7001305949 ✨ Cheap Price Your BudgetEnjoy Anytime
 
Next-generation AAM aircraft unveiled by Supernal, S-A2
Next-generation AAM aircraft unveiled by Supernal, S-A2Next-generation AAM aircraft unveiled by Supernal, S-A2
Next-generation AAM aircraft unveiled by Supernal, S-A2Hyundai Motor Group
 
08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking MenDelhi Call girls
 
Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024Scott Keck-Warren
 
Making_way_through_DLL_hollowing_inspite_of_CFG_by_Debjeet Banerjee.pptx
Making_way_through_DLL_hollowing_inspite_of_CFG_by_Debjeet Banerjee.pptxMaking_way_through_DLL_hollowing_inspite_of_CFG_by_Debjeet Banerjee.pptx
Making_way_through_DLL_hollowing_inspite_of_CFG_by_Debjeet Banerjee.pptxnull - The Open Security Community
 
AI as an Interface for Commercial Buildings
AI as an Interface for Commercial BuildingsAI as an Interface for Commercial Buildings
AI as an Interface for Commercial BuildingsMemoori
 
CloudStudio User manual (basic edition):
CloudStudio User manual (basic edition):CloudStudio User manual (basic edition):
CloudStudio User manual (basic edition):comworks
 
Pigging Solutions in Pet Food Manufacturing
Pigging Solutions in Pet Food ManufacturingPigging Solutions in Pet Food Manufacturing
Pigging Solutions in Pet Food ManufacturingPigging Solutions
 
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure serviceWhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure servicePooja Nehwal
 
Injustice - Developers Among Us (SciFiDevCon 2024)
Injustice - Developers Among Us (SciFiDevCon 2024)Injustice - Developers Among Us (SciFiDevCon 2024)
Injustice - Developers Among Us (SciFiDevCon 2024)Allon Mureinik
 
Presentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreterPresentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreternaman860154
 
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 3652toLead Limited
 
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024BookNet Canada
 
How to Remove Document Management Hurdles with X-Docs?
How to Remove Document Management Hurdles with X-Docs?How to Remove Document Management Hurdles with X-Docs?
How to Remove Document Management Hurdles with X-Docs?XfilesPro
 
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024BookNet Canada
 
Swan(sea) Song – personal research during my six years at Swansea ... and bey...
Swan(sea) Song – personal research during my six years at Swansea ... and bey...Swan(sea) Song – personal research during my six years at Swansea ... and bey...
Swan(sea) Song – personal research during my six years at Swansea ... and bey...Alan Dix
 
Unblocking The Main Thread Solving ANRs and Frozen Frames
Unblocking The Main Thread Solving ANRs and Frozen FramesUnblocking The Main Thread Solving ANRs and Frozen Frames
Unblocking The Main Thread Solving ANRs and Frozen FramesSinan KOZAK
 
Breaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountBreaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountPuma Security, LLC
 
My Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 PresentationMy Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 PresentationRidwan Fadjar
 

Recently uploaded (20)

Integration and Automation in Practice: CI/CD in Mule Integration and Automat...
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...Integration and Automation in Practice: CI/CD in Mule Integration and Automat...
Integration and Automation in Practice: CI/CD in Mule Integration and Automat...
 
Hyderabad Call Girls Khairatabad ✨ 7001305949 ✨ Cheap Price Your Budget
Hyderabad Call Girls Khairatabad ✨ 7001305949 ✨ Cheap Price Your BudgetHyderabad Call Girls Khairatabad ✨ 7001305949 ✨ Cheap Price Your Budget
Hyderabad Call Girls Khairatabad ✨ 7001305949 ✨ Cheap Price Your Budget
 
Next-generation AAM aircraft unveiled by Supernal, S-A2
Next-generation AAM aircraft unveiled by Supernal, S-A2Next-generation AAM aircraft unveiled by Supernal, S-A2
Next-generation AAM aircraft unveiled by Supernal, S-A2
 
08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men
 
Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024
 
Making_way_through_DLL_hollowing_inspite_of_CFG_by_Debjeet Banerjee.pptx
Making_way_through_DLL_hollowing_inspite_of_CFG_by_Debjeet Banerjee.pptxMaking_way_through_DLL_hollowing_inspite_of_CFG_by_Debjeet Banerjee.pptx
Making_way_through_DLL_hollowing_inspite_of_CFG_by_Debjeet Banerjee.pptx
 
AI as an Interface for Commercial Buildings
AI as an Interface for Commercial BuildingsAI as an Interface for Commercial Buildings
AI as an Interface for Commercial Buildings
 
CloudStudio User manual (basic edition):
CloudStudio User manual (basic edition):CloudStudio User manual (basic edition):
CloudStudio User manual (basic edition):
 
Pigging Solutions in Pet Food Manufacturing
Pigging Solutions in Pet Food ManufacturingPigging Solutions in Pet Food Manufacturing
Pigging Solutions in Pet Food Manufacturing
 
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure serviceWhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
 
Injustice - Developers Among Us (SciFiDevCon 2024)
Injustice - Developers Among Us (SciFiDevCon 2024)Injustice - Developers Among Us (SciFiDevCon 2024)
Injustice - Developers Among Us (SciFiDevCon 2024)
 
Presentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreterPresentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreter
 
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
Tech-Forward - Achieving Business Readiness For Copilot in Microsoft 365
 
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
 
How to Remove Document Management Hurdles with X-Docs?
How to Remove Document Management Hurdles with X-Docs?How to Remove Document Management Hurdles with X-Docs?
How to Remove Document Management Hurdles with X-Docs?
 
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
Transcript: #StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
 
Swan(sea) Song – personal research during my six years at Swansea ... and bey...
Swan(sea) Song – personal research during my six years at Swansea ... and bey...Swan(sea) Song – personal research during my six years at Swansea ... and bey...
Swan(sea) Song – personal research during my six years at Swansea ... and bey...
 
Unblocking The Main Thread Solving ANRs and Frozen Frames
Unblocking The Main Thread Solving ANRs and Frozen FramesUnblocking The Main Thread Solving ANRs and Frozen Frames
Unblocking The Main Thread Solving ANRs and Frozen Frames
 
Breaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountBreaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path Mount
 
My Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 PresentationMy Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 Presentation
 

IIIF Canvases as First Class Citizens

  • 1. Canvases as First Class Citizens David Newbury, Head of Software, Getty IIIF Working Session, Fall 2020 1
  • 2. Background The Getty is a multifaceted institution, but all of our facets create and use images. We're: — A Museum — A Library — An Archive — A Publisher — A Website — A Conservator 2
  • 3. Some facets deal with objects. All of them deal with images. 3
  • 4. Often the same image. 4
  • 5. Getty is all-in on IIIF. This means that we're running into interesting edge cases. 5
  • 6. Everything I want to talk about is possible in the spec. It's a question of practice. 6
  • 7. 7
  • 8. Manifests are proxies for objects Canvases are proxies for views 8
  • 9. A Book The sequence of images is a proxy for the book. 9
  • 10. A Painting The "main" image can be a proxy, other images are o!en documentation. 10
  • 11. A Sculpture Images are different representations of the object. 11
  • 12. An Archival Folder Images are proxies for the contents of a folder, but are not a proxy for the objects within the folder. 12
  • 13. Publication comp. figures An aggregation of images that are conceptually related 13
  • 14. Search results Images are proxies for web pages that describe objects. 14
  • 15. A Image Carousel A carousel is a presentation of images that are conceptually related, but not a proxy for a "real" object. 15
  • 16. A website hero A image that is not a proxy for any object: editorial content. 16
  • 17. Novel Experiences Images used as "just images" or as collections of pixels. 17
  • 18. IIIF can be used in all of these use cases. 18
  • 19. Manifests make sense for some of these contexts. 19
  • 20. We have the Image API and the Presentation API. 20
  • 21. The problem is annotations. 21
  • 22. The problem is annotations and reuse. 22
  • 23. Observation #1 Manifests are o!en transient presentations: objects presented in a specific context. 23
  • 24. Shopping Cart interface Use case: Select and order a series of images for download or view. Manifests fit this role nicely— but should include (some of?) the annotations associated with those images. 24
  • 25. What we've heard is a desire to collect images, not objects. 25
  • 26. Observation #2 A given image may appear in many contexts, and may be part of many objects—either "real" or "contextual". Annotations (particularly computationally-generated annotations) are o!en about the image, not the object. 26
  • 27. 27
  • 28. 28
  • 29. Observation #3 Metadata is o!en related to the "View", and varies across images within the context of an "Object" — Visual description — Photography Credit — Alt Text 29
  • 30. Observation #4 Some annotations are related to the image-in-context, and other are intrinsic to the image-as-content. — OCR — Conservation Reporting — CV Tagging 30
  • 31. Canvases are a conceptual space that contains annotations that present a specific collection of content. 31
  • 32. My Questions: How do we handle interactions with images + annotations, not just manifests-as-object-proxies? What's intrinsic to the object and what's to the image or view? Does a canvas change impacts several manifests? Should we think about the Canvas a first-class resource within the IIIF environment? 32
  • 33. How do we manage this?: — From an authorship perspective? — From a technical perspective? — From a UX perspective? 33