Data scale and diversity issues at Europeana
•Download as PPT, PDF•
1 like•259 views
Presentation at the seminar "Collections: storing and using of the metadata" held at the Finnish National Museum Helsinki, 16-17 November 2017
Recommended
More Related Content
What's hot
What's hot (20)
Similar to Data scale and diversity issues at Europeana
Similar to Data scale and diversity issues at Europeana (20)
More from Antoine Isaac
More from Antoine Isaac (20)
Recently uploaded
Recently uploaded (20)
Data scale and diversity issues at Europeana
- 1. Data scale and diversity issues at Europeana Antoine Isaac Collections – storing and using the metadata Finnish National Museum, 16 November 2017
- 2. Title here CC BY-SA What is Europeana? CC BY-SA Europeana’s markets and services
- 3. Title here CC BY-SA Access to Europe’s cultural heritage Europeana Essentials CC BY-SACC BY-SA 53 million digitized objects, from 3,700 institutions in 44 countries
- 4. Engage people ● Place the digital cultural heritage where people are: Wikipedia, Pinterest, online but also in the street, participating via collection days, or transcribathons. ● And develop more browse entry points for specific interest areas
- 5. Re-use with Partners Make content available to: ●Educators, Teacher Networks and Ministries of Education ●Research Networks ●the Creative industries/innovators So it they can make it work for their audiences
- 6. Title here CC BY-SACC BY-SA A network of data partners ●Data providers: Cultural heritage institutions providing content and metadata to Europeana ●"Intermediate” Aggregators: organizations or projects gathering metadata and content for institutions from a specific country, sector, or on a specific domain (music, archaeology, theater…) and making it available for Europeana and other data consumers
- 7. Title here CC BY-SA What data does Europeana hold? Europeana Essentials CC BY-SACC BY-SA ● Descriptive and technical metadata ● Thumbnails As a rule, content is still served from our data partners ● Some content for specific projects ● newspapers text and images ● user-generated content (Europeana 1914-1918)
- 8. Title here CC BY-SA Big data? Europeana Essentials CC BY-SACC BY-SA Volume – not so big ● Metadata <1TB ● Thumbnails <4TB ● Some content for specific projects <10TB 53 million digitized objects, from 3,700 institutions in 44 countries
- 9. Title here CC BY-SA Big data? Europeana Essentials CC BY-SACC BY-SA Velocity - manageable ● Approx. 2M records added or removed between May 2017 and September 2017 ● Updates are done continuously, but not in real time (our data ingestion team pushes the buttons)
- 10. Title here CC BY-SA Big data? Europeana Essentials CC BY-SACC BY-SA Veracity - problematic ● We have big data quality issues
- 11. Title here CC BY-SA Big data? Europeana Essentials CC BY-SACC BY-SA Variety – huge 53 million digitized objects, from 3,700 institutions in 44 countries ● Many different themes and types of objects Books, newspapers, journals, letters, diaries, archival papers, paintings, maps, drawings, photographs, music, spoken word, radio broadcasts, film, newsreels, television, fashion, sculpture, 3D objects, and more ● Libraries, archives, museums have different ways to describe objects. Even within a sector, big differences can be observed ● Heterogeneity makes quality issues even harder to cope with
- 12. Title here CC BY-SA Multilinguism Europeana Essentials CC BY-SACC BY-SA ● Officially we get metadata in 39 languages ● But there are more languages used in individual metadata fields
- 13. Title here CC BY-SA Europeana Essentials CC BY-SACC BY-SA Work by Péter Kiraly (Göttingen Research alliance) http://144.76.218.178/europeana-qa/languages.php?collectionId=
- 14. Title here CC BY-SA Europeana Essentials CC BY-SACC BY-SA Work by Péter Kiraly (Göttingen Research alliance) http://144.76.218.178/europeana-qa/languages.php?collectionId=
- 15. Title here CC BY-SA Multilinguism Europeana Essentials CC BY-SACC BY-SA ● Officially we get metadata in 39 languages ● But there are more languages used in individual metadata fields • Over 400 language codes • E.g., 6 values in x-aramaic-latn - not a valid code by the way • But the most common case is lack of language information!
- 16. What do we do with it? France, Public Domain 1914, National Library of France Agence de presse Meurisse Concours de cycles nautiques sur le lac d’Enghien : Berregent piloté par Austerling
- 18. Title here CC BY-SA Europeana Collections Europeana Essentials CC BY-SACC BY-SA
- 19. Title here CC BY-SACC BY-SA Thematic collections
- 20. Title here CC BY-SA Contributing to third party sites - Wikimedia Commons Europeana Essentials CC BY-SACC BY-SA Europeana 1914-1918 content on Wikimedia Commons Wikimedia Commons| CC BY-SA
- 22. France, Public Domain 1932, National Library of France Agence de presse Mondial Photo-Presse. Tournoi royal de motos à Londres : changement d'une roue de side-car en marche Still, we need to work on data
- 23. Title here CC BY-SA Title here CC BY-SA Europeana Essentials CC BY-SA Data modelling for interoperability and richer data CC BY-SA Clavecin, Bartolomeo Cristofori Cite de la Musique, MIMO - Musical Instruments Museums Online|CC BY-NC-SA Europeana Data Model example
- 24. Title here CC BY-SACC BY-SA A community driven model • Involving experts from libraries, archives and museums, as well as academic partners • The input from the different communities makes the model stronger Bible Translators Anatolia College, Greece | Public Domain
- 25. Title here CC BY-SACC BY-SA The Europeana Data Model (EDM) OAI- ORE OWL
- 26. Title here CC BY-SACC BY-SA Following the Linked Open Data principles http://vimeo.com/36752317
- 27. Title here CC BY-SA Title here CC BY-SA Europeana Essentials CC BY-SA Enriching data CC BY-SA Several processes produce richer data that we and others can use to build new and innovative services • Harvesting richer Linked Open Data from data partners • Crowdsourcing •Automatic semantic enrichment Latvijas dzelzce u karteļ 1937, National Library of Latvia, Latvia | Public Domain
- 28. CC BY-SA Thumbnail Metadata Link to data provider Rights
- 29. CC BY-SA Links to contextual entities
- 30. Title here CC BY-SACC BY-SA The Entity Collection Contribution to multilingual coverage Entities effectively used to enrich Europeana Objects Entities present in the Entity Collection
- 31. Title here CC BY-SACC BY-SA Multilingual enrichment is not easy Poisonous India or the Importance of a Semantic and Multilingual Enrichment Strategy Marlies Olensky, Juliane Stiller, Evelyn Dröge, MTSR 2012 http://link.springer.com/chapter/10.1007%2F978-3-642-35233-1_2
- 32. Title here CC BY-SACC BY-SA Data Quality Committee Working on recommendations for the community on: ○ Mandatory metadata elements for ingestion of EDM data ○ Metadata checking and normalization ○ Meaningful metadata values (in the context of use) ○ Quality of content (digital media) ○ Coordination with other quality-related initiatives http://pro.europeana.eu/get-involved/europeana-tech/data-quality-committee
- 33. Title here CC BY-SACC BY-SA Title here CC BY-SA Name of image | Creator Providing organization| Country, licence Name of image | Creator Providing organization| Country, licence antoine.isaac@europeana.eu @antoine_isaac
Editor's Notes
- Image is: http://www.europeana.eu/portal/record/9200365/BibliographicResource_1000055421061.html Copyright url: http://creativecommons.org/publicdomain/mark/1.0/
- Europeana gives you access to: Books, newspapers, journals, letters, diaries, archival papers, paintings, maps, drawings, photographs, music, spoken word, radio broadcasts, film, newsreels, television, fashion, sculpture, 3D objects, and more Previews and information (metadata) about each object with, where possible, (direct) access to full texts, high-quality imagery, sound and video files either on Europeana or on the provider’s own website. Europeana Collections was updated and given its new name in December 2015. Its fresh, clean feel, designed in response to stakeholder and audience feedback, makes it easy to navigate. Improved search and filters, including innovative colour searches (try this one for ‘Dark slate blue’) and quality searches (find our very best maps of Paris), mean finding what you’re looking for is simple. Better, bigger previews, a zoom function for high resolution images and documents (get really close up to this Monet), direct play for video (try this silent film) and audio (listen to this Maria Callas aria) and a new download option mean less time clicking and more time engrossed in cultural content. Clear copyright information shows you what you can and can’t do with the treasures you find. All this together gives you trustworthy and relevant information and content to use, to learn, to share or to contribute to research. See for yourself with our quick demo. Explore Europeana Collections at http://europeana.eu
- 3. Engaging and involving people more We also need to continue to deliver content to Wikipedia and Pinterest so that the more casual user gets to experience a broader spectrum of our heritage in the places they already use. And we undertake broad engagement campaigns such as Europeana 1914-1918 which I will come to and we are building one on migration to play out next year because we know that as a citizen of Europe, taking part in our thematic campaigns – like adding your family memorabilia to Europeana 1914-1918 – helps increase appreciation of our shared history and reinforces the importance of our shared future.
- 53 million pieces of cultural heritage - search, browse, filter From 3,500 institutions in 35 countries Europeana gives you access to: Books, newspapers, journals, letters, diaries, archival papers, paintings, maps, drawings, photographs, music, spoken word, radio broadcasts, film, newsreels, television, fashion, sculpture, 3D objects, and more Previews and information (metadata) about each object with, where possible, (direct) access to full texts, high-quality imagery, sound and video files either on Europeana or on the provider’s own website. Europeana Collections was updated and given its new name in December 2015. Its fresh, clean feel, designed in response to stakeholder and audience feedback, makes it easy to navigate. Improved search and filters, including innovative colour searches (try this one for ‘Dark slate blue’) and quality searches (find our very best maps of Paris), mean finding what you’re looking for is simple. Better, bigger previews, a zoom function for high resolution images and documents (get really close up to this Monet), direct play for video (try this silent film) and audio (listen to this Maria Callas aria) and a new download option mean less time clicking and more time engrossed in cultural content. Clear copyright information shows you what you can and can’t do with the treasures you find. All this together gives you trustworthy and relevant information and content to use, to learn, to share or to contribute to research. See for yourself with our quick demo. Explore Europeana Collections at http://europeana.eu
- Europeana isn’t content with a service in which audiences simply come to us. We take Europe’s collections to the online places in which our audiences congregate. We share openly licensed collections in as many places as we can. Here are some examples. Europeana 1914-1918 The Europeana blog Europeana virtual exhibitions, curated by our expert partners Facebook Pinterest Twitter Google+ Wikimedia Europeana newsletter We’re always looking for ways to improve how we connect with our audiences, so our work on things like the portal, blog, virtual exhibitions and our newsletter is never done! Working with partners and projects is really important for our end-user services. It’s their expertise in specific areas that helps us create fascinating exhibitions and take people on great cultural journeys with our channels.
- 2. Scaling with partners We have 5 markets we are trying to reach with Europeana: Lovers of the various aspects of culture from music to art to fashion to maps to natural history; whether they are Cultural Professionals; Educators, Researchers or from the Creative Industries and Innovators. We cannot reach these markets by ourselves we dont have the subject knowledge or capability of reaching the audiences so need to rely on partners. But to do this we must be able to provide educator, researcher or creative, with clearly labelled, high-quality material content for use. So they can make it work in their systems and users get rich, trusted cultural heritage in their workflow, tailored to their specific need.
- Image url:http://www.europeana.eu/portal/record/90402/SK_A_3899.html Copyright url:http://creativecommons.org/publicdomain/mark/1.0/