Intro to PBCore Zen, PBCore workshop, AMIA 2011 - jack brighton

Intro to PBCore Zen Jack Brighton director of new media & innovation Illinois Public Media jackb@illinois.edu

PART ONE:Why does metadata matter?

A story about broadcasting

WILL Radio interview with John Brady Kiesling, former U.S. diplomat, on“The War In Iraq: U.S. Foreign Policy And The Crisis Of InternationalLegitimacy,” Focus 580, September 23, 2005Interviewer: Jack BrightonProducer: Harriet Williamson

Descriptive Metadata• title:Focus 580 on WILL-AM• subject: The War In Iraq: U.S. Foreign Policy And The Crisis Of International Legitimacy• description: U.S. diplomat Interview with John Brady Kiesling, former• genre: politics, United States, Iraq, foreign policy, war• date of broadcast: September 23, 2005• etcetera...

Administrative Metadata• creator: WILL Radio• publisher: WILL Public Media• copyright holder: University of Illinois• rights summary: may be repurposed for non-commercial and educational purposes with attribution to WILL• etcetera...

Technical Metadata• format:broadcast wav file• sampling rate: 44.1 kHz• bit depth:16 bit• tracks:mono• ﬁle size: 248,673,242 bites• location:Enco DAD cut #36465• etcetera...

a media object

as a web page

media object as rss feed <?xml version="1.0" encoding="UTF-8" ?>- <rss xmlns:itunes="http://www.itunes.com/DTDs/Podcast-1.0.dtd" version="2.0">- <channel> <title>Focus 580 on WILL-AM</title> <description>An intelligent interview program on current affairs</description> <link>http://www.will.uiuc.edu/am/focus</link> <language>en-us</language> <copyright>Copyright 2005 University of Illinois</copyright> <itunes:image href="http://www.will.uiuc.edu/am/focus/images/focuspodcast.jpg" /> <lastBuildDate>Fri, 23 Sep 2005 12:10:00 CST</lastBuildDate> <pubDate>Fri, 23 Sep 2005 12:10:00 CST</pubDate> <docs>http://blogs.law.harvard.edu/tech/rss</docs> <webMaster>jackb@uiuc.edu</webMaster>- <item> <title>The War In Iraq: U.S. Foreign Policy And The Crisis Of International Legitimacy</title> <link>http://will.uiuc.edu/am/focus</link> <description>Interview with John Brady Kiesling, former U.S. diplomat</description> <enclosure url="http://www.will.uiuc.edu/willmp3/focus050923a.mp3" length="24767532"type="audio/mpeg" /> <category>Current Events</category> <pubDate>Fri, 23 Sep 2005 12:10:00 CST</pubDate> </item> </channel> </rss>

rss feed viewed in Firefox

rss feed in iTunes

as a Dublin Core record<?xml version="1.0"?><!DOCTYPE rdf:RDF SYSTEM "http://dublincore.org/documents/2002/07/31/dcmes-xml/dcmes-xml-dtd.dtd"><rdf:RDF xmlns:rdf="http://www.w3.org/1999/02/22-rdf-syntax-ns#" xmlns:dc="http://purl.org/dc/elements/1.1/"> <rdf:Description rdf:about="http://will.atlas.uiuc.edu/focus580/interview/focus050923a/"> <dc:title> The War In Iraq: U.S. Foreign Policy And The Crisis Of International Legitimacy </dc:title> <dc:creator> WILL Public Media - http://will.illinois.edu </dc:creator> <dc:subject> WILL; public affairs; public radio; interviews; talk show; NPR; Illinois; Indiana; University of Illinois; Iraq; United States; Foreign Policy </dc:subject> <dc:description> Interview with John Brady Kiesling, former U.S. Diplomat </dc:description> <dc:publisher> WILL-AM, University of Illinois </dc:publisher> <dc:contributor> Jack Brighton, interviewer </dc:contributor> <dc:type> Sound </dc:type> <dc:language> en </dc:language> <dc:relation> http://will.illinois.edu/media/focus050923a.mp3 </dc:relation> <dc:rights> c 2008 University of Illinois </dc:rights> </rdf:Description></rdf:RDF>

with more detail as a PBCore record:<?xml version="1.0" encoding="UTF-8"?> <PBCoreDescriptionDocument xmlns="http://www.pbcore.org/PBCore/PBCoreNamespace.html"> <pbcoreIdentifier> <identifier>focus050923a</identifier> <identifierSource>Illinois Public Media</identifierSource> </pbcoreIdentifier> <pbcoreTitle> <title>The War In Iraq: U.S. Foreign Policy And The Crisis Of International Legitimacy</title> <titleType>Interview</titleType> </pbcoreTitle> <pbcoreSubject> <subject>Iraq</subject> <subjectAuthorityUsed>Illinois Public Media Subjects</subjectAuthorityUsed> </pbcoreSubject> <pbcoreSubject> <subject>Insurgency--Iraq</subject> <subjectAuthorityUsed>Library of Congress Subject Headings</subjectAuthorityUsed> </pbcoreSubject> <pbcoreDescription> <description>WILL Radio interview with John Brady Kiesling, former U.S. diplomat, on “The War In Iraq: U.S. Foreign Policy And The Crisis Of International Legitimacy,”</ description> <descriptionType>Abstract</descriptionType> </pbcoreDescription> <pbcoreCoverage> <coverage>Iraq</coverage> <coverageType>Spatial</coverageType> </pbcoreCoverage> <pbcoreCreator> <creator>WILL-AM</creator> <creatorRole>Creator</creatorRole> </pbcoreCreator> <pbcorePublisher> <publisher>University of Illinois</publisher> <publisherRole>Copyright Holder</publisherRole> </pbcorePublisher> <pbcoreRightsSummary> <rightsSummary>Permission granted by the copyright holder to stream and download for non-profit and educational use.</rightsSummary> </pbcoreRightsSummary> <pbcoreInstantiation> <pbcoreFormatID> <formatIdentifier>focus050923a.mp3</formatIdentifier> <formatIdentifierSource>Illinois Public Media</formatIdentifierSource> </pbcoreFormatID> <dateCreated>Fri, 23 Sep 2005 12:00:00 CST</dateCreated> <dateIssued>Fri, 23 Sep 2005 12:10:00 CST</dateIssued> <formatDigital>mp3</formatDigital> <formatLocation>http://will.illinois.edu/media/focus050923a.mp3</formatLocation> <formatMediaType>Sound</formatMediaType> <formatGenerations>Copy: access</formatGenerations> <formatDuration>00:52:08</formatDuration> </pbcoreInstantiation> </PBCoreDescriptionDocument>

XML documents

Structured Data

Data Portability

Interoperability

Ubiquitous Connections

We are not just cataloging,We are enabling connection

Digital Media Ecology

“The opportunity before all of us is living up to thedream of the Library of Alexandria and then taking it a step further: Universal access to all knowledge. Interestingly, it is now technically doable. “ Brewster Kahle, founder of the Internet Archive

PART TWO:PBCore Origins

Dublin Core (ISO 15836)The Dublin Core set of metadata elements provides a small andfundamental group of text elements through which most resourcescan be described and catalogued. Using only 15 base text ﬁelds, aDublin Core metadata record can describe physical resources suchas books, digital materials such as video, sound, image, or text ﬁles,and composite media like web pages. http://en.wikipedia.org/wiki/Dublin_Core

Simple Dublin Core The Simple Dublin Core Metadata Element Set (DCMES) consists of 15 metadata elements: • Title • Creator • Subject • Description • Publisher • Contributor • Date • Type • Format • Identiﬁer • Source • Language • Relation • Coverage • RightsReference: http://dublincore.org/documents/usageguide/elements.shtml

DC Structure:Resource: the media item in the abstract

DC Structure:Manifestation: a physical or digital instance of the resource

DC Structure:A Resource can have one and only one Manifestation

DC Structure:• Resource: the media item in the abstract• Manifestation: a physical or digital instance of the resource• A Resource can have one and only one Manifestation

The One-to-One PrincipleIn general Dublin Core metadata describes one manifestation orversion of a resource, rather than assuming that manifestationsstand in for one another. For instance, a jpeg image of the Mona Lisahas much in common with the original painting, but it is not thesame as the painting. http://dublincore.org/documents/usageguide/

The One-to-One principle is inefﬁcient and/ormessy when dealing with multiple manifestations of amedia resource.Steven J. Miller, The One-To-One Principle: Challenges in CurrentPractice

Other Dublin Core gaps

Other Dublin Core gaps• DC has no place for genre

Other Dublin Core gaps• DC has no place for genre• DC says nothing about versioning or provenance

Other Dublin Core gaps• DC has no place for genre• DC says nothing about versioning or provenance• DC says little about media format

PBCore• built on Dublin Core• created by the American public broadcasting community for use by public media• funded by the Corporation for Public Broadcasting pbcore.org

PBCore Strengths• Simple like Dublin Core• Improved for moving images• Solves the one-to-one problem• Strong on technical metadata• Extensible• User community growth

People using PBCore• PBS & NPR & local stations• Film Archives• Northeast Historic Film• Democracy Now!• Fresh Air with Terry Gross• WNYC• The Dance Heritage Collection• Alliance for Community Media• Open Media Project• The Rock n’ Roll Hall of Fame• The American Archive• User community growing fast...

PBCore Community• pbcore.org• PBCore listserv• pbcoreresources.org

PBCore Versions• 1.0 - ﬁrst public release in 2005• 1.1 - January 2007, minor ﬁxes• 1.2 - December 2008, added pbcoreEssenceTrack• 1.3 - August 2010, added the top-level element pbcoreAssetType• 2.0 - February 2011, many improvements based on user-community input• 2.1 - Hopefully soon

PBCore Structure:Asset: the media item in the abstract

PBCore Structure:Instantiation: a physical or digital instance of the asset

PBCore Structure:A single Asset can have many Instantiations

PBCore Structure:• Asset: the media item in the abstract• Instantiation: a physical or digital instance of the asset• A single Asset can have many Instantiations

PBCore Instantiations

PBCore Instantiations• Instantiations capture technical metadata for either physical or digital media objects

PBCore Instantiations• Instantiations capture technical metadata for either physical or digital media objects• This is needed for provenance and preservation

PBCore Instantiations• Instantiations capture technical metadata for either physical or digital media objects• This is needed for provenance and preservation• Also needed by software applications that handle digital media

PBCore Instantiations• Instantiations capture technical metadata for either physical or digital media objects• This is needed for provenance and preservation• Also needed by software applications that handle digital media• Also important for answering the question “Where is the media object?”

PBCore compared with Dublin Core Dublin Core PBCoretitle titlecreator creatorsubject subjectdescription descriptionpublisher publishercontributor contributordate datetype typeformat formatidentiﬁer identiﬁersource sourcelanguage languagerelation relationcoverage coveragerights rights

Required Elements in PBCore • Identiﬁer • Title • Description

additional descriptive elements • Genre • Audience Level • Audience Rating • Creator • Contributor • Publisher

new PBCore root element Collection

PBCore Instantiation additional elements • instantiationIdentifier • instantiationDate • instantiationDimensions • instantiationPhysical • instantiationDigital • instantiationStandard • instantiationLocation • instantiationMediaType • instantiationGenerations • instantiationFileSize • instantiationTimeStart • instantiationDuration • instantiationDataRate • instantiationColors • instantiationTracks • instantiationChannelConfiguration • instantiationLanguage • instantiationAlternativeModes • instantiationEssenceTrack • instantiationRelation • instantiationRelationType • instantiationRelationIdentifier • instantiationRights • rightsSummary • rightsLink • rightsEmbedded • instantiationAnnotation • instantiationPart • instantiationExtension

PBCore instantiationEssenceTrack subelements: instantiationEssenceTrack • essenceTrackType • essenceTrackIdentiﬁer • essenceTrackStandard • essenceTrackEncoding • essenceTrackDataRate • essenceTrackFrameRate • essenceTrackPlaybackSpeed • essenceTrackSamplingRate • essenceTrackBitDepth • essenceTrackFrameSize • essenceTrackAspectRatio • essenceTrackTimeStart • essenceTrackDuration • essenceTrackLanguage • essenceTrackAnnotation • essenceTrackExtension

Instantiation Tools for Digital Media • GetID3 • FFMPEG • MediaInfo • MediaInfo Mac application • PBCore Instantiationizer

PART THREE: Tools

Stupid CMS Tricks

ExpressionEngine

The TIME Project

Drupal

It’s about Data Portability

We can export and import structured data

Ensemble Video

Merlin

Catalog by any means necessary

But follow standards andprovide structured data

PART FOUR:PBCore 2.0

PBCore 1.x weaknesses• No way to record separate dates for the Asset and its Instantiations• No way to record information about multi-part Instantiations• No way to record distinct rights information for different Instantiations• No way to show relationships between Instantiations, e.g. that an MPEG4 file was made from a master video file• You can record that Harrison Ford is an Actor, but you can’t specify what role he plays in the film• You can’t identify clip information within an asset, e.g. where in the timeline a subject or person occurs• You can’t bundle together a collection of PBCore 1.x records for easy transfer to other technical systems and collections

new in PBCore 2.0 Attributes

pbcoreIdentifier element: PBCore 1.x<pbcoreIdentifier> <identifier>focus050923a</identifier> <identifierSource>Illinois Public Media</identifierSource></pbcoreIdentifier>

pbcoreIdentifier element: PBCore 1.x<pbcoreIdentifier> <identifier>focus050923a</identifier> <identifierSource>Illinois Public Media</identifierSource></pbcoreIdentifier> PBCore 2.0

pbcoreIdentifier element: PBCore 1.x <pbcoreIdentifier> <identifier>focus050923a</identifier> <identifierSource>Illinois Public Media</identifierSource> </pbcoreIdentifier> PBCore 2.0 <pbcoreIdentifier source="Illinois Public Media"ref="http://will.illinois.edu">focus050923a</pbcoreIdentifier>

Key Concept: URI: Uniform Resource Identifiera string of characters used to identify a name or a resource on theInternet. Such identification enables interaction with representations ofthe resource over a network (typically the World Wide Web) usingspecific protocols.

pbcoreSubject element: PBCore 1.x<pbcoreSubject> <subject>Insurgency--Iraq</subject> <subjectAuthorityUsed>Library of Congress Subject Headings</subjectAuthorityUsed></pbcoreSubject>

pbcoreSubject element: PBCore 1.x<pbcoreSubject> <subject>Insurgency--Iraq</subject> <subjectAuthorityUsed>Library of Congress Subject Headings</subjectAuthorityUsed></pbcoreSubject> PBCore 2.0

pbcoreSubject element: PBCore 1.x<pbcoreSubject> <subject>Insurgency--Iraq</subject> <subjectAuthorityUsed>Library of Congress Subject Headings</subjectAuthorityUsed></pbcoreSubject> PBCore 2.0<pbcoreSubject source="Library of Congress Subject Headings" ref="http://id.loc.gov/authorities/sh2008123892#concept">Insurgency--Iraq</pbcoreSubject>

PBCore 2.0 subject with time attributes<pbcoreSubject source="Library of Congress Subject Headings"ref="http://id.loc.gov/authorities/sh2008123892#concept"startTime=”00:23:14” endTime=”00:27:28”>Insurgency--Iraq</pbcoreSubject>

pbcoreCoverage element: PBCore 1.x<pbcoreCoverage> <coverage>Iraq</coverage> <coverageType>Spatial</coverageType></pbcoreCoverage>

pbcoreCoverage element: PBCore 1.x<pbcoreCoverage> <coverage>Iraq</coverage> <coverageType>Spatial</coverageType></pbcoreCoverage> PBCore 2.0

pbcoreCoverage element: PBCore 1.x<pbcoreCoverage> <coverage>Iraq</coverage> <coverageType>Spatial</coverageType></pbcoreCoverage> PBCore 2.0<pbcoreCoverage> <coverage source="ISO-3166" ref="http://www.geonames.org/countries/IQ/iraq.html">IRQ</coverage> <coverageType>Spatial</coverageType></pbcoreCoverage>

pbcoreCreator element: PBCore 1.x<pbcoreCreator> <creator>WILL-AM</creator> <creatorRole>Production Unit</creatorRole></pbcoreCreator>

pbcoreCreator element: PBCore 1.x<pbcoreCreator> <creator>WILL-AM</creator> <creatorRole>Production Unit</creatorRole></pbcoreCreator> PBCore 2.0

pbcoreCreator element: PBCore 1.x<pbcoreCreator> <creator>WILL-AM</creator> <creatorRole>Production Unit</creatorRole></pbcoreCreator> PBCore 2.0<pbcoreCreator> <creator afﬁliation="University of Illinois" ref=”http://will.illinois.edu/am”>WILL-AM</creator> <creatorRole>Production Unit</creatorRole></pbcoreCreator>

pbcoreContributor element: PBCore 1.x<pbcoreContributor> <contributor>John Brady Kiesling</contributor> <contributorRole>Interviewee</contributorRole></pbcoreContributor>

pbcoreContributor element: PBCore 1.x<pbcoreContributor> <contributor>John Brady Kiesling</contributor> <contributorRole>Interviewee</contributorRole></pbcoreContributor> PBCore 2.0

pbcoreContributor element: PBCore 1.x <pbcoreContributor> <contributor>John Brady Kiesling</contributor> <contributorRole>Interviewee</contributorRole> </pbcoreContributor> PBCore 2.0 <pbcoreContributor> <contributor ref="http://en.wikipedia.org/wiki/Brady_Kiesling">John Brady Kiesling</contributor> <contributorRole source="PBCore" ref="http://pbcore.org/vocabularies/contributorRole#interviewee">Interviewee</contributorRole> </pbcoreContributor>

PBCore 2.0 Contributor with portrayal attribute <pbcoreContributor> <contributor ref="http://en.wikipedia.org/wiki/Sean_Connery">Sean Connery</contributor> <contributorRole portrayal=”James Bond” source="PBCore" ref="http://pbcore.org/vocabularies/contributorRole#actor">Actor</contributorRole> </pbcoreContributor>

pbcoreRightsSummary: PBCore 1.x <pbcoreRightsSummary> <rightsSummary>Permission granted by the copyright holder to stream and download fornon-proﬁt and educational use.</rightsSummary>

pbcoreRightsSummary: PBCore 1.x <pbcoreRightsSummary> <rightsSummary>Permission granted by the copyright holder to stream and download fornon-proﬁt and educational use.</rightsSummary> PBCore 2.0

pbcoreRightsSummary: PBCore 1.x <pbcoreRightsSummary> <rightsSummary>Permission granted by the copyright holder to stream and download fornon-proﬁt and educational use.</rightsSummary> PBCore 2.0 <pbcoreRightsSummary> <rightsSummary>Permission granted by the copyright holder to stream and download for non-proﬁtand educational use under a Creative Commons Attribution-NonCommercial-ShareAlike 2.0 Generic (CCBY-NC-SA 2.0)</rightsSummary> <rightsLink>http://creativecommons.org/licenses/by-nc-sa/2.0/</rightsLink> </pbcoreRightsSummary>

PBCore 2.0 Common Attributes

PBCore 2.0 Common Attributes • Source • Ref • Version • Annotation

PBCore 2.0 Common Attributes • Source • Ref • Version • Annotation • startTime • endTime • timeAnnotation

a PBCore 2.0 record:<?xml version="1.0" encoding="UTF-8"?> <PBCoreDescriptionDocument xmlns="http://www.pbcore.org/PBCore/PBCoreNamespace.html"> <pbcoreAssetType ref="http://pbcore.org/vocabularies/pbcoreAssetType#program">Program</pbcoreAssetType> <pbcoreAssetDate>Fri, 23 Sep 2005 12:00:00 CST</pbcoreAssetDate> <pbcoreIdentifier source="Illinois Public Media" ref="http://will.illinois.edu">focus050923a</pbcoreIdentifier> <pbcoreTitle titleType="Main">The War In Iraq: U.S. Foreign Policy And The Crisis Of International Legitimacy</pbcoreTitle> <pbcoreSubject subjectType="topic" source="Illinois Public Media Subjects">Iraq</pbcoreSubject> <pbcoreSubject subjectType="topic" source="Library of Congress Subject Headings" ref="http://id.loc.gov/authorities/sh2008123892#concept">Insurgency--Iraq</ pbcoreSubject> <pbcoreDescription descriptionType="Summary" ref="http://pbcore.org/vocabularies/pbcoreDescription/descriptionType#summary">WILL Radio interview with John Brady Kiesling, former U.S. diplomat, on “The War In Iraq: U.S. Foreign Policy And The Crisis Of International Legitimacy”</pbcoreDescription> <pbcoreGenre source="PBCore" ref="http://pbcore.org/vocabularies/pbcoreGenre#interview">Interview</pbcoreGenre> <pbcoreCoverage> <coverage source="ISO-3166" ref="http://www.geonames.org/countries/IQ/iraq.html">IRQ</coverage> <coverageType>Spatial</coverageType> </pbcoreCoverage> <pbcoreCreator> <creator affiliation="Illinois Public Media">Jack Brighton</creator> <creatorRole>Interviewer</creatorRole> </pbcoreCreator> <pbcoreCreator> <creator affiliation="University of Illinois" ref="http://will.illinois.edu/am">WILL-AM</creator> <creatorRole>Production Unit</creatorRole> </pbcoreCreator> <pbcoreContributor> <contributor ref="http://en.wikipedia.org/wiki/Brady_Kiesling">John Brady Kiesling</contributor> <contributorRole source="PBCore" ref="http://pbcore.org/vocabularies/contributorRole#interviewee">Interviewee</contributorRole> </pbcoreContributor> <pbcorePublisher> <publisher ref=”http://illinois.edu”>University of Illinois</publisher> <publisherRole ref="http://pbcore.org/vocabularies/publisherRole#copyright-holder">Copyright Holder</publisherRole> </pbcorePublisher> <pbcoreRightsSummary> <rightsSummary>Permission granted by the copyright holder to stream and download for non-profit and educational use under a Creative Commons Attribution- NonCommercial-ShareAlike 2.0 Generic (CC BY-NC-SA 2.0)</rightsSummary> <rightsLink>http://creativecommons.org/licenses/by-nc-sa/2.0/</rightsLink> </pbcoreRightsSummary> <pbcoreInstantiation> <instantiationIdentifier source="Illinois Public Media" ></instantiationIdentifier> <instantiationDate dateType="date created">Fri, 23 Sep 2005 12:00:00 CST</instantiationDate> <instantiationDate dateType="date issued">Fri, 23 Sep 2005 12:10:00 CST</instantiationDate> <instantiationDigital>mp3</instantiationDigital> <instantiationLocation>http://will.illinois.edu/media/focus050923a.mp3</instantiationLocation> <instatiationMediaType>Sound</instatiationMediaType> <instantiationGenerations>Copy: access</instantiationGenerations> <instantiationFileSize unitsOfMeasure="bytes">24767532</instantiationFileSize> <instantiationDuration>00:52:08</instantiationDuration> </pbcoreInstantiation> </PBCoreDescriptionDocument>

PART FIVE:Ontology

Is bark what a dog says or what a tree grows?

Systems of meaning:

Systems of meaning:• Taxonomy: The use of Controlled Vocabularies created and maintained by authorities, e.g. Library of Congress Subject Headings, or PBCore lists on the Open Metadata Registry

Systems of meaning:• Taxonomy: The use of Controlled Vocabularies created and maintained by authorities, e.g. Library of Congress Subject Headings, or PBCore lists on the Open Metadata Registry• Folksonomy: User tagging of content with freestyle keywords for which no authority beyond the user exists

Systems of meaning:• Taxonomy: The use of Controlled Vocabularies created and maintained by authorities, e.g. Library of Congress Subject Headings, or PBCore lists on the Open Metadata Registry• Folksonomy: User tagging of content with freestyle keywords for which no authority beyond the user exists• Taxonomy + Folksonomy = Powerful stuff

Web Services can mapmetadata formats and taxonomies

Linked Data

Intro to PBCore Zen Jack Brighton director of new media & innovation Illinois Public Media jackb@illinois.edu

Intro to PBCore Zen, PBCore workshop, AMIA 2011 - jack brighton

by Jack Brighton on Jan 08, 2012

Accessibility

Categories

Tags

Upload Details

Usage Rights

Statistics

Intro to PBCore Zen, PBCore workshop, AMIA 2011 - jack brighton — Presentation Transcript