Linked Library Data in the wild

Linked Library Datain the wild

Technical Lead for Prism Phil John Introductions...

So, what’s Prism then? Introductions...

a next generation discovery interface Prism Introductions

(yes…even configuration settings) Built entirely on Linked Data Prism

Discovery of library catalogue resources Prism but grander plans afoot...

...some future sources... Prism ,[object Object]

archives/records (e.g. DS Calm)

rare items/special collections

MARC 21 RDF Performs data conversion Prism

this ensures it keeps in sync with the LMS Initial “bulk” conversion then periodic “delta” files Prism

provided by a suite of RESTful web services Borrower/Availability data pulled from LMS “live” Prism

just add .rss to collectionsor .rdf/.nt/.ttl/.json to items Linked Data API Prism

Extracting data from MARC 21 The Challenges

Some quotes... Extracting Data from MARC 21 ...cataloguers may want to look away now

...and even if it does, there are millions of existing records that we’ll want to convert MARC 21 is not going away anytime soon... Extracting Data from MARC 21

How are we approaching it? Extracting Data from MARC 21

By tackling it in small chunks! Extracting Data from MARC 21

We’ve created a solution that... Extracting Data from MARC 21 ,[object Object]

compartmentalises code for different sections

allows us to experiment ,[object Object]

fires events when it encounters a MARC 21 data structure; very strict with syntax MARC 21 Parser Extracting Data from MARC 21

listens for MARC 21 data structures and hands control over to one or more handlers Event Observer Extracting Data from MARC 21

know how to convert MARC 21structures and fields into linked data Bibliographic Handlers Extracting Data from MARC 21

So, where are we up to? Extracting Data from MARC 21

we tackled this one first as it allows us to reason more fully about the record Format (and duration) Extracting Data from MARC 21

In theory quite easy... Format

...in practice not so much... Format ,[object Object]

DVD and LaserDisc share(d) a code

LC slow(ish) to support new formats in M21

limited use of control field (007) codings...

...so need to parse text from 3xx, 5xx fields,[object Object]

an important part of the recordto model, or so I’ve been told Title Extracting Data from MARC 21

Quite tricky because... Title ,[object Object]

‡c must be last subfield in a 245...

...so sometimes data from ‡n / ‡p is in ‡c instead...

...which means we can’t just drop the ‡c ,[object Object]

sounds easy...acronyms from EAN to UPC describing 13 digit codes...right? Identifier Extracting Data from MARC 21

what are all those other things doing in the ‡a? ...STOP! Identifier

Identifier “For a hardbound resource, there is no attempt to use a consistent term other than to use one that conveys the condition intelligibly.” Library of Congress Rule Interpretation 1.8

(and then validate whatever’s left) So we need to parse them out Identifier

LDR: 01425ngm a22005058 4504 001: 750785 003: xxxxxxx 005: 20090824164118.0 007: vd||s|||| 008: 080623s2007 enk||| e v|eng d 020: , | $c Retail (S24.99) | 024: 3, | $a 7321900108089 | 028: 4, 0 | $a BDY10808 | $b Warner Home Video | 029: , | $a 7321900108089 | 082: , | $a 812 245: 0, 0 | $a Goodfellas | $h [videorecording] / | $c directed by Martin Scorsese ; music by Christopher Brooks 260: , | $b Warner Home Video, | $c 2007. | 300: , | $a 1 Blu-Ray (139 min.) : | $b col. | 306: , | $a 021900 | 366: , | $b 20070611 | 511: , | $a Starring Robert De Niro, Ray Liotta and Joe Pesci 521: 8, | $a BBFC code: 18. | 538: , | $a Blu-Ray. | 700: 1, | $a Scorsese, Martin | 700: 1, | $a Brooks, Christopher | 852: , | $b John Harvard | $c BLU-RAY DISC | $m 18 | $z , $z Blu Ray Disc. 18Cert Phew, this one’s easy, no (pbk), (hbk) or even (pbk. , alk. paper) to contend with

Now we can start performing lookups against other sources!

hardest of the lot... Author Extracting Data from MARC 21

...why? Author ,[object Object]

Rowling, J.K. vs Rowling, Joanne K.

Few records with relator term in 100/700 ‡e...

...so we have to parse that from the 245 ‡c...

...and we don’t just deal with English records.,[object Object]

we’ve licensed the names/subjects authority files, and created RDF from them Library of Congress to the rescue! Author

LDR: 01425ngm a22005058 4504 001: 750785 003: xxxxxxx 005: 20090824164118.0 007: vd||s|||| 008: 080623s2007 enk||| e v|eng d 020: , | $c Retail (S24.99) | 024: 3, | $a 7321900108089 | 028: 4, 0 | $a BDY10808 | $b Warner Home Video | 029: , | $a 7321900108089 | 082: , | $a 812 245: 0, 0 | $a Goodfellas | $h [videorecording] / | $c directed by Martin Scorsese ; music by Christopher Brooks 260: , | $b Warner Home Video, | $c 2007. | 300: , | $a 1 Blu-Ray (139 min.) : | $b col. | 306: , | $a 021900 | 366: , | $b 20070611 | 511: , | $a Starring Robert De Niro, Ray Liotta and Joe Pesci 521: 8, | $a BBFC code: 18. | 538: , | $a Blu-Ray. | 700: 1, | $a Scorsese, Martin | 700: 1, | $a Brooks, Christopher | $e music 852: , | $b John Harvard | $c BLU-RAY DISC | $m 18 | $z , $z Blu Ray Disc. 18Cert A contrived example (sorry!) with and without relator terms

Hope you can all read this at the back!

A closer look at Authority Matching Author

Some requirements: Author ,[object Object]

...(able to process 2M records in several hours)

must handle pseudonyms and variant spellings,[object Object]

You can tell J.K. Rowling is successful, she’s been translated lots

Language/Alternate Graphical Representation Extracting Data from MARC 21

Nice “high impact” feature Language ,[object Object]

Linked Library Data in the wild

Recommended

Recommended

More Related Content

Similar to Linked Library Data in the wild

Similar to Linked Library Data in the wild (20)

Recently uploaded

Recently uploaded (20)

Linked Library Data in the wild