0
Interoperability and
Its Role In Standardization
Peter Murray
Assistant Director,Technology Services Development, LYRASIS
...
NISO Update,American Library Association, 30-Jun-2013Cape Town Book Fair at Cape Town Internation Convention Centre by Dan...
NISO Update,American Library Association, 30-Jun-2013
Cape Town Book Fair at Cape Town Internation Convention Centre by Da...
NISO Update,American Library Association, 30-Jun-2013
Cape Town Book Fair at Cape Town Internation Convention Centre by Da...
NISO Update,American Library Association, 30-Jun-2013
Cape Town Book Fair at Cape Town Internation Convention Centre by Da...
NISO Update,American Library Association, 30-Jun-2013
Cape Town Book Fair at Cape Town Internation Convention Centre by Da...
NISO Update,American Library Association, 30-Jun-2013
Cape Town Book Fair at Cape Town Internation Convention Centre by Da...
NISO Update,American Library Association, 30-Jun-2013
Cape Town Book Fair at Cape Town Internation Convention Centre by Da...
NISO Update,American Library Association, 30-Jun-2013
Cape Town Book Fair at Cape Town Internation Convention Centre by Da...
NISO Update,American Library Association, 30-Jun-2013
Cape Town Book Fair at Cape Town Internation Convention Centre by Da...
NISO Update,American Library Association, 30-Jun-2013 3The ghost of a systems admin by Mike Wallis on Flickr
NISO Update,American Library Association, 30-Jun-2013
• MARC
• ONIX
• Z39.50
• EPub
• SIP/NCIP
• EDI
• ISBN
• SUSHI
• Open...
NISO Update,American Library Association, 30-Jun-2013 5
Layer Aim Objects Solutions
Technical
Interoperability
Syntactic
I...
NISO Update,American Library Association, 30-Jun-2013 5
Layer Aim Objects Solutions
Technical
Interoperability
Syntactic
I...
NISO Update,American Library Association, 30-Jun-2013 5
Layer Aim Objects Solutions
Technical
Interoperability
Syntactic
I...
NISO Update,American Library Association, 30-Jun-2013 5
Layer Aim Objects Solutions
Technical
Interoperability
Syntactic
I...
NISO Update,American Library Association, 30-Jun-2013 5
Layer Aim Objects Solutions
Technical
Interoperability
Syntactic
I...
NISO Update,American Library Association, 30-Jun-2013 6
Today...
• ResourceSync
Peter Murray, LYRASIS
• NCIP
Mike Dicus, E...
ResourceSync: Leveraging Sitemaps
for Resource Synchronization
Slides adapted from talk by
Bernhard Haslhofer, University ...
NISO Update,American Library Association, 30-Jun-2013
What?
• A framework for synchronizing Web
resources from a Source to...
NISO Update,American Library Association, 30-Jun-2013
Why?
• rsync: filesystem sync, but not Web
• OAI-PMH: metadata, but n...
NISO Update,American Library Association, 30-Jun-2013
arxiv.org mirroring
• 2.4M resources (PDF,
metadata, Latex src)
• ~8...
NISO Update,American Library Association, 30-Jun-2013
Wikipedia
• 1.4 updates / sec
• many dependent
services reusing
Wiki...
NISO Update,American Library Association, 30-Jun-2013
data.europeana.eu
• aggregates metadata
from >200 data
providers in ...
NISO Update,American Library Association, 30-Jun-2013
Design Guidelines
• Sync small websites / repositories (few
resource...
NISO Update,American Library Association, 30-Jun-2013
Builds on ‘Sitemaps’ Specs
14
<?xml version="1.0" encoding="UTF-8"?>...
NISO Update,American Library Association, 30-Jun-2013
Builds on ‘Sitemaps’ Specs
14
<?xml version="1.0" encoding="UTF-8"?>...
NISO Update,American Library Association, 30-Jun-2013
<?xml version="1.0" encoding="UTF-8"?>
<urlset xmlns="http://www.sit...
NISO Update,American Library Association, 30-Jun-2013
<?xml version="1.0" encoding="UTF-8"?>
<urlset xmlns="http://www.sit...
NISO Update,American Library Association, 30-Jun-2013 16
NISO Update,American Library Association, 30-Jun-2013
Status
• Beta spec (v. 0.9) for public comment
http://www.openarchiv...
NISO Update,American Library Association, 30-Jun-2013
Next Steps
• Continue tool development & deployment
• Collect
• publ...
NISO Update,American Library Association, 30-Jun-2013
Thanks!
@DataG
http://slideshare.net/DataGazetteer
http://openarchiv...
Upcoming SlideShare
Loading in...5
×

Interoperability and Its Role In Standardization, Plus A ResourceSync Overview

3,059

Published on

Presentation at the NISO Update Session. American Library Association. Chicago, IL. Jun 2013

Published in: Technology, Education, Business
0 Comments
3 Likes
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total Views
3,059
On Slideshare
0
From Embeds
0
Number of Embeds
22
Actions
Shares
0
Downloads
5
Comments
0
Likes
3
Embeds 0
No embeds

No notes for slide

Transcript of "Interoperability and Its Role In Standardization, Plus A ResourceSync Overview"

  1. 1. Interoperability and Its Role In Standardization Peter Murray Assistant Director,Technology Services Development, LYRASIS NISO Update,American Library Association 2013 1
  2. 2. NISO Update,American Library Association, 30-Jun-2013Cape Town Book Fair at Cape Town Internation Convention Centre by Danie van der Merwe on Flickr 2
  3. 3. NISO Update,American Library Association, 30-Jun-2013 Cape Town Book Fair at Cape Town Internation Convention Centre by Danie van der Merwe on Flickr DSC01522.JPG by jaysones 2
  4. 4. NISO Update,American Library Association, 30-Jun-2013 Cape Town Book Fair at Cape Town Internation Convention Centre by Danie van der Merwe on Flickr DSC01522.JPG by jaysones Masterton District Library by Keith Davenport on Flickr 2
  5. 5. NISO Update,American Library Association, 30-Jun-2013 Cape Town Book Fair at Cape Town Internation Convention Centre by Danie van der Merwe on Flickr DSC01522.JPG by jaysones Masterton District Library by Keith Davenport on Flickr The OCLC Mothership by Michael Porter on Flickr 2
  6. 6. NISO Update,American Library Association, 30-Jun-2013 Cape Town Book Fair at Cape Town Internation Convention Centre by Danie van der Merwe on Flickr DSC01522.JPG by jaysones Masterton District Library by Keith Davenport on Flickr The OCLC Mothership by Michael Porter on Flickr Self checkout stations by San José Library on Flickr 2
  7. 7. NISO Update,American Library Association, 30-Jun-2013 Cape Town Book Fair at Cape Town Internation Convention Centre by Danie van der Merwe on Flickr DSC01522.JPG by jaysones Masterton District Library by Keith Davenport on Flickr The OCLC Mothership by Michael Porter on Flickr Self checkout stations by San José Library on Flickr The Discharge Area by Canton Public Library on Flickr 2
  8. 8. NISO Update,American Library Association, 30-Jun-2013 Cape Town Book Fair at Cape Town Internation Convention Centre by Danie van der Merwe on Flickr DSC01522.JPG by jaysones Masterton District Library by Keith Davenport on Flickr The OCLC Mothership by Michael Porter on Flickr Self checkout stations by San José Library on Flickr The Discharge Area by Canton Public Library on Flickr 2The future of books by Johan Larsson on Flickr
  9. 9. NISO Update,American Library Association, 30-Jun-2013 Cape Town Book Fair at Cape Town Internation Convention Centre by Danie van der Merwe on Flickr DSC01522.JPG by jaysones Masterton District Library by Keith Davenport on Flickr The OCLC Mothership by Michael Porter on Flickr Self checkout stations by San José Library on Flickr The Discharge Area by Canton Public Library on Flickr 2 The future of books by Johan Larsson on Flickr eBook Readers Galore by Michael Porter on Flickr
  10. 10. NISO Update,American Library Association, 30-Jun-2013 Cape Town Book Fair at Cape Town Internation Convention Centre by Danie van der Merwe on Flickr DSC01522.JPG by jaysones Masterton District Library by Keith Davenport on Flickr The OCLC Mothership by Michael Porter on Flickr Self checkout stations by San José Library on Flickr The Discharge Area by Canton Public Library on Flickr 2 The future of books by Johan Larsson on Flickr eBook Readers Galore by Michael Porter on Flickr
  11. 11. NISO Update,American Library Association, 30-Jun-2013 3The ghost of a systems admin by Mike Wallis on Flickr
  12. 12. NISO Update,American Library Association, 30-Jun-2013 • MARC • ONIX • Z39.50 • EPub • SIP/NCIP • EDI • ISBN • SUSHI • OpenURL • DOI • SRU/SRW • ERM • METS • HTML • RDF • OAI-PMH • DAISY • PDF Standards Making It Happen 4
  13. 13. NISO Update,American Library Association, 30-Jun-2013 5 Layer Aim Objects Solutions Technical Interoperability Syntactic Interoperability Semantic Interoperability Organizational Interoperability Technically Secure Data Transfer Signals Protocols of Data Transfer Processing of Received Data Data Standardized Data Exchange (e.g. XML) Processing and Interpretation of Data Information Common Directories,Data Keys,Ontologies Automatic Linkage of Processes Process (Workflow) Standardized Process Elements “Three dimensions of organizational interoperability”, European Journal of ePractice, Nº 6 · January 2009 · ISSN: 1988-625X Four Levels of Interoperability
  14. 14. NISO Update,American Library Association, 30-Jun-2013 5 Layer Aim Objects Solutions Technical Interoperability Syntactic Interoperability Semantic Interoperability Organizational Interoperability Technically Secure Data Transfer Signals Protocols of Data Transfer Processing of Received Data Data Standardized Data Exchange (e.g. XML) Processing and Interpretation of Data Information Common Directories,Data Keys,Ontologies Automatic Linkage of Processes Process (Workflow) Standardized Process Elements “Three dimensions of organizational interoperability”, European Journal of ePractice, Nº 6 · January 2009 · ISSN: 1988-625X Four Levels of Interoperability
  15. 15. NISO Update,American Library Association, 30-Jun-2013 5 Layer Aim Objects Solutions Technical Interoperability Syntactic Interoperability Semantic Interoperability Organizational Interoperability Technically Secure Data Transfer Signals Protocols of Data Transfer Processing of Received Data Data Standardized Data Exchange (e.g. XML) Processing and Interpretation of Data Information Common Directories,Data Keys,Ontologies Automatic Linkage of Processes Process (Workflow) Standardized Process Elements “Three dimensions of organizational interoperability”, European Journal of ePractice, Nº 6 · January 2009 · ISSN: 1988-625X Four Levels of Interoperability
  16. 16. NISO Update,American Library Association, 30-Jun-2013 5 Layer Aim Objects Solutions Technical Interoperability Syntactic Interoperability Semantic Interoperability Organizational Interoperability Technically Secure Data Transfer Signals Protocols of Data Transfer Processing of Received Data Data Standardized Data Exchange (e.g. XML) Processing and Interpretation of Data Information Common Directories,Data Keys,Ontologies Automatic Linkage of Processes Process (Workflow) Standardized Process Elements “Three dimensions of organizational interoperability”, European Journal of ePractice, Nº 6 · January 2009 · ISSN: 1988-625X Four Levels of Interoperability
  17. 17. NISO Update,American Library Association, 30-Jun-2013 5 Layer Aim Objects Solutions Technical Interoperability Syntactic Interoperability Semantic Interoperability Organizational Interoperability Technically Secure Data Transfer Signals Protocols of Data Transfer Processing of Received Data Data Standardized Data Exchange (e.g. XML) Processing and Interpretation of Data Information Common Directories,Data Keys,Ontologies Automatic Linkage of Processes Process (Workflow) Standardized Process Elements “Three dimensions of organizational interoperability”, European Journal of ePractice, Nº 6 · January 2009 · ISSN: 1988-625X Four Levels of Interoperability
  18. 18. NISO Update,American Library Association, 30-Jun-2013 6 Today... • ResourceSync Peter Murray, LYRASIS • NCIP Mike Dicus, Ex Libris • SIP Ted Coppel,Auto-Graphics • IOTA Rafal Kasprowski, Rice University • Other NISO Initiatives Nettie Lagace, NISO
  19. 19. ResourceSync: Leveraging Sitemaps for Resource Synchronization Slides adapted from talk by Bernhard Haslhofer, University ofVienna WWW 2013, Rio de Janeiro, May 17th http://www.openarchives.org/rs/ 7
  20. 20. NISO Update,American Library Association, 30-Jun-2013 What? • A framework for synchronizing Web resources from a Source to a Destination 8 Web sync
  21. 21. NISO Update,American Library Association, 30-Jun-2013 Why? • rsync: filesystem sync, but not Web • OAI-PMH: metadata, but not resources • Web-DAV: extends HTTP, requires server installation at source • ... 9 … because lots of projects and services are doing synchronization but rely on ad-hoc solutions!
  22. 22. NISO Update,American Library Association, 30-Jun-2013 arxiv.org mirroring • 2.4M resources (PDF, metadata, Latex src) • ~800/day created or updated • uses homebrew mirroring since 1994 (!) • look for more general solution to support independent destinations 10
  23. 23. NISO Update,American Library Association, 30-Jun-2013 Wikipedia • 1.4 updates / sec • many dependent services reusing Wikipedia content (e.g., DBPedia, Freebase, etc.) • harvest articles via OAI- PMH, retrieve changes via IRC, download dumps 11
  24. 24. NISO Update,American Library Association, 30-Jun-2013 data.europeana.eu • aggregates metadata from >200 data providers in Europe • 10 largest providers contribute 80% • >190 providers contribute 20% 12
  25. 25. NISO Update,American Library Association, 30-Jun-2013 Design Guidelines • Sync small websites / repositories (few resources) but also large data collections (millions of resources) • Support low change frequency (weeks / months) to high change frequency (seconds) sources • Low adoption barrier! 13
  26. 26. NISO Update,American Library Association, 30-Jun-2013 Builds on ‘Sitemaps’ Specs 14 <?xml version="1.0" encoding="UTF-8"?> <urlset xmlns="http://www.sitemaps.org/schemas/sitemap/0.9" xmlns:rs="http://www.openarchives.org/rs/terms/"> <rs:md capability="resourcelist" from="2013-01-03T09:00:00Z"/> <url> <loc>http://example.com/res1</loc> <lastmod>2013-01-02T13:00:00Z</lastmod> <rs:md hash="md5:1584abdf8ebdc9802ac0c6a7402c03b6"/> </url> <url> <loc>http://example.com/res2</loc> <lastmod>2013-01-02T14:00:00Z</lastmod> <rs:md hash="md5:1e0d5cb8ef6ba40c99b14c0237be735e"/> </url> </urlset>
  27. 27. NISO Update,American Library Association, 30-Jun-2013 Builds on ‘Sitemaps’ Specs 14 <?xml version="1.0" encoding="UTF-8"?> <urlset xmlns="http://www.sitemaps.org/schemas/sitemap/0.9" xmlns:rs="http://www.openarchives.org/rs/terms/"> <rs:md capability="resourcelist" from="2013-01-03T09:00:00Z"/> <url> <loc>http://example.com/res1</loc> <lastmod>2013-01-02T13:00:00Z</lastmod> <rs:md hash="md5:1584abdf8ebdc9802ac0c6a7402c03b6"/> </url> <url> <loc>http://example.com/res2</loc> <lastmod>2013-01-02T14:00:00Z</lastmod> <rs:md hash="md5:1e0d5cb8ef6ba40c99b14c0237be735e"/> </url> </urlset> <?xml version="1.0" encoding="UTF-8"?> <urlset xmlns="http://www.sitemaps.org/schemas/sitemap/0.9" xmlns:rs="http://www.openarchives.org/rs/terms/"> <rs:md capability="resourcelist" from="2013-01-03T09:00:00Z"/> <url> <loc>http://example.com/res1</loc> <lastmod>2013-01-02T13:00:00Z</lastmod> <rs:md hash="md5:1584abdf8ebdc9802ac0c6a7402c03b6"/> </url> <url> <loc>http://example.com/res2</loc> <lastmod>2013-01-02T14:00:00Z</lastmod> <rs:md hash="md5:1e0d5cb8ef6ba40c99b14c0237be735e"/> </url> </urlset>
  28. 28. NISO Update,American Library Association, 30-Jun-2013 <?xml version="1.0" encoding="UTF-8"?> <urlset xmlns="http://www.sitemaps.org/schemas/sitemap/0.9" xmlns:rs="http://www.openarchives.org/rs/terms/"> <rs:md capability="changelist" from="2013-01-01T11:00:00Z" until="2013-01-03T11:00:00Z"/> <url> <loc>http://example.com/res2.pdf</loc> <lastmod>2013-01-02T13:00:00Z</lastmod> <rs:md change="updated"/> </url> <url> <loc>http://example.com/res3.tiff</loc> <lastmod>2013-01-02T18:00:00Z</lastmod> <rs:md change="deleted"/> </url> </urlset> Builds on ‘Sitemaps’ Specs 15
  29. 29. NISO Update,American Library Association, 30-Jun-2013 <?xml version="1.0" encoding="UTF-8"?> <urlset xmlns="http://www.sitemaps.org/schemas/sitemap/0.9" xmlns:rs="http://www.openarchives.org/rs/terms/"> <rs:md capability="changelist" from="2013-01-01T11:00:00Z" until="2013-01-03T11:00:00Z"/> <url> <loc>http://example.com/res2.pdf</loc> <lastmod>2013-01-02T13:00:00Z</lastmod> <rs:md change="updated"/> </url> <url> <loc>http://example.com/res3.tiff</loc> <lastmod>2013-01-02T18:00:00Z</lastmod> <rs:md change="deleted"/> </url> </urlset> <?xml version="1.0" encoding="UTF-8"?> <urlset xmlns="http://www.sitemaps.org/schemas/sitemap/0.9" xmlns:rs="http://www.openarchives.org/rs/terms/"> <rs:md capability="changelist" from="2013-01-01T11:00:00Z" until="2013-01-03T11:00:00Z"/> <url> <loc>http://example.com/res2.pdf</loc> <lastmod>2013-01-02T13:00:00Z</lastmod> <rs:md change="updated"/> </url> <url> <loc>http://example.com/res3.tiff</loc> <lastmod>2013-01-02T18:00:00Z</lastmod> <rs:md change="deleted"/> </url> </urlset> Builds on ‘Sitemaps’ Specs 15
  30. 30. NISO Update,American Library Association, 30-Jun-2013 16
  31. 31. NISO Update,American Library Association, 30-Jun-2013 Status • Beta spec (v. 0.9) for public comment http://www.openarchives.org/rs/toc • Tool development started • Separate documents for archiving and push deployments 17
  32. 32. NISO Update,American Library Association, 30-Jun-2013 Next Steps • Continue tool development & deployment • Collect • public comments on resourcesync@googlegroups.com • implementation issues on https://github.com/resync/resync/issues • Version 1.0 in fall 2013 (NISO standard) 18
  33. 33. NISO Update,American Library Association, 30-Jun-2013 Thanks! @DataG http://slideshare.net/DataGazetteer http://openarchives.org/rs resourcesync@googlegroups.com 19
  1. A particular slide catching your eye?

    Clipping is a handy way to collect important slides you want to go back to later.

×