Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.
“Synchronize your resources with ResourceSync”
July 10, 2013, Open Repositories 2013, PEI, Canada
Synchronize your
resourc...
“Synchronize your resources with ResourceSync”
July 10, 2013, Open Repositories 2013, PEI, Canada 2
Team sport
“Synchronize your resources with ResourceSync”
July 10, 2013, Open Repositories 2013, PEI, Canada 3
more, still more missi...
“Synchronize your resources with ResourceSync”
July 10, 2013, Open Repositories 2013, PEI, Canada 4
Alfred P. Sloan
Founda...
“Synchronize your resources with ResourceSync”
July 10, 2013, Open Repositories 2013, PEI, Canada
Synchronize
• keep “in s...
“Synchronize your resources with ResourceSync”
July 10, 2013, Open Repositories 2013, PEI, Canada
Resources
aka Web Resour...
“Synchronize your resources with ResourceSync”
July 10, 2013, Open Repositories 2013, PEI, Canada
Why?
“Synchronize your resources with ResourceSync”
July 10, 2013, Open Repositories 2013, PEI, Canada
Scholarly repositories
•...
“Synchronize your resources with ResourceSync”
July 10, 2013, Open Repositories 2013, PEI, Canada
Linked data
Fundamentall...
“Synchronize your resources with ResourceSync”
July 10, 2013, Open Repositories 2013, PEI, Canada
Didn’t you sell us OAI-
...
“Synchronize your resources with ResourceSync”
July 10, 2013, Open Repositories 2013, PEI, Canada
What?
“Synchronize your resources with ResourceSync”
July 10, 2013, Open Repositories 2013, PEI, Canada
1. Baseline sync
Initial...
“Synchronize your resources with ResourceSync”
July 10, 2013, Open Repositories 2013, PEI, Canada
2. Incremental sync
Keep...
“Synchronize your resources with ResourceSync”
July 10, 2013, Open Repositories 2013, PEI, Canada
3. Audit
Destination sho...
“Synchronize your resources with ResourceSync”
July 10, 2013, Open Repositories 2013, PEI, Canada
How?
“Synchronize your resources with ResourceSync”
July 10, 2013, Open Repositories 2013, PEI, Canada
“Synchronize your resources with ResourceSync”
July 10, 2013, Open Repositories 2013, PEI, Canada 17
Minor?
<urlset xmlns=...
“Synchronize your resources with ResourceSync”
July 10, 2013, Open Repositories 2013, PEI, Canada
Baseline sync & Google
M...
19
Modular
Discovery
Four Core
Capabilities
1 2 3 4
“Synchronize your resources with ResourceSync”
July 10, 2013, Open Repositories 2013, PEI, Canada
Extensible
Extensible us...
“Synchronize your resources with ResourceSync”
July 10, 2013, Open Repositories 2013, PEI, Canada
Push = Lower latency
Pul...
“Synchronize your resources with ResourceSync”
July 10, 2013, Open Repositories 2013, PEI, Canada
Timeline
January 2013
Ju...
23
http://www.openarchives.org/rs/
• Framework
• Archives
• Push (to come)
• Links to Google
group, associated
articles, b...
24
Upcoming SlideShare
Loading in …5
×

ResourceSync in 24x7

921 views

Published on

Overview of ResourceSync (http://www.openarchives.org/rs) given as a 24x7 presentation at Open Repositories 2013 (http://or2013.net/), July 10, 2013.

Published in: Education, Technology, Business
  • Be the first to comment

ResourceSync in 24x7

  1. 1. “Synchronize your resources with ResourceSync” July 10, 2013, Open Repositories 2013, PEI, Canada Synchronize your resources with ResourceSync Simeon Warner (Cornell University Library) 1
  2. 2. “Synchronize your resources with ResourceSync” July 10, 2013, Open Repositories 2013, PEI, Canada 2 Team sport
  3. 3. “Synchronize your resources with ResourceSync” July 10, 2013, Open Repositories 2013, PEI, Canada 3 more, still more missing JISC Richard Jones Graham Klyne Stuart Lewis OCLC Jeff Young LOCKSS David Rosenthal RedHat Christian Sadilek Ex Libris Inc. Shlomo Sanders Library of Congress Kevin Ford
  4. 4. “Synchronize your resources with ResourceSync” July 10, 2013, Open Repositories 2013, PEI, Canada 4 Alfred P. Sloan Foundation
  5. 5. “Synchronize your resources with ResourceSync” July 10, 2013, Open Repositories 2013, PEI, Canada Synchronize • keep “in sync” (colloq.) • Following changes over time and • Keeping copies on different systems the same • Tackle only the unidirectional problem: From a Source, to a Destination 5
  6. 6. “Synchronize your resources with ResourceSync” July 10, 2013, Open Repositories 2013, PEI, Canada Resources aka Web Resources: have URI, HTTP GET representation(s)  Many / Few  Big / Small  Fast / Slow 6
  7. 7. “Synchronize your resources with ResourceSync” July 10, 2013, Open Repositories 2013, PEI, Canada Why?
  8. 8. “Synchronize your resources with ResourceSync” July 10, 2013, Open Repositories 2013, PEI, Canada Scholarly repositories • Replicate data/articles for mirroring, reuse, indexing, ... • OAI-PMH for metadata • Many custom solutions for full content 8
  9. 9. “Synchronize your resources with ResourceSync” July 10, 2013, Open Repositories 2013, PEI, Canada Linked data Fundamentally distributed but local copy often required. Either: 1. cache 2. sync local copy... • Many custom solutions for local copy 9 Last.FM MusicBrainz GeoNames DBpedia others... BBC
  10. 10. “Synchronize your resources with ResourceSync” July 10, 2013, Open Repositories 2013, PEI, Canada Didn’t you sell us OAI- PMH? Or... will ResourceSync replace OAI-PMH?  Proven metadata transfer protocol  Widely adopted in our community X Predates REST, not “of the web” X Not adopted for content transfer Can replace, likely coexistence 10
  11. 11. “Synchronize your resources with ResourceSync” July 10, 2013, Open Repositories 2013, PEI, Canada What?
  12. 12. “Synchronize your resources with ResourceSync” July 10, 2013, Open Repositories 2013, PEI, Canada 1. Baseline sync Initial load, copy, or catch-up from source • need list of all resources • optional packaged content Want to • avoid out-of-band setup & customization 12
  13. 13. “Synchronize your resources with ResourceSync” July 10, 2013, Open Repositories 2013, PEI, Canada 2. Incremental sync Keep up-to-date with changes at a source • need information about changes • optional packaged content • minimal primitives: create/update/delete Want • allow catch-up after destination offline • lower latency and/or greater efficiency than repeated baseline sync 13
  14. 14. “Synchronize your resources with ResourceSync” July 10, 2013, Open Repositories 2013, PEI, Canada 3. Audit Destination should be able to verify whether it is synchronized with a source • need list of all resources + fixity info Want • lower latency and/or greater efficiency than baseline sync • note: subject to some latency 14
  15. 15. “Synchronize your resources with ResourceSync” July 10, 2013, Open Repositories 2013, PEI, Canada How?
  16. 16. “Synchronize your resources with ResourceSync” July 10, 2013, Open Repositories 2013, PEI, Canada
  17. 17. “Synchronize your resources with ResourceSync” July 10, 2013, Open Repositories 2013, PEI, Canada 17 Minor? <urlset xmlns=“http://www.sitemaps.org/schemas/sitemap/0.9” xmlns:rs="http://www.openarchives.org/rs/terms/”> <rs:ln …/> <rs:md …/> <url> <loc>http://example.com/res1</loc> <lastmod>2013-01-02T13:00:00Z</lastmod> <rs:ln …/> <rs:md …/> </url> <url> … </url> </urlset>
  18. 18. “Synchronize your resources with ResourceSync” July 10, 2013, Open Repositories 2013, PEI, Canada Baseline sync & Google Most basic capability is Resource List: • Snapshot of state of resources • URI, datestamp + optional extra fixity info • Destination does GET on each resource ResourceSync Baseline sync & Audit Google/Bing/Yahoo!/etc. harvest 18
  19. 19. 19 Modular Discovery Four Core Capabilities 1 2 3 4
  20. 20. “Synchronize your resources with ResourceSync” July 10, 2013, Open Repositories 2013, PEI, Canada Extensible Extensible use of Link Relations from Atom • Spec describes use for mirrors, patches, historical, provenance, conneg... • Use <rs:ln rel=“your-relation-here” .../> Extensible attributes for fixity etc. • Includes lastmod, fixity, length, type... Extensible framework -> new capabilities 20
  21. 21. “Synchronize your resources with ResourceSync” July 10, 2013, Open Repositories 2013, PEI, Canada Push = Lower latency Pull • easy setup, no trust required Push Changes • lower latency, better scaling • same descriptions as pull • standard transports (XMPP, Websockets...) • can push discovery info to trigger pull 21
  22. 22. “Synchronize your resources with ResourceSync” July 10, 2013, Open Repositories 2013, PEI, Canada Timeline January 2013 June 2013 July 2013 Fall 2013 • Tools and libraries being developed to ease implementation  First beta  Version 0.9  Update and push spec  NISO standardization • Tutorials at major conferences (OAI8, OR, JCDL,...) 22
  23. 23. 23 http://www.openarchives.org/rs/ • Framework • Archives • Push (to come) • Links to Google group, associated articles, blogs, etc.
  24. 24. 24

×