eXtensible Catalog - afternoon session - Tilburg

1,634 views

Published on

eXtensible Catalog (afternoon session) Integrated Search Towards Catalogue 2.0
July 31, 2009
Digital Libraries à la Carte 2009
Tilburg University, the Netherlands

Published in: Education
0 Comments
1 Like
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total views
1,634
On SlideShare
0
From Embeds
0
Number of Embeds
4
Actions
Shares
0
Downloads
17
Comments
0
Likes
1
Embeds 0
No embeds

No notes for slide

eXtensible Catalog - afternoon session - Tilburg

  1. 1. eXtensible Catalog David Lindahl University of Rochester
  2. 2. Metadata Management and Connectivity <ul><li>XC OAI Toolkit </li></ul><ul><ul><li>Make metadata available from a repository or ILS that does not already have a standard interface </li></ul></ul><ul><ul><li>Once added, any OAI-PMH harvester can maintain a synchronized copy of data in that repository </li></ul></ul><ul><li>XC NCIP Toolkit </li></ul><ul><ul><li>Access to local authentication system (ILS, LDAP) </li></ul></ul><ul><ul><li>Access to circulation system in an ILS for status and placing requests </li></ul></ul><ul><li>XC Metadata Services Toolkit </li></ul><ul><ul><li>Metadata management tools </li></ul></ul><ul><ul><li>Pluggable services including aggregation, FRBR-ization and record cleanup </li></ul></ul>
  3. 3. XC OAI Toolkit <ul><li>Moves metadata with OAI-PMH </li></ul><ul><ul><li>OAI Toolkit + ILS </li></ul></ul><ul><ul><li>OAI Toolkit + repository </li></ul></ul><ul><ul><li>OAI-PMH works with any metadata schema </li></ul></ul><ul><ul><li>Performance </li></ul></ul><ul><li>All XC components can talk OAI-PMH </li></ul>
  4. 4. XC NCIP Toolkit <ul><li>Integrates circulation with NCIP </li></ul><ul><ul><li>NCIP Toolkit + ILS </li></ul></ul><ul><ul><li>XC discovery interface uses NCIP </li></ul></ul><ul><ul><li>Live circulation status </li></ul></ul><ul><ul><li>Authentication </li></ul></ul><ul><ul><li>Places circulation requests (hold, recall, etc) </li></ul></ul>
  5. 5. XC Software Overview ILS Repository ILS Repository Sources XC Metadata Services Toolkit Aggregation Normalization FRBRization Authority Control Metadata management software XC Drupal Toolkit XC LMS Toolkit Web application platforms OAI NCIP OAI Web Content Management System Next-Generation Catalog Software OAI Harvester OAI Harvester XC OAI Toolkit Connectivity Software XC NCIP Toolkit XC OAI Toolkit
  6. 6. XC Software Overview ILS Repository ILS Repository Sources XC Metadata Services Toolkit Aggregation Normalization FRBRization Authority Control Metadata management software XC Drupal Toolkit XC LMS Toolkit Web application platforms OAI NCIP OAI Web Content Management System Next-Generation Catalog Software OAI Harvester OAI Harvester XC OAI Toolkit Connectivity Software XC NCIP Toolkit XC OAI Toolkit
  7. 7. These records are stored in folders setup by OAI Toolkit ILS Sources XC OAI Toolkit Connectivity Software OAI Toolkit Software Convert to XC-item OAI-PMH Provider Convert Database (XML records) Modify OAI Toolkit Server Machine Load MARCXML records and XC-item records available for harvest via OAI-PMH protocol ILS software MARC Holding Records MARC Authority Records Item Data MARC Bibliographic Records ILS Server Machine MARCXML MARCXML Schedule to run nightly XC item Convert, Modify and Load Script RAW MARC Raw item data export file ILS Export Script Schedule to run nightly ILS Item-data Export Script
  8. 8. NCIP Toolkit ILS (Voyager) Configuration File ILS Sources Connectivity Software XC NCIP Toolkit Aleph Interface III Interface Illiad Interface Voyager Interface Request Listener Request Handler ILS Interface
  9. 9. XC Software Overview ILS Repository ILS Repository Sources XC Metadata Services Toolkit Aggregation Normalization FRBRization Authority Control Metadata management software XC Drupal Toolkit XC LMS Toolkit Web application platforms OAI NCIP OAI Web Content Management System Next-Generation Catalog Software OAI Harvester OAI Harvester XC OAI Toolkit Connectivity Software XC NCIP Toolkit XC OAI Toolkit
  10. 10. XC Metadata Services Toolkit <ul><li>Enables libraries to aggregate metadata and run services on it </li></ul><ul><li>User interface for library staff, not end users </li></ul><ul><li>NOT a metadata editor (but can eventually incorporate one) </li></ul><ul><li>Services </li></ul><ul><ul><li>Automated </li></ul></ul><ul><ul><li>Configurable </li></ul></ul><ul><ul><li>Pluggable </li></ul></ul>
  11. 11. How the XC MST works <ul><li>OAI-PMH Harvester </li></ul><ul><ul><li>Register remote OAI-PMH repositories to pull metadata from, select subsets </li></ul></ul><ul><ul><li>Schedule harvests to pull incremental changes </li></ul></ul><ul><li>Local storage </li></ul><ul><ul><li>Stores harvested metadata in any XML format </li></ul></ul><ul><ul><li>Stores results of processing by services </li></ul></ul><ul><li>OAI-PMH providers (repositories) </li></ul><ul><ul><li>Makes all locally stored metadata available to other harvesters </li></ul></ul><ul><ul><li>Make improved metadata available </li></ul></ul>
  12. 12. How the XC MST works <ul><li>Services </li></ul><ul><ul><li>Downloadable, plug-in services that process metadata and make new versions of the metadata </li></ul></ul><ul><ul><li>XC provides some services, or build your own </li></ul></ul><ul><li>Orchestration </li></ul><ul><ul><li>Select metadata for processing and sequence it through services </li></ul></ul><ul><li>Faceted browse interface </li></ul><ul><ul><li>Library staff can browse harvested and processed metadata </li></ul></ul><ul><ul><li>Works with any XML schema </li></ul></ul><ul><li>Logs </li></ul><ul><ul><li>Debug issues with harvested or processed metadata </li></ul></ul>
  13. 13. XC advantages for metadata <ul><li>Enables automated handling of metadata changes: </li></ul><ul><ul><li>New records, updates, deletes </li></ul></ul><ul><ul><li>Propagates changes throughout the system </li></ul></ul><ul><li>Web interfaces for trouble-shooting </li></ul><ul><li>Low risk of data corruption (easy to fix) </li></ul><ul><li>Ideal platform for experimentation </li></ul>
  14. 14. New roles for catalogers <ul><li>Design and test metadata services </li></ul><ul><li>Manage flow of metadata </li></ul><ul><li>System/application design </li></ul><ul><li>User research </li></ul>
  15. 15. XC metadata services <ul><li>Normalization </li></ul><ul><ul><li>Transform metadata so that it can be displayed </li></ul></ul><ul><li>Schema transformation: </li></ul><ul><ul><li>MARCXML to XC, DC to XC </li></ul></ul><ul><li>“ FRBRization” </li></ul><ul><li>Authority control matching </li></ul><ul><li>Aggregation </li></ul>
  16. 16. Normalization Services <ul><li>MARCXML, Dublin Core </li></ul><ul><li>Stays in same schema </li></ul><ul><li>Prepares metadata for use in web applications (faceted browse interface) or back into an ILS </li></ul><ul><li>Examples of normalized coded data: </li></ul><ul><ul><li>Location codes </li></ul></ul><ul><ul><li>Languages </li></ul></ul><ul><ul><li>Type of material </li></ul></ul>
  17. 17. Transformation Services <ul><li>MARCXML to XC Schema; DC to XC Schema </li></ul><ul><li>Parses data into FRBR Group 1 entity structure (work, expression, manifestation, item, plus holdings) </li></ul><ul><li>Creates additional works and expressions for MARC analytics (7XX fields) </li></ul>
  18. 18. Authority Control Services <ul><li>MARCXML, Dublin Core </li></ul><ul><li>Match headings against MARCXML authority resource file </li></ul><ul><li>Populate records with authority control identifier </li></ul><ul><li>Tool for debugging probable, unlikely matches </li></ul><ul><li>Prototype developed by RIT students </li></ul>
  19. 19. Aggregation Service <ul><li>Prepares metadata for use in XC user interfaces (Drupal and LMS Toolkits) </li></ul><ul><li>Aggregates records that represent the same resource </li></ul><ul><li>Manages relationships between records </li></ul><ul><li>Will give us experience managing FRBRized records </li></ul>
  20. 20. eXtensibleCatalog.org [email_address]
  21. 21. Metadata Services Toolkit <ul><li>Add Repositories </li></ul><ul><li>Schedule Harvests </li></ul><ul><li>Orchestrate Services </li></ul><ul><li>Browse Records </li></ul><ul><li>Make improved metadata available </li></ul>Metadata Services Toolkit Record Cleanup FRBRization Authority Control Aggregation <ul><li>Metadata Tools: </li></ul>
  22. 22. Metadata Services Toolkit <ul><li>Add Repositories </li></ul><ul><li>Schedule Harvests </li></ul><ul><li>Orchestrate Services </li></ul><ul><li>Browse Records </li></ul><ul><li>Make improved metadata available </li></ul>Metadata Services Toolkit Record Cleanup FRBRization Authority Control Aggregation <ul><li>Metadata Tools: </li></ul>
  23. 23. Metadata Services Toolkit <ul><li>Add Repositories </li></ul><ul><li>Schedule Harvests </li></ul><ul><li>Orchestrate Services </li></ul><ul><li>Browse Records </li></ul><ul><li>Make improved metadata available </li></ul>Metadata Services Toolkit Record Cleanup FRBRization Authority Control Aggregation <ul><li>Metadata Tools: </li></ul>
  24. 24. Metadata Services Toolkit <ul><li>Add Repositories </li></ul><ul><li>Schedule Harvests </li></ul><ul><li>Orchestrate Services </li></ul><ul><li>Browse Records </li></ul><ul><li>Make improved metadata available </li></ul>Metadata Services Toolkit Record Cleanup FRBRization Authority Control Aggregation <ul><li>Metadata Tools: </li></ul>
  25. 25. Metadata Services Toolkit <ul><li>Add Repositories </li></ul><ul><li>Schedule Harvests </li></ul><ul><li>Orchestrate Services </li></ul><ul><li>Browse Records </li></ul><ul><li>Make improved metadata available </li></ul>Metadata Services Toolkit Record Cleanup FRBRization Authority Control Aggregation <ul><li>Metadata Tools: </li></ul>
  26. 26. Metadata Services Toolkit <ul><li>Add Repositories </li></ul><ul><li>Schedule Harvests </li></ul><ul><li>Orchestrate Services </li></ul><ul><li>Browse Records </li></ul><ul><li>Make improved metadata available </li></ul>Metadata Services Toolkit Record Cleanup FRBRization Authority Control Aggregation <ul><li>Metadata Tools: </li></ul>
  27. 27. Metadata Services Toolkit <ul><li>Add Repositories </li></ul><ul><li>Schedule Harvests </li></ul><ul><li>Orchestrate Services </li></ul><ul><li>Browse Records </li></ul><ul><li>Make improved metadata available </li></ul>Metadata Services Toolkit Record Cleanup FRBRization Authority Control Aggregation <ul><li>Metadata Tools: </li></ul>
  28. 28. Metadata Services Toolkit <ul><li>Add Repositories </li></ul><ul><li>Schedule Harvests </li></ul><ul><li>Orchestrate Services </li></ul><ul><li>Browse Records </li></ul><ul><li>Make improved metadata available </li></ul>Metadata Services Toolkit Record Cleanup FRBRization Authority Control Aggregation <ul><li>Metadata Tools: </li></ul>
  29. 29. Metadata Services Toolkit <ul><li>Add Repositories </li></ul><ul><li>Schedule Harvests </li></ul><ul><li>Orchestrate Services </li></ul><ul><li>Browse Records </li></ul><ul><li>Make improved metadata available </li></ul>Metadata Services Toolkit Record Cleanup FRBRization Authority Control Aggregation <ul><li>Metadata Tools: </li></ul>
  30. 30. Metadata Services Toolkit <ul><li>Add Repositories </li></ul><ul><li>Schedule Harvests </li></ul><ul><li>Orchestrate Services </li></ul><ul><li>Browse Records </li></ul><ul><li>Make improved metadata available </li></ul>Error Info Metadata Services Toolkit Record Cleanup FRBRization Authority Control Aggregation <ul><li>Metadata Tools: </li></ul>
  31. 31. Metadata Services Toolkit <ul><li>Add Repositories </li></ul><ul><li>Schedule Harvests </li></ul><ul><li>Orchestrate Services </li></ul><ul><li>Browse Records </li></ul><ul><li>Make improved metadata available </li></ul>Metadata Services Toolkit Record Cleanup FRBRization Authority Control Aggregation <ul><li>Metadata Tools: </li></ul>
  32. 32. Metadata Services Toolkit <ul><li>Add Repositories </li></ul><ul><li>Schedule Harvests </li></ul><ul><li>Orchestrate Services </li></ul><ul><li>Browse Records </li></ul><ul><li>Make improved metadata available </li></ul>Metadata Services Toolkit Record Cleanup FRBRization Authority Control Aggregation <ul><li>Metadata Tools: </li></ul>

×