Becoming Truly Innovative: Migrating from Millennium to Koha Ian Walls code4lib 2010 Asheville, NC 2010-02-24 10:55:00
Variable Declaration <ul><li>$NYUHSL = New York University Health Sciences Libraries; </li></ul><ul><li>$III = Innovative ...
Some Context <ul><li>NYUHSL had been using Millennium for over a decade and a half </li></ul><ul><li>Used to have root acc...
Connection Method 1 2 MEDCat III Firewall
WTF?! <ul><li>When NetSec consolidated, policies were brought into focus </li></ul><ul><li>YOU MAY NOT CIRCUMVENT THE FIRE...
Stalemate <ul><li>NetSec required all vendors to connect using the Juniper VPN </li></ul><ul><li>III only uses the Cisco V...
When Titans collide…
Meanwhile, Koha! <ul><li>Switching to an open source ILS had long been in mind </li></ul><ul><li>Did a test install on an ...
What Info to Migrate? <ul><li>Bibliographic/Authority </li></ul><ul><li>Patron </li></ul><ul><li>Checkouts </li></ul><ul><...
Only Migrate “Active” Patrons <ul><li>Where “Active” means: </li></ul><ul><li>Has an item out OR </li></ul><ul><li>Owes us...
Patron Data Migration
Bibliographic Migration
Why not CSV? <ul><li>Millennium tags to MARC fields not 1-1 </li></ul><ul><li>Also not comprehensive </li></ul><ul><li>Wou...
Bibliographic Migration
Why not Data Exchange? <ul><li>Not set up </li></ul><ul><li>III couldn’t connect to set it up </li></ul><ul><li>May well w...
Bibliographic Migration
Why not OPAC export? <ul><li>No ‘backend’ codes </li></ul><ul><li>No transactional data </li></ul><ul><li>OPAC MARC export...
Why not Shrew? <ul><li>Looked at it, couldn’t really get it to work </li></ul><ul><li>Maybe another library would have mor...
Chosen Method: Xrecords
Overview of Code <ul><li>Supply list of record numbers (bibs and associated items on one line) </li></ul><ul><li>Pulls III...
XSLT! <ul><li>Each XSLT will need to be customized for the institutions particular coding structure </li></ul><ul><li>Mill...
Circ Transactions <ul><li>Quick List export of which patron barcodes have which item barcodes out on which dates </li></ul...
Decision time <ul><li>In May, III and NetSec finally come to an agreement to use Juniper VPN </li></ul><ul><li>This is, of...
Let’s Do This!
Migration Schedule <ul><li>Aug 6: Freeze cataloging in Millennium </li></ul><ul><li>Aug 7: Initial data load into producti...
What Info to Migrate? <ul><li>Bibliographic/Authority (80k/5k) </li></ul><ul><li>Patron (11k) </li></ul><ul><li>Checkouts ...
Serials Issues <ul><li>MFHD support was originally slated for Koha 3.2 </li></ul><ul><li>Um, yeah </li></ul><ul><li>NYUHSL...
The Outcome?
Further Outcome?
Well, maybe more like:
Caveats/Warnings <ul><li>No MFHD support yet </li></ul><ul><li>Diacritics: Bracecodes vs. UTF-8 </li></ul><ul><li>Cross li...
Thanks! <ul><li>Download full package at contribs.koha.org as early as next week </li></ul><ul><li>Thanks to Cody Hennesy ...
Upcoming SlideShare
Loading in …5
×

Becoming Truly Innovative

1,983 views

Published on

Presentation by Ian Walls to Code4Lib 2010 in Asheville, NC on 2010-02-24.

Published in: Technology, Education
1 Comment
3 Likes
Statistics
Notes
  • excellent use of fireballs
       Reply 
    Are you sure you want to  Yes  No
    Your message goes here
No Downloads
Views
Total views
1,983
On SlideShare
0
From Embeds
0
Number of Embeds
4
Actions
Shares
0
Downloads
16
Comments
1
Likes
3
Embeds 0
No embeds

No notes for slide

Becoming Truly Innovative

  1. 1. Becoming Truly Innovative: Migrating from Millennium to Koha Ian Walls code4lib 2010 Asheville, NC 2010-02-24 10:55:00
  2. 2. Variable Declaration <ul><li>$NYUHSL = New York University Health Sciences Libraries; </li></ul><ul><li>$III = Innovative Interfaces, Inc.; </li></ul><ul><li>$NetSec = Network Security (at NYU Med Center); </li></ul>
  3. 3. Some Context <ul><li>NYUHSL had been using Millennium for over a decade and a half </li></ul><ul><li>Used to have root access, but no longer </li></ul><ul><li>Set up a bastion host in 2002 to III allow access </li></ul><ul><li>Outside the library, IT departments in the Med Center are merging… </li></ul>
  4. 4. Connection Method 1 2 MEDCat III Firewall
  5. 5. WTF?! <ul><li>When NetSec consolidated, policies were brought into focus </li></ul><ul><li>YOU MAY NOT CIRCUMVENT THE FIREWALL! </li></ul><ul><li>As Server 2 neared end of life, it was just dismantled and “put on the side of the road” </li></ul><ul><li>Only discovered this because our ILS was down… </li></ul>
  6. 6. Stalemate <ul><li>NetSec required all vendors to connect using the Juniper VPN </li></ul><ul><li>III only uses the Cisco VPN </li></ul><ul><li>NYUHSL just wants their ILS to work </li></ul>
  7. 7. When Titans collide…
  8. 8. Meanwhile, Koha! <ul><li>Switching to an open source ILS had long been in mind </li></ul><ul><li>Did a test install on an old desktop machine </li></ul><ul><li>Just needed to get the pesky data migrated… </li></ul>
  9. 9. What Info to Migrate? <ul><li>Bibliographic/Authority </li></ul><ul><li>Patron </li></ul><ul><li>Checkouts </li></ul><ul><li>Holds </li></ul><ul><li>Serials issues </li></ul><ul><li>Acquisitions </li></ul>
  10. 10. Only Migrate “Active” Patrons <ul><li>Where “Active” means: </li></ul><ul><li>Has an item out OR </li></ul><ul><li>Owes us money OR </li></ul><ul><li>Circ Active since 2008 OR </li></ul><ul><li>Created since 2008 </li></ul><ul><li>AND </li></ul><ul><li>Is ‘active’ according to HR </li></ul>
  11. 11. Patron Data Migration
  12. 12. Bibliographic Migration
  13. 13. Why not CSV? <ul><li>Millennium tags to MARC fields not 1-1 </li></ul><ul><li>Also not comprehensive </li></ul><ul><li>Would have had to manually enter in every MARC subfield in our data not covered by Millennium tags </li></ul><ul><li>What about multiple subfields? </li></ul>
  14. 14. Bibliographic Migration
  15. 15. Why not Data Exchange? <ul><li>Not set up </li></ul><ul><li>III couldn’t connect to set it up </li></ul><ul><li>May well work for anyone in different circumstances </li></ul>
  16. 16. Bibliographic Migration
  17. 17. Why not OPAC export? <ul><li>No ‘backend’ codes </li></ul><ul><li>No transactional data </li></ul><ul><li>OPAC MARC export can only be done in batches on some kind of search (subjects, titles, etc.) </li></ul>
  18. 18. Why not Shrew? <ul><li>Looked at it, couldn’t really get it to work </li></ul><ul><li>Maybe another library would have more luck </li></ul>
  19. 19. Chosen Method: Xrecords
  20. 20. Overview of Code <ul><li>Supply list of record numbers (bibs and associated items on one line) </li></ul><ul><li>Pulls IIIXML in batches </li></ul><ul><li>Converts IIIXML into MARCXML with user-configured XSLT (xalan) </li></ul><ul><li>Imports MARCXML into Koha </li></ul><ul><li>Can handle bib, item & checkin records, or authorities </li></ul>
  21. 21. XSLT! <ul><li>Each XSLT will need to be customized for the institutions particular coding structure </li></ul><ul><li>Millennium codes didn’t map directly to Koha codes; had to use a lot of conditionals </li></ul><ul><li>Certain patterns are common, and make good starting points </li></ul>No
  22. 22. Circ Transactions <ul><li>Quick List export of which patron barcodes have which item barcodes out on which dates </li></ul><ul><li>Can also transport in-house use counts for the year and previous </li></ul><ul><li>Holds would be handled manually </li></ul>
  23. 23. Decision time <ul><li>In May, III and NetSec finally come to an agreement to use Juniper VPN </li></ul><ul><li>This is, of course, $$$ </li></ul><ul><li>NYUHSL’s contract ended on Aug 31, with 90 days notice required… </li></ul>
  24. 24. Let’s Do This!
  25. 25. Migration Schedule <ul><li>Aug 6: Freeze cataloging in Millennium </li></ul><ul><li>Aug 7: Initial data load into production system </li></ul><ul><li>Aug 24-26: Training from ByWater Solutions </li></ul><ul><li>Aug 27: Serials and Acquisitions frozen in Millennium </li></ul><ul><li>Aug 29: Circ frozen in Millennium </li></ul><ul><li>Aug 30: Koha migration day </li></ul><ul><li>Aug 31: Koha is live! </li></ul>
  26. 26. What Info to Migrate? <ul><li>Bibliographic/Authority (80k/5k) </li></ul><ul><li>Patron (11k) </li></ul><ul><li>Checkouts (few hundred) </li></ul><ul><li>Holds </li></ul><ul><li>Serials issues </li></ul><ul><li>Acquisitions </li></ul>
  27. 27. Serials Issues <ul><li>MFHD support was originally slated for Koha 3.2 </li></ul><ul><li>Um, yeah </li></ul><ul><li>NYUHSL was only keeping a couple hundred print titles, anyway </li></ul><ul><li>Manual checkin of new issues, old ones will just get bound and added as items </li></ul>
  28. 28. The Outcome?
  29. 29. Further Outcome?
  30. 30. Well, maybe more like:
  31. 31. Caveats/Warnings <ul><li>No MFHD support yet </li></ul><ul><li>Diacritics: Bracecodes vs. UTF-8 </li></ul><ul><li>Cross linked items </li></ul><ul><li>Multiple barcodes/call numbers </li></ul><ul><li>Keeping track of old record numbers can be tricky </li></ul><ul><li>Be sure you pull your patron data on migration day, not a week before </li></ul>
  32. 32. Thanks! <ul><li>Download full package at contribs.koha.org as early as next week </li></ul><ul><li>Thanks to Cody Hennesy for beta testing </li></ul>

×