Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Marcive Documents: Catching Up and Keeping Up

0 views

Published on

How we process Marcive files
the technical part of a co-presentation with Mary Ross

Published in: Technology, Business
  • Be the first to comment

  • Be the first to like this

Marcive Documents: Catching Up and Keeping Up

  1. 1. Marcive Documents : Catching Up and Keeping Up Implementation Details
  2. 2. It took a lot of time to develop the procedure.
  3. 3. It took a lot of time to develop the procedure. Frustration, puzzlement, head scratching…
  4. 4. It took a lot of time to develop the procedure. Frustration, puzzlement, head scratching… Development continued well into the EUGM submission process.
  5. 5. <ul><li>Prebulk , </li></ul><ul><li>Bulkimport </li></ul>The script makes calls to:
  6. 6. <ul><li>Prebulk , </li></ul><ul><li>Bulkimport , </li></ul><ul><li>wmich8.pl , which is our implementation of the algorithm that Endeavor supplied to us for the initial remapping of Marcive data </li></ul>The script makes calls to:
  7. 7. <ul><li>Prebulk , </li></ul><ul><li>Bulkimport , </li></ul><ul><li>wmich8.pl , which is our implementation of the algorithm that Endeavor supplied to us for the initial remapping of Marcive data, and </li></ul><ul><li>several home-grown Perl utilities </li></ul>The script makes calls to:
  8. 8. Our home-grown Perl utilities: <ul><li>Marcedit inputfile outputfile .ini-file edits MARC files according to .ini directives </li></ul>
  9. 9. Our home-grown Perl utilities: <ul><li>Marcedit inputfile outputfile .ini-file edits MARC files according to .ini directives </li></ul><ul><li>Marcread marcfile provides human-formatted output of a MARC file </li></ul>
  10. 10. Our home-grown Perl utilities: <ul><li>Marcedit inputfile outputfile .ini-file edits MARC files according to .ini directives </li></ul><ul><li>Marcread marcfile provides human-formatted output of a MARC file </li></ul><ul><li>Marccount marcfile provides a record count for the MARC file </li></ul>
  11. 11. Our home-grown Perl utilities: <ul><li>Marcedit is extensively used </li></ul>
  12. 12. Our home-grown Perl utilities: <ul><li>Marcedit is extensively used </li></ul><ul><li>Marcread is used in one step where a human needs to see the data </li></ul>
  13. 13. Our home-grown Perl utilities: <ul><li>Marcedit is extensively used </li></ul><ul><li>Marcread is used in one step where a human needs to see the data </li></ul><ul><li>Marccount really isn’t needed, but provides useful feedback for the various steps </li></ul>
  14. 14. Marcive data High-level Overview
  15. 15. wmich8.pl Marcive data High-level Overview maplc.cfg
  16. 16. marcedit wmich8.pl Marcive data High-level Overview maplc.cfg marceditxxx.ini
  17. 17. prebulk marcedit wmich8.pl Marcive data High-level Overview maplc.cfg marceditxxx.ini prebulkxxx.cfg
  18. 18. Voyager bulkimport prebulk marcedit wmich8.pl Marcive data High-level Overview maplc.cfg marceditxxx.ini prebulkxxx.cfg
  19. 19. Details...
  20. 20. Low-level Overview Step 1 marcedit marcedit_655.ini Marcive data Edit 655 |2 , where found
  21. 21. Low-level Overview Step 1 Edit 655 |2 , where found marcedit_655.ini [ADD] [REMOVE] [EDIT] replacesubfield|655|2|local|LCSH [FIND]
  22. 22. Low-level Overview Step 2 wmich8.pl maplc.cfg not remapped prebulk remapped prebulk_lc_yes.cfg to bulkimport Remap GPO number to LC number where possible
  23. 23. Low-level Overview Step 2 Remap GPO number to LC number where possible map item? wmich8.pl detail not remapped no
  24. 24. Low-level Overview Step 2 Remap GPO number to LC number where possible map item? has 074 |a? wmich8.pl detail not remapped no no yes
  25. 25. Low-level Overview Step 2 Remap GPO number to LC number where possible map item? has 074 |a? GPO # in table? wmich8.pl detail not remapped no no no yes yes
  26. 26. Low-level Overview Step 2 Remap GPO number to LC number where possible map item? has 074 |a? GPO # in table? 099 found? delete 099 add 099 with LC # from table wmich8.pl detail not remapped remapped no no no yes yes yes yes no
  27. 27. Low-level Overview Step 2 maplc.cfg 619-M-42 G 3961s .C1 24-250 .G35 0619-P-17 G 3703s .C1 50-100 .U57 0378-E-05 G 3201s .P6 TPC- .G73 0191-B-14 G 3311s .P5 5-2,100 .N25 Remap GPO number to LC number where possible
  28. 28. prebulk_lc_yes.cfg
  29. 29. prebulk_lc_yes.cfg Low-level Overview Step 2
  30. 30. prebulk_lc_yes.cfg Low-level Overview Step 2
  31. 31. Low-level Overview Step 3 marcedit marcedit_yesmap.ini prebulk prebulk_lc_no.cfg to bulkimport not remapped marcread email to recipients Extract a copy of records with 049 |a wmap,map copy extract
  32. 32. Low-level Overview Step 3 marcedit_yesmap.ini [ADD] [REMOVE] [EDIT] [FIND] 049||||||a||wmap,map Extract a copy of records with 049 |a wmap,map
  33. 33. Low-level Overview Step 3 prebulk_lc_no.cfg (differences) Extract a copy of records with 049 |a wmap,map
  34. 34. Low-level Overview Step 3 Extract a copy of records with 049 |a wmap,map Extracts bib IDs from a log.imp* file to another file. It optionally precedes each number with an R or and an A, to indicate if that record was replaced or added. Example: Useful at this stage... implogidextract.pl log.impxxx outfile desc
  35. 35. Low-level Overview Step 4 marcedit marcedit_yesnaut.ini prebulk prebulk_lc_no.cfg to bulk import Extract a copy of records with 049 |a wmap,naut copy extract
  36. 36. Low-level Overview Step 4 Extract a copy of records with 049 |a wmap,naut marcedit_yesnaut.ini [ADD] [REMOVE] [EDIT] [FIND] 049||||||a||wmap,naut
  37. 37. Low-level Overview Step 4 prebulk_lc_no.cfg Extract a copy of records with 049 |a wmap,naut
  38. 38. Low-level Overview Step 5 marcedit marcedit_www_yes_minus_099.ini Remove the 099 field from records containing 049 |a wdoc,www
  39. 39. Low-level Overview Step 5 Remove the 099 field from records containing 049 |a wdoc,www marcedit_www_yes_minus_099.ini [ADD] [REMOVE] 099 [EDIT] [FIND] 049||||||a||wdoc,www
  40. 40. Low-level Overview Step 6 marcedit marcedit_www_yes_add_099.ini prebulk prebulk_www_yes.cfg to bulkimport Add our own 099 field to records containing 049 |a wdoc,www and extract a copy copy extract
  41. 41. Low-level Overview Step 6 Add our own 099 field to records containing 049 |a wdoc,www and extract a copy marcedit_www_yes_add_099.ini [ADD] 099||9|1|a|_ [REMOVE] [EDIT] [FIND] 049||||||a||wdoc,www
  42. 42. Low-level Overview Step 6 Add our own 099 field to records containing 049 |a wdoc,www and extract a copy prebulk_www_yes.cfg (differences)
  43. 43. Low-level Overview Step 7 marcedit marcedit_nomap.ini Remove records containing 049 |a wmap,map
  44. 44. Low-level Overview Step 7 Remove records containing 049 |a wmap,map marcedit_nomap.ini [ADD] [REMOVE] Record [EDIT] [FIND] not 049||||||a||wmap,map
  45. 45. Low-level Overview Step 8 marcedit marcedit_nonaut.ini Remove records containing 049 |a wmap,naut
  46. 46. Low-level Overview Step 8 Remove records containing 049 |a wmap,naut marcedit_nonaut.ini [ADD] [REMOVE] Record [EDIT] [FIND] not 049||||||a||wmap,naut
  47. 47. Low-level Overview Step 9 marcedit marcedit_nowww.ini Remove records containing 049 |a wdoc,www
  48. 48. Low-level Overview Step 9 Remove records containing 049 |a wdoc,www marcedit_nowww.ini [ADD] [REMOVE] Record [EDIT] [FIND] not 049||||||a||wdoc,www
  49. 49. Low-level Overview Step 10 prebulk prebulk_www_no.cfg Run what’s left through prebulk
  50. 50. Low-level Overview Step 10 Run what’s left through prebulk prebulk_www_no.cfg (differences)
  51. 51. Low-level Overview Step 11 bulkimport Marcive bulk import rules Run everything through bulkimport Voyager Records that were previously copied/extracted and run through prebulk
  52. 52. Resources implogidextract.pl http://homepages.wmich.edu/~zimmer/marc_index.html marcedit.pl marcread.pl marccount.pl http://homepages.wmich.edu/~zimmer/other_index.html
  53. 53. Thanks for listening. Questions? [email_address] 269.387.3885 Picture © 2003 by Roy Zimmer

×