Marcive Documents: Catching Up and Keeping Up

932 views
751 views

Published on

How we process Marcive files
the technical part of a co-presentation with Mary Ross

Published in: Technology, Business
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
932
On SlideShare
0
From Embeds
0
Number of Embeds
1
Actions
Shares
0
Downloads
4
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

Marcive Documents: Catching Up and Keeping Up

  1. 1. Marcive Documents : Catching Up and Keeping Up Implementation Details
  2. 2. It took a lot of time to develop the procedure.
  3. 3. It took a lot of time to develop the procedure. Frustration, puzzlement, head scratching…
  4. 4. It took a lot of time to develop the procedure. Frustration, puzzlement, head scratching… Development continued well into the EUGM submission process.
  5. 5. <ul><li>Prebulk , </li></ul><ul><li>Bulkimport </li></ul>The script makes calls to:
  6. 6. <ul><li>Prebulk , </li></ul><ul><li>Bulkimport , </li></ul><ul><li>wmich8.pl , which is our implementation of the algorithm that Endeavor supplied to us for the initial remapping of Marcive data </li></ul>The script makes calls to:
  7. 7. <ul><li>Prebulk , </li></ul><ul><li>Bulkimport , </li></ul><ul><li>wmich8.pl , which is our implementation of the algorithm that Endeavor supplied to us for the initial remapping of Marcive data, and </li></ul><ul><li>several home-grown Perl utilities </li></ul>The script makes calls to:
  8. 8. Our home-grown Perl utilities: <ul><li>Marcedit inputfile outputfile .ini-file edits MARC files according to .ini directives </li></ul>
  9. 9. Our home-grown Perl utilities: <ul><li>Marcedit inputfile outputfile .ini-file edits MARC files according to .ini directives </li></ul><ul><li>Marcread marcfile provides human-formatted output of a MARC file </li></ul>
  10. 10. Our home-grown Perl utilities: <ul><li>Marcedit inputfile outputfile .ini-file edits MARC files according to .ini directives </li></ul><ul><li>Marcread marcfile provides human-formatted output of a MARC file </li></ul><ul><li>Marccount marcfile provides a record count for the MARC file </li></ul>
  11. 11. Our home-grown Perl utilities: <ul><li>Marcedit is extensively used </li></ul>
  12. 12. Our home-grown Perl utilities: <ul><li>Marcedit is extensively used </li></ul><ul><li>Marcread is used in one step where a human needs to see the data </li></ul>
  13. 13. Our home-grown Perl utilities: <ul><li>Marcedit is extensively used </li></ul><ul><li>Marcread is used in one step where a human needs to see the data </li></ul><ul><li>Marccount really isn’t needed, but provides useful feedback for the various steps </li></ul>
  14. 14. Marcive data High-level Overview
  15. 15. wmich8.pl Marcive data High-level Overview maplc.cfg
  16. 16. marcedit wmich8.pl Marcive data High-level Overview maplc.cfg marceditxxx.ini
  17. 17. prebulk marcedit wmich8.pl Marcive data High-level Overview maplc.cfg marceditxxx.ini prebulkxxx.cfg
  18. 18. Voyager bulkimport prebulk marcedit wmich8.pl Marcive data High-level Overview maplc.cfg marceditxxx.ini prebulkxxx.cfg
  19. 19. Details...
  20. 20. Low-level Overview Step 1 marcedit marcedit_655.ini Marcive data Edit 655 |2 , where found
  21. 21. Low-level Overview Step 1 Edit 655 |2 , where found marcedit_655.ini [ADD] [REMOVE] [EDIT] replacesubfield|655|2|local|LCSH [FIND]
  22. 22. Low-level Overview Step 2 wmich8.pl maplc.cfg not remapped prebulk remapped prebulk_lc_yes.cfg to bulkimport Remap GPO number to LC number where possible
  23. 23. Low-level Overview Step 2 Remap GPO number to LC number where possible map item? wmich8.pl detail not remapped no
  24. 24. Low-level Overview Step 2 Remap GPO number to LC number where possible map item? has 074 |a? wmich8.pl detail not remapped no no yes
  25. 25. Low-level Overview Step 2 Remap GPO number to LC number where possible map item? has 074 |a? GPO # in table? wmich8.pl detail not remapped no no no yes yes
  26. 26. Low-level Overview Step 2 Remap GPO number to LC number where possible map item? has 074 |a? GPO # in table? 099 found? delete 099 add 099 with LC # from table wmich8.pl detail not remapped remapped no no no yes yes yes yes no
  27. 27. Low-level Overview Step 2 maplc.cfg 619-M-42 G 3961s .C1 24-250 .G35 0619-P-17 G 3703s .C1 50-100 .U57 0378-E-05 G 3201s .P6 TPC- .G73 0191-B-14 G 3311s .P5 5-2,100 .N25 Remap GPO number to LC number where possible
  28. 28. prebulk_lc_yes.cfg
  29. 29. prebulk_lc_yes.cfg Low-level Overview Step 2
  30. 30. prebulk_lc_yes.cfg Low-level Overview Step 2
  31. 31. Low-level Overview Step 3 marcedit marcedit_yesmap.ini prebulk prebulk_lc_no.cfg to bulkimport not remapped marcread email to recipients Extract a copy of records with 049 |a wmap,map copy extract
  32. 32. Low-level Overview Step 3 marcedit_yesmap.ini [ADD] [REMOVE] [EDIT] [FIND] 049||||||a||wmap,map Extract a copy of records with 049 |a wmap,map
  33. 33. Low-level Overview Step 3 prebulk_lc_no.cfg (differences) Extract a copy of records with 049 |a wmap,map
  34. 34. Low-level Overview Step 3 Extract a copy of records with 049 |a wmap,map Extracts bib IDs from a log.imp* file to another file. It optionally precedes each number with an R or and an A, to indicate if that record was replaced or added. Example: Useful at this stage... implogidextract.pl log.impxxx outfile desc
  35. 35. Low-level Overview Step 4 marcedit marcedit_yesnaut.ini prebulk prebulk_lc_no.cfg to bulk import Extract a copy of records with 049 |a wmap,naut copy extract
  36. 36. Low-level Overview Step 4 Extract a copy of records with 049 |a wmap,naut marcedit_yesnaut.ini [ADD] [REMOVE] [EDIT] [FIND] 049||||||a||wmap,naut
  37. 37. Low-level Overview Step 4 prebulk_lc_no.cfg Extract a copy of records with 049 |a wmap,naut
  38. 38. Low-level Overview Step 5 marcedit marcedit_www_yes_minus_099.ini Remove the 099 field from records containing 049 |a wdoc,www
  39. 39. Low-level Overview Step 5 Remove the 099 field from records containing 049 |a wdoc,www marcedit_www_yes_minus_099.ini [ADD] [REMOVE] 099 [EDIT] [FIND] 049||||||a||wdoc,www
  40. 40. Low-level Overview Step 6 marcedit marcedit_www_yes_add_099.ini prebulk prebulk_www_yes.cfg to bulkimport Add our own 099 field to records containing 049 |a wdoc,www and extract a copy copy extract
  41. 41. Low-level Overview Step 6 Add our own 099 field to records containing 049 |a wdoc,www and extract a copy marcedit_www_yes_add_099.ini [ADD] 099||9|1|a|_ [REMOVE] [EDIT] [FIND] 049||||||a||wdoc,www
  42. 42. Low-level Overview Step 6 Add our own 099 field to records containing 049 |a wdoc,www and extract a copy prebulk_www_yes.cfg (differences)
  43. 43. Low-level Overview Step 7 marcedit marcedit_nomap.ini Remove records containing 049 |a wmap,map
  44. 44. Low-level Overview Step 7 Remove records containing 049 |a wmap,map marcedit_nomap.ini [ADD] [REMOVE] Record [EDIT] [FIND] not 049||||||a||wmap,map
  45. 45. Low-level Overview Step 8 marcedit marcedit_nonaut.ini Remove records containing 049 |a wmap,naut
  46. 46. Low-level Overview Step 8 Remove records containing 049 |a wmap,naut marcedit_nonaut.ini [ADD] [REMOVE] Record [EDIT] [FIND] not 049||||||a||wmap,naut
  47. 47. Low-level Overview Step 9 marcedit marcedit_nowww.ini Remove records containing 049 |a wdoc,www
  48. 48. Low-level Overview Step 9 Remove records containing 049 |a wdoc,www marcedit_nowww.ini [ADD] [REMOVE] Record [EDIT] [FIND] not 049||||||a||wdoc,www
  49. 49. Low-level Overview Step 10 prebulk prebulk_www_no.cfg Run what’s left through prebulk
  50. 50. Low-level Overview Step 10 Run what’s left through prebulk prebulk_www_no.cfg (differences)
  51. 51. Low-level Overview Step 11 bulkimport Marcive bulk import rules Run everything through bulkimport Voyager Records that were previously copied/extracted and run through prebulk
  52. 52. Resources implogidextract.pl http://homepages.wmich.edu/~zimmer/marc_index.html marcedit.pl marcread.pl marccount.pl http://homepages.wmich.edu/~zimmer/other_index.html
  53. 53. Thanks for listening. Questions? [email_address] 269.387.3885 Picture © 2003 by Roy Zimmer

×