Your SlideShare is downloading. ×
Marcive Documents: Catching Up and Keeping Up
Upcoming SlideShare
Loading in...5
×

Thanks for flagging this SlideShare!

Oops! An error has occurred.

×
Saving this for later? Get the SlideShare app to save on your phone or tablet. Read anywhere, anytime – even offline.
Text the download link to your phone
Standard text messaging rates apply

Marcive Documents: Catching Up and Keeping Up

656
views

Published on

How we process Marcive files …

How we process Marcive files
the technical part of a co-presentation with Mary Ross

Published in: Technology, Business

0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total Views
656
On Slideshare
0
From Embeds
0
Number of Embeds
0
Actions
Shares
0
Downloads
2
Comments
0
Likes
0
Embeds 0
No embeds

Report content
Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
No notes for slide

Transcript

  • 1. Marcive Documents : Catching Up and Keeping Up Implementation Details
  • 2. It took a lot of time to develop the procedure.
  • 3. It took a lot of time to develop the procedure. Frustration, puzzlement, head scratching…
  • 4. It took a lot of time to develop the procedure. Frustration, puzzlement, head scratching… Development continued well into the EUGM submission process.
  • 5.
    • Prebulk ,
    • Bulkimport
    The script makes calls to:
  • 6.
    • Prebulk ,
    • Bulkimport ,
    • wmich8.pl , which is our implementation of the algorithm that Endeavor supplied to us for the initial remapping of Marcive data
    The script makes calls to:
  • 7.
    • Prebulk ,
    • Bulkimport ,
    • wmich8.pl , which is our implementation of the algorithm that Endeavor supplied to us for the initial remapping of Marcive data, and
    • several home-grown Perl utilities
    The script makes calls to:
  • 8. Our home-grown Perl utilities:
    • Marcedit inputfile outputfile .ini-file edits MARC files according to .ini directives
  • 9. Our home-grown Perl utilities:
    • Marcedit inputfile outputfile .ini-file edits MARC files according to .ini directives
    • Marcread marcfile provides human-formatted output of a MARC file
  • 10. Our home-grown Perl utilities:
    • Marcedit inputfile outputfile .ini-file edits MARC files according to .ini directives
    • Marcread marcfile provides human-formatted output of a MARC file
    • Marccount marcfile provides a record count for the MARC file
  • 11. Our home-grown Perl utilities:
    • Marcedit is extensively used
  • 12. Our home-grown Perl utilities:
    • Marcedit is extensively used
    • Marcread is used in one step where a human needs to see the data
  • 13. Our home-grown Perl utilities:
    • Marcedit is extensively used
    • Marcread is used in one step where a human needs to see the data
    • Marccount really isn’t needed, but provides useful feedback for the various steps
  • 14. Marcive data High-level Overview
  • 15. wmich8.pl Marcive data High-level Overview maplc.cfg
  • 16. marcedit wmich8.pl Marcive data High-level Overview maplc.cfg marceditxxx.ini
  • 17. prebulk marcedit wmich8.pl Marcive data High-level Overview maplc.cfg marceditxxx.ini prebulkxxx.cfg
  • 18. Voyager bulkimport prebulk marcedit wmich8.pl Marcive data High-level Overview maplc.cfg marceditxxx.ini prebulkxxx.cfg
  • 19. Details...
  • 20. Low-level Overview Step 1 marcedit marcedit_655.ini Marcive data Edit 655 |2 , where found
  • 21. Low-level Overview Step 1 Edit 655 |2 , where found marcedit_655.ini [ADD] [REMOVE] [EDIT] replacesubfield|655|2|local|LCSH [FIND]
  • 22. Low-level Overview Step 2 wmich8.pl maplc.cfg not remapped prebulk remapped prebulk_lc_yes.cfg to bulkimport Remap GPO number to LC number where possible
  • 23. Low-level Overview Step 2 Remap GPO number to LC number where possible map item? wmich8.pl detail not remapped no
  • 24. Low-level Overview Step 2 Remap GPO number to LC number where possible map item? has 074 |a? wmich8.pl detail not remapped no no yes
  • 25. Low-level Overview Step 2 Remap GPO number to LC number where possible map item? has 074 |a? GPO # in table? wmich8.pl detail not remapped no no no yes yes
  • 26. Low-level Overview Step 2 Remap GPO number to LC number where possible map item? has 074 |a? GPO # in table? 099 found? delete 099 add 099 with LC # from table wmich8.pl detail not remapped remapped no no no yes yes yes yes no
  • 27. Low-level Overview Step 2 maplc.cfg 619-M-42 G 3961s .C1 24-250 .G35 0619-P-17 G 3703s .C1 50-100 .U57 0378-E-05 G 3201s .P6 TPC- .G73 0191-B-14 G 3311s .P5 5-2,100 .N25 Remap GPO number to LC number where possible
  • 28. prebulk_lc_yes.cfg
  • 29. prebulk_lc_yes.cfg Low-level Overview Step 2
  • 30. prebulk_lc_yes.cfg Low-level Overview Step 2
  • 31. Low-level Overview Step 3 marcedit marcedit_yesmap.ini prebulk prebulk_lc_no.cfg to bulkimport not remapped marcread email to recipients Extract a copy of records with 049 |a wmap,map copy extract
  • 32. Low-level Overview Step 3 marcedit_yesmap.ini [ADD] [REMOVE] [EDIT] [FIND] 049||||||a||wmap,map Extract a copy of records with 049 |a wmap,map
  • 33. Low-level Overview Step 3 prebulk_lc_no.cfg (differences) Extract a copy of records with 049 |a wmap,map
  • 34. Low-level Overview Step 3 Extract a copy of records with 049 |a wmap,map Extracts bib IDs from a log.imp* file to another file. It optionally precedes each number with an R or and an A, to indicate if that record was replaced or added. Example: Useful at this stage... implogidextract.pl log.impxxx outfile desc
  • 35. Low-level Overview Step 4 marcedit marcedit_yesnaut.ini prebulk prebulk_lc_no.cfg to bulk import Extract a copy of records with 049 |a wmap,naut copy extract
  • 36. Low-level Overview Step 4 Extract a copy of records with 049 |a wmap,naut marcedit_yesnaut.ini [ADD] [REMOVE] [EDIT] [FIND] 049||||||a||wmap,naut
  • 37. Low-level Overview Step 4 prebulk_lc_no.cfg Extract a copy of records with 049 |a wmap,naut
  • 38. Low-level Overview Step 5 marcedit marcedit_www_yes_minus_099.ini Remove the 099 field from records containing 049 |a wdoc,www
  • 39. Low-level Overview Step 5 Remove the 099 field from records containing 049 |a wdoc,www marcedit_www_yes_minus_099.ini [ADD] [REMOVE] 099 [EDIT] [FIND] 049||||||a||wdoc,www
  • 40. Low-level Overview Step 6 marcedit marcedit_www_yes_add_099.ini prebulk prebulk_www_yes.cfg to bulkimport Add our own 099 field to records containing 049 |a wdoc,www and extract a copy copy extract
  • 41. Low-level Overview Step 6 Add our own 099 field to records containing 049 |a wdoc,www and extract a copy marcedit_www_yes_add_099.ini [ADD] 099||9|1|a|_ [REMOVE] [EDIT] [FIND] 049||||||a||wdoc,www
  • 42. Low-level Overview Step 6 Add our own 099 field to records containing 049 |a wdoc,www and extract a copy prebulk_www_yes.cfg (differences)
  • 43. Low-level Overview Step 7 marcedit marcedit_nomap.ini Remove records containing 049 |a wmap,map
  • 44. Low-level Overview Step 7 Remove records containing 049 |a wmap,map marcedit_nomap.ini [ADD] [REMOVE] Record [EDIT] [FIND] not 049||||||a||wmap,map
  • 45. Low-level Overview Step 8 marcedit marcedit_nonaut.ini Remove records containing 049 |a wmap,naut
  • 46. Low-level Overview Step 8 Remove records containing 049 |a wmap,naut marcedit_nonaut.ini [ADD] [REMOVE] Record [EDIT] [FIND] not 049||||||a||wmap,naut
  • 47. Low-level Overview Step 9 marcedit marcedit_nowww.ini Remove records containing 049 |a wdoc,www
  • 48. Low-level Overview Step 9 Remove records containing 049 |a wdoc,www marcedit_nowww.ini [ADD] [REMOVE] Record [EDIT] [FIND] not 049||||||a||wdoc,www
  • 49. Low-level Overview Step 10 prebulk prebulk_www_no.cfg Run what’s left through prebulk
  • 50. Low-level Overview Step 10 Run what’s left through prebulk prebulk_www_no.cfg (differences)
  • 51. Low-level Overview Step 11 bulkimport Marcive bulk import rules Run everything through bulkimport Voyager Records that were previously copied/extracted and run through prebulk
  • 52. Resources implogidextract.pl http://homepages.wmich.edu/~zimmer/marc_index.html marcedit.pl marcread.pl marccount.pl http://homepages.wmich.edu/~zimmer/other_index.html
  • 53. Thanks for listening. Questions? [email_address] 269.387.3885 Picture © 2003 by Roy Zimmer

×