SlideShare a Scribd company logo
1 of 15
Download to read offline
A presentation for the
              Ex Libris Northeast User Group
                            October 27, 2011


Beth Brennan, Metadata Systems Librarian
Christine Moulen, Library Systems Manager
   Two different times working groups
    determined the single record approach was
    better for users
   We have a few exceptions, but policy is to
    add additional formats to existing catalog
    records
   E-book explosion meant we now needed a
    way to do it via batch loading



                         Batch loading e-books | ENUG
                                                  2011
   Developed in cooperation with e-books
    cataloger, now departed
   Start with our basic load script structure
   Identify match points and merge
    preferences
   Use Aleph services when possible
   Create scripts for additional matching
   Create scripts to build merge file



                          Batch loading e-books | ENUG
                                                   2011
   Run an Aleph fix over all records to clean
    up URL note subfields, and indicators
   Add local 956 URL if needed
   Delete URLs that don't match expected
    pattern for this package
   Flag and report records with no URL




                         Batch loading e-books | ENUG
                                                  2011
   Most records are coming from OCLC, but
    separate records often exist for print and
    e versions of the same title
   Attempt match anyway (035 and 776
    fields)
   If matched, check incoming URL against
    existing. No need to load if we already
    have this URL
    ◦ If URL is new, move to overlay file



                              Batch loading e-books | ENUG
                                                       2011
   Not all e-book records are from OCLC, so
    try other matching
   Attempt a title match (?!)
   Follow up title matching with publisher
    check




                        Batch loading e-books | ENUG
                                                 2011
   Match incoming 245 $$a$$b against title
    headings index
   Report system number, 035, and publisher
    of multi-matched records
   Export uniquely matched records for
    additional comparisons
   Unmatched records load as new




                       Batch loading e-books | ENUG
                                                2011
   Check for 245 $$n and $$p in matched
    records, both incoming and existing.
    Report if found. (may be serial or added
    volume)
   Check whether existing matched records
    are from certain packages, on order, or
    suppressed records. (load as new)




                        Batch loading e-books | ENUG
                                                 2011
   Compare 260 $$b 533 $$c (pub)
    Compare 260 $$c 533 $$d (date)
    Compare 260 $$b$$c 260 $$b$$c
   Load as new if no match on publisher or
    date
   Overlay if matched on both publisher and
    date




                        Batch loading e-books | ENUG
                                                 2011
   Export all records to be overlaid, including
    PST (virtual location tag)
   Check for 006
    ◦ If found in exported record, remove tag from
      load file
   Check for NET holdings
    ◦ If found in exported record, remove 949 tag
      from load file.
    ◦ If not found, change 949 to 959
   Check for format SE
    ◦ move to load as new

                            Batch loading e-books | ENUG
                                                     2011
   Build a new 776 tag from 035
   Correct indicators on all 776, 856 and 956
    tags




                         Batch loading e-books | ENUG
                                                  2011
   New
    ◦ All unmatched records, or otherwise determined
      to be new
    ◦ Build NET holdings (our sublibrary for e-
      resources) from 949 tag
   Overlay
    ◦ Load/Merge only 006, 776, 856, 946, 956, 959
      into existing records
    ◦ Build NET holdings from 959 tag



                           Batch loading e-books | ENUG
                                                    2011
   Report out any rejected records to
    catalogers
   Report matched "on order" records to
    acquisitions
   Report matched serial records to
    catalogers




                        Batch loading e-books | ENUG
                                                 2011
Contact us
  Beth Brennan siers@mit.edu
  Christine Moulen orbitee@mit.edu




    Batch loading e-books | ENUG
                             2011
   Please note that the PDF version of these
    slides contains an attachment
   This text file has additional technical detail
    on some steps, including Aleph tables and
    service parameters




                          Batch loading e-books | ENUG
                                                   2011

More Related Content

Viewers also liked

Marketing & publicity week 1 august 2010
Marketing & publicity week 1   august 2010Marketing & publicity week 1   august 2010
Marketing & publicity week 1 august 2010
Niki Cheong
 
documentation-testing.ppt
documentation-testing.pptdocumentation-testing.ppt
documentation-testing.ppt
Gaurav Nigam
 
Comentary final draft for hand in
Comentary final draft for hand inComentary final draft for hand in
Comentary final draft for hand in
gokicchi
 
Presentatie NVIH pecha kucha
Presentatie NVIH pecha kuchaPresentatie NVIH pecha kucha
Presentatie NVIH pecha kucha
Guido Snijders
 
Digital basicsworkshop2012
Digital basicsworkshop2012Digital basicsworkshop2012
Digital basicsworkshop2012
WiLS
 
Callahan princetonenug2011
Callahan princetonenug2011Callahan princetonenug2011
Callahan princetonenug2011
ENUG
 

Viewers also liked (18)

Undergrads scholars
Undergrads scholarsUndergrads scholars
Undergrads scholars
 
Snacky Day
Snacky DaySnacky Day
Snacky Day
 
Marketing & publicity week 1 august 2010
Marketing & publicity week 1   august 2010Marketing & publicity week 1   august 2010
Marketing & publicity week 1 august 2010
 
documentation-testing.ppt
documentation-testing.pptdocumentation-testing.ppt
documentation-testing.ppt
 
Comentary final draft for hand in
Comentary final draft for hand inComentary final draft for hand in
Comentary final draft for hand in
 
Presentatie NVIH pecha kucha
Presentatie NVIH pecha kuchaPresentatie NVIH pecha kucha
Presentatie NVIH pecha kucha
 
Sábanas
SábanasSábanas
Sábanas
 
Steph Steinhardt "Big Data, Open Infrastructure and Care: Following the Rise ...
Steph Steinhardt "Big Data, Open Infrastructure and Care: Following the Rise ...Steph Steinhardt "Big Data, Open Infrastructure and Care: Following the Rise ...
Steph Steinhardt "Big Data, Open Infrastructure and Care: Following the Rise ...
 
Optimize Your Email Marketing Campaigns
Optimize Your Email Marketing Campaigns	Optimize Your Email Marketing Campaigns
Optimize Your Email Marketing Campaigns
 
Von ESE zu EDM und darüber hinaus: Wie Europeana Zugang zu Objekten des Kultu...
Von ESE zu EDM und darüber hinaus: Wie Europeana Zugang zu Objekten des Kultu...Von ESE zu EDM und darüber hinaus: Wie Europeana Zugang zu Objekten des Kultu...
Von ESE zu EDM und darüber hinaus: Wie Europeana Zugang zu Objekten des Kultu...
 
Digital basicsworkshop2012
Digital basicsworkshop2012Digital basicsworkshop2012
Digital basicsworkshop2012
 
Elnet
ElnetElnet
Elnet
 
Historia del internet
Historia del internetHistoria del internet
Historia del internet
 
Mediation To Stay Married
Mediation To Stay MarriedMediation To Stay Married
Mediation To Stay Married
 
Callahan princetonenug2011
Callahan princetonenug2011Callahan princetonenug2011
Callahan princetonenug2011
 
Dr. William Allan Kritsonis, Dissertation Chair for Grace Thomas Nickerson, D...
Dr. William Allan Kritsonis, Dissertation Chair for Grace Thomas Nickerson, D...Dr. William Allan Kritsonis, Dissertation Chair for Grace Thomas Nickerson, D...
Dr. William Allan Kritsonis, Dissertation Chair for Grace Thomas Nickerson, D...
 
Securitarian
SecuritarianSecuritarian
Securitarian
 
Epithelialtissue 120208062655-phpapp02
Epithelialtissue 120208062655-phpapp02Epithelialtissue 120208062655-phpapp02
Epithelialtissue 120208062655-phpapp02
 

More from ENUG

Jaffe o'brien-rosetta
Jaffe o'brien-rosettaJaffe o'brien-rosetta
Jaffe o'brien-rosetta
ENUG
 
Jones aleph acqorders
Jones aleph acqordersJones aleph acqorders
Jones aleph acqorders
ENUG
 
Yang enhance-voyager-user-innovations
Yang enhance-voyager-user-innovationsYang enhance-voyager-user-innovations
Yang enhance-voyager-user-innovations
ENUG
 
Yang hofmann-next generationcatalogforenug
Yang hofmann-next generationcatalogforenugYang hofmann-next generationcatalogforenug
Yang hofmann-next generationcatalogforenug
ENUG
 
Bischof custom-circ-ov
Bischof custom-circ-ovBischof custom-circ-ov
Bischof custom-circ-ov
ENUG
 
Wenger sf xin-barton
Wenger sf xin-bartonWenger sf xin-barton
Wenger sf xin-barton
ENUG
 
Collins whats buggingyou-aleph
Collins whats buggingyou-alephCollins whats buggingyou-aleph
Collins whats buggingyou-aleph
ENUG
 
Wagner whats buggingyou-voyager
Wagner whats buggingyou-voyagerWagner whats buggingyou-voyager
Wagner whats buggingyou-voyager
ENUG
 
Oneal perl-code-to-extract-from-voyager
Oneal perl-code-to-extract-from-voyagerOneal perl-code-to-extract-from-voyager
Oneal perl-code-to-extract-from-voyager
ENUG
 
Schwartz ez proxy-logs
Schwartz ez proxy-logsSchwartz ez proxy-logs
Schwartz ez proxy-logs
ENUG
 
Moulen digital bookplates
Moulen digital bookplatesMoulen digital bookplates
Moulen digital bookplates
ENUG
 
Moulen aleph update
Moulen aleph updateMoulen aleph update
Moulen aleph update
ENUG
 
Enug2011 innovative use-of_sfx_with_new_interface-final
Enug2011 innovative use-of_sfx_with_new_interface-finalEnug2011 innovative use-of_sfx_with_new_interface-final
Enug2011 innovative use-of_sfx_with_new_interface-final
ENUG
 
Baksik3 enug baksik_xmlinvoice
Baksik3 enug baksik_xmlinvoiceBaksik3 enug baksik_xmlinvoice
Baksik3 enug baksik_xmlinvoice
ENUG
 
Baksik2 enug baksik_ebookplates
Baksik2 enug baksik_ebookplatesBaksik2 enug baksik_ebookplates
Baksik2 enug baksik_ebookplates
ENUG
 
Baksik1 enug baksik_rest
Baksik1 enug baksik_restBaksik1 enug baksik_rest
Baksik1 enug baksik_rest
ENUG
 
O neal columbia
O neal columbiaO neal columbia
O neal columbia
ENUG
 

More from ENUG (18)

Jaffe o'brien-rosetta
Jaffe o'brien-rosettaJaffe o'brien-rosetta
Jaffe o'brien-rosetta
 
Jones aleph acqorders
Jones aleph acqordersJones aleph acqorders
Jones aleph acqorders
 
Yang enhance-voyager-user-innovations
Yang enhance-voyager-user-innovationsYang enhance-voyager-user-innovations
Yang enhance-voyager-user-innovations
 
Yang hofmann-next generationcatalogforenug
Yang hofmann-next generationcatalogforenugYang hofmann-next generationcatalogforenug
Yang hofmann-next generationcatalogforenug
 
Bischof custom-circ-ov
Bischof custom-circ-ovBischof custom-circ-ov
Bischof custom-circ-ov
 
Wenger sf xin-barton
Wenger sf xin-bartonWenger sf xin-barton
Wenger sf xin-barton
 
Guy avoiding-dat apocalypse
Guy avoiding-dat apocalypseGuy avoiding-dat apocalypse
Guy avoiding-dat apocalypse
 
Collins whats buggingyou-aleph
Collins whats buggingyou-alephCollins whats buggingyou-aleph
Collins whats buggingyou-aleph
 
Wagner whats buggingyou-voyager
Wagner whats buggingyou-voyagerWagner whats buggingyou-voyager
Wagner whats buggingyou-voyager
 
Oneal perl-code-to-extract-from-voyager
Oneal perl-code-to-extract-from-voyagerOneal perl-code-to-extract-from-voyager
Oneal perl-code-to-extract-from-voyager
 
Schwartz ez proxy-logs
Schwartz ez proxy-logsSchwartz ez proxy-logs
Schwartz ez proxy-logs
 
Moulen digital bookplates
Moulen digital bookplatesMoulen digital bookplates
Moulen digital bookplates
 
Moulen aleph update
Moulen aleph updateMoulen aleph update
Moulen aleph update
 
Enug2011 innovative use-of_sfx_with_new_interface-final
Enug2011 innovative use-of_sfx_with_new_interface-finalEnug2011 innovative use-of_sfx_with_new_interface-final
Enug2011 innovative use-of_sfx_with_new_interface-final
 
Baksik3 enug baksik_xmlinvoice
Baksik3 enug baksik_xmlinvoiceBaksik3 enug baksik_xmlinvoice
Baksik3 enug baksik_xmlinvoice
 
Baksik2 enug baksik_ebookplates
Baksik2 enug baksik_ebookplatesBaksik2 enug baksik_ebookplates
Baksik2 enug baksik_ebookplates
 
Baksik1 enug baksik_rest
Baksik1 enug baksik_restBaksik1 enug baksik_rest
Baksik1 enug baksik_rest
 
O neal columbia
O neal columbiaO neal columbia
O neal columbia
 

Recently uploaded

Why Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businessWhy Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire business
panagenda
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Safe Software
 

Recently uploaded (20)

Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin WoodPolkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
 
HTML Injection Attacks: Impact and Mitigation Strategies
HTML Injection Attacks: Impact and Mitigation StrategiesHTML Injection Attacks: Impact and Mitigation Strategies
HTML Injection Attacks: Impact and Mitigation Strategies
 
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
 
presentation ICT roal in 21st century education
presentation ICT roal in 21st century educationpresentation ICT roal in 21st century education
presentation ICT roal in 21st century education
 
🐬 The future of MySQL is Postgres 🐘
🐬  The future of MySQL is Postgres   🐘🐬  The future of MySQL is Postgres   🐘
🐬 The future of MySQL is Postgres 🐘
 
AWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of TerraformAWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of Terraform
 
Why Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businessWhy Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire business
 
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
 
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
 
Manulife - Insurer Innovation Award 2024
Manulife - Insurer Innovation Award 2024Manulife - Insurer Innovation Award 2024
Manulife - Insurer Innovation Award 2024
 
Strategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a FresherStrategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a Fresher
 
Exploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone ProcessorsExploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone Processors
 
Partners Life - Insurer Innovation Award 2024
Partners Life - Insurer Innovation Award 2024Partners Life - Insurer Innovation Award 2024
Partners Life - Insurer Innovation Award 2024
 
Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)
 
A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)A Domino Admins Adventures (Engage 2024)
A Domino Admins Adventures (Engage 2024)
 
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
 
Artificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : UncertaintyArtificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : Uncertainty
 
Top 10 Most Downloaded Games on Play Store in 2024
Top 10 Most Downloaded Games on Play Store in 2024Top 10 Most Downloaded Games on Play Store in 2024
Top 10 Most Downloaded Games on Play Store in 2024
 
GenAI Risks & Security Meetup 01052024.pdf
GenAI Risks & Security Meetup 01052024.pdfGenAI Risks & Security Meetup 01052024.pdf
GenAI Risks & Security Meetup 01052024.pdf
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
 

Moulen batch loadingebookspdf

  • 1. A presentation for the Ex Libris Northeast User Group October 27, 2011 Beth Brennan, Metadata Systems Librarian Christine Moulen, Library Systems Manager
  • 2. Two different times working groups determined the single record approach was better for users  We have a few exceptions, but policy is to add additional formats to existing catalog records  E-book explosion meant we now needed a way to do it via batch loading Batch loading e-books | ENUG 2011
  • 3. Developed in cooperation with e-books cataloger, now departed  Start with our basic load script structure  Identify match points and merge preferences  Use Aleph services when possible  Create scripts for additional matching  Create scripts to build merge file Batch loading e-books | ENUG 2011
  • 4. Run an Aleph fix over all records to clean up URL note subfields, and indicators  Add local 956 URL if needed  Delete URLs that don't match expected pattern for this package  Flag and report records with no URL Batch loading e-books | ENUG 2011
  • 5. Most records are coming from OCLC, but separate records often exist for print and e versions of the same title  Attempt match anyway (035 and 776 fields)  If matched, check incoming URL against existing. No need to load if we already have this URL ◦ If URL is new, move to overlay file Batch loading e-books | ENUG 2011
  • 6. Not all e-book records are from OCLC, so try other matching  Attempt a title match (?!)  Follow up title matching with publisher check Batch loading e-books | ENUG 2011
  • 7. Match incoming 245 $$a$$b against title headings index  Report system number, 035, and publisher of multi-matched records  Export uniquely matched records for additional comparisons  Unmatched records load as new Batch loading e-books | ENUG 2011
  • 8. Check for 245 $$n and $$p in matched records, both incoming and existing. Report if found. (may be serial or added volume)  Check whether existing matched records are from certain packages, on order, or suppressed records. (load as new) Batch loading e-books | ENUG 2011
  • 9. Compare 260 $$b 533 $$c (pub) Compare 260 $$c 533 $$d (date) Compare 260 $$b$$c 260 $$b$$c  Load as new if no match on publisher or date  Overlay if matched on both publisher and date Batch loading e-books | ENUG 2011
  • 10. Export all records to be overlaid, including PST (virtual location tag)  Check for 006 ◦ If found in exported record, remove tag from load file  Check for NET holdings ◦ If found in exported record, remove 949 tag from load file. ◦ If not found, change 949 to 959  Check for format SE ◦ move to load as new Batch loading e-books | ENUG 2011
  • 11. Build a new 776 tag from 035  Correct indicators on all 776, 856 and 956 tags Batch loading e-books | ENUG 2011
  • 12. New ◦ All unmatched records, or otherwise determined to be new ◦ Build NET holdings (our sublibrary for e- resources) from 949 tag  Overlay ◦ Load/Merge only 006, 776, 856, 946, 956, 959 into existing records ◦ Build NET holdings from 959 tag Batch loading e-books | ENUG 2011
  • 13. Report out any rejected records to catalogers  Report matched "on order" records to acquisitions  Report matched serial records to catalogers Batch loading e-books | ENUG 2011
  • 14. Contact us Beth Brennan siers@mit.edu Christine Moulen orbitee@mit.edu Batch loading e-books | ENUG 2011
  • 15. Please note that the PDF version of these slides contains an attachment  This text file has additional technical detail on some steps, including Aleph tables and service parameters Batch loading e-books | ENUG 2011