IMPACT Final Event 26-06-2012 - Library experiences in IMPACT: KB National library of the Netherlands by Judith Rog (KB)

632 views

Published on

Published in: Education
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
632
On SlideShare
0
From Embeds
0
Number of Embeds
70
Actions
Shares
0
Downloads
0
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

IMPACT Final Event 26-06-2012 - Library experiences in IMPACT: KB National library of the Netherlands by Judith Rog (KB)

  1. 1. KB pilot OCR correctionJudith Rog, 26 juni 2012, Impact Final Event
  2. 2. EDBO Pilot OCR CorrectionEarly Dutch Books Online (EDBO)• Special Collections of the University libraries of Leiden and Amsterdam and the KB• Concentrating on historical, political, theological, and literary works from the period of 1781 to1800• +/- 11.000 books +/- 2.ooo.ooo pages• For each page: • Image • ALTO • Txt file• For each book : • MPEG21 • PDF• Website: www.earlydutchbooksonline.nlKoninklijke Bibliotheek – National Library of the Netherlands
  3. 3. EDBO Pilot OCR CorrectionEarly Dutch Books Online (EDBO)• Website:Koninklijke Bibliotheek – National Library of the Netherlands
  4. 4. EDBO Pilot OCR CorrectionEarly Dutch Books Online (EDBO)• Website:Koninklijke Bibliotheek – National Library of the Netherlands
  5. 5. EDBO Pilot OCR CorrectionOCR-quality• Voorbeelden van boeken met voorkomende fouten link naar Impact leggenKoninklijke Bibliotheek – National Library of the Netherlands
  6. 6. EDBO Pilot OCR CorrectionEarly Dutch Books Online (EDBO)• Website and data were delivered, 1st stage project ended.• What to do next?Koninklijke Bibliotheek – National Library of the Netherlands
  7. 7. EDBO Pilot OCR Correction EDBO-OCR-QualityKoninklijke Bibliotheek – National Library of the Netherlands
  8. 8. EDBO Pilot OCR CorrectionEDBO-OCR-QualityKoninklijke Bibliotheek – National Library of the Netherlands
  9. 9. EDBO Pilot OCR CorrectionKoninklijke Bibliotheek – National Library of the Netherlands
  10. 10. EDBO Pilot OCR Correction Improve Quality OCR  more specific word accuracy to improve searchingVisit to the Impact colleagues down thehall….•What is available on short term?•Bad timing•Evaluation/pilot Koninklijke Bibliotheek – National Library of the Netherlands
  11. 11. EDBO Pilot OCR Correction Set-up: books2. Title: Verzameling van placaaten, resolutien en andere authentyke stukken enz. betrekking hebbende tot de gewigtige gebeurtenissen, in de maand september MDCCLXXXVII, bevooren en vervolgens, in het gemeenebest der Vereenigde Nederlanden voorgevallen. : Part 29 • Year: 1791 • Copy: Leiden, Universiteitsbibliotheek: 1006 A 29 • No. of pages: 3383. Title: Verhandelingen van het Genootschap ter bevordering der heelkunde, te Amsterdam. : Part 1 • Year: 1791 • Copy: Leiden, Universiteitsbibliotheek: 1448 G 2 • No. of pages: 331• Ground-truth• Large numbers of pages Koninklijke Bibliotheek – National Library of the Netherlands
  12. 12. EDBO Pilot OCR Correction Set-up Alto Edit LMU PlaIR Person 1 Set 1-1 Set 1-2 Set 2-1 Person 2 Set 1-2 Set 1-3 Set 2-2 Person 3 Set 1-3 Set 1-1 - Person 4 Set 2-1 Set 2-2 Set 1-1 Person 5 Set 2-2 Set 2-3 Set 1-2 Person 6 Set 2-3 Set 2-1 Set 1-3• Before the first tool: general introduction, guidelines, introduction on 18th century books• Training session: 2.5 hrs per tool in the afternoon• Next morning: 3 hrs correction, 15 min break• 6 humanities students Koninklijke Bibliotheek – National Library of the Netherlands
  13. 13. Pilot set-up: tools  AltoEdit KBEDBO Pilot OCR Correction KB Alto Edit main screenKoninklijke Bibliotheek – National Library of the Netherlands
  14. 14. Pilot set-up: tools  AltoEdit KBEDBO Pilot OCR Correction Segmentation correction in Alto EditKoninklijke Bibliotheek – National Library of the Netherlands
  15. 15. Pilot set-up: tools  LMU EDBO Pilot OCR Correction Overview LMU Post Correction ToolKoninklijke Bibliotheek – National Library of the Netherlands
  16. 16. Pilot set-up: tools  LMU EDBO Pilot OCR Correction Batch correction by error pattern (n>u> Batch correct by wordKoninklijke Bibliotheek – National Library of the Netherlands
  17. 17. Pilot set-up: tools  PlaIR EDBO Pilot OCR Correction Overview PlaIR platformKoninklijke Bibliotheek – National Library of the Netherlands
  18. 18. Pilot set-up: tools  PlaIR EDBO Pilot OCR Correction PlaIR Correction modeKoninklijke Bibliotheek – National Library of the Netherlands
  19. 19. EDBO Pilot OCR Correction Set-up: toolsTools for post-correction• AltoEdit KB• LMU Profiler and Post Correction Tool• PlaIR (LITIS Laboratory - Rouen)• (IBM Concert)Re-OCR• Adaptive OCR• ABBYY FRE 10 with internal dictionaries• ABBYY FRE 10 with IMPACT Historical Dictionary as developed in Impact Koninklijke Bibliotheek – National Library of the Netherlands
  20. 20. Comments EDBO Pilot OCR Correction•Familiarity to the material and theguidelines•Boredom•Functionalities differ•LMU for large sets•PlaIR for newspapers•Not the same base set of OCR for LMUKoninklijke Bibliotheek – National Library of the Netherlands
  21. 21. Conclusion• The goal of any OCR improvement project is very important in choosing the correct tool: • Crowdsourcing and little resources?  Basic tools • ALTO Edit • PlaIR • More functionalities and resources?  Advanced tools • LMU’s Profiler and Post correction tool • CONCERT • Automated process with least amount of effort?  re-OCRing • ABBYY FRE10 • Internal dictionary • Historical dictionary • IBM’s Adaptive OCR• Ideally, all material is re-OCRed before any post correction, resulting in the highest possible word accuracy.Koninklijke Bibliotheek – National Library of the Netherlands
  22. 22. EDBO Pilot OCR CorrectionKoninklijke Bibliotheek – National Library of the Netherlands

×