IMPACT is supported by the European Community under the FP7 ICT Work Programme. The project is coordinated by the National...
IMPACT is supported by the European Community under the FP7 ICT Work Programme. The project is coordinated by the National...
IMPACT is supported by the European Community under the FP7 ICT Work Programme. The project is coordinated by the National...
IMPACT is supported by the European Community under the FP7 ICT Work Programme. The project is coordinated by the National...
IMPACT is supported by the European Community under the FP7 ICT Work Programme. The project is coordinated by the National...
IMPACT is supported by the European Community under the FP7 ICT Work Programme. The project is coordinated by the National...
IMPACT is supported by the European Community under the FP7 ICT Work Programme. The project is coordinated by the National...
IMPACT is supported by the European Community under the FP7 ICT Work Programme. The project is coordinated by the National...
IMPACT is supported by the European Community under the FP7 ICT Work Programme. The project is coordinated by the National...
IMPACT is supported by the European Community under the FP7 ICT Work Programme. The project is coordinated by the National...
IMPACT is supported by the European Community under the FP7 ICT Work Programme. The project is coordinated by the National...
IMPACT is supported by the European Community under the FP7 ICT Work Programme. The project is coordinated by the National...
IMPACT is supported by the European Community under the FP7 ICT Work Programme. The project is coordinated by the National...
IMPACT is supported by the European Community under the FP7 ICT Work Programme. The project is coordinated by the National...
IMPACT is supported by the European Community under the FP7 ICT Work Programme. The project is coordinated by the National...
IMPACT is supported by the European Community under the FP7 ICT Work Programme. The project is coordinated by the National...
IMPACT is supported by the European Community under the FP7 ICT Work Programme. The project is coordinated by the National...
IMPACT is supported by the European Community under the FP7 ICT Work Programme. The project is coordinated by the National...
IMPACT is supported by the European Community under the FP7 ICT Work Programme. The project is coordinated by the National...
IMPACT is supported by the European Community under the FP7 ICT Work Programme. The project is coordinated by the National...
Upcoming SlideShare
Loading in …5
×

IMPACT Interoperability and Evaluation Framework. Clemens Neudecker

736
-1

Published on

Presentada en "Sesión de demostración de IMPACT en la BNE" en octubre, en la Biblioteca Nacional de España (BNE).

Published in: Technology, Education
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total Views
736
On Slideshare
0
From Embeds
0
Number of Embeds
0
Actions
Shares
0
Downloads
5
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

IMPACT Interoperability and Evaluation Framework. Clemens Neudecker

  1. 1. IMPACT is supported by the European Community under the FP7 ICT Work Programme. The project is coordinated by the National Library of the Netherlands.IMPACT Interoperability andEvaluation FrameworkClemens Neudecker, National Library of the NetherlandsIMPACT Demo Day, Biblioteca Nacional de España
  2. 2. IMPACT is supported by the European Community under the FP7 ICT Work Programme. The project is coordinated by the National Library of the Netherlands.OCR: A multitude of challenges…I. OCR challenges (gothic fonts, bleed-through, warping, etc.)
  3. 3. IMPACT is supported by the European Community under the FP7 ICT Work Programme. The project is coordinated by the National Library of the Netherlands.OCR: A multitude of challenges…II. Language challenges (spelling variants, inflection, and many more!)Example: historical variants of the Dutch word ‘wereld’ (world):werelt weerelt wereld weerelds wereldt werelden weereld werrelts waerelds weerlytwereldts vveerelts waereld weerelden waerelden weerlt werlt werelds sweerelszwerlys swarels swerelts werelts swerrels weirelts tsweerelds werret vverelt werltswerrelt worreld werlden wareld weirelt weireld waerelt werreld werld vvereld weereltswerlde tswerels werreldts weereldt wereldje waereldje weurlt wald weëled
  4. 4. IMPACT is supported by the European Community under the FP7 ICT Work Programme. The project is coordinated by the National Library of the Netherlands.And a multitude of solutions! 22 different ‘tools’ from diverse developers: OCR (C++, C#), Image Processing & Lexica (DLL), Command Line Tools (Win/Linux), Java, Ruby, PHP, Perl, etc. + 3rd party software! “One ring to rule them all...”→ IMPACT Interoperability Framework (IIF)
  5. 5. IMPACT is supported by the European Community under the FP7 ICT Work Programme. The project is coordinated by the National Library of the Netherlands.Main requirementsBehavioural: Minimize integration effort Minimize deployment effort Maximize usability Maximize scalabilityFunctional: Modular Transparent Expandable Open source Platform independent
  6. 6. IMPACT is supported by the European Community under the FP7 ICT Work Programme. The project is coordinated by the National Library of the Netherlands.Architecture IMPACT Interoperability Framework: Technologies - Java 6 - Generic Web Service Wrapper - Apache Ant/Maven - Apache Tomcat/httpd - Apache Axis2 - Apache Synapse - Taverna Workflow Engine IMPACT Evaluation Framework: Dataset - approx. 5 TB raw data (images, text files, metadata) and growing - Ground truth transcriptions - Evaluation modules
  7. 7. IMPACT is supported by the European Community under the FP7 ICT Work Programme. The project is coordinated by the National Library of the Netherlands.Components I: IIF Enterprise Service Bus receives (SOAP) requests from users and distributes the load to the available worker nodes Main effect: Process parallelization, Load distribution, Fail over
  8. 8. IMPACT is supported by the European Community under the FP7 ICT Work Programme. The project is coordinated by the National Library of the Netherlands.Framework integration Easy to use generic command line wrapper (open source)
  9. 9. IMPACT is supported by the European Community under the FP7 ICT Work Programme. The project is coordinated by the National Library of the Netherlands.Workflow development OCR workflow = data pipeline Building blocks = processing steps (nodes) Integration = interaction between nodes (mashup)
  10. 10. IMPACT is supported by the European Community under the FP7 ICT Work Programme. The project is coordinated by the National Library of the Netherlands.Workflow management Web 2.0 style registry: myExperiment Local client: Taverna Workbench Web client: project website API: SOAP/REST
  11. 11. IMPACT is supported by the European Community under the FP7 ICT Work Programme. The project is coordinated by the National Library of the Netherlands.Community Web2.0 style workflow registry Community of experts Sharing of resources Knowledge exchange A central meeting point for users and researchers
  12. 12. IMPACT is supported by the European Community under the FP7 ICT Work Programme. The project is coordinated by the National Library of the Netherlands.Components II: DatasetDatabase and front end, hosted at the PRIMAresearch group at University of Salford,School of Computing, United Kingdom- more than 500.000 images from Digital Libraries- more than 50.000 ground truth representations- up to 10.000 direct access calls per month- 4 TB of space and growing
  13. 13. IMPACT is supported by the European Community under the FP7 ICT Work Programme. The project is coordinated by the National Library of the Netherlands.Dataset Access to a representative and annotated dataset of significant size, with metadata, ground truth and search facilities
  14. 14. IMPACT is supported by the European Community under the FP7 ICT Work Programme. The project is coordinated by the National Library of the Netherlands.Evaluation features Text based comparison of result with ground truth, using Levenshtein distance method Layout based comparison of result with ground truth, using the Page Analysis And Ground Truth Elements Framework Example:
  15. 15. IMPACT is supported by the European Community under the FP7 ICT Work Programme. The project is coordinated by the National Library of the Netherlands.
  16. 16. IMPACT is supported by the European Community under the FP7 ICT Work Programme. The project is coordinated by the National Library of the Netherlands.Ground-Truthing Tools Aletheia FineReader PAGE Exporter GT Validator GT Normalizer 16
  17. 17. IMPACT is supported by the European Community under the FP7 ICT Work Programme. The project is coordinated by the National Library of the Netherlands.
  18. 18. IMPACT is supported by the European Community under the FP7 ICT Work Programme. The project is coordinated by the National Library of the Netherlands. Measures – Segmentation Errors Miss Partial MissMis-classi- Mergefication Caption Paragraph Ground Truth Segmentation Result Split 18
  19. 19. IMPACT is supported by the European Community under the FP7 ICT Work Programme. The project is coordinated by the National Library of the Netherlands.OCR Accuracy
  20. 20. IMPACT is supported by the European Community under the FP7 ICT Work Programme. The project is coordinated by the National Library of the Netherlands. Thank you! Questions?
  1. A particular slide catching your eye?

    Clipping is a handy way to collect important slides you want to go back to later.

×