1. Mobile and Cloud OCR for your App
Winning and Retaining Customers
Dr. Rainer Pausch
Product Group Head, SDKs
ABBYY Europe GmbH
© Copyright 2016, ABBYY

2. Mobile Phones are Everywhere
2

3. Agenda
Mobility 2016: Connect with Your Customers
Company Overview: ABBYY Europe
Mobile Capture: Scenario Overview
Mobile Capture: ABBYY technology -
present and future
References: Large Bank, XING,
Intuit Turbotax, McDonald‘s

4. Connect with Customers:
Anywhere at Anytime

5. Connect with Customers – Anytime and Anywhere
Thousands Millions Billions
Connected devices
Trillions
Customer interactions
Mainframe
SNA
Terminal
Server
LAN/WAN
Client
Cloud
Mobile
LTE

6. Most Important Industry Topics in 2016
Source: ECM-Barometer, 2015, BITKOM, Participants: all ECM Providers in DACH
40%
Mobile
Capture
37%
Digital
Archive
26%
Invoice
Processing
26%
Business
Collaboration
18%
Big
Data
18%
Unstructured
Information
23%
Workflows
& BPM

7. 7
The Story Begins: Customer Onboarding

8. The Story Begins: Customer Onboarding
● Easy & fast
● Minimum amount of data
● Variety of ways to capture data
● Appropriate confidence and security level
● Appropriate document
8

9. Business Processes –
General Considerations
9
● Self Service vs. guided/professional
● One-time vs. multiple
● Dedicated vs. embedded
● App (iOS, Android) vs. web page (HTML5)

10. Mobile Capture – Banking/Insurance
Banking
● Mortgage processing
● Processing of bank transfer
documents (IBAN)
● Check reading and personal
expense management
10
Insurance
● Insurance claim processing
● Illness notification processing for health
insurance
● Account opening and forms processing

11. Mobile Capture
ERP / Corporate Finance
● Invoice processing
● Travel expense management
● Receipt capture
Logistics
● Delivery notes processing
● Freight paper delivery confirmation
11

12. Mobile Capture
Marketing
● Loyalty management
● Sweepstakes
● Price/product comparison
12
Customer Satisfaction
● Inquiries for product information
● Claim handling
● Questionnaires

13. Mobile Capture
13
Healthcare
● Doctors’ letters
● Prescriptions
● Personal health file
Your Industry/Scenario
● Your document
● Your document
● Your document

14. ABBYY Europe
Company Overview

15. Global
14 offices with >1.300 representatives in
Europe, USA, Asia and Australia, and Russia
Innovative
27% of the revenues invested in R&D
with > 400 scientists and developers
Solution Oriented
Professional services, support and training
for technologies, products and solutions
-op
Network
Co-operating with more than
500 partners in >150 countries
Successful
> 40 mio. users process > 9 bil. pages per
annum with ABBYY software
(according to ABBYY internal surveys)
Regional
Sales, marketing, project implementation
& support for Western Europe in Munich
ABBYY Worldwide

16. Scenario Overview

17. Mobile Capture and Cloud Processing
Mobile Scanning and Verification
Challenges
• Image quality
• User guidance
• Internet connection quality
Advantages
• (Mobile) platform independent
• Fast integration into
standalone app or integrated
into customer’s mobile app
• Real-time cloud data center
processing
• Suitable for sophisticated
scenarios
• Powerful image pre-processing
technology on server
Document
photo
Recognised
data
Mobile client
application
Data verification and approval
Processing/storage server
Data processing and saving
to CRM, ERP or other system
Mobile client
application
Success page
Paper documents, forms Mobile client application
taking pictureusing
mobile camera
Recognition & Capture Server
Pre-processing
Recognition
Data extraction
Verified dataProcessing
result
Document
photo

18. Mobile Capture and Pre-Processing, Cloud Processing
Hybrid Approach
Advantages
• Good image quality ensured by
direct feedback
• Automatic capture possible
• Lower internet bandwidth
needed
• Real-time cloud data center
processing
• Suitable for sophisticated
scenarios
Trade offs
● (Mobile) platform dependent
● Standalone app or integration
into customer’s mobile app
Document
photo
Preprocessed
document
photo
Paper documents, forms Mobile client application
taking picture
quality control
image preprocessing
Recognition & Capture Server
(Pre-processing)
Recognition
Data extraction
Recognised
data
Mobile client
application
Data verification and approval
Processing/storage server
Data processing and saving
to CRM, ERP or other system
Mobile client
application
Success page
Verified dataProcessing
result

19. Mobile Text Recognition On-Device
On-device recognition
Advantages
• Image quality ensured by
direct feedback
• Automatic capture possible
• No internet connection
needed
• Fast for simple scenarios
Trade offs
● (Mobile) platform
dependent
● Standalone app or
integration into customer’s
mobile app
Documents, ID-Cards,
business cards, checks
Mobile client application
taking picture
quality control
Image pre-processing
On-device image optimisation
and pre-processing
OCR
Document analysis
Detection of letters, noise removal
reading area cleaning
Optical Character Recognition
OCR/ Text recognition on device
On-device Results
Processing of the OCR/Text
Recognition results in the APP
Document
photo Document
Photo
Document
analysis

20. Recommendations – When to use what
On Device Online
Cloud OCR SDK Private Cloud / Own DC
Data Control +++ + ++
Complexity 0 + ++
Ramp-Up Costs +++
Implementation Speed +++
Offline Use + -
Usage on single device often seldom
Data Volume ++ Hybrid approach to reduce image size
Processing Speed simple scenarios complex scenarios
Device Independency -- ++
20

21. ABBYY Technology

22. ABBYY Mobile Imaging SDK
High Image Quality for Server-side Processing
Noise DetectionGlare DetectionBlur Detection
Image Quality Evaluation
Detection of image blur, uneven lighting,
or noise in the scanned image
Brightness Perspec. Correction Rotation Auto Crop
Image Enhancement
Crop, perspective correction, rotation, edge
detection, manual contrast adjustment,
noise removal, binarisation and sharpening
Single Page Export Multi Page Export
Single and multi-page Export
Single page export to PDF, PNG, or JPG and
multi page export to PDF

23. ABBYY Mobile OCR Engine
On-Device Mobile Text Recognition (OCR)
BinarisationDocument OrientationSkew Detection
Image Pre-processing
Detection and correction of skews,
binarisation, and document orientation
detection
Certainty Control Dictionaries
Text Recognition
Certainty control, confidence levels, data
analysis algorithms and spell checking using
dictionaries
Business Card Reading Barcode Recognition
Additional Features
Multilingual OCR, column detection, express
and accuracy mode, business card reading,
barcode recognition
Express & Balanced Mode

24. Example – ABBYY Business Card Reader
24

25. ABBYY Cloud OCR SDK
● OCR service in the Cloud from a market leader
● Pre-defined OCR functionalities and scenarios
● Easy start
● Easy integration in many platforms and
programming languages
● Proven and secure Microsoft Azure infrastructure
● European data centers
● Scales with your needs
● Pay-per-use
● No upfront investment
www.ocrsdk.com

26. Core Cloud OCR Functionality
Conversion to:
26
Business card
recognition
Barcode
recognition
Field/zonal
recognition
Checkmarks and
handprint text
recognition
Searchable PDF DOCX, XLSX, PPTX, TXT XML
Professional recognition tools:
MRZ recognition

27. ABBYY Cloud OCR SDK:
High Volume Applications
● Many apps process approx. 1-2,5k pages/day
● Several apps process approx. 10-30k pages/day
● 1 app processes more than 60k pages/day

28. ABBYY Cloud OCR SDK Scaling – Real Data
28

29. ABBYY Cloud OCR SDK Scaling – Real Data
29

30. ID Capture: Read MRZ

31. MRZ in Passports
31

32. Example Passport
32
• Read MRZ and perform checks
• ABBYY Cloud OCR SDK
• processMRZ method
• Off the shelf, ready to use, no parameters

33. ID Capture: Project UK
Driver‘s Licence

34. Project: UK Driver’s Licence Capture
34

35. Beta: Receipt Capture

36. ABBYY Receipt Capture
36
● Recognition of cash register receipts
● Automatic extraction of receipt fields
● Works out of the box
● No templates training required, free-form
technology
● Works with scanned receipts and images taken
by smartphone camera
● High accuracy even on bad images
● Support of mayor European countries

37. Receipt Capture Usage Scenarios
37
● Loyalty management
● Corporate expense management
● Private expense management
Other possible scenarios:
● Tax deduction
● Financial audit
● Tax administration

38. Receipt Capture Demo (Video)
38

39. 39
Preview:
ABBYY Real-Time Recognition SDK

40. Real-Time OCR
Recognise text on video frames from the smartphone’s camera
● Does not require to snap a photo
● All processing on a mobile device – no internet connection needed
● Any background
● Recognition in parallel in several threads - speeds up the processing
● Merging of results - higher accuracy
40Recognised frames
Final result

41. Real-Time Text Capture
41
● No need to take picture
● Fast
● Convenient
● Picture is not stored
● Confidentiality
● Scenarios
● ID Capture
● Banking, e.g. IBAN

42. Real-time Translation
42
● On device without any internet connection
● Parallel recognition and translation
● Build-in translation dictionaries
● Optimised for mobile devices
● Most popular European and CJK languages
● Detection of colors of source text and
background
● Allows to insert translated text exactly in the image
displayed on the smartphone’s screen.

43. References and
Customer Use Cases

44. Example: Banking
Powered by ABBYY Mobile Capture
● Cloud OCR SDK for processing of various documents
like payment slips, ID cards, receipts
● Self-service for customers

45. Example: Banking
Scanning of payment slips (IBAN):
1. Open App 2. Scanning 3. Payment
© Copyright 2015, VENETO BANCA S.p.A.

46. 46
● XING – European social business network with more
than 12 million members worldwide, HQ in Germany
● Legal setup took longer than the technical
implementation
● Cloud processing was preferred to on
device processing, because of….
● The app size
● Simpler implementation & maintenance
● Keep update rate high as well as the update over the air
Use Case: Mobile-to-Cloud
powered by ABBYY Mobile Capture and Cloud

47. Use Case: Mobile-to-Cloud
powered by ABBYY Mobile Capture and Cloud
Implementation from a user point of view:
47
XING APP
Business Card Reading
part of the XING
Mobile APP
Photo Taking
Capture of a business
card and preparation
for processing
Pre-Processing
Pre-Processing of the business
card, preparation for cloud
data extraction
Data Extraction
Extraction of relevant
data and matching with
XING user database

48. Reference: Mobile Capture with Intuit Turbotax
Step 1 Step 2 Step 3 Step 4
• Picture of tax
declaration
• Transfer to Cloud
Capture server
• Processing in the
Cloud
• Data extraction on
the server
• Push data to the
smartphone
• Validation through
the user
• Customer validates
tax data
• Storage of the refund
document as a PDF
• Send the tax refund
declaration online
• One-click sending into
the tax authorities

49. Use Case: Marketing App with Text Capture in the Cloud
● German McDonald‘s mobile campaign
for the 2014 FIFA World Cup Brazil
● App with Cloud OCR connector available
for iOS, Android & Windows Phone

50. Questions and Discussion

51. Thank you!
When will you start?
© Copyright 2016, ABBYY
Dr. Rainer Pausch
Product Group Head, SDKs
ABBYY Europe GmbH
pausch@abbyy.com , +49 89 69 3333 310