.

2. AIRPLANEBUDDYMATCHINGUSINGAZURE
FORMRECOGNIZERANDML
@RaduVunvulea
GroupHeadof Cloud,Endava | Microsoft RegionalDirector | Microsoft AzureMVP

3. “BE THE CHANGE THAT YOU
WISH TO SEE IN THE WORLD”
Mahatma Gandhi

4. FUTURE IS A BLEND

5. NEW WAYS OF SEARCH WILL BECOME
MAINSTREAM
BY 2021, 80% OF EMERGING TECHNOLOGIES WILL
HAVE AI FOUNDATIONS
60% OF PEOPLE PREFER TO MESSAGE A CHAT BOT VS.
TALK WITH A HUMAN WHEN COMMUNICATING WITH
A BUSINESS

6. ROMANIA

7. MISSION

8. BUILD A SYSTEM THAT CAN IDENTIFY PEOPLE
THAT FLIGHT TO THE SAME DESTINATION

9. CHALLENGE

10. CHALLENGE

11. COMPUTER
VISION
OCR SUPPORT

12. FORM
RECOGNIZER
OCR SUPPORT

13. FORM RECOGNITION

14. https://azure.microsoft.com/en-us/services/form-recognizer

15. CUSTOM MODELS PREBUILT MODELS
5 SAMPLES ARE REQUIRED
1. CLUSTER THE FORMS
2. DISCOVER KEYS & TABLES
3. ASSOCIATE VALUES TO KEYS
TEST AND RETRAIN AS MUCH AS YOU WANT
PREBUILT RECEIPT MODEL
TIME AND DATE
MERCHANT INFORMATION
ITEMS AND VALUES
TAXES
TOTAL

16. PREBUILD MODELS
NOW (2022)
PREBUILT MODELS
2020
PREBUILT RECEIPT MODEL
TIME AND DATE
MERCHANT INFORMATION
ITEMS AND VALUES
TAXES
TOTAL
RECEIPT
INVOICE
BUSINESS CARD
ID DOCUMENT
LAYOUT
GENERAL
DOCUMENT

20. CUSTOM MODELS WHERE DOES IT RUN?
5 SAMPLES ARE REQUIRED
1. CLUSTER THE FORMS
2. DISCOVER KEYS & TABLES
3. ASSOCIATE VALUES TO KEYS
TEST AND RETRAIN AS MUCH AS YOU WANT
DOCKER CONTAINER
SOFTWARE AS A SERVICE
PRICING
FREE UP TO 500 PAGES / MONTH
CUSTOM S0 $50 / 1000 PAGES
PREBUILD S0 $10 / 1000 PAGES
COMMITMENT

22. FORM RECOGNIZER
MICROSOFT FLOW
INTERNET

23. https://docs.microsoft.com/en-us/azure/cognitive-services/form-recognizer/quickstarts/curl-train-extract

28. rvbuddy.cognitiveservices.azure.com

29. rvbuddy.cognitiveservices.azure.com
e859035620be4cf8a73775885c6845d8

30. rvbuddy.cognitiveservices.azure.com
e859035620be4cf8a73775885c6845d8
https://rvticketsstorage.blob.core.windows.net/tickets?sv=
2019-10-10&ss=bfqt&srt=sco&sp=rwdlacupx&se=2020-07-
31T19:43:48Z&st=2020-07-
02T11:43:48Z&spr=https,http&sig=eeeT8Zc5hfAVWkHgCdtT
3iGmKzzcn34Eim9OtroeeDU%3D

31. https://rvbuddy.cognitiveservices.azure.com/formrecognizer/v2.0/cu
stom/models/ae1f9521-94df-4fbc-b60f-da284bd2d6d9

32. https://rvbuddy.cognitiveservices.azure.com/formrecognizer/v2.0/cu
stom/models/ae1f9521-94df-4fbc-b60f-da284bd2d6d9

33. curl -X GET
"https://rvbuddy.cognitiveservices.azure.com/formrecognizer/v2.0
/custom/models/ae1f9521-94df-4fbc-b60f-da284bd2d6d9" -H
"Content-Type: application/json" -H "Ocp-Apim-Subscription-Key:
e859035620be4cf8a73775885c6845d8"

34. {"modelInfo":
{"modelId":"ae1f9521-94df-4fbc-b60f-da284bd2d6d9",
"status":"ready",
"createdDateTime":"2020-07-02T11:52:28Z",
"lastUpdatedDateTime":"2020-07-02T11:52:54Z"},
"trainResult":{
"trainingDocuments":[
{"documentName":"T1.pdf","pages":2,"errors":[],"status":"succeeded"},
{"documentName":"T2.pdf","pages":2,"errors":[],"status":"succeeded"},
{"documentName":"T3.pdf","pages":2,"errors":[],"status":"succeeded"},
{"documentName":"T4.pdf","pages":2,"errors":[],"status":"succeeded"},
{"documentName":"T5.pdf","pages":2,"errors":[],"status":"succeeded"},
{"documentName":"T6.pdf","pages":2,"errors":[],"status":"succeeded"
{"documentName":"T7.pdf","pages":2,"errors":[],"status":"succeeded"}],"errors":[]}}

35. https://rvbuddy.cognitiveservices.azure.com/formrecognizer/v2.0/c
ustom/models/ae1f9521-94df-4fbc-b60f-da284bd2d6d9
e859035620be4cf8a73775885c6845d8
https://rvticketsstorage.blob.core.windows.net/tickets/T1.pdf?sv=2
019-10-10&ss=bfqt&srt=sco&sp=rwdlacupx&se=2020-07-
31T19:43:48Z&st=2020-07-
02T11:43:48Z&spr=https,http&sig=eeeT8Zc5hfAVWkHgCdtT3iGmKz
zcn34Eim9OtroeeDU%3D"

36. https://rvbuddy.cognitiveservices.azure.com/formrecognizer/v2.0/c
ustom/models/ae1f9521-94df-4fbc-b60f-da284bd2d6d9
e859035620be4cf8a73775885c6845d8
https://rvticketsstorage.blob.core.windows.net/tickets/T1.pdf?sv=2
019-10-10&ss=bfqt&srt=sco&sp=rwdlacupx&se=2020-07-
31T19:43:48Z&st=2020-07-
02T11:43:48Z&spr=https,http&sig=eeeT8Zc5hfAVWkHgCdtT3iGmKz
zcn34Eim9OtroeeDU%3D"

37. Operation-Location:
https://rvbuddy.cognitiveservices.azure.com/formrecognizer/v2.0/custom/models/ae1f9521-94df-4fbc-b60f-
da284bd2d6d9/analyzeresults/7e6c8c62-521c-4961-b672-ef387200579b

38. https://rvbuddy.cognitiveservices.azure.com/formreco
gnizer/v2.0/custom/models/ae1f9521-94df-4fbc-b60f-
da284bd2d6d9/analyzeresults/7e6c8c62-521c-4961-
b672-ef387200579b
e859035620be4cf8a73775885c6845d8

41. OUT OF THE BOX FORM
RECOGNITION
NO CUSTOMISATION
REQUIRED
PAY PER USE
SIMPLE TO TRAIN
SUPPORT MULTIPLE
FORMATS
OFFERED AS SAAS
CAN RUN INSIDE
DOCKER CONTAINER

42. Thanks!
AIRPLANEBUDDYMATCHINGUSINGAZUREFORM
RECOGNIZERANDML
@RaduVunvulea
vunvulearadu.blogspot.com
https://www.linkedin.com/in/raduvunvulea/
vunvulear@outlook.com