Annotated Arabic-English Receipt Dataset for Key Information Extraction and Classification

1. 1

2. Unleashing the Power of AI
How NLP & LLM models
can excel in comprehending
the intricacies
of Arabic Language

3. In today's digital world, personal data protection
laws are of utmost importance for businesses.
With the increasing amount of personal data being
collected, it is crucial to comply with these laws to
ensure the privacy and security of individuals'
information. At the same time, AI can leverage first-
party data to provide valuable insights to businesses
that can help them make better decisions and
improve their bottom line.
Today, we will explore how AI can use first-party
data to create behavioral scoring systems and KYC
for banks and financial institutions, enhance
customer understanding, and optimize customer
acquisition strategies.
We will also discuss the benefits of having your own
LLM service to provide powerful AI capabilities and
why it requires thorough planning to enhance
enterprise profitability.
Introduction

4.  Enhancing Customer Understanding
 First-Party Data vs. Anonymized Data
 Behavioral Scoring Systems
 Data collection and Extraction
 Technology and How it works
 Case Studies
 Market Insights
 Benefits of Custom LLM Service
CONTENTS

5. Enhancing Customer Understanding
01

6. AI provides financial institutions, brands ,merchants
with invaluable insights into their customer base,
allowing them to optimize their customer acquisition
strategies and predictive analytics.
For example, AI can help businesses understand the
preferences and behavior of individual customers,
providing personalized recommendations and
marketing messages.
It can also help identify high-value customers and
predict which customers are most likely to churn,
allowing businesses to take proactive measures to
retain them.
With AI, businesses can analyze vast amounts of
data in real-time, identifying patterns and trends
that would be impossible for humans to detect.
Enhancing Customer Understanding

7. 02
First-Party Data vs. Anonymized Data

8. First-party data refers to information collected
directly from customers, such as their purchase
history or website behavior.
Anonymized data, on the other hand, is data that has
been stripped of any personally identifiable
information. While anonymized data can still provide
valuable insights, it lacks the context and specificity
that first-party data offers.
AI can leverage first-party data to provide more
valuable insights because it allows for a deeper
understanding of customer behavior & preferences.
By analyzing first-party data, AI can identify patterns
and make predictions with greater accuracy, leading
to more effective marketing strategies and
personalized experiences for customers.
First-Party Data vs. Anonymized Data

9. Behavioral Scoring Systems
03

10. Behavioral scoring systems are a powerful tool for
banks and financial institutions to assess credit risk
and make informed lending decisions.
By leveraging first-party data, AI can create highly
accurate behavioral scoring models that take into
account a wide range of factors, including spending
patterns, transaction history, and demographic
information.
AI algorithms are able to analyze customer data
and generate a comprehensive credit score that
takes into account a range of factors beyond
traditional credit history.
This allows the bank to make more informed
lending decisions and offer better rates to
customers who might otherwise be overlooked by
traditional credit scoring models.
Behavioral Scoring Systems

11. Data Collection and Extraction
04

12. Data extraction
Data Capturing
Our DEEP LEARNING AI software will
read in real-time any receipts
whatever it is ( Hardcopy or Digital )
Also, our algorism able to understand
and categorized the data in receipts
using NLP technology.
Data Extraction
Data is extracted in a structured format
with line item detail including but not
limited to; date, time, retailer name,
payment methods, products details,
tax, and total paid money.
Product Intelligence
We get insight into products purchased with details on category, SKU, full description, and Prices from our extensive Big Data Platform.
CUSTOMER
MERCHANTS
SUPPLIERS

13. Data extraction

14. And 21 more images
Image Uploading
Phase 1
Image slicing
Phase 2
Text Extraction
Phase 3
Fields Extraction
Phase 4
And 21 more image
"text": [
[
"Carrefour ‫كارفور‬
"
,
" MALL OF EGYPT ‫م‬ ‫بك‬
"
,
" L",
" ‫الل‬ ‫الديترجاع‬ ‫ساازية‬ ‫اللفئرة‬
٢٤
‫ساعة‬
"
,
" Keep rcpt For refund/exchange",
"1 day Fresh food, 30 days others",
"622201898310",
"T 79.95 ‫وجه‬ ‫فوطه‬
100 X50 ‫سا‬
"
,
"
200000492412
"
,
(" M) 05. ‫م‬ ‫تبرع‬
.
‫لالعاقة‬ ‫سيتي‬
"
,
****" TOT 80.00",
"Cash 100.00",
"CHANGE 20.00",
"SERVED BY MOHAMED ELIAS",
"TOTAL NUMBER DF ITEMS SOLD = -2",
"18/12/21 18:41 211 09 0096 117",
"INVOICE NO :",
"6021100900962112181841",
"Prices Include VAT",
"On Subjected Items Only",
"Brought to you by MAJID AL FUTTAIM",
"42XXX*********X**X**XXXXXXXXXX*XXXXX
",
" ‫لتبرعكم‬ ‫شكرا‬
"
,
" DB ‫ي‬
‫س‬
"
,
"
‫الف‬
"
,
"
‫بقيمة‬ EGP ,05 ‫بنيه‬
"
,
" Donat ions are not refundable",
"A*2*********************************
*******"
]
]
"meta_data": [
{
"field_name": " ‫االجمالي‬
"
,
" field_value": “80.00"
},
{
"field_name": " ‫التاريخ‬
/ Date",
"field_value": "18/12/21"
},
{
"field_name": " ‫الوقت‬ Time",
"field_value": "18:41 "
},
{
"field_name": “invoice_number",
"field_value": "6021100900962112181841"
},
{
"field_name": “cashier_name",
"field_value": " MOHAMED ELIAS "
}
},
{
"field_name": “branch_name",
"field_value": “MALL OF EGYPT"
}
],
Data extraction

15. And 21 more images
Items Extraction
Phase 5
Item Analyzer
Phase 6
{
"item_name": " T 79.95 ‫وجه‬ ‫فوطه‬
100 X50 ‫"سا‬,
"item_quntity": "1",
"item_price": "79.95",
"item_discount": "",
"item_ barcode": " 622201898310 ",
"item_totals": "79 . 95"
},
Searching
Attribute Value
Item Name Arabic ‫قطن‬ ‫وجه‬ ‫فوطة‬
50
100 x
‫سم‬
-
‫اسود‬
Item Name English Cotton More Face Towel - 50 x 100 cm - Black
Item Barcode 6222018983104
Item Unit piece
Item Category Furniture & Home Deco / Carpets Covers & Pillows / Towels & Robes
Item Average Price 84.95
Item Tags Material : Cotton – Size : 50 x 100 cm - Color : Black – Brand : No Brand
Item Image https://cdnprod.mafretailproxy.com/sys-master-
root/hec/h6f/17176677416990/552146_main.jpg_200Wx200H
Prices Detected Date Price
2022-03-04 19:28:20.480 79.95
2022-04-21 10:19:21.627 89.95
"items": [
{
"item_name": " T 79.95 ‫وجه‬ ‫فوطه‬
100 X50 ‫"سا‬,
"item_quntity": "1",
"item_price": "79.95",
"item_discount": "",
"item_ barcode": " 622201898310 ",
"item_totals": "79 . 95"
},
{
"item_name": " ‫م‬ ‫تبرع‬
.
‫لالعاقة‬ ‫سيتي‬ ",
"item_quntity": “1",
"item_price": “0.05",
"item_discount": "",
"item_ barcode": " 200000492412 ",
"item_totals": “0.05"
}
]
Data extraction

16. 05
Technology and How it works

17. Artificial Intelligence wiring?

18. Deep learning & NLP
• Deep Learning and Neural Networks are
synonymous.
• It’s a part of machine learning based on a set of
algorithms that attempt to model high level of
abstractions in data by using deep graph with
multiple processing layers, composed of multiple
linear and non- linear transformations.
What we see What the computer “sees”

19. Use cases
06
Consumer’s empowerment using AI tools

20. Merchants can know if their customers are not coming to buy their Shelf Products
Use Case 1
Knowing Customer Behavior throughout their day

21. By analyzing first party data coming from users, Platforms can profile the right customer persona
Use Case 2
Customer Persona

22. 24.53%
23.32%
13.99%
8.20%
5.56%
5.26%
5.17%
2.83%
2.26%
2.10%
1.87%
1.41%
0.92%
0.84%
0.72%
0.52%
0.28%
0.22%
One Month Expenses
House Rent & Utilities
Expenses
School Quarter Installment
Mom & Dad Expenses
Kids Expenses
Outing
Grocery
House Supplements
Protein
Fast Food
Cloths - Mom
Fruits & vegetable
Pharmacy
Kids Expenses
Category Total %
House Rent & Utilities Expenses 10,520 24.53%
School Quarter Installment 10,000 23.32%
Mom & Dad Expenses 6,000 13.99%
Kids Expenses 3,517 8.20%
Outing 2,383 5.56%
Grocery 2,256 5.26%
House Supplements 2,219 5.17%
Protein 1,212 2.83%
Fast Food 968 2.26%
Cloths - Mom 900 2.10%
Fruits & vegetable 800 1.87%
Pharmacy 605 1.41%
Kids Expenses 396 0.92%
Personal Care 360 0.84%
Cosmetics 307 0.72%
Confectionary 221 0.52%
Detergents 119 0.28%
Tips & Parking 96 0.22%
Grand Total 42,878 100.00%
Use Case 3
expenditure breakdown

23. Actual Spend
Predicted Spend
A.I platform can predict and adapt to the consumer spending habit,
and recommend spending strategies, to maximize savings and optimize spending
Use Case 4
Customer Spending Recommendation

24. Use Case 5
Product Recommendation
Helping consumers find top alternative products, while saving the most money.

25. 07
Market insights
It is all about data…

26. Chicken Industry Sample Report

29. 08
Custom LLM
Service

30. Deploying a custom LLM service can provide
businesses with powerful AI capabilities that are
tailored to their specific needs.
By creating a unique solution, companies can
enhance profitability by gaining valuable insights
into their data and optimizing their operations.
However, it is important to note that deploying a
custom LLM service requires thorough planning. This
involves identifying the specific requirements of the
business and designing a solution that meets those
needs.
It also requires ongoing maintenance and updates to
ensure that the system continues to operate
effectively.
Benefits of Custom LLM Service

31. Conclusion
In conclusion, it is clear that complying with
personal data protection laws is of utmost
importance for businesses.
However, leveraging AI to provide valuable insights
can also be a game-changer. By using first-party
data instead of anonymized data, AI can create
behavioral scoring systems and KYC for banks and
financial institutions, as well as optimize customer
acquisition strategies for brands and merchants.
Deploying your own custom LLM service requires
thorough planning, but the benefits are worth it.
With powerful AI capabilities at your fingertips,
you can enhance enterprise profitability and gain
a deeper understanding of your customer base.
It is time for businesses to take action and
embrace the potential of AI while ensuring
compliance with personal data protection laws.

32. Thank You
Yasser El-Bendary
yelbendary@update-us.com
http://www.discoapp.ai/
+02 012 23122942