Listex is a comprehensive online platform that includes the creation and management of digital content, automatization, and management of the planogramming process, as well as the automatic recognition of planograms in the name of merchandising processes optimization in retail. Our technologies allow FMCG and CPG companies to control the placement of trade names with minimal use of manual labor. We’ve created a unique solution based on a neural network, which helps to recognize products on a store shelf, checking them against an existing planogram and correcting any inaccuracies automatically in a matter of minutes. We present a modular solution that consists of: 1) Listex - in cooperation with retailers, we create multi-purpose digital content about products (photos, attributes, weight and size characteristics) using the latest equipment within the module. 2) IdealoRama - having professional photographs, as well as the geometric dimensions of the goods, in the web service, we create planograms for displaying goods on shelves. 3) Plexa - using neural networks, as well as an application for smartphones/tablets, we check the correct location of goods on shelves by comparing them with planogram data. The determination occurs by comparing the images of goods with existing in the database of the neural network. Three modules of our software solution are ideally combined with each other and make up the whole ecosystem. But you can use any component individually or combining it with another component. Follow the link to find our video that you could see at the exhibition at our booth https://www.youtube.com/watch?v=mzgcax9ra94&feature=youtu.be.

1. Automatic planogram recognition solution
by .
IdealoRama

2. Why do you need it?
Did you know what is a planogram?

3. By analyzing past and current buying patterns, a planogram
manager can make recommendations about the number of
"facings" (product faces) a certain product should have on a retail
display. The diagram will indicate a certain (shelf) height level
from the floor on which the product should be displayed, as well
as which products should surround it.
Moreover product location within a store is important
for supplier, who is interested in the most favorable and
crowded place in order to increase sales.
A planogram is a diagram that shows how and where specific retail products should be
placed on shelves or displays. The main motive to have a planogram is to ensure the convenient and logical
location of products on a retail shelf in order to increase sales.

4. Today
Conventional planogram management

5. Thousands of employees
check products on-shelf availability
and out-of-stock manually,
validate correctness of disposition
with the requirements and
agreements. This takes time,
money, and mistakes are very
likely.

6. Let's thinking what do we have now..
Many manufacturers enter into agreements with retailers to display their
goods in certain ways. Everyone wants their product to be placed in the center opposite
consumers eyes and occupy the largest possible area on a shelf. But this seldom
works as expected.
Thousands of merchandisers move from store to store to make sure that their
company's products are on the shelf and presented in accordance with the contract.
Sometimes they are lazy: it is much easier to forge the report without leaving
your home than to go to a point of sale.

7. Next
The future of planogram management

8. Our complete solution now
equipped with AI helps
optimize and improve all
processes of planning, building and
controlling planograms.
It enables you to control the
placement of thousands of products
with little or no human
involvement.

9. Let's imagine what is needed for a store ..
We select products directly from the database, simply by ticking the checkbox opposite
the required product in the database. Instantly, all selected positions are pulled into the
constructor, in the form of rectangles with their own proportions and sizes. In the
planogram designer software, we set the sizes of the available shelves and arrange the
virtual products on them. The planogram is ready! Immediately, we send it via online to a
responsible employee. He receives an understandable and clear layout to implement on
the shelves. The next day, an employee takes pictures of the actual shelves and in case
there are an error you’ll immediately receive a notification!

10. We are
Let we introduce ourself

11. Since 2006 our R&D office in Eastern Europe, Ukraine has developed dozens of projects
for retail which nowadays operate in Ukraine, Russia, Kazakhstan, EU and the US.
We have an extensive background in CSP (content service providers), PIM (product
information management), EDI (electronic data interchange), SCM (supply chain
management) systems.
The idea of Idealorama originally comes from repeated inquiries from our regular retail
customers. The IdealoRama turned out so cool that we want to offer it to you!

12. We proud to have such successful partners

13. We made the
`Next` closer!
What do we offer

14. These are 3 software modules
These three modules are ideally combined with each other and make up the whole
ecosystem. But you can use any component individually or combining it with another
component.

15. The complex consists of 3 main modules:
Listex — is a digital catalog of
consumer goods. Listex.info is an
open catalogue that can be used by
retailers, suppliers, distributors, and
customers.
Product catalogue module

16. The complex consists of 3 main modules:
This is online WYSIWYG designer for
creating planograms. Plexa pulls
products data from Listex. Created
planograms can be printed out, stored or
sent as a PDF file by mail and are
immediately available to any employee
responsible for placing products on a
shelf.
Planogram recognition module

17. The complex consists of 3 main modules:
This module is used for automated
verification of products on a shelf, and
validate their positions against
planogram.
It requires moderate AI training (to
recognize your actual products) before
the neural network will be able to
identify the products on the picture.
Planogram management module

18. You can use it almost in any configuration
(no need to replace your existing MDM or planogram management software)

19. IdealoRama
The modular software complex to enable planogram
compliance within your organization

20. Step 0 Starting screen
Shown for a few seconds while app is loading.
We require app to be vertical layout only, ready for
iphone8 and above.

21. Step 1 Camera capture
Camera capture is shown the way it eagerly uses all
available screen space. It’s overlayed with the
button to make a shoot which is placed in the
middle of the bottom line.
While camera capturing, algo trying to mark
products it sees with half-transparent yellow boxes.
Once the user is satisfied he’d tap the shoot button.

22. Step 2 Image processing
Once “shoot” is pressed, camera capture stopped,
the screen now shows taken image with yellow
semi-transparent boxes on it. The whole screen is
overlayed with a semi-transparent gray box with
“Processing…” message in it.
The app sends taken image to the backend for
processing. Backward the app gets JSON with
coords and product description for each zone.

23. Step 3.1 Results report visualization
As soon as the app gets a response from the backend, it
should change the layout to show the back button at the top,
and two tabs at the bottom line.
The body must render taken image with semi-transparent red
(product not identified) and green (product identified) boxes.
Left tab should be active.
The image along with the overlayed boxes should be
zoomable with a two-fingers “zoom” gesture. The minimum
zoom level equals to when whole image fits the screen. The
maximum - 5x zoom.

24. Step 3.2 Results report listing
On the second tab, the user can see a response
from backend represented as a list of products.
Each product represented with it’s cut from taken
image plus product headline and barcode to the
right.
The list should be scrollable.

25. IdealoRama helps optimize and improve all processes of planning, building and
controlling planograms.
It is modular software for planogram compliance management. Allows you to manage
thousands of SKUs with little or no human involvement.
Automatic planogram recognition solution IdealoRama

27. Planning and Building aspect
The functional has a set of mock-ups of equipment of a store with dimensions of
racks and shelves.
Thanks to the Listex digital catalogue, we have photos and weight & size
characteristics that are used in the construction of the planogram.
The ability to save the finished planogram in PDF format and send directly to the
store.

28. Controlling aspect
Special robotic device scans a shelf with a display of products.
The shelf photo is sent to the server for analysis by specially trained machine
learning algorithms.
Algorithms recognize products on the photo based on their distinctive features
which combine the following parameters: logo, color, shape, type of packaging.
1
2
3

29. Controlling aspect
From the photo of the shelf with the goods, IdealoRama automatically determines
which goods are present in the display and whether the display corresponds to
the planogram, and creates an analytical report.
IdealoRama automatically recognizes goods (SKU) on a shelf by the machine
learning methods. Thus, now it is not necessary for the merchandiser to
photograph the display on the shelf and upload photos for further manual
processing.
4

30. Planogram compliance control with IdealoRama
IdealoRama automatically determines from the photograph or video of the shelf
with the goods which goods are present in the display and whether the display
corresponds to the planogram, and then creates an analytical report.
Analysis is performed automatically solely on the basis of incoming pictures and
does not require additional calculations. The report is transmitted to the
company’s department (or to responsible employee) via mobile application. The
response from the system comes in real-time, which means that the employee
can take actions immediately.

31. IdealoRama’s
Customer benefits
What do you get

32. IdealoRama allows you
to manage thousands
of products with
virtually no human
involvement.
Being fully automated,
IdealoRama minimizes
the human factor when
collecting and analyzing
information, reducing
the percentage of errors
close to zero.
Recognition accuracy
equal or greater then
95%
(depends on quality of learning dataset)
Merchandisers can deal
with sales and
promotions of goods,
rather than constantly
monitoring the display
of goods on a shelf.

33. Real-time analysis of
any shelf in your
stores.
Online reporting makes
it possible to take
needed actions in a
store immediately.
Received reports allow
you to analyze sales,
orders and stocks of
goods.
You will become
innovative :)

34. Training your AI
As easy as 1-2-3!

35. Our neural network is pretrained, but anyway it should be
adopted to your local conditions and it must “know” your
products.
1
We take about 3 000 - 10 000 pictures of your shelves with your products in
several different locations. It should be ~20-50 SKU per shot which is
approximately 500 000 assigned barcodes in total.
Then we identify each product on the pictures, assign a class (one of box, pack,
bag, bottle) and set it’s barcode (with help of LISTEX product catalogue or your
own existing MDM system). It is the most time-consuming stage of the project
called data-acquisition.
1
2

36. After such actions taken, the train dataset is ready to be processed, we call it
training. It will take about 10-20 days and will require a computer with hi-end
video card (NVIDIA Titan RTX, NVIDIA Quadro and similar) having powerful GPU
and huge amount of video-memory (apx. 24GB+).
3
Quite a lot of mistakes and strange features happen in the process of training
and
we might have to run through do-check-fix-restart loop several times

37. Training procedure -1-
Train dataset photo-session
Taking 10k+ photos of racks in 10 trade halls

38. Training procedure -2-
Photo annotation
Annotating images - identifying each product by record it’s class (box,
bottle, can, bag, etc.) and product identifier (UPC, barcode, or article
number)

39. Training procedure -3-
DNN training
Process of DNN-training is happening (~10-20 days)

40. Training procedure -4-
Calculate descriptors
Just born AI calculates descriptors which will help to recognize any
products in your database

41. Training procedure -5-
Production detection
New SKU coming

42. We can outsource training process
for your projects as well

43. Now we have well-trained Alpha.hdf5!
Our team comes to a store and takes pictures of product shelves using different
smartphones (with different cameras).
Annotation team identifies products on these pictures (one rectangle box = one
product).
Product detection neural network (PDNN) gets trained to identify these products.
When predefined loss function has no longer decreasing and test & validation are
going well, learning process stops.
1
2
3
4

44. IdealoRama’s
magic sauce
IdealoRama an inside look

45. 2 Products detection process
Report
3 Identification 4 Image descriptor
5 Ranking
descriptors library
1 Taking pictures of a shelf

46. Magic sauce
1 Take pictures 2 Products detection on a shot
Weights file for detection
(Alpha.hdf5)

47. Magic sauce
3 Identification
Weight file for auto encoder
(Golf.hdf5)
4 Image descriptor
(4096 x 3 byte floating
point real numbers)

48. Magic sauce
5 Ranking
Ranking by sum of finite differences
of pixel subtraction of the first or
second order
Report
Descriptors library
JSON with
product barcodes
and boxes

49. Thank you for your attention!
https://idealorama.com
https://listex.online
+1 (415) 890-20-97