The I3D product represents digitalization of processes in industrial company, combines virtual reality (VR) and augmented reality (AR) to provide guidance for a worker through the process of training and the process of work execution.

1. II3Ds
Speaker: Dominik DEMETER, Martin MOJŽIŠ

2. Outline
1. Brief Company introduction
2. AS-IS scenario and challenges
3. TO-BE scenario and description of the experiment workflow
4. Architecture and technical details
5. KPIs & Business impact

3. NOVITECH a.s.
Company introduction

4. Novitech a.s.
1. Technology SME was established in Košice (Slovakia) by the visionary founder Attila Toth in 1989,
current president of the company
2. The main focus of the company is to provide quality innovative services to our customers in the areas
of:
• IT system architecture design
• Process and project management
• Information systems design and specifications
• IT systems development and operational support
• Business process automation
• WEB applications and portal solutions
• Collaborative solutions
• AR/VR solutions in industrial setting
3. International group of companies with different competencies and expertise
4. EBN certified innovation centre – to support innovative internal projects (I3D)

5. Novitech a.s.
Novitech (I3D team) is implementing international EU funded projects:
1. “BIMERR- BIM-based holistic tools for Energy-driven Renovation of
existing Residences (no. 820621)”- H2O2O
2. “CBC Tours - Cross-border HU-SK virtual tours“- Interreg HU-SK Program
3. "COGITO - COnstruction-phase diGItal Twin mOdel
(no. 958310),H2020, starting in November, 2020
4. In preparation: Project addressing the COVID epidemic – partnership
with Faculty of Medicine and Faculty of Management

6. AS-IS scenario
I3D before MIDIH

7. AS-IS scenario and challenges
• Set of tools/services to provide on-site support for workers to execute properly their work orders and to
collect data for further analysis
• Focus on voice-controlled smart glasses - RW HMT-1, support for different HW missing
• Main goal: industrial client independent on vendor and 3rd party licenses
• Web based UI for technologist and operator to create and manage:
• Workflows – templates for work orders
• Work orders – issue based on workflows and assigned to selected worker
• Basic plant structure modeling tool
• Basic work reports to follow the work order results
• Smart glasses application
• Displays the worker the detailed instructions about what, where and how to do, including additional information potentially needed
by worker
• Provides integrated interface for results reporting/recording on instructions level
• VR mode for learning; AR mode for execution – all with the same set of data

8. TO-BE scenario
I3D after MIDIH

9. TO-BE scenario and description of the experiment
workflow
• Functionalities implemented and covered by FIWARE components
• Customizable work order reports to provide the option for operators to produce work order reports which just fit their
needs – plant level; equipment level; worker level, ...
• Tool to analyse and compare the collected data of the executed work orders and generate customized reports.
FIWARE KNOWAGE
• Custom dashboard for operator to follow the activity of workers and the status of the work orders
FIWARE Wirecloud Widget Mashup
• Indoor localization based on QR code reading in terms of verification, if the worker is on right place
FIWARE Kurento media server + ZBarFilter
• Computer-vision based identification of objects to provide additional information for workers related to the marked objects.
FIWARE Kurento media server + ZBarFilter

10. TO-BE scenario and description of the experiment
workflow
• Prototype of II3Ds implemented = 3 FIWARE components integrated to I3D to test and verify
• 1 Demonstration workflow has been implemented – Daily Maintenance at Biogas Station in Valaliky
• Several demo work order executions have been provided on different smart glasses to collect data for
analysis
• Support for new type of smart glasses has been implemented:
• ThirdEye Gen X2
• Google Enterprise Edition 2
• Microsoft HoloLens2
• Smart glasses compared to provide guidenance for future users to select the best smart glasses based
on their USE-CASE scenario

11. TO-BE scenario and description of the experiment
workflow

12. Architecture
and technical details

13. Architecture and technical details

14. I3D SERVER (Backend)
I3D DBS
I3D Webservice / API
File storage
14
I3D SERVER (Web-based Frontend)
I3D
Web-based
Front-end
• Technologist defines workflows
• Shopfloor manager issues work orders
• Shopfloor manager monitors work order status
• Shopfloor manager generates pre-defined reports
Workflow management
Work order mng.
Simple reports
Smart glasses
(tablets, smart phones)
I3D
Application
• Worker is guided through the list of work orders
• Worker is guided through the execution of each work order
instruction by instruction
• Worker is reporting the results in real-time
Work order execution
Instant reporting

15. I3D SERVER (Backend)
I3D DBS
I3D Webservice / API
File storage
15
Kurento media
server
I3D SERVER (Frontend)
I3D
Web-based
Front-end
• Technologist defines workflows
• Shopfloor manager issues work orders
• Shopfloor manager monitors work order status – also via custom
dashboard
• Shopfloor manager generates pre-defined reports and custom reports
Workflow management
Work order mng.
Simple reports
Extended reports
Smart glasses
(tablets, smart phones)
I3D
Application
• Worker is guided trough the list of work orders
• Worker is guided trough execution of each work order instruction by
instruction
• Worker is reporting the results real-time
• Smart glasses detect QR codes and provide additional info to worker
Work order execution
Instant reporting
QR based localization
+New Dashboard
Wirecloud
Knowage

16. KPIs
and Business Impact

17. KPIs & Business impact
• KPI1 – I3D + MIDIH = II3DS – extended toolset implemented and tested
• 3 FIWARE components integrated to I3D
• Verification by: testing report.
• KPI2 – Workflow of a maintenance task from the testing factory implemented
• Verification by: Workflow approval report describing the instructions to provide maintenance tasks via smart glasses – extended
with the new functionalities
• KPI3 – On-field demonstration of the new toolset working with 3 different types of glasses provided.
• Verification by: Practical demonstration report.
• Future of FIWARE components in I3D/Novitech
• Wirecloud
• Knowage
• Kurento Media server

18. THANK
YOU!

19. Contacts
Novitech a.s.
Moyzesova 58
040 01 Košice
Slovakia
www.novitech.sk
https://i3d.novitech.sk
Dominik Demeter
I3D Development manager
demeter@novitechgroup.sk
Martin Mojžiš
EU project manager
mojzis@novitechgroup.sk