The INART experiment demonstrates a novel way of Augmented Reality (AR) guided assembly in manufacturing environments through MIDIH ecosystem

1. On-site training of INdustrial workers
using AR Technology (INART).OC1
Speaker: Dimitris Katsikas (Co-founder/General Manager)

2. INART Solution
The INART experiment demonstrates a novel way of Augmented Reality (AR) guided assembly in
manufacturing environments through MIDIH ecosystem.
TAKEAWAYS
➢ Hands-free solution with technical drawings and training material
available & in view at all times.
➢ Blending of real execution, support and training makes equipment
and assemblyoperations easier to learn/use
➢ Gamification increases worker engagement and potentially skills
➢ Time and cost-efficient industrial training
➢ Assembly recordings can be analyzed and allow for sequence
optimization, support decision making and drive growth.

3. INART through MIDIH Ecosystem
The INART architecture is built on the MIDIH RA
standards:
➢Datain Motion (DiM) concept
➢Dataat Rest (DaR) concept
INART consists of two major components:
➢ The AR HoloLens Application that runs on the
Microsoft HoloLens device.
➢ The Immersive Framework that acts as the
backend platform for recording and sharing data.

4. The experiment

5. The Bilbao Experiment
About the experiment:
▪ A multi-step 3D Assembly was developed for HoloLensGlasses.
▪ The experiment was conducted in a single day (March 22nd) at the AIC (Automotive Intelligence Center) didactic
factory in Bilbao.
▪ The experiment was conducted by six (6) participants. Only two (2) of them were experts in the specific assembly.
Non of them had prior experience with any type of AR Glasses.
▪ Participants filled-in the INART questionnairealong with a GDBR complianceconsent form.
3D
Assembly
AR HoloLens
App

6. The Bilbao Experiment: A 2-step experiment
2nd STEP: Participants completed the assembly task
manually while wearing the Microsoft’s HoloLens and
interacting with the 3D assembly.
1st STEP: Participants completed the assembly task
manually by reading the hardcopy instructions.

7. The Bilbao Experiment : Use Case Video
Performing manual assembly while guided by
Hololens 3D Assembly
See-through Hololens (Indicative)

8. LEGO assembly
A 10-step LEGO 3D assembly was developed and a demonstration
of INART/MIDIH was carried out to selected industrial customers,
resulting to a more robust experiment.
Questionnaires were filled in by participants in Bilbao and by D-
Cube’s customer executivesand workers.
The actual
LEGO model
The virtual
LEGO model

9. KPIs

10. Report on KPIsKPI Goal Target Achieved Comments
KPI1.1 Reduction of task completion times in an
analysis of variance between groups: > 20%
>20% 31,00% Validated solely on Bilbao Experiment recording assembly execution times
for 6 participants
KPI1.2 At least 1 interactive 3D hologram depicting
a sequential assembly operation
>1 2 Two (2) multi-step 3D holograms for HoloLens were developed
KPI2.1 TAM + Cronbach’s Alpha Index > 0,70 >0,7 0,76 Cronbach’s Alpha Index : 0,76
Technology Acceptance Model (TAM) : 92,4%
TAM was used as the theoretical model for the design of the questionnaire.
Validated by answers from both Bilbao participants and D-Cube customers.
KPI2.2 % of workers supporting the adoption of
proposed approaches >=30%
>=30% 83,20% Validated by answers from both Bilbao participants and D-Cube customers.
KPI2.3 % of experiment participants with positive
opinion of AR technology >=50%
>50% 85,25% Validated by answers from both Bilbao participants and D-Cube customers.

11. Report on KPIs: KPI1.1
ID Session Expert Offline Training
Time
Assembly
execution
Duration
Total
Duration
% Reduction due to
INART solution
% Reduction
due to AR
familiarisation
01 Manual Session YES 3’ 04’35” 07’35” - -
01 AR Session #1 YES 0‘ 12’44” 12’44” -68% -
01 AR Session #2 YES 0‘ 08’03” 08’03” -6% 37%
02 Manual Session NO 3’ 09’02” 12’02” - -
02 AR Session #1 NO 0‘ 07’10” 07’10” 40% -
02 AR Session #2 NO 0‘ 06’47” 06’47” 44% 5%
03 Manual Session YES (very) 3’ 03’22” 06’22” - -
03 AR Session #1 YES (very) 0‘ 12’25” 12’25” -95% -
03 AR Session #2 YES (very) 0‘ 06’19” 06’19” 1% 49%
04 Manual Session NO 3’ 07’29” 10’29” - -
04 AR Session #1 NO 0‘ 08’15” 08’15” 21% -
04 AR Session #2 NO 0‘ 07’14” 07’14” 31% 12%
05 Manual Session NO 3’ 06’02” 09’02” - -
05 AR Session #1 NO 0‘ 09’51” 09’51” -10% -
05 AR Session #2 NO 0‘ 06’54” 06’54” 24% 31%
06 Manual Session NO 3’ 08’51” 11’51” - -
06 AR Session #1 NO 0‘ 07’36” 07’36” 36% -
06 AR Session #2 NO 0‘ 04’07” 04’07” 65% 46%
➢ The average reduction
of task completion:31%
➢ The inexperienced
participants (4 out of 6)
spent 42% (>20% set on
the KPI) less time.

12. Outlook

13. Dissemination and Exploitation Activities
➢Showcasing INART/MIDIH in D-cube Web site
(http://www.d-cube.eu/who-trusts-us/inart/)
➢Creating a Demo video for the Bilbao didactic
factory
➢Creating a Pitch video
➢Demonstrating INART and MIDH to D-cube’s
clients, using the Lego assembly
➢Identifying INARTbusiness opportunities in
diverse sectors

14. Business Opportunities: Examined Use Cases
Company ExaminedUse Case Sector
Remote training on chemical analysis machines in Cyprus, Bulgaria
and Romania
Agricultural, Food & Feed,
Environmental Protection
Quality assurance, product inspection using AR Plant Propagation, Food,
Agricultural
▪ Training workers on new marble processing machines
▪ Supporting QA processes using AR (i.e. marble slab inpection).
▪ Digitize Dry Lay procedure (3D representation of the floor and the
worker's guidance according to designs and CAD files via AR)
Materials, Marble processing
▪ Design and geometry validation of aluminum profiles (against 3D
CAD files)
▪ Remote training on extrusion press operation (i.e. Serbia Plant)
Materials, Aluminum
extrusion and processing
▪ AR ready Talent Development Platform
▪ Support 3D Holographic Training Experience
▪ Training Sequence recording and evaluation with machine learning
E-Learning,
Talent Development platform
provider

15. Benefits and Lessons Learnt
Based on the experiment results,
▪ The AR guided assembly improves both the assembly training
and the operation of assembly lines.
▪ Both workers and supervisors, are potentially ready to accept
and use products related to AR/MR technologies.
▪ The tap gesture requires some acquaintance before the user
being feels comfortable using it.
▪ A wearable click button (clicker) is the option that most of the
participants preferred.
In terms of business opportunities,
▪ The INART software proven to be a strong case for a
variety of scenarios in different industry sectors.
▪ Αn authoring tool for faster ingestion of new
assemblies into the HoloLens App would provide a
strong key advantage.
▪ INART can be a very competitive product for D-cube in
the southwestern Europe and middle east region.
In terms of technology readiness of the D-cube solution,
▪ The Immersive Framework proved capable to manage both
Data in Motion and Data at Rest modes.
▪ Augmented and VR headset market is still something new
and immature in some ways.

16. Future Plan
➢D-cube aims to continue the development and enhancements of its Immersivesolution and specifically
the AR guided assembly framework.
➢D-cube will work on the user experience, the graphics and the refinement of the UI as the first step
towards integrating the lessons learnt.
➢The implementation of an authoring tool is the next development goal for the global acceptance and
adoption of the proposed technology.

17. THANK
YOU!