Design, develop and validate an Augmented Reality (AR) application for training-on-the-job and maintenance assist operations- An AllbeSmart experiment based on MIDIH Open Platform Architecture

1. E-ROBOTIC
Speaker: Hugo Marques
Mentor: Oliver Keil

2. Company Presentation

3. Lisbon
Oporto
Castelo Branco
Faro
Who we are – Allbesmart
• Allbesmart is a technological SME founded in 2015:
• 8 Engineers (4 PhDs) in Telecommunications
and Computer Science.
• Specialized in:
• Customized software development
• Wireless connectivity (3G/4G/5G, Vehicular, WiFi)
• IoT solutions (Smart city solutions)
• Industry 4.0 (Image Processing, Augmented Reality)
• Systems integration
Water monitoring V2V & V2I Transportation Industry 4.0 AR for Utilities
Smart city
Mobility
Industry 4.0
Transport
Infrastructure
IT services

4. Lisbon
Oporto
Castelo Branco
Faro
Our customer – StoneShield
• StoneShield is an industrial SME founded in 2017:
• 12 Engineers (1 PhD) in Telecommunications,
Mechanics and Computer Science
• Specialized in:
• Design and development of customized
machines for industrial applications
• Robotic solutions
• Taping solutions
• Industrial engineering solutions
• The team has 15+ year experience in the
design and development of machines for
industrial applications

5. AS-IS Scenario

6. AS-IS scenario, challenge, problem to be solved
• 90+ million vehicles are manufactured every year
• 60% of all electric cables manufactured are installed in
cars
• Car manufacturers are using increasingly smaller
components
• Miniaturization raises new challenges for manual labour
• Automation requires training/education and specialized
maintenance operations
• Taking advantage of this opportunity, several
Portuguese SMEs are designing and manufacturing
machines for the automation of the cable
assembly industry
Robotic Seal Inserter (RoSI)

7. TO-BE Scenario

8. TO-BE Scenario
• E-ROBOTIC Main Goal
• Design, develop and validate an Augmented Reality (AR)
application for training-on-the-job and maintenance
assist operations. (Conceptual images, February 2020)

9. TO-BE scenario
• E-ROBOTIC Main AR
interface Bar

10. TO-BE scenario & Workflow
• E-ROBOTIC Main AR interface Bar
submenus and navigation

11. E-ROBOTIC
Architecture

12. Architecture

13. Architecture – Possible improvements
• When implementing a
topology with a context
broker as a central hub for
all information flows we
should minimize the volume
of data that traverses the
context broker
• This approach takes the
load from the context
broker
• when retrieving large files
(documents, images or
videos).

14. KPIs & Business Impact

15. KPIs & Business impact
Increase
Increase
Decrease
Decrease
From 20% to 5% Up to 70%
Decrease
Up to 40%
!
Machine
Downtime
Cost of
Training
Faulty
Products
Machine
Lifetime
Worker
Safety
Increase
New
customers
Increase
Revenue
Increase
New jobs
Up to 40% Up to 30% Up to 20%

16. THANK
YOU!
Promotional video available at: https://youtu.be/7llR-k7J55g