SlideShare a Scribd company logo
1 of 20
Download to read offline
© Kompetenzzentrum Virtuelle Realität und Kooperatives Engineering w. V. – Virtual Dimension Center (VDC )
Prof. Dr.-Ing. Dipl.-Kfm. Christoph Runde
Marianne Ludwig
Virtual Dimension Center (VDC) Fellbach
Auberlenstr. 13
70736 Fellbach
www.vdc-fellbach.de
VR / AR / MR in MRO & Service
VDC Whitepaper
overview Missionservice assistanceserviceability validation service training summary
Whitepaper
VR / AR / MR in MRO & Service
service documentation
 increased product complexity, creating
impact on: development, production,
commissioning, operation, service
 increasing number of variants
 mass customization, highly
differentiable products
 language and cultural barriers of
world markets
 machine operator business models:
not the machine hardware, but the
output is sold (responsibility for the
operation of the machine is therefore
the responsibility of the manufacturer)
20.07.2018 2
actual challenges e.g. in
mechanical engineering
application fields of VR/ AR
 service engineering (ensuring
serviceability) and service planning
 service training
 service assistance
overview service assistanceserviceability validation service training summaryservice documentation
overview Missionservice assistanceserviceability validation service training summary
Whitepaper
VR / AR / MR in MRO & Service
service documentation
serviceability studies
 checking accessibility visually and manually
 check accessibility of assemblies, fasteners,
lubrication points, etc
o visually
o with hands and
o tools
 all variants, perspectives and positions
 check disassembly / assembly, assembly
sequences
 avoidance of special tools
 memorandum, determination of default times
20.07.2018 3
service engineering / serviceability validation
fig: Industriehansa
Documentation of
the work steps:
Generation of
default times
fig: Virtalis
Installation/ disassembly
inspections using haptics
(and force feedback via
mechanical articulated
arm system)
fig: ESI Courtesy of Extricom
Virtual disassembly:
accessibility
serviceability validation
overview Missionservice assistanceserviceability validation service training summary
Whitepaper
VR / AR / MR in MRO & Service
service documentation
technical approaches
 user in VR environment or virtual human
model
 advantage of “real user method”:
subjective assessment, (implicit) expert
knowledge
 advantage of “human model method”:
objective, statements for large part of the
population achievable
 evaluation results:
ergonomics, strains, suitability of the process
20.07.2018 4
fig: OPTIMA
fig: Siemens PLM
Gripping space-
investigations on a
mixed mock-up
Accessibility studies
with a virtual
human model
service engineering / serviceability validation
serviceability validation
overview Missionservice assistanceserviceability validation service training summary
Whitepaper
VR / AR / MR in MRO & Service
service documentation
20.07.2018 5
fig: Virtalis
Review using a
Powerwall at CNH
service engineering / serviceability validation
serviceability validation
overview Missionservice assistanceserviceability validation service training summary
Whitepaper
VR / AR / MR in MRO & Service
service documentation
possible types of knowledge to manage
in virtual environments
 position knowledge
 structural knowledge
 behavioral Sciences
 procedure knowledge
Possibilities of learning in virtual environments:
 spatial exploration
 conceptual learning
 motor skills learning
 procedural learning
20.07.2018 6
service training
fig: 5DT
Diagram of the
transformer station with
spatial allocation
fig: ESI
Tool change under
collision and sliding
conditions
Virtual service review at
Daimler-VRSC, Brühlfig: ESI – IC.IDO
service training
overview Missionservice assistanceserviceability validation service training summary
Whitepaper
VR / AR / MR in MRO & Service
service documentation
fundamental concepts
 advantages of virtual training:
o presentation of critical scenarios without danger
to human and machine
o location- and time-independent training,
even training in non-existent future environments
o training without occupancy (expensive, dangerous,
...) of real infrastructure
 learning concept in 3 stages:
o demonstrate
o accompany
o assess
20.07.2018 7
service training
fig: LightShape
Transfer process
knowledge: Stitch
types at Groz-
Beckert
fig: Volkswagen
AR front projection on
physical vehicle
fig: ESI – IC.IDO
Removing engine
from forklift
service training
overview Missionservice assistanceserviceability validation service training summary
Whitepaper
VR / AR / MR in MRO & Service
service documentation
fundamental concepts
 processes, process knowledge
 risk of damage
 resource / tool use
 all variants
 all perspectives
 incorporating documentation
 incorporating simulators
 visualization of hidden elements
 [animated] AR front projection
(e.g. obscured installations) on real objects
20.07.2018 8
fig: ESI
Ambidextrous removal
simulation
Virtual service review at
Daimler-VRSC, Brühlfig: Daimler
fig: VRMMP How a process works
service training
service training
overview Missionservice assistanceserviceability validation service training summary
Whitepaper
VR / AR / MR in MRO & Service
service documentation
20.07.2018 9
Image: VRMMP
Screenshot of a
distributed,
cooperative
training simulator
of the Virtual
Reality &
Multimedia Park
Turin for Total: a
group of
employees - each
with their own
avatar - has joint
tasks to solve the
fault diagnosis and
repair.
service training
service training
overview Missionservice assistanceserviceability validation service training summary
Whitepaper
VR / AR / MR in MRO & Service
service documentation
fundamental concepts
 display on mobile device:
o next steps
o process places
o necessary tools
o process parameters in the field of view of the
observer
 illustration correctly superimposed with
camera image of the real object
 recording the current status
(disassembly, control, ...)
 remote service experts may
join via tele conferencing
20.07.2018 10
service assistance
fig: Volkswagen
AR-based
maintenance & repair
assistant "Marta" on
tablet PC
fig: Nee
Crossfade online
process data on
workpiece
fig: Fraunhofer IPA
AR-supported
machine operation
service assistance
overview Missionservice assistanceserviceability validation service training summary
Whitepaper
VR / AR / MR in MRO & Service
service documentation
20.07.2018 11
tele support with augmented
reality: operator in central
receives view of the worker
and his problem definition.
worker receives instructions
from the operator with correct
assignmentfig: Re‘flekt
service assistance
service assistance
overview Missionservice assistanceserviceability validation service training summary
Whitepaper
VR / AR / MR in MRO & Service
service documentation
documentation & proof
 documentation within the 3D model
 AR annotations for mobile devices
 recording (digitizing) new knowledge about
mobile devices (camera recording, sensor data
acquisition, etc.); Filing for documentation and
sharing with others (such as knowledge
management systems and social media)
[Knowledge types in virtual environments:
position, structural, behavioral and procedural
knowledge]
20.07.2018 12
fig: Volkswagen
fig: Fh-IPA
fig: ProGlove
AR-based, mobile
workshop information
system data browser
demonstrator "Service
Tools": documentation in
the interactive 3D model
data glove for industrial
context with CPU,
display, scanner, sensors
(inter alia, voltage,
temperature) Detection
of manual activities, and
wireless connection
service assistance
service assistance
overview Missionservice assistanceserviceability validation service training summary
Whitepaper
VR / AR / MR in MRO & Service
service documentation
digital capture of a service process
 purpose
o quality assurance
o conflict resolution
o basis for invoicing
o valuable content for entreprise social network
(information back channel)
 technologies
o cameras
o 3D depth sensors
o gesture recognition
o tracking technologies
o machine sensor data
o measurement devices
20.07.2018 13
3D hand capture
photo comparison
and documentationfig: Airbus / Testia
photo documentation
service documentation
fig: VDI-Nachrichten
Ifig: ioxp
service documentation
overview Missionservice assistanceserviceability validation service training summary
Whitepaper
VR / AR / MR in MRO & Service
service documentation
 fundamental concepts: motivation for AR use
20.07.2018 14
o what is the desired result of the data glasses usage?
o what are indicators for success? How to measure?
fig: BMWfigPicavi fig: Volvo
logistics
• faster
• flawless commissions
maintenance, Repair, Service
• lower qualification
requirements
• focus experts in strategic
projects
• reduce travel costs
• offer solutions ad-hoc
• documentation process
manufacturing
• accelerate training
• increase quality
• control customized
products
• documentation process
AR assistance systems discussion
summary
overview Missionservice assistanceserviceability validation service training summary
Whitepaper
VR / AR / MR in MRO & Service
service documentation
fundamental concepts: basic functions of an AR system
 tele conference
 assistance, X-ray,
consistency check
real-digital with
augmented reality
 simple information
display
20.07.2018 15
 documentation
 training
 real-time tracking
and tracing for big
data analysis, such
as process
improvementsfig: all-electronics.de
fig: VDI-Nachrichten
fig: itiZZimo Ifig: ioxp
fig: ioxp
fig: metaio
AR assistance systems discussion
summary
overview Missionservice assistanceserviceability validation service training summary
Whitepaper
VR / AR / MR in MRO & Service
service documentation
conditions of use - 1
 under which conditions are the data glasses used?
o dirt, narrowness, temperatures, humidity, dust, noise, explosive environment, ...
20.07.2018 16
fig: www. v3.co.ukfig: Microsoft fig: KNAPP
AR assistance systems discussion
summary
overview Missionservice assistanceserviceability validation service training summary
Whitepaper
VR / AR / MR in MRO & Service
service documentation
conditions of use - 2
 who uses the smart device?
o qualifcation, overall tasks, glasses, other handicaps with
impact on smart device operation, usual task during
smart device usage
 what are respective knowledge and experiences?
o knowledge of actual work task, IT knowledge,
wearables knowledge
 what the individual user‘s advantages out of smart
glasses use?
o service business model
o job description, performance assessment
20.07.2018 17
AR assistance systems discussion
fig: Ii‘s OWL
fig: Ubimax
fig: 123RF
summary
overview Missionservice assistanceserviceability validation service training summary
Whitepaper
VR / AR / MR in MRO & Service
service documentation
 main application fields of virtual techniques in the field of service:
o serviceability validation
o service training
o service assistance
o service documentation
 sensuring serviceability and service training
o local and cooperative through projections
o distributed or individually via HMDs
 service assistance
o through tablet PCs, smartphones and smart glasses
o small display size requires customized content
(pictograms, symbols, little text, ...)
=> efficient content supply chain crucial
o develop efficient and robust interaction concepts
for use in a variety of environments
20.07.2018 18
Summary
3D content supply chain
CAD
VR
summary
overview Missionservice assistanceserviceability validation service training summary
Whitepaper
VR / AR / MR in MRO & Service
service documentation
VDC members in this topic
20.07.2018 19
summary
© Kompetenzzentrum Virtuelle Realität und Kooperatives Engineering w. V. – Virtual Dimension Center (VDC )
Thanks for your interest
You are interested in the topic and are you looking for contact persons?
Talk to us.
Virtual Dimension Center (VDC) Fellbach
Auberlenstr. 13
70736 Fellbach
www.vdc-fellbach.de

More Related Content

Similar to Whitepaper VR / AR / MR in MRO & Service

I4MS Talks: Augmented reality in service operations
I4MS Talks: Augmented reality in service operationsI4MS Talks: Augmented reality in service operations
I4MS Talks: Augmented reality in service operationsIrina Frigioiu
 
IRJET- A Quality Watch Android Based Application for Monitoring Robotic A...
IRJET-  	  A Quality Watch Android Based Application for Monitoring Robotic A...IRJET-  	  A Quality Watch Android Based Application for Monitoring Robotic A...
IRJET- A Quality Watch Android Based Application for Monitoring Robotic A...IRJET Journal
 
Industrial Data Space: Digital Sovereignty for Industry 4.0 and Smart Services
Industrial Data Space: Digital Sovereignty for Industry 4.0 and Smart ServicesIndustrial Data Space: Digital Sovereignty for Industry 4.0 and Smart Services
Industrial Data Space: Digital Sovereignty for Industry 4.0 and Smart ServicesBoris Otto
 
Aviation Case Study — VR SIMULATION - TILT LABS
Aviation Case Study — VR SIMULATION - TILT LABSAviation Case Study — VR SIMULATION - TILT LABS
Aviation Case Study — VR SIMULATION - TILT LABSTiltlabs
 
Value propositions enabled by digital twins in the context of servitization v002
Value propositions enabled by digital twins in the context of servitization v002Value propositions enabled by digital twins in the context of servitization v002
Value propositions enabled by digital twins in the context of servitization v002Shaun West
 
Knapp smart conference - augmented reality summary
Knapp   smart conference - augmented reality summaryKnapp   smart conference - augmented reality summary
Knapp smart conference - augmented reality summaryMichael Kemeny
 
Rep Presentation V4 13
Rep Presentation V4 13Rep Presentation V4 13
Rep Presentation V4 13lyndonroberts
 
CWIN17 Paris / L’opérateur augmenté,plus d’agilité pour gagner en performance
CWIN17 Paris / L’opérateur augmenté,plus d’agilité pour gagner en performanceCWIN17 Paris / L’opérateur augmenté,plus d’agilité pour gagner en performance
CWIN17 Paris / L’opérateur augmenté,plus d’agilité pour gagner en performanceCapgemini
 
Current Anaysis European Ict Trends April 2011 Ver 2
Current Anaysis   European Ict Trends April 2011 Ver 2Current Anaysis   European Ict Trends April 2011 Ver 2
Current Anaysis European Ict Trends April 2011 Ver 2bostergaard
 
4G Business Case Analysis Tool
4G Business Case Analysis Tool4G Business Case Analysis Tool
4G Business Case Analysis ToolAndrea Calcagno
 
Proposal for Virtual Machine Project
Proposal for Virtual Machine ProjectProposal for Virtual Machine Project
Proposal for Virtual Machine ProjectKiran Thapa
 

Similar to Whitepaper VR / AR / MR in MRO & Service (20)

Virtual Commercial Vehicle: VDC-Whitepaper
Virtual Commercial Vehicle: VDC-WhitepaperVirtual Commercial Vehicle: VDC-Whitepaper
Virtual Commercial Vehicle: VDC-Whitepaper
 
I4MS Talks: Augmented reality in service operations
I4MS Talks: Augmented reality in service operationsI4MS Talks: Augmented reality in service operations
I4MS Talks: Augmented reality in service operations
 
Virtual Techniques in the Marketing Process: VDC-Whitepaper
Virtual Techniques in the Marketing Process: VDC-WhitepaperVirtual Techniques in the Marketing Process: VDC-Whitepaper
Virtual Techniques in the Marketing Process: VDC-Whitepaper
 
Areas of Application for VR-Professionals
Areas of Application for VR-ProfessionalsAreas of Application for VR-Professionals
Areas of Application for VR-Professionals
 
IRJET- A Quality Watch Android Based Application for Monitoring Robotic A...
IRJET-  	  A Quality Watch Android Based Application for Monitoring Robotic A...IRJET-  	  A Quality Watch Android Based Application for Monitoring Robotic A...
IRJET- A Quality Watch Android Based Application for Monitoring Robotic A...
 
Industrial Data Space: Digital Sovereignty for Industry 4.0 and Smart Services
Industrial Data Space: Digital Sovereignty for Industry 4.0 and Smart ServicesIndustrial Data Space: Digital Sovereignty for Industry 4.0 and Smart Services
Industrial Data Space: Digital Sovereignty for Industry 4.0 and Smart Services
 
Virtual Techniques in Factory Planning: VDC-Whitepaper
Virtual Techniques in Factory Planning: VDC-WhitepaperVirtual Techniques in Factory Planning: VDC-Whitepaper
Virtual Techniques in Factory Planning: VDC-Whitepaper
 
Aviation Case Study — VR SIMULATION - TILT LABS
Aviation Case Study — VR SIMULATION - TILT LABSAviation Case Study — VR SIMULATION - TILT LABS
Aviation Case Study — VR SIMULATION - TILT LABS
 
Value propositions enabled by digital twins in the context of servitization v002
Value propositions enabled by digital twins in the context of servitization v002Value propositions enabled by digital twins in the context of servitization v002
Value propositions enabled by digital twins in the context of servitization v002
 
Knapp smart conference - augmented reality summary
Knapp   smart conference - augmented reality summaryKnapp   smart conference - augmented reality summary
Knapp smart conference - augmented reality summary
 
NNTC - VR portfolio
NNTC - VR portfolioNNTC - VR portfolio
NNTC - VR portfolio
 
Rep Presentation V4 13
Rep Presentation V4 13Rep Presentation V4 13
Rep Presentation V4 13
 
Virtual Reality in Plant Engineering: VDC-Whitepaper
Virtual Reality in Plant Engineering: VDC-WhitepaperVirtual Reality in Plant Engineering: VDC-Whitepaper
Virtual Reality in Plant Engineering: VDC-Whitepaper
 
CWIN17 Paris / L’opérateur augmenté,plus d’agilité pour gagner en performance
CWIN17 Paris / L’opérateur augmenté,plus d’agilité pour gagner en performanceCWIN17 Paris / L’opérateur augmenté,plus d’agilité pour gagner en performance
CWIN17 Paris / L’opérateur augmenté,plus d’agilité pour gagner en performance
 
Virtual Techniques in the Aviation Industry: VDC-Whitepaper
Virtual Techniques in the Aviation Industry: VDC-WhitepaperVirtual Techniques in the Aviation Industry: VDC-Whitepaper
Virtual Techniques in the Aviation Industry: VDC-Whitepaper
 
Current Anaysis European Ict Trends April 2011 Ver 2
Current Anaysis   European Ict Trends April 2011 Ver 2Current Anaysis   European Ict Trends April 2011 Ver 2
Current Anaysis European Ict Trends April 2011 Ver 2
 
AR Produkt
AR ProduktAR Produkt
AR Produkt
 
manufacturing technology
manufacturing technologymanufacturing technology
manufacturing technology
 
4G Business Case Analysis Tool
4G Business Case Analysis Tool4G Business Case Analysis Tool
4G Business Case Analysis Tool
 
Proposal for Virtual Machine Project
Proposal for Virtual Machine ProjectProposal for Virtual Machine Project
Proposal for Virtual Machine Project
 

More from Virtual Dimension Center (VDC) Fellbach

XR Week 2022 gemeinsam mit Euro XR und VR/AR-Workshop der Gesellschaft für In...
XR Week 2022 gemeinsam mit Euro XR und VR/AR-Workshop der Gesellschaft für In...XR Week 2022 gemeinsam mit Euro XR und VR/AR-Workshop der Gesellschaft für In...
XR Week 2022 gemeinsam mit Euro XR und VR/AR-Workshop der Gesellschaft für In...Virtual Dimension Center (VDC) Fellbach
 
PM: 2018-11 3D-Usability als Wettbewerbsfaktor: Projekt 3D-GUIde endet erfolg...
PM: 2018-11 3D-Usability als Wettbewerbsfaktor: Projekt 3D-GUIde endet erfolg...PM: 2018-11 3D-Usability als Wettbewerbsfaktor: Projekt 3D-GUIde endet erfolg...
PM: 2018-11 3D-Usability als Wettbewerbsfaktor: Projekt 3D-GUIde endet erfolg...Virtual Dimension Center (VDC) Fellbach
 

More from Virtual Dimension Center (VDC) Fellbach (20)

VDC Newsletter November 2022.pdf
VDC Newsletter November 2022.pdfVDC Newsletter November 2022.pdf
VDC Newsletter November 2022.pdf
 
2022-11 PM VDC-Mitgliederversammlung.pdf
2022-11 PM VDC-Mitgliederversammlung.pdf2022-11 PM VDC-Mitgliederversammlung.pdf
2022-11 PM VDC-Mitgliederversammlung.pdf
 
2022-11 PM 20 Jahre VDC.pdf
2022-11 PM 20 Jahre VDC.pdf2022-11 PM 20 Jahre VDC.pdf
2022-11 PM 20 Jahre VDC.pdf
 
VDC-Newsletter September 2022
VDC-Newsletter September 2022VDC-Newsletter September 2022
VDC-Newsletter September 2022
 
VDC-Newsletter August 2022
VDC-Newsletter August 2022VDC-Newsletter August 2022
VDC-Newsletter August 2022
 
VDC-Newsletter Juli 2022
VDC-Newsletter Juli 2022VDC-Newsletter Juli 2022
VDC-Newsletter Juli 2022
 
VDC-Newsletter Juni 2022
VDC-Newsletter Juni 2022VDC-Newsletter Juni 2022
VDC-Newsletter Juni 2022
 
VDC-Newsletter Mai 2022
VDC-Newsletter Mai 2022VDC-Newsletter Mai 2022
VDC-Newsletter Mai 2022
 
VDC-Newsletter April 2022
VDC-Newsletter April 2022VDC-Newsletter April 2022
VDC-Newsletter April 2022
 
VDC-Newsletter März 2022
VDC-Newsletter März 2022VDC-Newsletter März 2022
VDC-Newsletter März 2022
 
VDC-Newsletter Februar 2022
VDC-Newsletter Februar 2022VDC-Newsletter Februar 2022
VDC-Newsletter Februar 2022
 
Whitepaper zur standardisierten Indoor-Ortung mit omlox
Whitepaper zur standardisierten Indoor-Ortung mit omloxWhitepaper zur standardisierten Indoor-Ortung mit omlox
Whitepaper zur standardisierten Indoor-Ortung mit omlox
 
XR Week 2022 gemeinsam mit Euro XR und VR/AR-Workshop der Gesellschaft für In...
XR Week 2022 gemeinsam mit Euro XR und VR/AR-Workshop der Gesellschaft für In...XR Week 2022 gemeinsam mit Euro XR und VR/AR-Workshop der Gesellschaft für In...
XR Week 2022 gemeinsam mit Euro XR und VR/AR-Workshop der Gesellschaft für In...
 
VDC Newsletter Januar 2022
VDC Newsletter Januar 2022VDC Newsletter Januar 2022
VDC Newsletter Januar 2022
 
VDC- Newsletter Dezember 2021
VDC- Newsletter Dezember 2021VDC- Newsletter Dezember 2021
VDC- Newsletter Dezember 2021
 
VDC Newsletter November 2021
VDC Newsletter November 2021VDC Newsletter November 2021
VDC Newsletter November 2021
 
VDC-Newsletter April 2021
VDC-Newsletter April 2021 VDC-Newsletter April 2021
VDC-Newsletter April 2021
 
VDC Newsletter Juli 2020
VDC Newsletter Juli 2020VDC Newsletter Juli 2020
VDC Newsletter Juli 2020
 
2019-07 PM VDC und VR/AR Association besiegeln Partnerschaft
2019-07 PM VDC und VR/AR Association besiegeln Partnerschaft2019-07 PM VDC und VR/AR Association besiegeln Partnerschaft
2019-07 PM VDC und VR/AR Association besiegeln Partnerschaft
 
PM: 2018-11 3D-Usability als Wettbewerbsfaktor: Projekt 3D-GUIde endet erfolg...
PM: 2018-11 3D-Usability als Wettbewerbsfaktor: Projekt 3D-GUIde endet erfolg...PM: 2018-11 3D-Usability als Wettbewerbsfaktor: Projekt 3D-GUIde endet erfolg...
PM: 2018-11 3D-Usability als Wettbewerbsfaktor: Projekt 3D-GUIde endet erfolg...
 

Recently uploaded

Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024Victor Rentea
 
Simplifying Mobile A11y Presentation.pptx
Simplifying Mobile A11y Presentation.pptxSimplifying Mobile A11y Presentation.pptx
Simplifying Mobile A11y Presentation.pptxMarkSteadman7
 
TrustArc Webinar - Unified Trust Center for Privacy, Security, Compliance, an...
TrustArc Webinar - Unified Trust Center for Privacy, Security, Compliance, an...TrustArc Webinar - Unified Trust Center for Privacy, Security, Compliance, an...
TrustArc Webinar - Unified Trust Center for Privacy, Security, Compliance, an...TrustArc
 
ERP Contender Series: Acumatica vs. Sage Intacct
ERP Contender Series: Acumatica vs. Sage IntacctERP Contender Series: Acumatica vs. Sage Intacct
ERP Contender Series: Acumatica vs. Sage IntacctBrainSell Technologies
 
JohnPollard-hybrid-app-RailsConf2024.pptx
JohnPollard-hybrid-app-RailsConf2024.pptxJohnPollard-hybrid-app-RailsConf2024.pptx
JohnPollard-hybrid-app-RailsConf2024.pptxJohnPollard37
 
AI mind or machine power point presentation
AI mind or machine power point presentationAI mind or machine power point presentation
AI mind or machine power point presentationyogeshlabana357357
 
Event-Driven Architecture Masterclass: Challenges in Stream Processing
Event-Driven Architecture Masterclass: Challenges in Stream ProcessingEvent-Driven Architecture Masterclass: Challenges in Stream Processing
Event-Driven Architecture Masterclass: Challenges in Stream ProcessingScyllaDB
 
JavaScript Usage Statistics 2024 - The Ultimate Guide
JavaScript Usage Statistics 2024 - The Ultimate GuideJavaScript Usage Statistics 2024 - The Ultimate Guide
JavaScript Usage Statistics 2024 - The Ultimate GuidePixlogix Infotech
 
Tales from a Passkey Provider Progress from Awareness to Implementation.pptx
Tales from a Passkey Provider  Progress from Awareness to Implementation.pptxTales from a Passkey Provider  Progress from Awareness to Implementation.pptx
Tales from a Passkey Provider Progress from Awareness to Implementation.pptxFIDO Alliance
 
Continuing Bonds Through AI: A Hermeneutic Reflection on Thanabots
Continuing Bonds Through AI: A Hermeneutic Reflection on ThanabotsContinuing Bonds Through AI: A Hermeneutic Reflection on Thanabots
Continuing Bonds Through AI: A Hermeneutic Reflection on ThanabotsLeah Henrickson
 
ChatGPT and Beyond - Elevating DevOps Productivity
ChatGPT and Beyond - Elevating DevOps ProductivityChatGPT and Beyond - Elevating DevOps Productivity
ChatGPT and Beyond - Elevating DevOps ProductivityVictorSzoltysek
 
Human Expert Website Manual WCAG 2.0 2.1 2.2 Audit - Digital Accessibility Au...
Human Expert Website Manual WCAG 2.0 2.1 2.2 Audit - Digital Accessibility Au...Human Expert Website Manual WCAG 2.0 2.1 2.2 Audit - Digital Accessibility Au...
Human Expert Website Manual WCAG 2.0 2.1 2.2 Audit - Digital Accessibility Au...Skynet Technologies
 
The Ultimate Prompt Engineering Guide for Generative AI: Get the Most Out of ...
The Ultimate Prompt Engineering Guide for Generative AI: Get the Most Out of ...The Ultimate Prompt Engineering Guide for Generative AI: Get the Most Out of ...
The Ultimate Prompt Engineering Guide for Generative AI: Get the Most Out of ...SOFTTECHHUB
 
Working together SRE & Platform Engineering
Working together SRE & Platform EngineeringWorking together SRE & Platform Engineering
Working together SRE & Platform EngineeringMarcus Vechiato
 
UiPath manufacturing technology benefits and AI overview
UiPath manufacturing technology benefits and AI overviewUiPath manufacturing technology benefits and AI overview
UiPath manufacturing technology benefits and AI overviewDianaGray10
 
Design Guidelines for Passkeys 2024.pptx
Design Guidelines for Passkeys 2024.pptxDesign Guidelines for Passkeys 2024.pptx
Design Guidelines for Passkeys 2024.pptxFIDO Alliance
 
ADP Passwordless Journey Case Study.pptx
ADP Passwordless Journey Case Study.pptxADP Passwordless Journey Case Study.pptx
ADP Passwordless Journey Case Study.pptxFIDO Alliance
 
TEST BANK For Principles of Anatomy and Physiology, 16th Edition by Gerard J....
TEST BANK For Principles of Anatomy and Physiology, 16th Edition by Gerard J....TEST BANK For Principles of Anatomy and Physiology, 16th Edition by Gerard J....
TEST BANK For Principles of Anatomy and Physiology, 16th Edition by Gerard J....rightmanforbloodline
 
Top 10 CodeIgniter Development Companies
Top 10 CodeIgniter Development CompaniesTop 10 CodeIgniter Development Companies
Top 10 CodeIgniter Development CompaniesTopCSSGallery
 
Finding Java's Hidden Performance Traps @ DevoxxUK 2024
Finding Java's Hidden Performance Traps @ DevoxxUK 2024Finding Java's Hidden Performance Traps @ DevoxxUK 2024
Finding Java's Hidden Performance Traps @ DevoxxUK 2024Victor Rentea
 

Recently uploaded (20)

Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
 
Simplifying Mobile A11y Presentation.pptx
Simplifying Mobile A11y Presentation.pptxSimplifying Mobile A11y Presentation.pptx
Simplifying Mobile A11y Presentation.pptx
 
TrustArc Webinar - Unified Trust Center for Privacy, Security, Compliance, an...
TrustArc Webinar - Unified Trust Center for Privacy, Security, Compliance, an...TrustArc Webinar - Unified Trust Center for Privacy, Security, Compliance, an...
TrustArc Webinar - Unified Trust Center for Privacy, Security, Compliance, an...
 
ERP Contender Series: Acumatica vs. Sage Intacct
ERP Contender Series: Acumatica vs. Sage IntacctERP Contender Series: Acumatica vs. Sage Intacct
ERP Contender Series: Acumatica vs. Sage Intacct
 
JohnPollard-hybrid-app-RailsConf2024.pptx
JohnPollard-hybrid-app-RailsConf2024.pptxJohnPollard-hybrid-app-RailsConf2024.pptx
JohnPollard-hybrid-app-RailsConf2024.pptx
 
AI mind or machine power point presentation
AI mind or machine power point presentationAI mind or machine power point presentation
AI mind or machine power point presentation
 
Event-Driven Architecture Masterclass: Challenges in Stream Processing
Event-Driven Architecture Masterclass: Challenges in Stream ProcessingEvent-Driven Architecture Masterclass: Challenges in Stream Processing
Event-Driven Architecture Masterclass: Challenges in Stream Processing
 
JavaScript Usage Statistics 2024 - The Ultimate Guide
JavaScript Usage Statistics 2024 - The Ultimate GuideJavaScript Usage Statistics 2024 - The Ultimate Guide
JavaScript Usage Statistics 2024 - The Ultimate Guide
 
Tales from a Passkey Provider Progress from Awareness to Implementation.pptx
Tales from a Passkey Provider  Progress from Awareness to Implementation.pptxTales from a Passkey Provider  Progress from Awareness to Implementation.pptx
Tales from a Passkey Provider Progress from Awareness to Implementation.pptx
 
Continuing Bonds Through AI: A Hermeneutic Reflection on Thanabots
Continuing Bonds Through AI: A Hermeneutic Reflection on ThanabotsContinuing Bonds Through AI: A Hermeneutic Reflection on Thanabots
Continuing Bonds Through AI: A Hermeneutic Reflection on Thanabots
 
ChatGPT and Beyond - Elevating DevOps Productivity
ChatGPT and Beyond - Elevating DevOps ProductivityChatGPT and Beyond - Elevating DevOps Productivity
ChatGPT and Beyond - Elevating DevOps Productivity
 
Human Expert Website Manual WCAG 2.0 2.1 2.2 Audit - Digital Accessibility Au...
Human Expert Website Manual WCAG 2.0 2.1 2.2 Audit - Digital Accessibility Au...Human Expert Website Manual WCAG 2.0 2.1 2.2 Audit - Digital Accessibility Au...
Human Expert Website Manual WCAG 2.0 2.1 2.2 Audit - Digital Accessibility Au...
 
The Ultimate Prompt Engineering Guide for Generative AI: Get the Most Out of ...
The Ultimate Prompt Engineering Guide for Generative AI: Get the Most Out of ...The Ultimate Prompt Engineering Guide for Generative AI: Get the Most Out of ...
The Ultimate Prompt Engineering Guide for Generative AI: Get the Most Out of ...
 
Working together SRE & Platform Engineering
Working together SRE & Platform EngineeringWorking together SRE & Platform Engineering
Working together SRE & Platform Engineering
 
UiPath manufacturing technology benefits and AI overview
UiPath manufacturing technology benefits and AI overviewUiPath manufacturing technology benefits and AI overview
UiPath manufacturing technology benefits and AI overview
 
Design Guidelines for Passkeys 2024.pptx
Design Guidelines for Passkeys 2024.pptxDesign Guidelines for Passkeys 2024.pptx
Design Guidelines for Passkeys 2024.pptx
 
ADP Passwordless Journey Case Study.pptx
ADP Passwordless Journey Case Study.pptxADP Passwordless Journey Case Study.pptx
ADP Passwordless Journey Case Study.pptx
 
TEST BANK For Principles of Anatomy and Physiology, 16th Edition by Gerard J....
TEST BANK For Principles of Anatomy and Physiology, 16th Edition by Gerard J....TEST BANK For Principles of Anatomy and Physiology, 16th Edition by Gerard J....
TEST BANK For Principles of Anatomy and Physiology, 16th Edition by Gerard J....
 
Top 10 CodeIgniter Development Companies
Top 10 CodeIgniter Development CompaniesTop 10 CodeIgniter Development Companies
Top 10 CodeIgniter Development Companies
 
Finding Java's Hidden Performance Traps @ DevoxxUK 2024
Finding Java's Hidden Performance Traps @ DevoxxUK 2024Finding Java's Hidden Performance Traps @ DevoxxUK 2024
Finding Java's Hidden Performance Traps @ DevoxxUK 2024
 

Whitepaper VR / AR / MR in MRO & Service

  • 1. © Kompetenzzentrum Virtuelle Realität und Kooperatives Engineering w. V. – Virtual Dimension Center (VDC ) Prof. Dr.-Ing. Dipl.-Kfm. Christoph Runde Marianne Ludwig Virtual Dimension Center (VDC) Fellbach Auberlenstr. 13 70736 Fellbach www.vdc-fellbach.de VR / AR / MR in MRO & Service VDC Whitepaper
  • 2. overview Missionservice assistanceserviceability validation service training summary Whitepaper VR / AR / MR in MRO & Service service documentation  increased product complexity, creating impact on: development, production, commissioning, operation, service  increasing number of variants  mass customization, highly differentiable products  language and cultural barriers of world markets  machine operator business models: not the machine hardware, but the output is sold (responsibility for the operation of the machine is therefore the responsibility of the manufacturer) 20.07.2018 2 actual challenges e.g. in mechanical engineering application fields of VR/ AR  service engineering (ensuring serviceability) and service planning  service training  service assistance overview service assistanceserviceability validation service training summaryservice documentation
  • 3. overview Missionservice assistanceserviceability validation service training summary Whitepaper VR / AR / MR in MRO & Service service documentation serviceability studies  checking accessibility visually and manually  check accessibility of assemblies, fasteners, lubrication points, etc o visually o with hands and o tools  all variants, perspectives and positions  check disassembly / assembly, assembly sequences  avoidance of special tools  memorandum, determination of default times 20.07.2018 3 service engineering / serviceability validation fig: Industriehansa Documentation of the work steps: Generation of default times fig: Virtalis Installation/ disassembly inspections using haptics (and force feedback via mechanical articulated arm system) fig: ESI Courtesy of Extricom Virtual disassembly: accessibility serviceability validation
  • 4. overview Missionservice assistanceserviceability validation service training summary Whitepaper VR / AR / MR in MRO & Service service documentation technical approaches  user in VR environment or virtual human model  advantage of “real user method”: subjective assessment, (implicit) expert knowledge  advantage of “human model method”: objective, statements for large part of the population achievable  evaluation results: ergonomics, strains, suitability of the process 20.07.2018 4 fig: OPTIMA fig: Siemens PLM Gripping space- investigations on a mixed mock-up Accessibility studies with a virtual human model service engineering / serviceability validation serviceability validation
  • 5. overview Missionservice assistanceserviceability validation service training summary Whitepaper VR / AR / MR in MRO & Service service documentation 20.07.2018 5 fig: Virtalis Review using a Powerwall at CNH service engineering / serviceability validation serviceability validation
  • 6. overview Missionservice assistanceserviceability validation service training summary Whitepaper VR / AR / MR in MRO & Service service documentation possible types of knowledge to manage in virtual environments  position knowledge  structural knowledge  behavioral Sciences  procedure knowledge Possibilities of learning in virtual environments:  spatial exploration  conceptual learning  motor skills learning  procedural learning 20.07.2018 6 service training fig: 5DT Diagram of the transformer station with spatial allocation fig: ESI Tool change under collision and sliding conditions Virtual service review at Daimler-VRSC, Brühlfig: ESI – IC.IDO service training
  • 7. overview Missionservice assistanceserviceability validation service training summary Whitepaper VR / AR / MR in MRO & Service service documentation fundamental concepts  advantages of virtual training: o presentation of critical scenarios without danger to human and machine o location- and time-independent training, even training in non-existent future environments o training without occupancy (expensive, dangerous, ...) of real infrastructure  learning concept in 3 stages: o demonstrate o accompany o assess 20.07.2018 7 service training fig: LightShape Transfer process knowledge: Stitch types at Groz- Beckert fig: Volkswagen AR front projection on physical vehicle fig: ESI – IC.IDO Removing engine from forklift service training
  • 8. overview Missionservice assistanceserviceability validation service training summary Whitepaper VR / AR / MR in MRO & Service service documentation fundamental concepts  processes, process knowledge  risk of damage  resource / tool use  all variants  all perspectives  incorporating documentation  incorporating simulators  visualization of hidden elements  [animated] AR front projection (e.g. obscured installations) on real objects 20.07.2018 8 fig: ESI Ambidextrous removal simulation Virtual service review at Daimler-VRSC, Brühlfig: Daimler fig: VRMMP How a process works service training service training
  • 9. overview Missionservice assistanceserviceability validation service training summary Whitepaper VR / AR / MR in MRO & Service service documentation 20.07.2018 9 Image: VRMMP Screenshot of a distributed, cooperative training simulator of the Virtual Reality & Multimedia Park Turin for Total: a group of employees - each with their own avatar - has joint tasks to solve the fault diagnosis and repair. service training service training
  • 10. overview Missionservice assistanceserviceability validation service training summary Whitepaper VR / AR / MR in MRO & Service service documentation fundamental concepts  display on mobile device: o next steps o process places o necessary tools o process parameters in the field of view of the observer  illustration correctly superimposed with camera image of the real object  recording the current status (disassembly, control, ...)  remote service experts may join via tele conferencing 20.07.2018 10 service assistance fig: Volkswagen AR-based maintenance & repair assistant "Marta" on tablet PC fig: Nee Crossfade online process data on workpiece fig: Fraunhofer IPA AR-supported machine operation service assistance
  • 11. overview Missionservice assistanceserviceability validation service training summary Whitepaper VR / AR / MR in MRO & Service service documentation 20.07.2018 11 tele support with augmented reality: operator in central receives view of the worker and his problem definition. worker receives instructions from the operator with correct assignmentfig: Re‘flekt service assistance service assistance
  • 12. overview Missionservice assistanceserviceability validation service training summary Whitepaper VR / AR / MR in MRO & Service service documentation documentation & proof  documentation within the 3D model  AR annotations for mobile devices  recording (digitizing) new knowledge about mobile devices (camera recording, sensor data acquisition, etc.); Filing for documentation and sharing with others (such as knowledge management systems and social media) [Knowledge types in virtual environments: position, structural, behavioral and procedural knowledge] 20.07.2018 12 fig: Volkswagen fig: Fh-IPA fig: ProGlove AR-based, mobile workshop information system data browser demonstrator "Service Tools": documentation in the interactive 3D model data glove for industrial context with CPU, display, scanner, sensors (inter alia, voltage, temperature) Detection of manual activities, and wireless connection service assistance service assistance
  • 13. overview Missionservice assistanceserviceability validation service training summary Whitepaper VR / AR / MR in MRO & Service service documentation digital capture of a service process  purpose o quality assurance o conflict resolution o basis for invoicing o valuable content for entreprise social network (information back channel)  technologies o cameras o 3D depth sensors o gesture recognition o tracking technologies o machine sensor data o measurement devices 20.07.2018 13 3D hand capture photo comparison and documentationfig: Airbus / Testia photo documentation service documentation fig: VDI-Nachrichten Ifig: ioxp service documentation
  • 14. overview Missionservice assistanceserviceability validation service training summary Whitepaper VR / AR / MR in MRO & Service service documentation  fundamental concepts: motivation for AR use 20.07.2018 14 o what is the desired result of the data glasses usage? o what are indicators for success? How to measure? fig: BMWfigPicavi fig: Volvo logistics • faster • flawless commissions maintenance, Repair, Service • lower qualification requirements • focus experts in strategic projects • reduce travel costs • offer solutions ad-hoc • documentation process manufacturing • accelerate training • increase quality • control customized products • documentation process AR assistance systems discussion summary
  • 15. overview Missionservice assistanceserviceability validation service training summary Whitepaper VR / AR / MR in MRO & Service service documentation fundamental concepts: basic functions of an AR system  tele conference  assistance, X-ray, consistency check real-digital with augmented reality  simple information display 20.07.2018 15  documentation  training  real-time tracking and tracing for big data analysis, such as process improvementsfig: all-electronics.de fig: VDI-Nachrichten fig: itiZZimo Ifig: ioxp fig: ioxp fig: metaio AR assistance systems discussion summary
  • 16. overview Missionservice assistanceserviceability validation service training summary Whitepaper VR / AR / MR in MRO & Service service documentation conditions of use - 1  under which conditions are the data glasses used? o dirt, narrowness, temperatures, humidity, dust, noise, explosive environment, ... 20.07.2018 16 fig: www. v3.co.ukfig: Microsoft fig: KNAPP AR assistance systems discussion summary
  • 17. overview Missionservice assistanceserviceability validation service training summary Whitepaper VR / AR / MR in MRO & Service service documentation conditions of use - 2  who uses the smart device? o qualifcation, overall tasks, glasses, other handicaps with impact on smart device operation, usual task during smart device usage  what are respective knowledge and experiences? o knowledge of actual work task, IT knowledge, wearables knowledge  what the individual user‘s advantages out of smart glasses use? o service business model o job description, performance assessment 20.07.2018 17 AR assistance systems discussion fig: Ii‘s OWL fig: Ubimax fig: 123RF summary
  • 18. overview Missionservice assistanceserviceability validation service training summary Whitepaper VR / AR / MR in MRO & Service service documentation  main application fields of virtual techniques in the field of service: o serviceability validation o service training o service assistance o service documentation  sensuring serviceability and service training o local and cooperative through projections o distributed or individually via HMDs  service assistance o through tablet PCs, smartphones and smart glasses o small display size requires customized content (pictograms, symbols, little text, ...) => efficient content supply chain crucial o develop efficient and robust interaction concepts for use in a variety of environments 20.07.2018 18 Summary 3D content supply chain CAD VR summary
  • 19. overview Missionservice assistanceserviceability validation service training summary Whitepaper VR / AR / MR in MRO & Service service documentation VDC members in this topic 20.07.2018 19 summary
  • 20. © Kompetenzzentrum Virtuelle Realität und Kooperatives Engineering w. V. – Virtual Dimension Center (VDC ) Thanks for your interest You are interested in the topic and are you looking for contact persons? Talk to us. Virtual Dimension Center (VDC) Fellbach Auberlenstr. 13 70736 Fellbach www.vdc-fellbach.de