A talk from the Work Track at AWE USA 2018 - the World's #1 XR Conference & Expo in Santa Clara, California May 30- June 1, 2018. Aldis Sipolins (IBM): Psychology Behind Skill Transfer with AR/VR From the classroom to the manufacturing floor, immersive technology is changing the way we learn and work. Training and education are seen as low-hanging fruit for XR, but what does the data actually show? When does it make sense to use XR, and when is it unnecessary? When should we use VR vs AR? This talk will answer these questions and explain the psychology behind skill transfer. http://AugmentedWorldExpo.com

1. Former Head of Virtual Reality & Game Design
IBM Research
Aldis Sipolins
The Psychology Behind
Skill Transfer With XR

2. My Background

16. Hardware Landscape

18. Mobile Standalone High-End
$
Display quality
Tracking
$$
Convenience
Interactions
$$$
Display quality
Tracking

19. Mobile Standalone High-End
$
Display quality
Convenience
Interactions
$$$
Display quality
Tracking

22. Apple’s XR Plans: Codename T288

23. Wild Speculation
2020 release!
XR headset!
5G/WiGig cloud rendering!
Eye tracking!
Biosensors!
Hand tracking!
Walled garden!
8K per eye!

24. Why XR is Good for Science

25. What is “Presence”?

28. • Behavioral
• Physiological
• Cognitive
Ecological Validity

33. • Behavior
• Physiology
• Cognition
Ecological Validity

39. When to Use XR

42. “Do the thing that can only be done in VR,
not the thing that can also be done in VR”
Chet Faliszek

43. XR makes sense when…
AR makes sense when…
The RL environment matters
People are co-located
Reality is expensive
Reality is dangerous
Reality is insufficient
VR makes sense when…
Fidelity is important
Interactions are complex
People are remote

47. “…with the same experience this would take me
months to do with the traditional 3D approach.
And the result would look different”
Goro Fujita, Oculus Story Studio

49. Reality is insufficient
Interactions are complex
3D Modeling + Animation

50. Training

53. Reality is expensive
Reality is dangerous
Interactions are complex
Fewer mistakes Faster training time
Using an Espresso Machine

57. Quarterback Decision-Making
20% faster 6% more accurate
Reality is expensive
Reality is dangerous
Fidelity is important

60. On-Site Sales
40% faster training More effective training
Reality is expensive
Reality is insufficient

63. Customer Interactions
70% improvement 30% higher satisfaction
Reality is expensive
Reality is insufficient
Fidelity is important

68. Train Maintenance + Repair
20% faster 6% more accurate
Reality is expensive
Reality is dangerous
Fidelity is important

71. Reality is expensive
Reality is dangerous
Fidelity is important
Manufacturing + Assembly

73. Reality is expensive
Reality is dangerous
Fidelity is important
Reality is insufficient
Police Training

74. Performance Enhancement

82. Fidelity is important
Reality is insufficient
Real-Time Technical Support
8-11% Efficiency Improvement

83. Transfer

84. Fined $2,000,000 for false advertising

85. “There is little evidence that playing brain games improves
underlying broad cognitive abilities, or that it enables one
to better navigate a complex realm of everyday life”
A Consensus on the Brain Training Industry from the Scientific Community,
Stanford Center on Longevity

86. ≠

87. Thing 1 Thing 2
Transfer
Cognitive
Motor
Perceptual

88. Real-World Cognition
Memorization
minigame

90. Cost
Fidelity
VR
Simulations
Moblie AR

91. Punt Coma
Science for fun and profit

92. The Problem With Mobile AR
It’s fun for a few seconds, but it’s not sticky
The App Store and Google Play are full of
one-off gimmick apps
Most of the 500m+ potential AR users don’t even
know they already have an AR-ready device

93. Liar Liar
A mobile AR creative deception game for 2-6 people
There are two teams of three players. Team 1 describes an item
that Team 2 cannot see. They might be lying, they might be telling
the truth. Team 2 has to decide if it’s a Lie or Truth. If Team 1 guess
correctly, they get a point. If they get it wrong, Team 2 gets a point.
First team to 2 points wins. Teams switch roles between rounds.

96. Thanks for downloading our free game!
We hope you enjoy it as much as we do.
We love science and hope you’ll let us use
your data for research. Your data would be
anonymized on device and it won’t live on
anyone’s cloud.
Does that sound okay?
(If not, that’s fine too 8])
X ✓
Yes! I want to
help science
No! It’s my data

97. Data anonymized
on device
Sentto
cloud
Rem
oved
from
cloud
Users opt in (or not)
Encrypted
Data gets processed

98. 2,000,000,000+ Smartphones
iOS
ARKit
Android
ARCore
Face
Behavioral
Voice

99. Punt Coma
Science for fun and profit

100. “Good design is good business”
Thomas J. Watson

101. Thank You!
@AldisSipolins