AR conf 2016 10.03.2016

1. 1
Augmented Reality in Industry:
Experience and Future Directions
SAULI KIVIRANTA
AR Conference 2016
MOSCOW

2. SAULI KIVIRANTA
2
My road to Industrial AR
@sksauli

3. 3

4. 4

5. 5

6. 6

7. 7

8. 8

9. 9

10. 10

11. BUT WHY EXACTLY…

12. Why AR exists?
Modality 2Modality 1 Modality 3
???

13. 13
▪ Sight (visual)
▪ Hearing (aural)
▪ Touch (somatosensory)
▪ Smell (olfactory)
▪ Taste (gustatory)
For human, visual information is dominant for
perceiving and understanding this world...
Do not forget other senses!
5senses
FIRST PRINCIPLES:
HUMAN PERCEPTION

14. 500M years of evolution:
Concrete Reasoning
Vision starts to develop
Audition starts to develop
Proto language starts to develop
Visual acuity of modern eye
Human Evolution

15. Concrete mental models
Perception
▪ Visual
▪ Auditory
▪ Touch
▪ Olfactory
▪ Gustatory
Sense of relations, location,
motion, distance, proximity,
color, taste, smell...

16. Why AR exists?
Modality 2Modality 1 Modality 3
Concrete
Reasoning
??

17. Counting of items invented
Numbers for collections of items
Proto writing for storytelling emerged
Mathematics & written language emerge
Aural language emerges
Vision starts to develop
Audition starts to develop
Proto language starts to develop
Visual acuity of modern eye
Human Evolution
100k years of evolution:
Abstract Reasoning

18. Reference
▪ Visual
▪ Auditory
▪ Touch
▪ Olfactory
▪ Gustatory
References, Properties,
Syntax, Grammar, Denotation,
Abstracting abstractions...
Abstract mental models

19. Why AR exists?
Modality 2Modality 1 Modality 3
Concrete
Reasoning
Abstract
Reasoning
?

20. Linear perspective invented by Filippo Brunelleschi
Counting of items invented
Numbers for collections of items
Proto writing for storytelling emerged
Mathematics & written language emerge
Aural language emerges
Vision starts to develop
Audition starts to develop
Proto language starts to develop
Visual acuity of modern eye
Human Evolution
Key insight from
Prof. Dr. Giuseppe
Di Gironimo

21. Filippo Brunelleschi
Brunelleschi needed his perspective
realism to be proven against Euclidean
laws of geometric optics…

22. Looks familiar?
Augmenting factory under
construction in 2010
Augmenting baptistery under
construction in 1413

23. Brunelleschi demonstration was
equivalent to modern Augmented Reality
Filippo Brunelleschi

24. Brunelleschi impact on
visual simulation...

25. Parallax free view of graphics content
Optical principles for contextualized graphics
Linear perspective invented by Filippo Brunelleschi
Counting of items invented
Numbers for collections of items
Proto writing for storytelling emerged
Mathematics & written language emerge
Aural language emerges
Vision starts to develop
Audition starts to develop
Proto language starts to develop
Visual acuity of modern eye
Human Evolution
Ivan Sutherland1968

26. Augmented Reality – Thomas Caudell, Boeing 1990
Abstract and Concrete reasoning combined
Parallax free view of graphics content
Linear perspective invented by Filippo Brunelleschi
Counting of items invented
Numbers for collections of items
Proto writing for storytelling emerged
Mathematics & written language emerge
Aural language emerges
Vision starts to develop
Audition starts to develop
Proto language starts to develop
Visual acuity of modern eye
Dr.Thomas P. Caudell
Human Evolution

27. What did we learn?
Perspective drawing technology invented by Brunelleschi
• Spatial reasoning unleashed for art and engineering
What is called Augmented Reality started to take shape
• Technology to combine Concrete & Abstract reasoning

28. Why AR exists?
Modality 2Modality 1 Modality 3
Concrete
Reasoning
Abstract
Reasoning
?

29. ▪ Sight (visual)
▪ Hearing (aural)
▪ Touch (somatosensory)*
▪ Smell (olfactory)
▪ Taste (gustatory)
Human Sensors: Machine Sensors:
Gyroscope, Accelerometer, Magnetometer , Geophone,
Hydrophone, Microphone, Seismometer, Hall effect sensor,
MAP sensor, Mass flow sensor, Oxygen sensor, Speed
sensor, Breathalyzer, Carbon dioxide sensor, Carbon
monoxide detector, Electrochemical gas sensor,
Fluorescent chloride sensors, Hydrogen sulfide sensor,
Olfactometer, Smoke detector, Magnetometer, Geiger
counter, Altimeter, Variometer, Capacitive sensing, Free
fall sensor, Rotary encoder…
Human-Machine Systems
Unity of Human and Machine

30. Human Augmentation with
Transformational Reasoning

31. Modality 2Modality 1 Modality 3
Concrete
Reasoning
Abstract
Reasoning
Transformational
Reasoning
Why AR exists?

32. LETS REVIEWTHE 5 SENSES
Augmented Reality with Concrete & Abstract reasoning

33. Augmenting Vision
Concrete Abstract

34. Augmenting Audio
Concrete Abstract

35. Augmenting Touch
Concrete Abstract

36. Augmenting Smell
Ethanethiol
Propane
Concrete Abstract

37. Augmenting Taste
Concrete Abstract

38. EXAMPLES OF AUGMENTATION
Concrete, Abstract & Transformational reasoning

39. From sensors to sensations...
Yuta Takeuchi et al.

40. From sensors to sensations...

41. Lance Corporal Craig Lundberg
From sensors to sensations...

42. What did we learn?
• Concrete Reasoning & Abstract Reasoning
• Transformational Reasoning for new senses
• Brain is very plastic and it will adapt to AR…

43. We have not even started to properly
leverage the human potential...
Augmented Reality will change that!

44. 44
Augmented Reality as
a business foundation
HOW WE USETHIS AT DCL

45. 45

46. 46
46
Customer:
System is not working,
can you support us?
You:
First release the CMP
piping next to the
DLC pump…
Customer:
Where is the DLC
pump located?
You:
It is square looking
box and 5cm of it
there are 4 bolts…
Customer:
Uhmmmm… Can you
come visit us???
You:
OK, we will send
someone next week!
Communication is the problem…
Phone support:
Old way…

47. 47
Augmented Reality is the solution…
Customer:
System is not working,
can you Pointr us?
You:
For safety, do not
remove the cables
marked with red
Customer:
Ok, understood!
You:
Release CMP piping
by opening bolts
marked with green
Customer:
Great, that was easy!
You:
Happy to help!
Pointr support:
New way…

48. Pointr is
communication beyond
voice and video
POINTR APP
COMMUNICATION ATTHE NEXT LEVEL
Pointr is the best
way to solve technical
problems remotely

49. 49

50. POINTING IS UNIVERSAL
50
LEVERAGE 500M YEARS OF HUMAN EVOLUTION

51. 51
From disillusionment to productivity
Pointr

52. AUGMENTED REALITY IN INDUSTRY
• Repair & off-nominal maintenance
• Ramp-up & commissioning
• Upgrades & retrofit
• On-the-job training
• Quality assurance
• Warranty period support
PRODUCTIVITY BOOST TODAY…
TOMORROW AUGMENTED REALITY
WILL IMPACT ALL OF 7 BILLION PEOPLE…

53. 53
www.deltacygnilabs.com
@sksauli
BORIS
KRASSI, CEO
SAULI
KIVIRANTA, CTO
JOHANNA
ANIA,
MARKUS
MYHRBERG
TEEMU
KUMPUMÄKI
NIRDHARSH
SHETTY
IGOR
LEVOCHKIN
THANKYOU!
JARI
LAHTI