SlideShare a Scribd company logo
1 of 44
Download to read offline
Christian@Sandor.com
6 October 2020
Augmented Reality Evangelist
Co-Director
Associate Professor
Retrospective of My Last
20 years as AR Researcher
Matt Swoboda, Thanh Nguyen, Ulrich Eck, Gerhard Reitmayr, Stefan Hauswiesner,
Rene Ranftl, and Christian Sandor. Demo at IEEE International Symposium on Mixed
and Augmented Reality, Basel, Switzerland, October 2011. Best Demo Award
BURNAR: FEEL THE HEAT
Peter Weir, Christian Sandor, Matt Swoboda, Thanh Nguyen, Ulrich Eck,
Gerhard Reitmayr, and Arindam Dey. Proceedings of the IEEE Virtual
Reality Conference, pages 43–46, Orlando, FL, USA, March 2013.
BURNAR: INVOLUNTARY HEAT SENSATIONS IN AR
RECENT INVESTMENTS INTO AR & VR
3/2014: Facebook buys Oculus
2 Billion USD
10/2014: Google and others invest into Magic Leap
542 Million USD
1/2015: Microsoft releases Hololens
1 Billion USD
3/2018: More investments into Magic Leap; total now
2.3 Billion USD
The End of Hardware. Rolf R. Hainich. ISBN 1-4196-3036-9. 2006
VISION OF AR: ONE DISPLAY TO REPLACE ALL OTHERS
RECENT ADVANCES
Retinal 3D: Augmented Reality Near-Eye Display Via Pupil-Tracked Light Field
Projection on Retina. Changwon Jang, Kiseung Bang, Seokil Moon, Jonghyun Kim,
Seungjae Lee, and Byoungho Lee. ACM Transactions on Graphics 36(6):1-13. 2017
SEOKIL MOON, Seoul National University
JONGHYUN KIM, Seoul National University
SEUNGJAE LEE, Seoul National University
BYOUNGHO LEE, Seoul National University
Fig. 1. A) Overview of Retinal 3D. The proposed near-eye display provides virtual images with focus cues by generatin
real-time tracking that can then be directly projected onto the retina. Pupil-tracked light field generation can reduce
load as well as provide the eye-box that can overcome the drawbacks of retinal projection-type displays. B) A prototy
results showing the generation of focus cues. D) Demonstration of full-color 3D augmented reality.
We introduce an augmented reality near-eye display dubbed “Retinal 3D.” Key
features of the proposed display system are as follows: Focus cues are pro-
vided by generating the pupil-tracked light eld that can be directly projected
onto the retina. Generated focus cues are valid over a large depth range since
laser beams are shaped for a large depth of eld (DOF). Pupil-tracked light
eld generation signicantly reduces the needed information/computation
load. Also, it provides “dynamic eye-box” which can be a break-through
that overcome the drawbacks of retinal projection-type displays. For im-
Additional Key Words and Phrases:
putational displays, holographic opti
conict
ACM Reference format:
Changwon Jang, Kiseung Bang, Seok
and Byoungho Lee. 2017. Retinal 3D
Via Pupil-Tracked Light Field Projec
Benjamin Avery, Christian Sandor, Bruce H. Thomas. Improving Spatial Perception
for Augmented Reality X-Ray Vision. In Proceedings of the IEEE Virtual Reality
Conference, pages 79–82. IEEE, March 2009. Lafayette, Louisiana, USA.
EDGE-BASED X-RAY
Google Faculty Award (2014)
AR X-RAY FOR GOOGLE GLASS
FINAL DEMO (4/2015)
CURRENT WORK: MEDICAL APPLICATIONS
Locations: Worcester – Gold Start Blv. 508-856-9510, Back to Work Center 508-854-2426, Worcester Medical Center 508- 368-3143
Westboro 508-871-0789 Leominster 978-840-1900 Charlton 508-248-4141
Disclaimer: If you experience pain or worsening of symptoms call doctors office and stop doing your exercises.
Internet Access: www.fallonclinic.org Click on Medical Services, Specialty Care, Rehabilitation, Informative Exercise Sheets
Rehabilitation  Sports Medicine
Frozen Shoulder
SHOULDER - 26
Range of Motion Exercises:
Pendulum (Circular)
Let arm move in a circle
clockwise, then counter-
clockwise, by rocking body
weight in a circular pattern.
Repeat 10 times.
Do 3-5 sessions per day.
SHOULDER - 7
Range of Motion Exercises
(Self-Stretching Activities):
Flexion
Sitting upright, slide forearm
forward along table, bending
from waist until a stretch is
felt. Hold 30 seconds.
Repeat 1-4 times
Do 1 session per day.
SHOULDER - 11
Range of Motion Exercises
(Self-Stretching Activities):
External Rotation (alternate)
Keep palm of hand against
door frame, and elbow bent at
90°. Turn body from fixed
hand until a stretch is felt.
Hold 30 seconds.
Repeat 1-4 times
Do 1 session per day.
SHOULDER - 9
Range of Motion Exercises (Self-
Stretching Activities): Abduction
With arm resting on table, palm up, bring
head down toward arm and simultaneously
move trunk away from table. Hold 30
seconds.
Repeat 1-4 times Do 1 session per day.
SHOULDER - 73
Towel Stretch for Internal
Rotation
Pull involved arm up
behind back by pulling
towel upward with other
arm. Hold 30 seconds.
Repeat 1-4 times
Do 1 session per day.
SCAP SETS
Pull your shoulders back,
pinching the shoulder
blades together. Do not let
the shoulders come
forward. Hold 5-10
seconds.
Repeat 10 times
Do 1 session per day.
Courtesy of http://campar.in.tum.de/Main/FelixBork
CURRENT WORK: MEDICAL APPLICATIONS
Collaboration with Jockey Club College of Veterinary Medicine,
Johns Hopkins University (USA), and TU Munich (Germany)
AUGMENTED REALITY X-RAY FOR CANINE HEALTH CARE
Image adapted from 3D4Medical
Image adapted from Shutterstock
2009
CONCLUSIONS: 20 YEARS OF AR
My Past: serious applications
consumer, medical
(automotive, industrial, military)
2009 2020
https://www.youtube.com/watch?v=9jpWiTVR0GA
Nurikabe Kappa
Tengu
Long neck woman
Big centipede
Mokumokuren
Nopperabou
Tsuchigumo
Nurarihyon
Paper umbrella haunted
Umibouzu
Gasyadokuro
http://www.aryoukai.com
CONCLUSIONS: 20 YEARS OF AR
My past: serious applications
consumer, medical
(automotive, industrial, military)
2009 2020
2011 2016
My future in Hong Kong: AR for science, art  entertainment
Christian@Sandor.com
6 October 2020
Augmented Reality Evangelist
Co-Director
Associate Professor
the future
https://xr-lab.org
THE EXTENDED REALITY LAB
KHRONOS PROJECTOR. ALVARO CASSINELLI [2004]
ALVARO’S SPECIALITY: HIGH-SPEED OPTO-ELECTRONICS
https://www.youtube.com/watch?v=QDppJ9NWtaE
FIRST PAPER OF ALVARO  CHRIS
Alan Turing. Computing Machinery and Intelligence. Mind, 59 (236): 433–460, October 1950.
Inspired by Alan Turing’s
imitation game
1. undetectable modification of user’s perception
2. goal: seamless blend of real and virtual world
CHANGWON JANG, Seoul National University
KISEUNG BANG, Seoul National University
SEOKIL MOON, Seoul National University
JONGHYUN KIM, Seoul National University
SEUNGJAE LEE, Seoul National University
BYOUNGHO LEE, Seoul National University
Fig. 1. A) Overview of Retinal 3D. The proposed near-eye display provides virtual images with focu
real-time tracking that can then be directly projected onto the retina. Pupil-tracked light field gen
load as well as provide the eye-box that can overcome the drawbacks of retinal projection-type dis
results showing the generation of focus cues. D) Demonstration of full-color 3D augmented reality
We introduce an augmented reality near-eye display dubbed “Retinal 3D.” Key
features of the proposed display system are as follows: Focus cues are pro-
vided by generating the pupil-tracked light eld that can be directly projected
onto the retina. Generated focus cues are valid over a large depth range since
laser beams are shaped for a large depth of eld (DOF). Pupil-tracked light
eld generation signicantly reduces the needed information/computation
load. Also, it provides “dynamic eye-box” which can be a break-through
that overcome the drawbacks of retinal projection-type displays. For im-
plementation, we utilized a holographic optical element (HOE) as an image
combiner, which allowed high transparency with a thin structure. Compared
with current augmented reality displays, the proposed system shows com-
petitive performances of a large eld of view (FOV), high transparency, high
contrast, high resolution, as well as focus cues in a large depth range. Two
prototypes are presented along with experimental results and assessments.
Analysis on the DOF of light rays and validity of focus cue generation are
Additional Key W
putational display
conict
ACM Reference
Changwon Jang,
and Byoungho Le
Via Pupil-Tracked
6, Article 190 (No
DOI: 10.1145/313
1 INTRODU
e emergence
Christian Sandor, Martin Fuchs, Alvaro Cassinelli, Hao Li, Richard Newcombe, Goshiro
Yamamoto, and Steven Feiner. Breaking the Barriers to True Augmented Reality. ArXiv e-prints,
arXiv:1512.05471 [cs.HC], 13 pages, December 2015.
INTERACTIVE MINIMAL LATENCY LASER
GRAPHICS PIPELINE
2009
Jayson Haebich, Christian Sandor, and Alvaro Cassinelli.
Accepted for SIGGRAPH Asia Emerging Technologies. 2020
https://xr-lab.org
Christian@Sandor.com
6 October 2020
Augmented Reality Evangelist
Co-Director
Associate Professor
the future
https://geoshen.com/posts/the-pearl-river-delta-megalopolis
THE PEARL RIVER DELTA
AR/ VR GOVERNMENTAL PROJECTS IN CHINA
AR/ VR GOVERNMENTAL PROJECTS IN CHINA
Chengdu: Virtual
Reality Industry
Development
and Promotion
Plan
Chongqing:
Opinions on
Accelerating the
Development of
The Virtual
Reality Industry
Guiyang: Ten Policies of Gui'an New District
on Supporting the Development of Virtual
Reality Industry
Fuzhou: Ten Measures to Accelerate the
Development of VR Industry
Changsha: Development Plan for
Virtual Reality Industry
Nanchang: Policies on
Accelerating the Development
of VR/AR Industry
Shenzhen: Special Support
Fund Application Guide
for AR/VR Industry
Xiamen: Development Plan for
AR/VR Industry (2017-2022)
Jiaxing: Plan for AR/VR
Industry (2017-2020)
Hefei: Agreement on Strategic
Cooperation of VR Production-
Education Integration
Qingdao: Implementation Rules
for Promoting the Development
of Virtual Reality Industry in
Laoshan District
Beijing: Several Measures to Promote the
Innovation and Development of Virtual Reality
Industry in Zhongguancun
Weifang: Supporting Policy of
Building 100 Billion-Level VR
Industry
AR/ VR GOVERNMENTAL PROJECTS IN CHINA
Chengdu: Virtual
Reality Industry
Development
and Promotion
Plan
Chongqing:
Opinions on
Accelerating the
Development of
The Virtual
Reality Industry
Guiyang: Ten Policies of Gui'an New District
on Supporting the Development of Virtual
Reality Industry
Fuzhou: Ten Measures to Accelerate the
Development of VR Industry
Changsha: Development Plan for
Virtual Reality Industry
Nanchang: Policies on
Accelerating the Development
of VR/AR Industry
Shenzhen: Special Support
Fund Application Guide
for AR/VR Industry
Xiamen: Development Plan for
AR/VR Industry (2017-2022)
Jiaxing: Plan for AR/VR
Industry (2017-2020)
Hefei: Agreement on Strategic
Cooperation of VR Production-
Education Integration
Qingdao: Implementation Rules
for Promoting the Development
of Virtual Reality Industry in
Laoshan District
Beijing: Several Measures to Promote the
Innovation and Development of Virtual Reality
Industry in Zhongguancun
Weifang: Supporting Policy of
Building 100 Billion-Level VR
Industry
1.2 Billion EURO
600 Million EURO
AR/ VR COMPETENCE CENTERS
Nanchang Virtual Reality Testing Technology Co.,
Ltd.
Qingdao Jinggong VR Research Institute
Beijing Engineering Research Center of
Interactive Media Arts
BIT (Nanchang) VR Standard Testing and
Evaluation Centre
Beijing Engineering Research Center for Mixed
Reality and Advanced Display Technology
KEY PEOPLE AT BAYVR: SCIENTIFIC DIRECTION
SCHOOL OF OPTICS AND PHOTONICS
BEIJING INSTITUTE OF TECHNOLOGY
Professor
Yongtian Wang
Professor
Yue Liu
Associate Professor
Liqun Wang
KEY PEOPLE AT BAYVR: EXTERNAL EXPERTS
CONCLUSIONS: 20 YEARS OF AR
My past: serious applications
consumer, medical
(automotive, industrial, military)
2009 2020
2011 2016
My future in Hong Kong: AR for science, art  entertainment

More Related Content

What's hot

User Interfaces and User Centered Design Techniques for Augmented Reality and...
User Interfaces and User Centered Design Techniques for Augmented Reality and...User Interfaces and User Centered Design Techniques for Augmented Reality and...
User Interfaces and User Centered Design Techniques for Augmented Reality and...Stuart Murphy
 
COMP 4010: Lecture2 VR Technology
COMP 4010: Lecture2 VR TechnologyCOMP 4010: Lecture2 VR Technology
COMP 4010: Lecture2 VR TechnologyMark Billinghurst
 
2014 COSC 426 Lecture 2: Augmented Reality Technology
2014 COSC 426 Lecture 2: Augmented Reality Technology2014 COSC 426 Lecture 2: Augmented Reality Technology
2014 COSC 426 Lecture 2: Augmented Reality TechnologyMark Billinghurst
 
Stereoscopic 3D: Generation Methods and Display Technologies for Industry and...
Stereoscopic 3D: Generation Methods and Display Technologies for Industry and...Stereoscopic 3D: Generation Methods and Display Technologies for Industry and...
Stereoscopic 3D: Generation Methods and Display Technologies for Industry and...Ray Phan
 
The Mobile Future of Augmented Reality
The Mobile Future of Augmented RealityThe Mobile Future of Augmented Reality
The Mobile Future of Augmented RealityQualcomm Research
 
3D Television no more a fantasy
3D Television no more a fantasy3D Television no more a fantasy
3D Television no more a fantasyrathorenitin87
 
Lecture 2 Presence and Perception
Lecture 2 Presence and PerceptionLecture 2 Presence and Perception
Lecture 2 Presence and PerceptionMark Billinghurst
 
DISSERTATION - Bratislav Vidanovic, 77122071
DISSERTATION - Bratislav Vidanovic, 77122071DISSERTATION - Bratislav Vidanovic, 77122071
DISSERTATION - Bratislav Vidanovic, 77122071Bratislav Vidanovic
 
COMP 4010: Lecture 4 - 3D User Interfaces for VR
COMP 4010: Lecture 4 - 3D User Interfaces for VRCOMP 4010: Lecture 4 - 3D User Interfaces for VR
COMP 4010: Lecture 4 - 3D User Interfaces for VRMark Billinghurst
 
COMP 4010 - Lecture 3 VR Systems
COMP 4010 - Lecture 3 VR SystemsCOMP 4010 - Lecture 3 VR Systems
COMP 4010 - Lecture 3 VR SystemsMark Billinghurst
 
Developing AR and VR Experiences with Unity
Developing AR and VR Experiences with UnityDeveloping AR and VR Experiences with Unity
Developing AR and VR Experiences with UnityMark Billinghurst
 
Augmented Reality presentation
Augmented Reality presentationAugmented Reality presentation
Augmented Reality presentationTed Dinsmore
 
COMP 4010 - Lecture4 VR Technology - Visual and Haptic Displays
COMP 4010 - Lecture4 VR Technology - Visual and Haptic DisplaysCOMP 4010 - Lecture4 VR Technology - Visual and Haptic Displays
COMP 4010 - Lecture4 VR Technology - Visual and Haptic DisplaysMark Billinghurst
 

What's hot (20)

User Interfaces and User Centered Design Techniques for Augmented Reality and...
User Interfaces and User Centered Design Techniques for Augmented Reality and...User Interfaces and User Centered Design Techniques for Augmented Reality and...
User Interfaces and User Centered Design Techniques for Augmented Reality and...
 
COMP 4010: Lecture2 VR Technology
COMP 4010: Lecture2 VR TechnologyCOMP 4010: Lecture2 VR Technology
COMP 4010: Lecture2 VR Technology
 
2014 COSC 426 Lecture 2: Augmented Reality Technology
2014 COSC 426 Lecture 2: Augmented Reality Technology2014 COSC 426 Lecture 2: Augmented Reality Technology
2014 COSC 426 Lecture 2: Augmented Reality Technology
 
Raskar 6Sight Keynote Talk Nov09
Raskar 6Sight Keynote Talk Nov09Raskar 6Sight Keynote Talk Nov09
Raskar 6Sight Keynote Talk Nov09
 
Stereoscopic 3D: Generation Methods and Display Technologies for Industry and...
Stereoscopic 3D: Generation Methods and Display Technologies for Industry and...Stereoscopic 3D: Generation Methods and Display Technologies for Industry and...
Stereoscopic 3D: Generation Methods and Display Technologies for Industry and...
 
The Mobile Future of Augmented Reality
The Mobile Future of Augmented RealityThe Mobile Future of Augmented Reality
The Mobile Future of Augmented Reality
 
Raskar 2012, Idea Hexagon
Raskar 2012, Idea HexagonRaskar 2012, Idea Hexagon
Raskar 2012, Idea Hexagon
 
3d
3d3d
3d
 
3D
3D3D
3D
 
3D Television no more a fantasy
3D Television no more a fantasy3D Television no more a fantasy
3D Television no more a fantasy
 
Lecture 2 Presence and Perception
Lecture 2 Presence and PerceptionLecture 2 Presence and Perception
Lecture 2 Presence and Perception
 
Spatial computing - extending reality
Spatial computing - extending realitySpatial computing - extending reality
Spatial computing - extending reality
 
Augmented Reality
Augmented RealityAugmented Reality
Augmented Reality
 
DISSERTATION - Bratislav Vidanovic, 77122071
DISSERTATION - Bratislav Vidanovic, 77122071DISSERTATION - Bratislav Vidanovic, 77122071
DISSERTATION - Bratislav Vidanovic, 77122071
 
COMP 4010: Lecture 4 - 3D User Interfaces for VR
COMP 4010: Lecture 4 - 3D User Interfaces for VRCOMP 4010: Lecture 4 - 3D User Interfaces for VR
COMP 4010: Lecture 4 - 3D User Interfaces for VR
 
COMP 4010 - Lecture 3 VR Systems
COMP 4010 - Lecture 3 VR SystemsCOMP 4010 - Lecture 3 VR Systems
COMP 4010 - Lecture 3 VR Systems
 
Developing AR and VR Experiences with Unity
Developing AR and VR Experiences with UnityDeveloping AR and VR Experiences with Unity
Developing AR and VR Experiences with Unity
 
Virtual Reality
Virtual RealityVirtual Reality
Virtual Reality
 
Augmented Reality presentation
Augmented Reality presentationAugmented Reality presentation
Augmented Reality presentation
 
COMP 4010 - Lecture4 VR Technology - Visual and Haptic Displays
COMP 4010 - Lecture4 VR Technology - Visual and Haptic DisplaysCOMP 4010 - Lecture4 VR Technology - Visual and Haptic Displays
COMP 4010 - Lecture4 VR Technology - Visual and Haptic Displays
 

Similar to Keynote at VR in Science and Industry

Seminar presentation
Seminar presentationSeminar presentation
Seminar presentationBrij Kishore
 
Eyeglasses-free Display: Towards Correcting Visual Aberrations with Computati...
Eyeglasses-free Display: Towards Correcting Visual Aberrations with Computati...Eyeglasses-free Display: Towards Correcting Visual Aberrations with Computati...
Eyeglasses-free Display: Towards Correcting Visual Aberrations with Computati...Dario Caliendo
 
Sig2014 vision correcting display
Sig2014 vision correcting displaySig2014 vision correcting display
Sig2014 vision correcting displayWael Sharba
 
Keynote at 23rd International Display Workshop
Keynote at 23rd International Display WorkshopKeynote at 23rd International Display Workshop
Keynote at 23rd International Display WorkshopChristian Sandor
 
Semester vi bt9403-virtual reality-de (2)
Semester vi bt9403-virtual reality-de (2)Semester vi bt9403-virtual reality-de (2)
Semester vi bt9403-virtual reality-de (2)smumbahelp
 
Future Research Directions for Augmented Reality
Future Research Directions for Augmented RealityFuture Research Directions for Augmented Reality
Future Research Directions for Augmented RealityMark Billinghurst
 
Elaine truong desma9_midterm
Elaine truong desma9_midtermElaine truong desma9_midterm
Elaine truong desma9_midtermElaine Truong
 
A Seminar Report On Virtual Reality
A Seminar Report On Virtual RealityA Seminar Report On Virtual Reality
A Seminar Report On Virtual RealityLisa Riley
 
Virtual Reality Report
Virtual Reality ReportVirtual Reality Report
Virtual Reality ReportRashmi Gupta
 
All about Virtual Reality & Oculus Rift
All about Virtual Reality & Oculus RiftAll about Virtual Reality & Oculus Rift
All about Virtual Reality & Oculus RiftSaurabh Sawhney
 
Materi_01_VK_2223_3.pdf
Materi_01_VK_2223_3.pdfMateri_01_VK_2223_3.pdf
Materi_01_VK_2223_3.pdfichsan6
 
Comment réduire le cybermalaise de la réalité virtuelle ?
Comment réduire le cybermalaise de la réalité virtuelle ?Comment réduire le cybermalaise de la réalité virtuelle ?
Comment réduire le cybermalaise de la réalité virtuelle ?Pierre-Majorique Léger
 
Building an Academic Virtual Reality System
Building an Academic Virtual Reality SystemBuilding an Academic Virtual Reality System
Building an Academic Virtual Reality SystemBill E
 
Beyond Reality (2027): The Future of Virtual and Augmented Reality
Beyond Reality (2027): The Future of Virtual and Augmented RealityBeyond Reality (2027): The Future of Virtual and Augmented Reality
Beyond Reality (2027): The Future of Virtual and Augmented RealityMark Billinghurst
 
COMP 4010 Lecture12 - Research Directions in AR and VR
COMP 4010 Lecture12 - Research Directions in AR and VRCOMP 4010 Lecture12 - Research Directions in AR and VR
COMP 4010 Lecture12 - Research Directions in AR and VRMark Billinghurst
 
Google Cardboard Virtual Reality
Google Cardboard Virtual RealityGoogle Cardboard Virtual Reality
Google Cardboard Virtual RealityVicky VikRanth
 
NeuroVR 1.5 - Open Source VR system for neuroscience and behavioral healthcare
NeuroVR 1.5 - Open Source VR system for neuroscience and behavioral healthcareNeuroVR 1.5 - Open Source VR system for neuroscience and behavioral healthcare
NeuroVR 1.5 - Open Source VR system for neuroscience and behavioral healthcareRiva Giuseppe
 
44328856-Augmented-Reality.ppt
44328856-Augmented-Reality.ppt44328856-Augmented-Reality.ppt
44328856-Augmented-Reality.pptAjayPoonia22
 
44328856-Augmented-Reality.ppt
44328856-Augmented-Reality.ppt44328856-Augmented-Reality.ppt
44328856-Augmented-Reality.pptNagulahimasri
 

Similar to Keynote at VR in Science and Industry (20)

Seminar presentation
Seminar presentationSeminar presentation
Seminar presentation
 
Eyeglasses-free Display: Towards Correcting Visual Aberrations with Computati...
Eyeglasses-free Display: Towards Correcting Visual Aberrations with Computati...Eyeglasses-free Display: Towards Correcting Visual Aberrations with Computati...
Eyeglasses-free Display: Towards Correcting Visual Aberrations with Computati...
 
Sig2014 vision correcting display
Sig2014 vision correcting displaySig2014 vision correcting display
Sig2014 vision correcting display
 
Keynote at 23rd International Display Workshop
Keynote at 23rd International Display WorkshopKeynote at 23rd International Display Workshop
Keynote at 23rd International Display Workshop
 
ICAT2006_KEYNOTE_report_icat
ICAT2006_KEYNOTE_report_icatICAT2006_KEYNOTE_report_icat
ICAT2006_KEYNOTE_report_icat
 
Semester vi bt9403-virtual reality-de (2)
Semester vi bt9403-virtual reality-de (2)Semester vi bt9403-virtual reality-de (2)
Semester vi bt9403-virtual reality-de (2)
 
Future Research Directions for Augmented Reality
Future Research Directions for Augmented RealityFuture Research Directions for Augmented Reality
Future Research Directions for Augmented Reality
 
Elaine truong desma9_midterm
Elaine truong desma9_midtermElaine truong desma9_midterm
Elaine truong desma9_midterm
 
A Seminar Report On Virtual Reality
A Seminar Report On Virtual RealityA Seminar Report On Virtual Reality
A Seminar Report On Virtual Reality
 
Virtual Reality Report
Virtual Reality ReportVirtual Reality Report
Virtual Reality Report
 
All about Virtual Reality & Oculus Rift
All about Virtual Reality & Oculus RiftAll about Virtual Reality & Oculus Rift
All about Virtual Reality & Oculus Rift
 
Materi_01_VK_2223_3.pdf
Materi_01_VK_2223_3.pdfMateri_01_VK_2223_3.pdf
Materi_01_VK_2223_3.pdf
 
Comment réduire le cybermalaise de la réalité virtuelle ?
Comment réduire le cybermalaise de la réalité virtuelle ?Comment réduire le cybermalaise de la réalité virtuelle ?
Comment réduire le cybermalaise de la réalité virtuelle ?
 
Building an Academic Virtual Reality System
Building an Academic Virtual Reality SystemBuilding an Academic Virtual Reality System
Building an Academic Virtual Reality System
 
Beyond Reality (2027): The Future of Virtual and Augmented Reality
Beyond Reality (2027): The Future of Virtual and Augmented RealityBeyond Reality (2027): The Future of Virtual and Augmented Reality
Beyond Reality (2027): The Future of Virtual and Augmented Reality
 
COMP 4010 Lecture12 - Research Directions in AR and VR
COMP 4010 Lecture12 - Research Directions in AR and VRCOMP 4010 Lecture12 - Research Directions in AR and VR
COMP 4010 Lecture12 - Research Directions in AR and VR
 
Google Cardboard Virtual Reality
Google Cardboard Virtual RealityGoogle Cardboard Virtual Reality
Google Cardboard Virtual Reality
 
NeuroVR 1.5 - Open Source VR system for neuroscience and behavioral healthcare
NeuroVR 1.5 - Open Source VR system for neuroscience and behavioral healthcareNeuroVR 1.5 - Open Source VR system for neuroscience and behavioral healthcare
NeuroVR 1.5 - Open Source VR system for neuroscience and behavioral healthcare
 
44328856-Augmented-Reality.ppt
44328856-Augmented-Reality.ppt44328856-Augmented-Reality.ppt
44328856-Augmented-Reality.ppt
 
44328856-Augmented-Reality.ppt
44328856-Augmented-Reality.ppt44328856-Augmented-Reality.ppt
44328856-Augmented-Reality.ppt
 

Recently uploaded

Natural Polymer Based Nanomaterials
Natural Polymer Based NanomaterialsNatural Polymer Based Nanomaterials
Natural Polymer Based NanomaterialsAArockiyaNisha
 
Lucknow 💋 Russian Call Girls Lucknow Finest Escorts Service 8923113531 Availa...
Lucknow 💋 Russian Call Girls Lucknow Finest Escorts Service 8923113531 Availa...Lucknow 💋 Russian Call Girls Lucknow Finest Escorts Service 8923113531 Availa...
Lucknow 💋 Russian Call Girls Lucknow Finest Escorts Service 8923113531 Availa...anilsa9823
 
Isotopic evidence of long-lived volcanism on Io
Isotopic evidence of long-lived volcanism on IoIsotopic evidence of long-lived volcanism on Io
Isotopic evidence of long-lived volcanism on IoSérgio Sacani
 
Discovery of an Accretion Streamer and a Slow Wide-angle Outflow around FUOri...
Discovery of an Accretion Streamer and a Slow Wide-angle Outflow around FUOri...Discovery of an Accretion Streamer and a Slow Wide-angle Outflow around FUOri...
Discovery of an Accretion Streamer and a Slow Wide-angle Outflow around FUOri...Sérgio Sacani
 
Presentation Vikram Lander by Vedansh Gupta.pptx
Presentation Vikram Lander by Vedansh Gupta.pptxPresentation Vikram Lander by Vedansh Gupta.pptx
Presentation Vikram Lander by Vedansh Gupta.pptxgindu3009
 
Analytical Profile of Coleus Forskohlii | Forskolin .pptx
Analytical Profile of Coleus Forskohlii | Forskolin .pptxAnalytical Profile of Coleus Forskohlii | Forskolin .pptx
Analytical Profile of Coleus Forskohlii | Forskolin .pptxSwapnil Therkar
 
Physiochemical properties of nanomaterials and its nanotoxicity.pptx
Physiochemical properties of nanomaterials and its nanotoxicity.pptxPhysiochemical properties of nanomaterials and its nanotoxicity.pptx
Physiochemical properties of nanomaterials and its nanotoxicity.pptxAArockiyaNisha
 
Animal Communication- Auditory and Visual.pptx
Animal Communication- Auditory and Visual.pptxAnimal Communication- Auditory and Visual.pptx
Animal Communication- Auditory and Visual.pptxUmerFayaz5
 
Biological Classification BioHack (3).pdf
Biological Classification BioHack (3).pdfBiological Classification BioHack (3).pdf
Biological Classification BioHack (3).pdfmuntazimhurra
 
Recombinant DNA technology (Immunological screening)
Recombinant DNA technology (Immunological screening)Recombinant DNA technology (Immunological screening)
Recombinant DNA technology (Immunological screening)PraveenaKalaiselvan1
 
Formation of low mass protostars and their circumstellar disks
Formation of low mass protostars and their circumstellar disksFormation of low mass protostars and their circumstellar disks
Formation of low mass protostars and their circumstellar disksSérgio Sacani
 
A relative description on Sonoporation.pdf
A relative description on Sonoporation.pdfA relative description on Sonoporation.pdf
A relative description on Sonoporation.pdfnehabiju2046
 
Work, Energy and Power for class 10 ICSE Physics
Work, Energy and Power for class 10 ICSE PhysicsWork, Energy and Power for class 10 ICSE Physics
Work, Energy and Power for class 10 ICSE Physicsvishikhakeshava1
 
Artificial Intelligence In Microbiology by Dr. Prince C P
Artificial Intelligence In Microbiology by Dr. Prince C PArtificial Intelligence In Microbiology by Dr. Prince C P
Artificial Intelligence In Microbiology by Dr. Prince C PPRINCE C P
 
Labelling Requirements and Label Claims for Dietary Supplements and Recommend...
Labelling Requirements and Label Claims for Dietary Supplements and Recommend...Labelling Requirements and Label Claims for Dietary Supplements and Recommend...
Labelling Requirements and Label Claims for Dietary Supplements and Recommend...Lokesh Kothari
 
Spermiogenesis or Spermateleosis or metamorphosis of spermatid
Spermiogenesis or Spermateleosis or metamorphosis of spermatidSpermiogenesis or Spermateleosis or metamorphosis of spermatid
Spermiogenesis or Spermateleosis or metamorphosis of spermatidSarthak Sekhar Mondal
 
Is RISC-V ready for HPC workload? Maybe?
Is RISC-V ready for HPC workload? Maybe?Is RISC-V ready for HPC workload? Maybe?
Is RISC-V ready for HPC workload? Maybe?Patrick Diehl
 
Biopesticide (2).pptx .This slides helps to know the different types of biop...
Biopesticide (2).pptx  .This slides helps to know the different types of biop...Biopesticide (2).pptx  .This slides helps to know the different types of biop...
Biopesticide (2).pptx .This slides helps to know the different types of biop...RohitNehra6
 

Recently uploaded (20)

Natural Polymer Based Nanomaterials
Natural Polymer Based NanomaterialsNatural Polymer Based Nanomaterials
Natural Polymer Based Nanomaterials
 
Lucknow 💋 Russian Call Girls Lucknow Finest Escorts Service 8923113531 Availa...
Lucknow 💋 Russian Call Girls Lucknow Finest Escorts Service 8923113531 Availa...Lucknow 💋 Russian Call Girls Lucknow Finest Escorts Service 8923113531 Availa...
Lucknow 💋 Russian Call Girls Lucknow Finest Escorts Service 8923113531 Availa...
 
Isotopic evidence of long-lived volcanism on Io
Isotopic evidence of long-lived volcanism on IoIsotopic evidence of long-lived volcanism on Io
Isotopic evidence of long-lived volcanism on Io
 
Discovery of an Accretion Streamer and a Slow Wide-angle Outflow around FUOri...
Discovery of an Accretion Streamer and a Slow Wide-angle Outflow around FUOri...Discovery of an Accretion Streamer and a Slow Wide-angle Outflow around FUOri...
Discovery of an Accretion Streamer and a Slow Wide-angle Outflow around FUOri...
 
Presentation Vikram Lander by Vedansh Gupta.pptx
Presentation Vikram Lander by Vedansh Gupta.pptxPresentation Vikram Lander by Vedansh Gupta.pptx
Presentation Vikram Lander by Vedansh Gupta.pptx
 
Analytical Profile of Coleus Forskohlii | Forskolin .pptx
Analytical Profile of Coleus Forskohlii | Forskolin .pptxAnalytical Profile of Coleus Forskohlii | Forskolin .pptx
Analytical Profile of Coleus Forskohlii | Forskolin .pptx
 
Physiochemical properties of nanomaterials and its nanotoxicity.pptx
Physiochemical properties of nanomaterials and its nanotoxicity.pptxPhysiochemical properties of nanomaterials and its nanotoxicity.pptx
Physiochemical properties of nanomaterials and its nanotoxicity.pptx
 
Animal Communication- Auditory and Visual.pptx
Animal Communication- Auditory and Visual.pptxAnimal Communication- Auditory and Visual.pptx
Animal Communication- Auditory and Visual.pptx
 
Biological Classification BioHack (3).pdf
Biological Classification BioHack (3).pdfBiological Classification BioHack (3).pdf
Biological Classification BioHack (3).pdf
 
Recombinant DNA technology (Immunological screening)
Recombinant DNA technology (Immunological screening)Recombinant DNA technology (Immunological screening)
Recombinant DNA technology (Immunological screening)
 
Formation of low mass protostars and their circumstellar disks
Formation of low mass protostars and their circumstellar disksFormation of low mass protostars and their circumstellar disks
Formation of low mass protostars and their circumstellar disks
 
A relative description on Sonoporation.pdf
A relative description on Sonoporation.pdfA relative description on Sonoporation.pdf
A relative description on Sonoporation.pdf
 
Work, Energy and Power for class 10 ICSE Physics
Work, Energy and Power for class 10 ICSE PhysicsWork, Energy and Power for class 10 ICSE Physics
Work, Energy and Power for class 10 ICSE Physics
 
CELL -Structural and Functional unit of life.pdf
CELL -Structural and Functional unit of life.pdfCELL -Structural and Functional unit of life.pdf
CELL -Structural and Functional unit of life.pdf
 
Artificial Intelligence In Microbiology by Dr. Prince C P
Artificial Intelligence In Microbiology by Dr. Prince C PArtificial Intelligence In Microbiology by Dr. Prince C P
Artificial Intelligence In Microbiology by Dr. Prince C P
 
Engler and Prantl system of classification in plant taxonomy
Engler and Prantl system of classification in plant taxonomyEngler and Prantl system of classification in plant taxonomy
Engler and Prantl system of classification in plant taxonomy
 
Labelling Requirements and Label Claims for Dietary Supplements and Recommend...
Labelling Requirements and Label Claims for Dietary Supplements and Recommend...Labelling Requirements and Label Claims for Dietary Supplements and Recommend...
Labelling Requirements and Label Claims for Dietary Supplements and Recommend...
 
Spermiogenesis or Spermateleosis or metamorphosis of spermatid
Spermiogenesis or Spermateleosis or metamorphosis of spermatidSpermiogenesis or Spermateleosis or metamorphosis of spermatid
Spermiogenesis or Spermateleosis or metamorphosis of spermatid
 
Is RISC-V ready for HPC workload? Maybe?
Is RISC-V ready for HPC workload? Maybe?Is RISC-V ready for HPC workload? Maybe?
Is RISC-V ready for HPC workload? Maybe?
 
Biopesticide (2).pptx .This slides helps to know the different types of biop...
Biopesticide (2).pptx  .This slides helps to know the different types of biop...Biopesticide (2).pptx  .This slides helps to know the different types of biop...
Biopesticide (2).pptx .This slides helps to know the different types of biop...
 

Keynote at VR in Science and Industry

  • 1. Christian@Sandor.com 6 October 2020 Augmented Reality Evangelist Co-Director Associate Professor Retrospective of My Last 20 years as AR Researcher
  • 2. Matt Swoboda, Thanh Nguyen, Ulrich Eck, Gerhard Reitmayr, Stefan Hauswiesner, Rene Ranftl, and Christian Sandor. Demo at IEEE International Symposium on Mixed and Augmented Reality, Basel, Switzerland, October 2011. Best Demo Award BURNAR: FEEL THE HEAT
  • 3.
  • 4. Peter Weir, Christian Sandor, Matt Swoboda, Thanh Nguyen, Ulrich Eck, Gerhard Reitmayr, and Arindam Dey. Proceedings of the IEEE Virtual Reality Conference, pages 43–46, Orlando, FL, USA, March 2013. BURNAR: INVOLUNTARY HEAT SENSATIONS IN AR
  • 5. RECENT INVESTMENTS INTO AR & VR 3/2014: Facebook buys Oculus 2 Billion USD 10/2014: Google and others invest into Magic Leap 542 Million USD 1/2015: Microsoft releases Hololens 1 Billion USD 3/2018: More investments into Magic Leap; total now 2.3 Billion USD
  • 6.
  • 7. The End of Hardware. Rolf R. Hainich. ISBN 1-4196-3036-9. 2006 VISION OF AR: ONE DISPLAY TO REPLACE ALL OTHERS
  • 8. RECENT ADVANCES Retinal 3D: Augmented Reality Near-Eye Display Via Pupil-Tracked Light Field Projection on Retina. Changwon Jang, Kiseung Bang, Seokil Moon, Jonghyun Kim, Seungjae Lee, and Byoungho Lee. ACM Transactions on Graphics 36(6):1-13. 2017 SEOKIL MOON, Seoul National University JONGHYUN KIM, Seoul National University SEUNGJAE LEE, Seoul National University BYOUNGHO LEE, Seoul National University Fig. 1. A) Overview of Retinal 3D. The proposed near-eye display provides virtual images with focus cues by generatin real-time tracking that can then be directly projected onto the retina. Pupil-tracked light field generation can reduce load as well as provide the eye-box that can overcome the drawbacks of retinal projection-type displays. B) A prototy results showing the generation of focus cues. D) Demonstration of full-color 3D augmented reality. We introduce an augmented reality near-eye display dubbed “Retinal 3D.” Key features of the proposed display system are as follows: Focus cues are pro- vided by generating the pupil-tracked light eld that can be directly projected onto the retina. Generated focus cues are valid over a large depth range since laser beams are shaped for a large depth of eld (DOF). Pupil-tracked light eld generation signicantly reduces the needed information/computation load. Also, it provides “dynamic eye-box” which can be a break-through that overcome the drawbacks of retinal projection-type displays. For im- Additional Key Words and Phrases: putational displays, holographic opti conict ACM Reference format: Changwon Jang, Kiseung Bang, Seok and Byoungho Lee. 2017. Retinal 3D Via Pupil-Tracked Light Field Projec
  • 9. Benjamin Avery, Christian Sandor, Bruce H. Thomas. Improving Spatial Perception for Augmented Reality X-Ray Vision. In Proceedings of the IEEE Virtual Reality Conference, pages 79–82. IEEE, March 2009. Lafayette, Louisiana, USA. EDGE-BASED X-RAY
  • 10.
  • 11. Google Faculty Award (2014) AR X-RAY FOR GOOGLE GLASS
  • 13. CURRENT WORK: MEDICAL APPLICATIONS Locations: Worcester – Gold Start Blv. 508-856-9510, Back to Work Center 508-854-2426, Worcester Medical Center 508- 368-3143 Westboro 508-871-0789 Leominster 978-840-1900 Charlton 508-248-4141 Disclaimer: If you experience pain or worsening of symptoms call doctors office and stop doing your exercises. Internet Access: www.fallonclinic.org Click on Medical Services, Specialty Care, Rehabilitation, Informative Exercise Sheets Rehabilitation Sports Medicine Frozen Shoulder SHOULDER - 26 Range of Motion Exercises: Pendulum (Circular) Let arm move in a circle clockwise, then counter- clockwise, by rocking body weight in a circular pattern. Repeat 10 times. Do 3-5 sessions per day. SHOULDER - 7 Range of Motion Exercises (Self-Stretching Activities): Flexion Sitting upright, slide forearm forward along table, bending from waist until a stretch is felt. Hold 30 seconds. Repeat 1-4 times Do 1 session per day. SHOULDER - 11 Range of Motion Exercises (Self-Stretching Activities): External Rotation (alternate) Keep palm of hand against door frame, and elbow bent at 90°. Turn body from fixed hand until a stretch is felt. Hold 30 seconds. Repeat 1-4 times Do 1 session per day. SHOULDER - 9 Range of Motion Exercises (Self- Stretching Activities): Abduction With arm resting on table, palm up, bring head down toward arm and simultaneously move trunk away from table. Hold 30 seconds. Repeat 1-4 times Do 1 session per day. SHOULDER - 73 Towel Stretch for Internal Rotation Pull involved arm up behind back by pulling towel upward with other arm. Hold 30 seconds. Repeat 1-4 times Do 1 session per day. SCAP SETS Pull your shoulders back, pinching the shoulder blades together. Do not let the shoulders come forward. Hold 5-10 seconds. Repeat 10 times Do 1 session per day.
  • 15. Collaboration with Jockey Club College of Veterinary Medicine, Johns Hopkins University (USA), and TU Munich (Germany) AUGMENTED REALITY X-RAY FOR CANINE HEALTH CARE Image adapted from 3D4Medical Image adapted from Shutterstock 2009
  • 16. CONCLUSIONS: 20 YEARS OF AR My Past: serious applications consumer, medical (automotive, industrial, military) 2009 2020
  • 18. Nurikabe Kappa Tengu Long neck woman Big centipede Mokumokuren Nopperabou Tsuchigumo Nurarihyon Paper umbrella haunted Umibouzu Gasyadokuro
  • 20.
  • 21.
  • 22. CONCLUSIONS: 20 YEARS OF AR My past: serious applications consumer, medical (automotive, industrial, military) 2009 2020 2011 2016 My future in Hong Kong: AR for science, art entertainment
  • 23. Christian@Sandor.com 6 October 2020 Augmented Reality Evangelist Co-Director Associate Professor the future
  • 24.
  • 26. KHRONOS PROJECTOR. ALVARO CASSINELLI [2004]
  • 27. ALVARO’S SPECIALITY: HIGH-SPEED OPTO-ELECTRONICS https://www.youtube.com/watch?v=QDppJ9NWtaE
  • 28. FIRST PAPER OF ALVARO CHRIS Alan Turing. Computing Machinery and Intelligence. Mind, 59 (236): 433–460, October 1950. Inspired by Alan Turing’s imitation game 1. undetectable modification of user’s perception 2. goal: seamless blend of real and virtual world CHANGWON JANG, Seoul National University KISEUNG BANG, Seoul National University SEOKIL MOON, Seoul National University JONGHYUN KIM, Seoul National University SEUNGJAE LEE, Seoul National University BYOUNGHO LEE, Seoul National University Fig. 1. A) Overview of Retinal 3D. The proposed near-eye display provides virtual images with focu real-time tracking that can then be directly projected onto the retina. Pupil-tracked light field gen load as well as provide the eye-box that can overcome the drawbacks of retinal projection-type dis results showing the generation of focus cues. D) Demonstration of full-color 3D augmented reality We introduce an augmented reality near-eye display dubbed “Retinal 3D.” Key features of the proposed display system are as follows: Focus cues are pro- vided by generating the pupil-tracked light eld that can be directly projected onto the retina. Generated focus cues are valid over a large depth range since laser beams are shaped for a large depth of eld (DOF). Pupil-tracked light eld generation signicantly reduces the needed information/computation load. Also, it provides “dynamic eye-box” which can be a break-through that overcome the drawbacks of retinal projection-type displays. For im- plementation, we utilized a holographic optical element (HOE) as an image combiner, which allowed high transparency with a thin structure. Compared with current augmented reality displays, the proposed system shows com- petitive performances of a large eld of view (FOV), high transparency, high contrast, high resolution, as well as focus cues in a large depth range. Two prototypes are presented along with experimental results and assessments. Analysis on the DOF of light rays and validity of focus cue generation are Additional Key W putational display conict ACM Reference Changwon Jang, and Byoungho Le Via Pupil-Tracked 6, Article 190 (No DOI: 10.1145/313 1 INTRODU e emergence Christian Sandor, Martin Fuchs, Alvaro Cassinelli, Hao Li, Richard Newcombe, Goshiro Yamamoto, and Steven Feiner. Breaking the Barriers to True Augmented Reality. ArXiv e-prints, arXiv:1512.05471 [cs.HC], 13 pages, December 2015.
  • 29. INTERACTIVE MINIMAL LATENCY LASER GRAPHICS PIPELINE 2009 Jayson Haebich, Christian Sandor, and Alvaro Cassinelli. Accepted for SIGGRAPH Asia Emerging Technologies. 2020
  • 31.
  • 32. Christian@Sandor.com 6 October 2020 Augmented Reality Evangelist Co-Director Associate Professor the future
  • 34. AR/ VR GOVERNMENTAL PROJECTS IN CHINA
  • 35. AR/ VR GOVERNMENTAL PROJECTS IN CHINA Chengdu: Virtual Reality Industry Development and Promotion Plan Chongqing: Opinions on Accelerating the Development of The Virtual Reality Industry Guiyang: Ten Policies of Gui'an New District on Supporting the Development of Virtual Reality Industry Fuzhou: Ten Measures to Accelerate the Development of VR Industry Changsha: Development Plan for Virtual Reality Industry Nanchang: Policies on Accelerating the Development of VR/AR Industry Shenzhen: Special Support Fund Application Guide for AR/VR Industry Xiamen: Development Plan for AR/VR Industry (2017-2022) Jiaxing: Plan for AR/VR Industry (2017-2020) Hefei: Agreement on Strategic Cooperation of VR Production- Education Integration Qingdao: Implementation Rules for Promoting the Development of Virtual Reality Industry in Laoshan District Beijing: Several Measures to Promote the Innovation and Development of Virtual Reality Industry in Zhongguancun Weifang: Supporting Policy of Building 100 Billion-Level VR Industry
  • 36. AR/ VR GOVERNMENTAL PROJECTS IN CHINA Chengdu: Virtual Reality Industry Development and Promotion Plan Chongqing: Opinions on Accelerating the Development of The Virtual Reality Industry Guiyang: Ten Policies of Gui'an New District on Supporting the Development of Virtual Reality Industry Fuzhou: Ten Measures to Accelerate the Development of VR Industry Changsha: Development Plan for Virtual Reality Industry Nanchang: Policies on Accelerating the Development of VR/AR Industry Shenzhen: Special Support Fund Application Guide for AR/VR Industry Xiamen: Development Plan for AR/VR Industry (2017-2022) Jiaxing: Plan for AR/VR Industry (2017-2020) Hefei: Agreement on Strategic Cooperation of VR Production- Education Integration Qingdao: Implementation Rules for Promoting the Development of Virtual Reality Industry in Laoshan District Beijing: Several Measures to Promote the Innovation and Development of Virtual Reality Industry in Zhongguancun Weifang: Supporting Policy of Building 100 Billion-Level VR Industry 1.2 Billion EURO 600 Million EURO
  • 37. AR/ VR COMPETENCE CENTERS Nanchang Virtual Reality Testing Technology Co., Ltd. Qingdao Jinggong VR Research Institute Beijing Engineering Research Center of Interactive Media Arts BIT (Nanchang) VR Standard Testing and Evaluation Centre Beijing Engineering Research Center for Mixed Reality and Advanced Display Technology
  • 38. KEY PEOPLE AT BAYVR: SCIENTIFIC DIRECTION SCHOOL OF OPTICS AND PHOTONICS BEIJING INSTITUTE OF TECHNOLOGY Professor Yongtian Wang Professor Yue Liu Associate Professor Liqun Wang
  • 39. KEY PEOPLE AT BAYVR: EXTERNAL EXPERTS
  • 40.
  • 41.
  • 42.
  • 43.
  • 44. CONCLUSIONS: 20 YEARS OF AR My past: serious applications consumer, medical (automotive, industrial, military) 2009 2020 2011 2016 My future in Hong Kong: AR for science, art entertainment