Augmented Reality for Medical Education - Presented at Society for Technology in Anesthesia Mind and Machine 2019 Annual Conference, Scottsdale, January 9-12. Eric B. Bauman, PhD, FSSH

1. A u g m e n t e d R e a l i t y f o r
M e d i c a l E d u c a t i o n
Mind and Machine
2019 Annual Conference
January 9-12, 2019
Scottsdale, AZ
ERIC B. BAUMAN, PHD, FSSH, RN

2. ERIC B. BAUMAN, PHD, FSSH, RN
D i s c l o s u r e s
Executive Board Member
Wisconsin Games Alliance
Founder & Managing Member
Clinical Playground, LLC
Other Membership/Affiliations:
Society for Simulation in Healthcare
International Nursing Assoc. for Clinical Simulation & Learning
Sigma Theta Tau
Association Medical Educators Europe
International Association of Medical Science Educators

3. Objectives
• Participants will be able to
define Augmented Reality or
AR
• Participants will able to identify
variables that exist within the
paradigm of AR that alter user
perception of the real world
• Participants will be introduced
pedagogy that supports real-
time learning that is
complimentary to traditional
bricks & mortar and mannikin-
based simulation

4. Augmented Reality
Augmented Reality (AR) supplements the real-world such that
actual objects existing in the real-world appear to coexist with
virtual objects, computer generated images or artifacts that are
representations of actual objects.
In Short: Augment the real world with virtual objects
Azuma, R., Baillot, Y., Behringer, R., Feiner, S., Julier, S., & MacIntyre, B. (2001)
Bauman, E. B. (2012). Game-based Teaching and Simulation in Nursing & Healthcare. New York, NY: Springer Publishing Company.
Palmarini, R., Erkoyuncu, J. A., Roy, R., & Torabmostaedi, H. (2018). A systematic review of augmented reality applications in maintenance. Robotics and Computer-Integrated Manufacturing, 49, 215-228.
Univ. of Pittsburgh Simulation & Medical Technology Center

5. Contemporary Pedagogy: Simulation to Practice Pathway

6. Effective
AppealingEfficient
MEET THE CEO
Refers to a good or service being offered by a
company ideally a product
ABOUT US
Refers to a good or service being offered by a
company ideally a product
WELCOME MESSAGE
Refers to a good or service being offered by a
company ideally a product
B
C
A
VENN SLIDE
Your Subtitle Here
Contemporary Pedagogy:
Bauman’s Layered Learning theory
Didactic
Preparation
Interactive
AR/VR
Games
Application
.
Task Trainer
Standardized Pt
Simulator
Real World
Experience
©Bauman, 2013, 2019 Rights Reserved

7. Effective
AppealingEfficient
MEET THE CEO
Refers to a good or service being offered by a
company ideally a product
ABOUT US
Refers to a good or service being offered by a
company ideally a product
WELCOME MESSAGE
Refers to a good or service being offered by a
company ideally a product
B
C
A
VENN SLIDE
Your Subtitle Here
Is AR a Good Fit for your Curriculum
Proper Fit
Bauman, E. B. and Ralston-Berg, P. (2014). Virtual Simulation and Game-Based Learning. In J. Palaganas, J. Maxworthy, C. Epps, and M.E.
Mancini (Eds). Defining Excellence in Simulation. Wolters Kluwe – Lippincott Williams & Wilkins.

8. AppealingEfficient
MEET THE CEO
Refers to a good or service being offered by a
company ideally a product
ABOUT US
Refers to a good or service being offered by a
company ideally a product
WELCOME MESSAGE
Refers to a good or service being offered by a
company ideally a product
B
C
A
VENN SLIDE
Your Subtitle Here
Adoption of AR for Medical and Clinical Education:
Where are we now…
https://en.wikipedia.org/wiki/Hype_cycle

9. AppealingEfficient
MEET THE CEO
Refers to a good or service being offered by a
company ideally a product
ABOUT US
Refers to a good or service being offered by a
company ideally a product
WELCOME MESSAGE
Refers to a good or service being offered by a
company ideally a product
B
C
A
VENN SLIDE
Your Subtitle Here
Adoption of AR for Medical and Clinical Education:
Where are we now…

10. AppealingEfficient
MEET THE CEO
Refers to a good or service being offered by a
company ideally a product
ABOUT US
Refers to a good or service being offered by a
company ideally a product
WELCOME MESSAGE
Refers to a good or service being offered by a
company ideally a product
B
C
A
VENN SLIDE
Your Subtitle Here
Adoption of AR for Medical and Clinical Education:
Where are we now…
From remote surgery to X-ray vision, doctors are showing other industries how to use AR/VR
November 30, 2018
https://qz.com/1479385/from-remote-surgery-to-x-ray-vision-doctors-are-showing-other-industries-how-to-use-ar-vr/?fbclid=IwAR2qaeOj2-CPTHyvMTVuTDxZ8H7fpdhRHuuxVTK9cQ8MLnkdvhBvbCjjFVM
Combination of AR/VR is know as Extended Reality (XR)
Collapses distance between information, people and experiences – particularly useful for
education
Immersive Streaming Education
Potential for increased retention
Clinical uses:
Heads-Up-Display during surgical and invasive procedures leveraging DICOM data
FDA Approval: OpenSight Augmented Reality System
https://www.healthimaging.com/topics/advanced-visualization/fda-approves-augmented-reality-system-microsoft-hololens
FDA approves first Microsoft HoloLens augmented reality system for surgical use
October 18, 2018

11. Adoption of AR for Medical and Clinical Education:
Autonomous Intelligent Mentoring (AIM) – Endotracheal Intubation
Geoffrey Miller, MS & Andrew Cross
Research Scientist at Medical Modeling and Simulation Innovation Center (MMSIC), TATRC, US Army MRMC
Eastern Virginia School of Medicine
Institute of Medicine/Society for Simulation in Healthcare Leading Innovator Award
Forum on Innovation in Health Professional Education Workshop

12. Adoption of AR for Medical and Clinical Education:
Anesthesia Specific Lit Review
Diana M.; Soler L.; Agnus V.; D’Urso A.; Vix M.; Dallemagne B.; Faucher V.; Roy C.; Mutter D.; Marescaux J., Pessaux P. (2017). “Prospective evaluation of
precision multimodal gallbladder surgery navigation: virtual reality, near-infrared fluorescence, and x- ray-based intraoperative cholangiography”. Annals of
Surgery 266(5), pp. 890–897. doi: 10.1097/SLA.0000000000002400.
Rochlen L. R.; Levine R., Tait A. R. (2017). “First-person point-of-view-augmented reality for central line insertion training: A usability and feasibility study”.
Simulation in Healthcare 12(1), pp. 57–62. doi: 10.1097/SIH.0000000000000185.
Won Y-J., Kang S-H. (2017). “Application of augmented reality for inferior alveolar nerve block anesthesia: A technical note.” Journal of Dental Anesthesia and
Pain Medicine 17(2), pp. 129–134. doi: 10.17245/jdapm.2017.17.2.129.
Jeon Y.; Choi S., Kim H. (2014). “Evaluation of a simplified augmented reality device for ultrasound-guided vascular access in a vascular phantom.” Journal of
Clinical Anesthesia 26(6), pp. 485–489. doi: 10.1016/j.jclinane.2014.02.010.
Al-Deen Ashab H.; Lessoway V. A.; Khallaghi S.; Cheng A.; Rohling R., Abolmaesumi P. (2013). “An augmented reality system for epidural anesthesia (AREA):
Prepuncture identification of vertebrae.” IEEE Transactions on Bio-medical Engineering 60(9), pp. 2636– 2644. doi: 10.1109/TBME.2013.2262279.
Al-Deen Ashab H.; Lessoway V. A.; Khallaghi S.; Cheng A.; Rohling R., Abolmaesumi P. (2012). “AREA: An augmented reality system for epidural anaesthesia.”
In: Annual International Conference of the IEEE Engineering in Medicine and Biology Society. Vol. 2012. San Diego, CA: IEEE Engineering in Medicine and
Biology Society, pp. 2659–2663. doi: 10.1109/EMBC.2012.6346511.
Del Castillo A. S., Sardi N. S. (2012). “Augmented reality: Can it enrich the practice of anesthesiology?” Revista Brasileira de Anestesi- ologia 62(6), pp. 887–
888. doi: 10.1016/S0034-7094(12)70190-3.
Moore J.; Clarke C.; Bainbridge D.; Wedlake C.; Wiles A.; Pace D., Peters T. (2009). “Image guidance for spinal facet injections using tracked ultrasound.”
Medical Image Computing and Computer-assisted Intervention (Pt 1), pp. 516–523.
Special Thanks Gregory E. Glibert EdD

13. Contact Information
@bauman1967
ebauman@clinicalplayground.com
www.clinicalplayground.com
linkedin.com/in/ericbbauman