Dr. James Birt emphasizes the integration of mixed reality pedagogy into education, highlighting the evolving job landscape influenced by technology and the importance of skills such as communication and creative thinking. The document discusses the necessity for educational methods to adapt, particularly in the fields of interactive media and design, and how mixed reality can enhance learning experiences. It also addresses the challenges and reflections from paramedic distance education regarding the use of simulations and technology in skill acquisition.

1. Integrating Mixed Reality
Pedagogy into Education
DR JAMES BIRT

2. Dr. James Birt
bond.edu.au/profile/dr-james-birt
Multi-dimensional defines my 20 year
industry and academic career, but
gaming is my 34 year passion

3. THE FUTURE OF JOBS
CHECK YOUR

4. Affinity
What you love
LackPassion
Opportunity
What is wanted
Ability
What you’re good
at
CHOOSING A JOB: PASSION OR PRAGMATISM?
Sweet Spot

5. MY FIRST JOB
WITH GAMES
(1999-2000)
Farming Lower Guk in
Vanilla EverQuest in search
of the Shining Metallic
Robes, Short Sword of
Ykesha and the Flowing
Black Silk Sash and selling
on eBay
Affinity
What you love:
Playing
EverQuest
Ability
What you’re
good at:
Farming
Opportunity
What is
wanted: Virtual
Loot

6. MY CURRENT JOB
WITH GAMES
(2010 - Today)
Affinity
What you love:
Games and
Education
Ability
What you’re
good at:
Communicating
Opportunity
What is wanted:
Communicators
that understand
Tech and
Games
Associate Professor and
discipline lead for Interactive
Media and Design where I
coordinate the Mixed Reality
Research Lab and
Communicate on Technology
and Games

7. My Office – Still
Features Kings Quest,
World of Warcraft and
EverQuest!

8. YOUR FUTURE JOB COULD
INVOLVE CREATING
PERSONALITIES FOR
ROBOTS
Jobs Aussies can expect to emerge in the
future
Melanie Burgess News Corp May 11, 2018

9. BUT IS THIS JUST A TECHNOLOGY GIMMICK?
youtu.be/cUR-eYDAz9w

10. GOOGLE DUPLEX DEMO: Google IO (May 9, 2018)
youtu.be/bd1mEm2Fy08?t=1m10s youtu.be/bd1mEm2Fy08?t=3m
NEW roles are created daily as a result of changing technologies and
customer expectations. Workers hoping to remain employable must look
ahead and prepare for what is coming.

11. WHAT ABOUT A JOB IN ESPORTS?
The Project – Game on – rise of eSports

12. “Most of the job titles will be the same as today … we will still have carpenters, nurses, road repairers, even teachers ... but the
nature of what they do and the skills they need will change … just as they have over the past 20 years”
Ron Johnston Executive Director, Australian Centre for Innovation, University of Sydney; The Conversation (Aug 2, 2016)

13. AREN’T ALL
MILLENNIALS
DIGITAL NATIVES?
• “[Millennials] are prolific users of [digital
technology] … do not assume that they are
[proficient users] … the increased use of
technology is primarily for [social media and
communications] … use doesn't mean learning
deeper skills … that requires explicit teaching”
• Australian Curriculum Assessment and Reporting
Authority CEO; ABC News (Nov 17, 2015)
PROLIFIC USERS OF DIGITAL
TECHNOLOGY

14. WHAT ARE THE SKILLS
AND STRATERGIES
REQUIRED TO THRIVE
IN THE NEW
LANDSCAPE?

15. Gartner 2018 Emerging Technology Hype Cycle

16. “Very clear, strong trend between the creative content of a job and its probability of
computerisation and replacement by robots” - Oxford Professor Michael Osbourne
2018 Future of Jobs Report – Core Work Skills

18. T H E C H A N G E I N D E M A N D F O R C O R E W O R K - R E L AT E D S K I L L S
Its not about any one
technology or learning a tool it’s
about:
communication, creative
thinking, problem solving, agility,
digital skills and
entrepreneurship

19. Changing Face of Classrooms

20. EDUCAUSE Horizon Report: 2018 Higher Education Edition
Samantha Adams Becker, Malcolm Brown, Eden Dahlstrom, Annie Davis, Kristi DePaul, Veronica Diaz,
and Jeffrey Pomerantz. NMC Horizon Report: 2018 Higher Education Edition. Louisville, CO:
EDUCAUSE, 2018.

21. NMC/CoSN Horizon Report: 2017 K-12 Edition
Freeman, A., Adams Becker, S., Cummins, M., Davis, A., and Hall Giesinger, C. (2017). NMC/CoSN
Horizon Report: 2017 K–12 Edition. Austin, Texas: The New Media Consortium.

22. Mixed Reality – Intersection of Virtual & Physical Realities
Milgram, P., & Kishino, F. (1994). A taxonomy of mixed reality visual displays. IEICE Transactions on
Information and Systems, 77(12), 1321-1329.

23. Mixed Reality Relevance for Teaching & Learning

24. Mixed Reality Research Lab
www.mixedrealityresearch.com

25. Research Led Teaching Approach

26. www.mixedrealityresearch.com/#spatialCommTraditional Teaching Method
Comparative Design Visualisation of Space & Place

27. Traditional Teaching Method
27
www.mixedrealityresearch.com/#anatomy
Learning Anatomy & Physiology

28. www.mixedrealityresearch.com/#networkModeling
Traditional Teaching Method
28
Simulating Network Packet Flow

29. www.mixedrealityresearch.com/#paramedics
Traditional Teaching Method
29
Simulating Airways Training for Paramedics

30. How do we achieve this?

31. Pedagogy before Technology

32. Traditional Teaching Method
“this course is a 'skills' learning course
… there should be a way for us to
actually get more time doing skills …
distance students at a severe
disadvantage … I am missing out … you
can read about the skills but its
impossible to get feedback and to know
if you’re doing it right … no substitution
for experience … any software or
equipment to at least go through the
motions of doing the skills?” Paramedic Student
Learner(s) (201x-2014)
32
Paramedic Distance Education: The Problem

33. • [Discipline expert] we need every student to have a
portable airways mannequin & cheap tools to practice the
skills - but cost is prohibitive … residential schools work
… but not held early enough for students
• [Mixed Reality Team] tools could be provided to students
by 3D printing them (cost/set) ~ $1 AUD + postage
• [Mixed Reality Team] Airways mannequin could be
simulated virtually using a mobile phone
• [Discipline expert] students would need both hands free,
so the phone would need to be mounted in their eyeline
• [Mixed Reality Team] we can provide a hat and 3d printed
hat mount
• [Mixed Reality Team] A simulation app can then be
constructed using a free game engine [Unity3d] that could
observe and monitor [learner] skills
33
Paramedic Distance Education: Solving

34. Needtocreatea1:1mappingoftheskills
34
Paramedic Distance Education: Technology V1

35. • [Learners] were very excited … [practice] the skills at home ... [learner]
more involved in the course & less isolated
• [Observers] found most [learners] struggled with the setup of the
equipment & progression through the required steps … especially when
introducing the Magill forceps & removing the foreign body
• [Learners] commented “my hands seem to pass by the [simulated
airways manikin]” ... “spent too much time focusing on the markers & not
on the [simulated airways manikin] … resulting in frustration when the
simulation would present red boxed & restart
• Many [learners] commented that they did not get around to using the
[simulation] highlighting time struggles and being “extra” work
• [Head Paramedic] on reflection should have encouraged more frequent
use of the simulation with a reminder & linkage to the learning tasks
35
Paramedic Distance Education: Reflection

36. SolveV1issuesbutkeeplearningoutcomes
36
Paramedic Distance Education: Revision

37. • Unity3d game engine (www.unity3d.com)
• Vuforia augmented reality plugin
(www.vuforia.com)
• MySQL (www.mysql.com)
• Php (secure.php.net)
• Google Cardboard headset
(vr.google.com/cardboard)
• Makerbot 3D Printer (www.makerbot.com)
• Oculus Rift (www.oculus.com)
• Leap Motion (www.leapmotion.com)
• HTC VIVE (www.vive.com)
• Adobe Creative
(www.adobe.com/CreativeCloud)
• MANY MORE!
37
MIXED REALITY AND VIRTUAL PROTOTYPING TOOLS

38. BACHELOR OF INTERACTIVE MEDIA & DESIGN
bond.edu.au/imd
Latest News in Technology, Design & Society
flip.it/0TTuUW
Creative problem solving through
design & the latest technology

39. WHERE ARE THEY NOW?
Front End Engineer
Airwallex (pre Deloitte Digital)
TAYLOR
BETT
Interactive Experience Design Manager
Deloitte Digital
PAUL
CIAPPARA
SAXON
CAMERON
Senior Front End Consultant
Deloitte Digital
Directors Assistant
Seven Network
GEORDI AVILA
Interactive Experience Designer
Apple
AMY McGINTY PRISCILLA FOX
Digital Designer + Developer
Oracle

40. Education is about mentoring
inspiring young minds full of
inquisitive thought, entrepreneurship,
a love of creativity, design and
technology, and helping them set
goals and channel their creative
energies to solve real world
problems.

41. Integrating Mixed Reality
Pedagogy into Education
www.mixedrealityresearch.com
DR JAMES BIRT
Questions?