Presentation of a co-authored paper with Christian Sailer, David Rudi, Kuno Kurzhals, Martin Raubal (ETH Zurich GIS, Switzerland) mLearn19 September 16.- 18. 2019, Delft (NL) Presented at #mlearn19 in Delft, NL http://iamlearn.org/mlearn/

1. ||
Christian Sailer, David Rudi, Kuno Kurzhals, Martin Raubal (ETH Zurich GIS, Switzerland)
mLearn19 September 16.- 18. 2019, Delft (NL)
Towards Seamless Mobile Learning with
Mixed Reality on Head-Mounted Displays

2. ||
Christian Sailer, David Rudi, Kuno Kurzhals, Martin Raubal (ETH Zurich GIS, Switzerland)
mLearn19 September 16.- 18. 2019, Delft (NL)
Towards Seamless Mobile Learning with
Mixed Reality on Head-Mounted Displays

3. || 13.06.2019
34
Fish
AR Delft
#mlearn19
DISTRACTION by centering the
gaze on the SMALL DISPLAY

4. || 13.06.2019
https://iveybusinessjournal.com/the-real-story-about-augmented-reality/
GAME LIMITATIONS due the
SMALL VIEWING FRUSTUM

5. || 13.06.2019
https://medicalxpress.com/news/2018-02-addicted-smartphones-social-interaction.html
INTERACTION LIMITATIONS due the
hands are HOLDING the device

6. ||
Defiences in self-regulated and seamless
mobile learning on hand-held devices
Screen
Size
Field of
View
Human-Computer
Interaction
13.06.2019Towards Seamless Mobile Learning with Mixed Reality on HMDs

7. ||
210°
Hand-held vs. Head-Mounted
50°
13.06.2019Towards Seamless Mobile Learning with Mixed Reality on HMDs
AR Display Idea:
AR Device that is CLOSE to human’s eye (head-mounted)
and covers user field-of-view ENTIRELY

8. ||
 Contextual support  Peer-to-peer communication
Inquiry-based learning activities (Suàrez et al. 2018)
13.06.2019Towards Seamless Mobile Learning with Mixed Reality on HMDs
Suárez,Á.,Specht,M.,Prinsen,F.,Kalz,M.,&Ternier,S.(2018).Areviewofthetypesofmobile
activitiesinmobileinquiry-basedlearning.Computers&Education,118,38–55.

9. ||
for Seamless Mobile Learning Scenarios with
Mixed Reality on Head-Mounted Displays
A set of design examples and research directions
A set of design examples and research directions

10. ||
A set of design examples and research directions for
Seamless Mobile Learning Scenarios
GIS Interactions
(Contextual Support)
 Immersive simulations
 Geographical modeling
 Geospatial analysis
Human Interactions
(Peer-to-Peer Communication)
 Gaze-based interaction
 Close Collaboration
 Remote Collaboration

11. || 13.06.2019
GIS Interactions
Delft 3d

12. ||
3D simulations of past and future scenarios
Immersivesimulations
Top:
ArcGISWebScene
https://arcg.is/1rHei4
Data:https://www.kadaster.nl/producten/woning/kadastrale-kaart
Bottom:
GoogleStreetView
https://www.google.ch/maps/@52.0042625,4.3615689,3a,75y,139.18h,89.57t/data=!3m6!1e1!3m4!1s1s_Wpx8pnZQ38OLQg-
wKiQ!2e0!7i13312!8i6656

13. ||
Construction of physical and abstract models
Geographicalmodeling
Top:
ArcGISWebScene
https://arcg.is/1rHei4
Data:https://www.kadaster.nl/producten/woning/kadastrale-kaart
Bottom:
GoogleStreetView
https://www.google.ch/maps/@52.0042625,4.3615689,3a,75y,139.18h,89.57t/data=!3m6!1e1!3m4!1s1s_Wpx8pnZQ38OLQg-
wKiQ!2e0!7i13312!8i6656

14. ||
Shadow or sight calculations
Geospatialanalysis
Top:
ArcGISWebScene
https://arcg.is/1rHei4
Data:https://www.kadaster.nl/producten/woning/kadastrale-kaart
Bottom:
GoogleStreetView
https://www.google.ch/maps/@52.0042625,4.3615689,3a,75y,139.18h,89.57t/data=!3m6!1e1!3m4!1s1s_Wpx8pnZQ38OLQg-
wKiQ!2e0!7i13312!8i6656

15. || 13.06.2019
Human Interactions

16. ||
Visual and tactile examination, voice feedback
Gaze-basedInteraction
GoogleStreetView
https://www.google.ch/maps/@52.0042625,4.3615689,3a,75y,139.18h,89.57t/data=!3m6!1e1!3m4!1s1s_Wpx8pnZQ38OLQg-
wKiQ!2e0!7i13312!8i6656

17. ||
Recording and playback of face-to-face events
CloseCollabarotion
OMLETHFieldtripTecDayChurOMLETH:
https://www.satw.ch/fileadmin/user_upload/documents/03_Dialog/02_TecDays_TecNights/TecDay_Chur_2016.pdf
10:25
AM

18. ||
Holographic telepresence and remote inquiries
RemoteCollabarotion
Top:
OMLETHFieldtripTecDayChurOMLETH:
https://www.satw.ch/fileadmin/user_upload/documents/03_Dialog/02_TecDays_TecNights/TecDay_Chur_2016.pdf
ttps://www.satw.ch/fileadmin/user_upload/documents/03_Dialog/02_TecDays_TecNights/TecDay_Chur_2016.pdf
Bottom
GoogleStreetView
https://www.google.com/maps/place/Chur,+Switzerland/@46.8507835,9.5319859,3a,75y,90t/data=!3m8!1e2!3m6!1sAF1QipMqqPkMU
oELq6A6u9dysY6U7CWLlawWrzomVX1F!2e10!3e12!6shttps:%2F%2Flh5.googleusercontent.com%2Fp%2FAF1QipMqqPkMUoELq6A
6u9dysY6U7CWLlawWrzomVX1F%3Dw203-h270-k-
no!7i3036!8i4048!4m5!3m4!1s0x4784c7768af75b55:0x2b4f78a6d7011f30!8m2!3d46.8507835!4d9.531985
R: Hello!
N: Could you..
R: Wait..

19. ||
Current shortcoming
Image: HYPER-REALITY
A provocative and kaleidoscopic new vision of the future, where physical and virtual realities have merged, and the city is saturated in media…
13.06.2019
Hardware Limitations
Notification Terror
Misconceptions Real-World Problems ?

20. ||
 We identify several opportunities for seamless mobile learning activities
concerning contextual support and peer-to-peer interactions presented in
Suárez et al. (2018).
 We state challenges (e.g., hardware limitations, cognitive overload, situational
awareness distractions).
 We believe AR technology will built into normal glasses, or even into contact
lenses.
13.06.2019
Conclusion

21. ||
We extracted six research directions
for Seamless Mobile Learning Scenarios
with Mixed Reality on Head-Mounted Displays
• Immersive simulations
(3D simulations of past and
future scenarios)
• Geographical modeling
(Construction of physical and
abstract models)
• Geospatial analysis
(Shadow calculations)
 Gaze-based interaction
(Visual and tactile examination,
voice feedback)
 Close Collaboration
(Recording and playback of face-
to-face events)
 Remote Collaboration
(Holographic telepresence and
remote inquiries)
Future Work