My slides for the public keynote speech I gave for my doctoral thesis defense. You can grab an e-copy of my dissertation here: http://www.abdoelali.com/pdfs/phdthesis_abdallah_elali.pdf

1. Minimal Mobile
Human computer Interaction
Abdallah El Ali
15 Nov, 2013
www.abdoelali.com

2. 4.5 years
6 chapters
157 content pages

3. ~10 min!

4. #ugh

5. Why
Human Computer
Interaction?!

6. http://thumbs.dreamstime.com/z/businessman-multitasking-25640436.jpg

7. Efficiency,
accuracy,
recall,
satisfaction,
...
http://www.smartgirl.org/brain-food/career-hubs/human-computer-interaction.png

8. http://www.gfktechtalk.com/wp-content/uploads/2012/08/mobmobmob.jpg

9. 4

10. Touchscreen Interaction
6
http://why-sci.com/wp-content/uploads/2013/07/touchscreen1.jpg

11. 6
http://www.rustoneyeinstitute.com/images_content/eye.jpg

12. Attention Demanding
Frustrating
Safety
5

14. Hmmm...
http://www.wallm.com/images/2013/01/original-rubiks-cube-colorful-melting-background.jpg

15. Eyes-free Interaction
6
http://www.danielgallo.co.uk/wp-content/uploads/2013/01/MinorityReport.jpg

16. Touchscreen
is here to stay...

17. Context-aware
computing

18. Multimodal Interaction
3D Gestural Input
6
http://solidsmack.com/wp-content/uploads/2012/05/the-leap-02.jpg

19. Minimal Use of
Visual Modality

20. Okay, but why?

21. Location-Aware
Multimedia Messaging

22. time

23. !"#$%"$&"'$(')*+,-$&"'.$
/+012-3$2,$4'5126$4106+78
!"#"$%&'()*$%+
!"#$%"$&"'$(')*+,-$&"'.$
/+012-3$2,$4'5126$4106+78

24. $
/*0
,*
+
5$
$
%#$
?
$
+3
@7
?
%#$
)9
.4A
->
01
*3
?
?
15
&"#$
*->
5$
Domain Ratings!
=4
-+
41
<1
*+
3
!"#$
81
9:;
$
"#$
35
(#$
41
*-7
+
!%#$
)2
2
'#$
6$
&&#$
4+
5
!"#$
)*
+,
-./
$01
23
1,
2+3
6,4
78
52
95
$
+2$
:$
;,
-<
=,
/5,
.>+
2$
3 $:
$?
,>>
@A
,/*
B$
)8
95
.4
7*
$
153
/+,
5+9
-,
C-.
$
*2
D7
-+.
47
*$
12
2/ B
*0
,*
+$
)*
+,
-+.
Results
Task Ratings!
!%#$
&"#$
&'#$
(#$

25. $
/*0
,*
+
1,
2+3
6,4
78
52
95
$
+2$
:$
;,
-<
=,
/5,
.>+
2$
3 $:
$?
,>>
@A
,/*
B$
)8
95
.4
7*
$
153
/+,
5+9
-,
C-.
$
*2
D7
-+.
47
*$
12
2/ B
*0
,*
+$
)*
+,
-+.
!"#$
Domain Ratings!
!%#$
!"#$
&"#$
&"#$
&&#$
%#$
?
$
%#$
)9
.4A
->
$
5$
?
+3
*->
@7
=4
-+
$
5$
35
41
<1
*+
3
01
*3
?
?
15
81
9:;
41
*-7
+
"#$
)2
2
(#$
6$
'#$
4+
5
D
E
M
R
I
F
N
O
C
)*
+,
-./
$01
23
Results
Task Ratings!
!%#$
&'#$
(#$

27. 2
http://good-wallpapers.com/wallpapers/19486/Yawn%20Cat.jpg

28. Playful
Location-aware
Multimedia Messaging

30. Representation vs
Interaction
Incentive Mechanisms
Testing
Methodology
http://www.thebizseller.com/blog/wp-content/uploads/2012/07/3arrows1.jpg

32. 2
http://bridgetoit.com/wp-content/uploads/2012/11/Bridge_Wallpaper_by_tonvanalebeek.jpg

33. Automatic Exploration-based
Route Planning

34. 2
http://www.eurocheapo.com/blog/wp-content/uploads/2011/06/La-Rambla-Barcelona-crowds.jpg

36. Pffft...

38. Sequences in Amsterdam

39. Central Station to Museumplein Route
Photographer Paths
route (5.36 km)
Photo Density
route (3.83 km)
Google Maps
route (3.35 km)

40. Results
Central Station to Museumplein (CM) Route
"#
**
**
**
**
**
*
**
*
6789:1-#./)0123#!#
<,+/0),9:#46.!<5#
=>()-,?7:7@@#4=AA5#
$#
!"#$%
%#
&#
!%#
!$#
!"#
'()*+),-#./)0123#4'.5#
**
*
6789:1-#./)0123#!#;87:,23#
46.!;5#
&'("$)'*$%
!"#"$%$&
!"#"$%$'
'B929*()CB7(#')2B@#
'B929#D7:@123#
E99*07#F)C@#

41. Results
Central Station to Museumplein (CM) Route
"#
**
**
**
$#
!"#$%
%#
&#
!%#
!$#
!"#
D
E
M
R
I
F
N
O
C
**
*
!"#"$%$&
!"#"$%$'
*
**
'()*+),-#./)0123#4'.5#
**
**
6789:1-#./)0123#!#;87:,23#
46.!;5#
*
6789:1-#./)0123#!#
<,+/0),9:#46.!<5#
=>()-,?7:7@@#4=AA5#
&'("$)'*$%
'B929*()CB7(#')2B@#
'B929#D7:@123#
E99*07#F)C@#

42. Make the system context-aware
> Minimize user interaction

44. System /
Technique
Domain
Input
Modality
Output
Modality
Minimal
Interaction?
Location-aware
Multimedia
Messaging
Urban
Exploration
Touchscreen,
3D Gestures
Visual
(Augmented
Reality)
Contextawareness, Visualgestural Input
Location-aware
Multimedia
Messaging
Playfulness
Touchscreen,
3D Gestures
Visual
(Augmented
Reality)
Contextawareness, Visualgestural Input
Explorationbased Route
Planner
Urban
Exploration
Touchscreen
Visual
(Display)
Context-awareness
3D Gestural
Interaction
Taskindependent
3D Gestures
Visual
(Display)
Gestural Input
3D Gestures,
Touchscreen
Visual
(Display),
Non-speech
Audio
Visuo-Gestural
Input, Gestural
Input
3D Gestures,
Touchscreen
Visual
(Display),
Non-speech
Audio
Visuo-Gestural
Input, Gestural
Input
Magnet-based
ADI
Magnet-based
ADI
Playfulness
User
Authentication

45. Usability of
3D Gesture-based Interaction

46. 2

47. http://www.dailygalaxy.com/photos/uncategorized/2008/02/27/minorityreport.jpg

48. Errors...!…!
http://www.dailygalaxy.com/photos/uncategorized/2008/02/27/minorityreport.jpg

49. Results
!"#$%&'()*'+(,-'+
;/<=-00/0=>%$"
!":+31=-00/0=>%$"
?+@(=-00/0=>%$"
%:
"8
/0
9&/
"0
"#
".
56
",
$+7
$0%
3*
,"
#
$+/
,"
%#
'"
0./
01
&
'(
)*
+,%
$%
"#
!
! !!
!!
!! !!
!!
43
43
56
",
$
+7"
'0
".
"
8
/0
0"
9&/
%:
#,
"
$+/
#
0%
20
3*
$
'"
0./
01
%#
,"
-.
./
0$
&
'(
)*
+,%
%&
"#
$
!
!!
!
0$
!
!!
!
!!
!
!! !
!!
'0
!
&
!
!
!!
!
!!
! !!
!!
-.
./
!
20
!"#$%"&'($)%*+$)
;/<=-00/0=>%$"
!":+31=-00/0=>%$"
?+@(=-00/0=>%$"

50. Results
D
E
M
R
I
F
N
O
C
!"#$%&'()*'+(,-'+
;/<=-00/0=>%$"
!":+31=-00/0=>%$"
?+@(=-00/0=>%$"
%:
,"
"8
/0
9&/
"0
"#
56
",
$+7
'0
$0%
3*
!":+31=-00/0=>%$"
".
$+/
,"
%#
'"
0./
01
&
)*
+,%
$%
"#
!
'(
;/<=-00/0=>%$"
! !!
!!
!! !!
!!
43
43
56
",
$
+7"
'0
".
"
8
/0
0"
9&/
%:
#,
"
$+/
#
0%
20
3*
$
'"
0./
01
%#
,"
-.
./
0$
&
'(
)*
+,%
%&
"#
$
!
!!
!
0$
!
!!
!
!!
!
!! !
!!
#
!
&
!
!
!!
!
!!
! !!
!!
-.
./
!
20
!"#$%"&'($)%*+$)
?+@(=-00/0=>%$"

51. 40% user error tolerance shows
3D gestures are usable
http://eonreality.i3dsoftware.com/wp-content/uploads/2013/04/mwMch13eon-sch_0338-e1364923000265.jpg

53. Playful 3D Gestural Interaction

54. Magnet

57. Results
#$"
##"
#!"
'&"
!"#$%#&'()
'%"
'$"
'#"
'!"
&"
%"
$"
#"
!"
()$!"
$'*+!"
+'*%!"
%'*,!"
,'*&!"
*+#",-#)./.).'0"#)1,&-#)
./0"12"
./0"34/560"
./0"34/567859:"
&'*-!"
-'*'!!"

58. Results
D
E
M
R
I
F
N
O
C
#$"
##"
#!"
'&"
!"#$%#&'()
'%"
'$"
'#"
'!"
&"
%"
$"
#"
!"
()$!"
$'*+!"
+'*%!"
%'*,!"
,'*&!"
*+#",-#)./.).'0"#)1,&-#)
./0"12"
./0"34/560"
./0"34/567859:"
&'*-!"
-'*'!!"

60. 3D Gestural
User Authentication

61. 2
http://i1.ytimg.com/vi/hcXSzQjMJCc/maxresdefault.jpg

62. e
r
u
t
a
n
g
i
S

63. http://1.bp.blogspot.com/_xBMIyKYPNYs/TBMf8IVL8oI/AAAAAAAABZg/yV9_KcumZj4/s1600/shoulder+surfing.jpg

65. Results
ROC Curve!
NASA-TLX Scores!
'!!"
#!"
'&"
'%"
&!"
!"#$%&'()"*%
!"#$%&'$
'$"
%!"
$!"
'#"
'!"
&"
%"
$"
#!"
#"
!"
()*+,-"
!"
!"
#!"
$!"
%!"
("#$%&'$
&!"
./0123,-"
425)"
6789+"
'!!"
+#,"-().%
.)9:895,*3)" ;9<1+9,=8*"
><?@)3=A)"
B89C-8,D"

66. Results
D
E
M
R
I
F
N
O
C
ROC Curve!
'!!"
NASA-TLX Scores!
#!"
'&"
'%"
&!"
!"#$%&'()"*%
!"#$%&'$
'$"
%!"
$!"
'#"
'!"
&"
%"
$"
#!"
#"
!"
()*+,-"
!"
!"
#!"
$!"
%!"
("#$%&'$
&!"
./0123,-"
425)"
6789+"
'!!"
+#,"-().%
.)9:895,*3)" ;9<1+9,=8*"
><?@)3=A)"
B89C-8,D"

67. 2
http://i.huffpost.com/gen/1323258/thumbs/o-PASSWORD-facebook.jpg

68. 2
http://pages-tdm.au.dk/digitalkommunikation/files/2013/09/Funny-Smileys-768x1366.jpg

70. System /
Technique
Domain
Input
Modality
Output
Modality
Minimal
Interaction?
Location-aware
Multimedia
Messaging
Urban
Exploration
Touchscreen,
3D Gestures
Visual
(Augmented
Reality)
Contextawareness, Visualgestural Input
Location-aware
Multimedia
Messaging
Playfulness
Touchscreen,
3D Gestures
Visual
(Augmented
Reality)
Contextawareness, Visualgestural Input
Explorationbased Route
Planner
Urban
Exploration
Touchscreen
Visual
(Display)
Context-awareness
3D Gestural
Interaction
Taskindependent
3D Gestures
Visual
(Display)
Gestural Input
3D Gestures,
Touchscreen
Visual
(Display),
Non-speech
Audio
Visuo-Gestural
Input, Gestural
Input
3D Gestures,
Touchscreen
Visual
(Display),
Non-speech
Audio
Visuo-Gestural
Input, Gestural
Input
Magnet-based
ADI
Magnet-based
ADI
Playfulness
User
Authentication

71. http://www.wallsave.com/wallpapers/2048x1152/yes/332959/yes-barack-obama-we-can-332959.jpg

72. Touchscreen

73. Touchscreen
Contextawareness
http://www.wyokidsfirst.org/wp-content/uploads/2011/04/brain_cogs1.jpg

74. Touchscreen
Contextawareness
3D Gestural
Input
http://www.wyokidsfirst.org/wp-content/uploads/2011/04/brain_cogs1.jpg

75. Eyes-free Interaction
6
http://www.danielgallo.co.uk/wp-content/uploads/2013/01/MinorityReport.jpg

76. Keep designing for touchscreens.
But use
context-awareness or 3D gestural input
to minimize user interaction.

77. Thanks!
www.abdoelali.com

78. ALERT!
[Incoming
Questions!]