Minimal Mobile Human Computer Interaction

1,571 views
1,142 views

Published on

My slides for the public keynote speech I gave for my doctoral thesis defense.

You can grab an e-copy of my dissertation here: http://www.abdoelali.com/pdfs/phdthesis_abdallah_elali.pdf

Published in: Technology, Business
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total views
1,571
On SlideShare
0
From Embeds
0
Number of Embeds
22
Actions
Shares
0
Downloads
0
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

Minimal Mobile Human Computer Interaction

  1. 1. Minimal Mobile Human computer Interaction Abdallah El Ali 15 Nov, 2013 www.abdoelali.com
  2. 2. 4.5 years 6 chapters 157 content pages
  3. 3. ~10 min!
  4. 4. #ugh
  5. 5. Why Human Computer Interaction?!
  6. 6. http://thumbs.dreamstime.com/z/businessman-multitasking-25640436.jpg
  7. 7. Efficiency, accuracy, recall, satisfaction, ... http://www.smartgirl.org/brain-food/career-hubs/human-computer-interaction.png
  8. 8. http://www.gfktechtalk.com/wp-content/uploads/2012/08/mobmobmob.jpg
  9. 9. 4
  10. 10. Touchscreen Interaction 6 http://why-sci.com/wp-content/uploads/2013/07/touchscreen1.jpg
  11. 11. 6 http://www.rustoneyeinstitute.com/images_content/eye.jpg
  12. 12. Attention Demanding Frustrating Safety 5
  13. 13. Hmmm... http://www.wallm.com/images/2013/01/original-rubiks-cube-colorful-melting-background.jpg
  14. 14. Eyes-free Interaction 6 http://www.danielgallo.co.uk/wp-content/uploads/2013/01/MinorityReport.jpg
  15. 15. Touchscreen is here to stay...
  16. 16. Context-aware computing
  17. 17. Multimodal Interaction 3D Gestural Input 6 http://solidsmack.com/wp-content/uploads/2012/05/the-leap-02.jpg
  18. 18. Minimal Use of Visual Modality
  19. 19. Okay, but why?
  20. 20. Location-Aware Multimedia Messaging
  21. 21. time
  22. 22. !"#$%"$&"'$(')*+,-$&"'.$ /+012-3$2,$4'5126$4106+78 !"#"$%&'()*$%+ !"#$%"$&"'$(')*+,-$&"'.$ /+012-3$2,$4'5126$4106+78
  23. 23. $ /*0 ,* + 5$ $ %#$ ? $ +3 @7 ? %#$ )9 .4A -> 01 *3 ? ? 15 &"#$ *-> 5$ Domain Ratings! =4 -+ 41 <1 *+ 3 !"#$ 81 9:; $ "#$ 35 (#$ 41 *-7 + !%#$ )2 2 '#$ 6$ &&#$ 4+ 5 !"#$ )* +, -./ $01 23 1, 2+3 6,4 78 52 95 $ +2$ :$ ;, -< =, /5, .>+ 2$ 3 $: $? ,>> @A ,/* B$ )8 95 .4 7* $ 153 /+, 5+9 -, C-. $ *2 D7 -+. 47 *$ 12 2/ B *0 ,* +$ )* +, -+. Results Task Ratings! !%#$ &"#$ &'#$ (#$
  24. 24. $ /*0 ,* + 1, 2+3 6,4 78 52 95 $ +2$ :$ ;, -< =, /5, .>+ 2$ 3 $: $? ,>> @A ,/* B$ )8 95 .4 7* $ 153 /+, 5+9 -, C-. $ *2 D7 -+. 47 *$ 12 2/ B *0 ,* +$ )* +, -+. !"#$ Domain Ratings! !%#$ !"#$ &"#$ &"#$ &&#$ %#$ ? $ %#$ )9 .4A -> $ 5$ ? +3 *-> @7 =4 -+ $ 5$ 35 41 <1 *+ 3 01 *3 ? ? 15 81 9:; 41 *-7 + "#$ )2 2 (#$ 6$ '#$ 4+ 5 D E M R I F N O C )* +, -./ $01 23 Results Task Ratings! !%#$ &'#$ (#$
  25. 25. 2 http://good-wallpapers.com/wallpapers/19486/Yawn%20Cat.jpg
  26. 26. Playful Location-aware Multimedia Messaging
  27. 27. Representation vs Interaction Incentive Mechanisms Testing Methodology http://www.thebizseller.com/blog/wp-content/uploads/2012/07/3arrows1.jpg
  28. 28. 2 http://bridgetoit.com/wp-content/uploads/2012/11/Bridge_Wallpaper_by_tonvanalebeek.jpg
  29. 29. Automatic Exploration-based Route Planning
  30. 30. 2 http://www.eurocheapo.com/blog/wp-content/uploads/2011/06/La-Rambla-Barcelona-crowds.jpg
  31. 31. Pffft...
  32. 32. Sequences in Amsterdam
  33. 33. Central Station to Museumplein Route Photographer Paths route (5.36 km) Photo Density route (3.83 km) Google Maps route (3.35 km)
  34. 34. Results Central Station to Museumplein (CM) Route "# ** ** ** ** ** * ** * 6789:1-#./)0123#!# <,+/0),9:#46.!<5# =>()-,?7:7@@#4=AA5# $# !"#$% %# &# !%# !$# !"# '()*+),-#./)0123#4'.5# ** * 6789:1-#./)0123#!#;87:,23# 46.!;5# &'("$)'*$% !"#"$%$& !"#"$%$' 'B929*()CB7(#')2B@# 'B929#D7:@123# E99*07#F)C@#
  35. 35. Results Central Station to Museumplein (CM) Route "# ** ** ** $# !"#$% %# &# !%# !$# !"# D E M R I F N O C ** * !"#"$%$& !"#"$%$' * ** '()*+),-#./)0123#4'.5# ** ** 6789:1-#./)0123#!#;87:,23# 46.!;5# * 6789:1-#./)0123#!# <,+/0),9:#46.!<5# =>()-,?7:7@@#4=AA5# &'("$)'*$% 'B929*()CB7(#')2B@# 'B929#D7:@123# E99*07#F)C@#
  36. 36. Make the system context-aware > Minimize user interaction
  37. 37. System / Technique Domain Input Modality Output Modality Minimal Interaction? Location-aware Multimedia Messaging Urban Exploration Touchscreen, 3D Gestures Visual (Augmented Reality) Contextawareness, Visualgestural Input Location-aware Multimedia Messaging Playfulness Touchscreen, 3D Gestures Visual (Augmented Reality) Contextawareness, Visualgestural Input Explorationbased Route Planner Urban Exploration Touchscreen Visual (Display) Context-awareness 3D Gestural Interaction Taskindependent 3D Gestures Visual (Display) Gestural Input 3D Gestures, Touchscreen Visual (Display), Non-speech Audio Visuo-Gestural Input, Gestural Input 3D Gestures, Touchscreen Visual (Display), Non-speech Audio Visuo-Gestural Input, Gestural Input Magnet-based ADI Magnet-based ADI Playfulness User Authentication
  38. 38. Usability of 3D Gesture-based Interaction
  39. 39. 2
  40. 40. http://www.dailygalaxy.com/photos/uncategorized/2008/02/27/minorityreport.jpg
  41. 41. Errors...!…! http://www.dailygalaxy.com/photos/uncategorized/2008/02/27/minorityreport.jpg
  42. 42. Results !"#$%&'()*'+(,-'+ ;/<=-00/0=>%$" !":+31=-00/0=>%$" ?+@(=-00/0=>%$" %: "8 /0 9&/ "0 "# ". 56 ", $+7 $0% 3* ," # $+/ ," %# '" 0./ 01 & '( )* +,% $% "# ! ! !! !! !! !! !! 43 43 56 ", $ +7" '0 ". " 8 /0 0" 9&/ %: #, " $+/ # 0% 20 3* $ '" 0./ 01 %# ," -. ./ 0$ & '( )* +,% %& "# $ ! !! ! 0$ ! !! ! !! ! !! ! !! '0 ! & ! ! !! ! !! ! !! !! -. ./ ! 20 !"#$%"&'($)%*+$) ;/<=-00/0=>%$" !":+31=-00/0=>%$" ?+@(=-00/0=>%$"
  43. 43. Results D E M R I F N O C !"#$%&'()*'+(,-'+ ;/<=-00/0=>%$" !":+31=-00/0=>%$" ?+@(=-00/0=>%$" %: ," "8 /0 9&/ "0 "# 56 ", $+7 '0 $0% 3* !":+31=-00/0=>%$" ". $+/ ," %# '" 0./ 01 & )* +,% $% "# ! '( ;/<=-00/0=>%$" ! !! !! !! !! !! 43 43 56 ", $ +7" '0 ". " 8 /0 0" 9&/ %: #, " $+/ # 0% 20 3* $ '" 0./ 01 %# ," -. ./ 0$ & '( )* +,% %& "# $ ! !! ! 0$ ! !! ! !! ! !! ! !! # ! & ! ! !! ! !! ! !! !! -. ./ ! 20 !"#$%"&'($)%*+$) ?+@(=-00/0=>%$"
  44. 44. 40% user error tolerance shows 3D gestures are usable http://eonreality.i3dsoftware.com/wp-content/uploads/2013/04/mwMch13eon-sch_0338-e1364923000265.jpg
  45. 45. Playful 3D Gestural Interaction
  46. 46. Magnet
  47. 47. Results #$" ##" #!" '&" !"#$%#&'() '%" '$" '#" '!" &" %" $" #" !" ()$!" $'*+!" +'*%!" %'*,!" ,'*&!" *+#",-#)./.).'0"#)1,&-#) ./0"12" ./0"34/560" ./0"34/567859:" &'*-!" -'*'!!"
  48. 48. Results D E M R I F N O C #$" ##" #!" '&" !"#$%#&'() '%" '$" '#" '!" &" %" $" #" !" ()$!" $'*+!" +'*%!" %'*,!" ,'*&!" *+#",-#)./.).'0"#)1,&-#) ./0"12" ./0"34/560" ./0"34/567859:" &'*-!" -'*'!!"
  49. 49. 3D Gestural User Authentication
  50. 50. 2 http://i1.ytimg.com/vi/hcXSzQjMJCc/maxresdefault.jpg
  51. 51. e r u t a n g i S
  52. 52. http://1.bp.blogspot.com/_xBMIyKYPNYs/TBMf8IVL8oI/AAAAAAAABZg/yV9_KcumZj4/s1600/shoulder+surfing.jpg
  53. 53. Results ROC Curve! NASA-TLX Scores! '!!" #!" '&" '%" &!" !"#$%&'()"*% !"#$%&'$ '$" %!" $!" '#" '!" &" %" $" #!" #" !" ()*+,-" !" !" #!" $!" %!" ("#$%&'$ &!" ./0123,-" 425)" 6789+" '!!" +#,"-().% .)9:895,*3)" ;9<1+9,=8*" ><?@)3=A)" B89C-8,D"
  54. 54. Results D E M R I F N O C ROC Curve! '!!" NASA-TLX Scores! #!" '&" '%" &!" !"#$%&'()"*% !"#$%&'$ '$" %!" $!" '#" '!" &" %" $" #!" #" !" ()*+,-" !" !" #!" $!" %!" ("#$%&'$ &!" ./0123,-" 425)" 6789+" '!!" +#,"-().% .)9:895,*3)" ;9<1+9,=8*" ><?@)3=A)" B89C-8,D"
  55. 55. 2 http://i.huffpost.com/gen/1323258/thumbs/o-PASSWORD-facebook.jpg
  56. 56. 2 http://pages-tdm.au.dk/digitalkommunikation/files/2013/09/Funny-Smileys-768x1366.jpg
  57. 57. System / Technique Domain Input Modality Output Modality Minimal Interaction? Location-aware Multimedia Messaging Urban Exploration Touchscreen, 3D Gestures Visual (Augmented Reality) Contextawareness, Visualgestural Input Location-aware Multimedia Messaging Playfulness Touchscreen, 3D Gestures Visual (Augmented Reality) Contextawareness, Visualgestural Input Explorationbased Route Planner Urban Exploration Touchscreen Visual (Display) Context-awareness 3D Gestural Interaction Taskindependent 3D Gestures Visual (Display) Gestural Input 3D Gestures, Touchscreen Visual (Display), Non-speech Audio Visuo-Gestural Input, Gestural Input 3D Gestures, Touchscreen Visual (Display), Non-speech Audio Visuo-Gestural Input, Gestural Input Magnet-based ADI Magnet-based ADI Playfulness User Authentication
  58. 58. http://www.wallsave.com/wallpapers/2048x1152/yes/332959/yes-barack-obama-we-can-332959.jpg
  59. 59. Touchscreen
  60. 60. Touchscreen Contextawareness http://www.wyokidsfirst.org/wp-content/uploads/2011/04/brain_cogs1.jpg
  61. 61. Touchscreen Contextawareness 3D Gestural Input http://www.wyokidsfirst.org/wp-content/uploads/2011/04/brain_cogs1.jpg
  62. 62. Eyes-free Interaction 6 http://www.danielgallo.co.uk/wp-content/uploads/2013/01/MinorityReport.jpg
  63. 63. Keep designing for touchscreens. But use context-awareness or 3D gestural input to minimize user interaction.
  64. 64. Thanks! www.abdoelali.com
  65. 65. ALERT! [Incoming Questions!]

×