This document summarizes Rachel Hinman's presentation on emerging topics in mobile user experience design. She discusses three main topics: contextual computing, which involves understanding relationships between people, places, and things; a "brave new UI world" with interfaces beyond traditional graphical user interfaces; and shapeshifting interfaces that are not anchored and can change based on context and user intent. For each topic, Hinman provides examples and poses open-ended questions to spur further thinking about designing for the mobile environment and its rapid evolution.

1. The Mobile FrontierWebVisions 2011Rachel HinmanSenior Research Scientist Nokia Research Lab Palo Alto, California USATwitter: @HinmanTitle

2. Mobile = Wild West

3. A

4. Do you remember a time…Do you remember a time when the web was new?Q:A

5. Do you remember a time…“We need a web presence!”!A

6. 6Solution: Brochure - onlineBrochureware

7. “we need a web presence”“We need online commerce!”!A

8. 8Online commerceWhat about shipping?

9. Make it like the world“Let’s make our site like…”!AA

10. 10Southwest airlines

11. Hypothesis vs. AgendaThe Rearview Mirror

12. Hypothesis vs. AgendaEven in situations in which a spirit of exploration and freedom exist, where faculty are free to experiment to work beyond physical and social constraints, our cognitive habits often get in the way. Marshall McLuhan called it “the rear-view mirror effect,” noting that “We see the world through a rear-view mirror. We march backwards into the future.”Even in situations in which a spirit of exploration and freedom exist, where faculty are free to experiment to work beyond physical and social constraints, our cognitive habits often get in the way. Marshall McLuhan called it“the rear-view mirror effect,” noting that“We see the world through a rear-view mirror. We march backwards into the future.”

13. Hypothesis vs. Agenda

14. Hypothesis vs. Agenda

15. Hypothesis vs. Agenda

16. Hypothesis vs. Agenda

17. ADo you remember a time…The definition of insanity is doing the same thing over and over and expecting different results.

18. 18Mobile presents an opportunity to invent new ways…Opinion!Mobile presents an opportunity to invent new ways for users to interact with information.

19. A mobile phone is not a computer 19

20. umm…. duh!AUm… duh!

22. 22iPhoneMobile phones aren’t really phones anymore

23. 23iPhone

25. Hypothesis vs. AgendaMobile Devices are the Gateway Drug for Ubicomp

26. Hypothesis vs. AgendaFollowing toddlers into the future

27. Mobile = Wild West

28. Where to Look?

29. Great Mobile user experiencesEmergent Mobile UX Topics1Contextual Computing2A Brave NUI World3Shapeshifting

30. Contextual Computing

31. Pictures of mobile contextsWhat exactly do you mean by mobile “context” ?Q:A

32. Pictures of mobile contextsA

33. More pictures of mobile contexts

34. Social context

35. Context is complexContext is complex!!A

36. Context is about understanding human relationships to the people,places and things in the world.AContext is about understanding the relationships

37. 37Context FrameworkContext Frameworksteal this slide!

38. 38Context FrameworkContext Frameworksteal this slide!

39. 39Relationships ChordingOrchestration and Inflection

40. 40Peanut butter

41. 41Google: FacebookSpatial

42. 42TemporalTemporal

43. Spatial - peanut butterSocial43

44. Google: FacebookSemantic44

45. 45Peanut butter in DenverPeanut butter in Melbourne right now?

46. The web is good at people and things.The web is good at semantic relationships.(and okay at social relationships)AContext is about understanding the relationships

47. Context FrameworkMobile is good at places…steal this slide!47

48. Context FrameworkMobile is good at spatial and temporal relationships.steal this slide!48

49. 49Google maps - PC vs. Mobile

50. Temporal and spatial relationships are underservedThere are currently not many technologiesthat help us understand place, and temporal and spatial relationships.50

58. What we learned from the webContextual Computing QuestionsWhat is the “URL” for place?How might we break our 1:1 relationship with devices?Nature of the relationship between devices?Instead of burrowing into the world behind the LCD screen, how can devices help us connect us to the world around us?

59. 59WireframeA Brave NUI World

60. 60Differences in the mobile environmentSeated in a relatively predictable environmentLarge screen enables multi-taskingKeyboard and a mouse for input

61. 61WireframeWe’re reaching the edges of what GUI can do

62. 62Wireframe

63. Hypothesis vs. Agenda

64. Hypothesis vs. Agenda

65. 65Wireframe

66. 66Wireframesteal this slide!

67. 67WireframeIt’s not longer “what you see it what you get…”

68. 68Wireframe…now it’s “what you do is what you get”

69. 69WireframeDifferent platforms express characteristics differently

70. Paper Prototype exampleGUI = Computer as tool, NUI = Computer as Media70

71. 71WireframeGUI = Metaphorics, containment and place

72. 72WireframeNUI = Fluid, Unmediated, and Organic

73. Paper Prototype exampleGUIs = Heavy Chrome, Icons & Buttons73

74. NUIs = Let the Content be the Star74It’s like a game of cards

75. Paper Prototype exampleSCROLLGUI = “Desktop” and “Pages” as Anchors75

76. NUIs Can Feel Anchor-less76

77. Paper Prototype example[]+=77

78. Paper Prototype example=78

79. What we learned from the webAnimation & TransitionsA new design elements that can:steal this slide!Reinforce cognition.Help users form a mental model of how information will “unfold”.Provide cues for interaction.Help make your experience feel more intuitive for users.

80. Say Goodbye to Done80Wireframe

81. This should look familiar…81Wireframe

82. 82WireframeThis should look familiar…The web has evolved around a task-efficiency model.Mobile is different.

83. 83Mobile is differentMobile is different….Mobile is about pivoting people through information quickly.It’s about exposing possibilities.

84. What’s the point?“What can happen?”“What’s the point?”TASKPOSSIBILITIES

85. Tasks are about completion…85Tasks are about completion

86. 86Tasks are about completionTasks are about completion…Possibilities are interactions that accrue over time…

87. Tasks are about completion…Possibilities are interactions that accrue over time…… or facilitate exploration…87Tasks are about completion

88. … or facilitate exploration…88Tasks are about completionTasks are about completion…Possibilities are interactions that accrue over time…..or are about SENSINGINTENT!

89. 89Example -

90. 90Example -

91. 91Example -

92. 92Example -

93. 93Example -

94. 94Example -

95. What we learned from the webBrave NUI World QuestionsWhat’s beyond tasks?What’s after “computer as media”?How can we create interfaces that sense intent without going to the creepy “Hal” place?Can information objects be defined less by how they are and more by how they move?

96. Shape Shifting

97. We can annotate expectations in the web world97

99. How do you make interfaces that speak their powerA99

100. A100

101. A101

102. Hypothesis vs. Agenda

103. Hypothesis vs. Agenda

104. Hypothesis vs. Agenda

105. Hypothesis vs. Agenda

106. Hypothesis vs. Agenda

108. Paper Prototype example108

109. How do you make interfaces that speak their powerA109

110. How do you make interfaces that speak their powerA110

115. In reality… people’s lives are messy

116. Through Lines

117. Good luck

118. Good luck

119. Good luck

120. What we learned from the webShapeshifting QuestionsWhat’s after the desktop and “web pages”?Are metaphors dead? If not, can we get beyond our “lizard brain” need for physicality?How might we enable convergence with existing technology? Is retiring old technology the price of entry?

121. Great Mobile user experiencesEmergent Mobile UX Topics1Contextual Computing2A Brave NUI World3Shapeshifting

122. Shift your perspective and point of view“The rapid development of cell phones is killing early cell phones much faster than it's killing any of the early, older legacy technologies.I think that is a real principle... something you have to understand if you're going to be in this line of work. It's very romantic. It's very fast moving.You are building dead lumps of plastic.When people come out and they show you an iPhone, or an Android... they are showing you larval versions of something much more sophisticated.The world you are building right now is the ground floor for something much larger -- and the soil beneath that ground floor is violently unstable.”-- Mobile Monday Amsterdam – November 2008Rapid Evolution122

123. Thank you!Email:rachel.hinman@nokia.comThanks, and next up…

124. The Mobile FrontierA Guide for Designing Mobile ExperiencesExpected Publication: late 2011