Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Designing UX for the Internet of Things


Published on

Published in: Technology
  • Be the first to comment

Designing UX for the Internet of Things

  1. 1. Designing Interaction for the Internet of Things Fahim Kawsar Bell Labs
  2. 2. “This talk is about Consumer IoT”
  3. 3. 1 2 3 Users Connected Objects Web Services Data Management Platforms Focus of the Talk Consumer IoT
  4. 4. “A computationally instrumented tangible object with an established purpose that augments human perception and is aware of its operational situations and capable of providing supplementary services without compromising its original appearance and interaction metaphor significantly.” (Kawsar, 2007) Mediacup Beigl 1999 Intelligent Spoon Ishii 1997 Ambient Device 2004 Aware Mirror Fujinami 2004 Smart Furniture Tokuda 2004 Intelligent Spoon Selker 2004 Smart Objects Perceptual Augmentation Connectivity Situational Awareness Supplementary Services Smart Objects are the Building Blocks of Consumer IoT
  5. 5. Form factor and interaction consistency need to be maintained.
  6. 6. Ubicomp 2005, Soc-EUSAI 2005, IE 2007, MUM 2007, SIGAPP SAC 2006
  7. 7. Pervasive 2005
  8. 8. ACM UIST 2007
  9. 9. ACM MobileHCI 2010
  10. 10. Some Serious Applications Prevention of Knuckle Syndrome by Situated Feedback
  11. 11. Some Serious Applications Prevention of Adverse Drug Events
  12. 12. Interaction and User Interface
  13. 13. Discovery Control Feedback Graphical UI Static (Desktop) Natural UI Voice GestureEye Mobile Spatial (Projected) Augmented Reality Tangible UI Direct Manipulation Embodiment Metaphoric Virtual Reality Brain Consumer IoT - Interaction Space
  14. 14. For managing smart objects and profiles For managing applications For administrating smart objects and applications GUI Interaction
  15. 15. Hard to Understand Conflicting Mental Model Missing Tangibility
  16. 16. Mobile UI Interaction
  17. 17. Introduces Situational Disability
  18. 18. TUI Interaction
  19. 19. Introduces Spatial Distribution
  20. 20. Mobile Augmented Reality UI Interaction
  21. 21. Decomposition of the Interaction Space
  22. 22. 90 Spatial UI Interaction with Mobile Projector
  23. 23. Implications Introduces Fragmentation of Attention
  24. 24. Needs Better Hand Eye Co-ordination
  25. 25. 90 Spatial UI Interaction with Wearable Projector
  26. 26. Implications Introduces Fragmentation of Attention
  27. 27. What happened in the mean time…
  28. 28. There is an app for this..
  29. 29. Current IoT Interactions App Driven Object Centric Spatially Fixed Temporally Constrained
  30. 30. Human’s Interactions Activity Centric Spatially Distributed Temporally Dispersed
  31. 31. Direct Background Device Swarm One App One Service
 Reactive Model One App Few Identical Devices Reactive Model One App One Device
 Proactive Model One Experience Many Devices
 Intelligible Model • Why Partial: • No or little Understanding of Human Activity • A Lot of False Positives due to One Directional Sensing Scott Jenson’s UX Grid for IoT Reflective UX
  32. 32. Spontaneous Personalised Opportunistic Activity Aware Relevant Reflective UX Discovery Control Feedback DisappearIn-Situ Reflective UX for IoT
  33. 33. Design with Purposeful Data • Understand User Intention • Offer Ranked Services • Put User at Control
  34. 34. Design with Activity Awareness • Offer Situated Guidance • Just In Time Information
  35. 35. Design for Opportunistic UI • Use Environment • Short Lived • Spontaneous
  36. 36. Design for Ambient Attention • Glanceable Display • Proxemic Interaction • Use in-situ Feedback
  37. 37. Design for Personalisation
  38. 38. Design for Story Telling • Sense Making to Story Telling • Make it Social
  39. 39. Future : Intention Driven Reflective UX Mobile Sensing Trace Participatory Sensing Trace Spontaneous Personalised Adaptive Opportunistic Activity Aware Relevant Wearable Sensing Trace Environment Sensing Trace Behaviour Models 1 2 Reflective UX Web Services Connected Objects
  40. 40. Internet of Things Research @ Bell Labs Behaviour Modeling Smart Object Modeling Mobile Sensing Participatory Sensing Evolutionary Graph Real World SearchIndoor Localisation HCI Studies Pervasive Display Pervasive Privacy EF5 EF5 EF5 Novel Services For Retail Community Novel Services For Enterprise Community Novel Services For Urban Community
  41. 41. Thank You Fahim Kawsar @raswak eMail: