Wearable Sensors and UX Development


Published on

Presented at the Zurich Frontend Conference (http://2014.frontendconf.ch/) on August 29th, 2014. Here I presented ideas on the integration of user experience in the growing trends of Internet of Things (IoT) devices and wearable sensors.

Published in: Technology

Wearable Sensors and UX Development

  1. 1. Wearable Sensors and UX Development Mark Melnykowycz Frontend Conference 2014 August 29th 2014 Zurich, Switzerland mark@idezo.ch / @idezo_ch / @americanpeyote
  2. 2. Idea Flow Trends Science to Society Evolution of Materials IC Design / Production Material Library Influence on wearables Evolution of Computing Sensor use Wearables landscape Sensors Flexible sensors Future applications Prototyping @idezo_ch #fec14
  3. 3. Products and Innovation Pipeline Characterize and communicate how the world/universe work Putting science into something we can build things with Translating technology into something which people interact with @idezo_ch #fec14
  4. 4. Ubiquitous Computer Internet of Things (IoT) Web of Things (WoT) Wearable Computing @idezo_ch #fec14
  5. 5. Connected Device Evolution 50 Billion By 2020* Quantified User Quantified Self IoT @idezo_ch *http://share.cisco.com/internet-of-things.html #fec14
  6. 6. Computing Evolution Trends UX Patterns Increase with Devices Defined UX Space Distributed UX @idezo_ch #fec14
  7. 7. Separate Devices: Closed UX design spaces Devices Interactivity User patterns are learned and establish “easy to use” psychology @idezo_ch #fec14
  8. 8. Technology and User Experience “The reason OS X has a different interface than iOS isn’t because one came after the other or because this one’s old and this one’s new,” Federighi said. Instead, it’s because using a mouse and keyboard just isn’t the same as tapping with your finger. “This device,” Federighi said, pointing at a MacBook Air screen, “has been honed over 30 years to be optimal” for keyboards and mice.* -Apple senior vice president of software engineering Craig Federighi @idezo_ch *http://www.macworld.com/article/2090829/apple-executives-on-the-mac-at-30-the-mac-keeps-going-forever.html #fec14 iOS OSX Windows 8.1
  9. 9. Device vs Ecosystem UX Designing for one device UX is easier Designing for an ecosystem offers more opportunity @idezo_ch #fec14
  10. 10. Wearables / IoT: Open UX Design Ecosystem Many Devices Some Devices Talk Multiple Interaction Patterns Openness of ecosystem defines UX design space @idezo_ch #fec14
  11. 11. Quantified User Quantified Self Device Tracking and Data Interpretation Self-Tracking and Data Analysis Data Trends Low/Medium Accuracy Data Ingestion Data Interpretation Continuous Tracking Sensor Fusion User Data Profile Low/Medium/High Accuracy Smart Apps User is the Data Scientist App is the Data Scientist @idezo_ch #fec14
  12. 12. Quantified User User Tracking and Data Interpretation Total Data Profile The user is a person and an ecosystem of data Design UX based on data context @idezo_ch #fec14
  13. 13. User State Determination / Context Location Time Heart Rate Position …? Sensor Inputs/Fusion User State Application User Experience Sensor Hub @idezo_ch #fec14
  14. 14. Product Development Does Wearable make the difference? Data Wearable Computing User Experience Sensors / Actuators Application Development @idezo_ch #fec14
  15. 15. Current Single Device UX Design Trends Personal Tracking 2nd/3rd Screen Notifications Minimal Interactions Data Profile Creation @idezo_ch #fec14
  16. 16. Wrist-band Form Factor @idezo_ch #fec14
  17. 17. Wearable Sensors Wearable Activity Tracking Quantified Self http://amiigo.co/ ION Glasses Angel Acoustical Optical Acceleration Temperature Heart rate Skin temp. Blood oxygen Physical activity Fitbit @idezo_ch #fec14
  18. 18. Sensors Basics Time Acceleration GPS Compass … Direction/Amplitude Global Position Orientation Speed … Sensors Output Translates physical interaction into electrical signal @idezo_ch #fec14
  19. 19. Sensor Materials Evolution Integrated Circuits Layered designs Vapor deposition / etching Hard materials Silicon PVD / Metals Doped Oxides Ceramics PZT Quartz Surface micromachining Acceleration Sensor Pressure Sensor @idezo_ch #fec14
  20. 20. Smart Phone Sensor Anatomy Environment Sensing Connectivity Imaging Thermal Imaging Depth Sensing Motion GPS Acceleration Coprocessor Compass Motion Profile @idezo_ch #fec14
  21. 21. Near Future: Thermal Imaging Uses Metaio Thermal Touch Emotion Recognition? Nummenmaa L et al. PNAS 2014;111:646-651 Separate UI from device Visualize emotions @idezo_ch #fec14
  22. 22. Focus on Solving One User Problem Value for the User? Often good UX means solving one (or a few) problems really, really well in one product Don’t get lost in the ecosystem @idezo_ch #fec14
  23. 23. @idezo_ch 11th Wearable Technologies Conference 2014 I Europe #fec14
  24. 24. Business Modeling for Wearable Tech / IoT User Experience Application / Experience Development Sensors / Actuators Data Who What How @idezo_ch #fec14
  25. 25. Moticon (moticon.com) User Data Profile Remote Research Separation of UX, data profile and user value The ideal wearables UX is invisible @idezo_ch #fec14
  26. 26. Samsung Gear S Smart Watch Accelerometer Gyroscope Heart Rate UV Compass Barometer Ambient Light 3G Wide range of sensors and connectivity @idezo_ch #fec14
  27. 27. User – Data Pipeline API Sensors / Actuators Data Data Digestion / Algorithms Interpretation @idezo_ch #fec14
  28. 28. Wearables and IoT Development IoT / Hardware Tools Trends: Society vs. Technology Solution Idea @idezo_ch #fec14
  29. 29. Wearables Development Example: eHealth Sensor Technology Use Cases Acceleration Patient Temperature Light / Radiation Orientation Electrical Impulse Empowerment Self-Diagnosis Remote Monitoring Rehabilitation … @idezo_ch #fec14
  30. 30. Patient Empowerment UX Learning about their medical situation and understanding which actions can influence it Learn / Understand Act Quantify Taking steps and enacting change in their lives to affect their medical situation Gathering specific information on their condition, which can be used to influence it Patient @idezo_ch #fec14
  31. 31. Data Types Quantify Gathering specific information on their condition, which can be used to influence it Quantified Based on asking questions Depends on observations of a patient on how they feel Effective in building historical profiles of user states, emotions, etc. Measured data from an instrument (reproducible) Passively with wearable sensors or IoT devices Actively with specific tools @idezo_ch #fec14
  32. 32. Hardware Prototyping for eHealth Easy testing of medical parameters with Arduino / Raspberry Pi Flexible toolkit of basic sensors Open hardware platform Convert physical elements into digital signals @idezo_ch #fec14
  33. 33. Multiple Sensor Connections @idezo_ch #fec14
  34. 34. Flexible Data Delivery iOS / Android App API @idezo_ch #fec14
  35. 35. Wearables and User Experience Value for the User? Solve a user problem Look at the device ecosystem Be aware of sensor function UI and device may be separate The best solution might be invisible @idezo_ch #fec14
  36. 36. Contact / Questions mark@idezo.ch @idezo_ch / @americanpeyote @idezo_ch #fec14