Using Sensors to Infer how People Feel

1,486 views

Published on

Overview of the current research around emotionsense.org

Published in: Technology, Business
  • Be the first to comment

  • Be the first to like this

Using Sensors to Infer how People Feel

  1. 1. how can sensor data be used toinfer how people feel?@neal_lathiauniversity of cambridge
  2. 2. how many smartphones doyou have?
  3. 3. how often do you carry yourphone with you (%) ?
  4. 4. how often do you carry yourphone with you (%) ?research: 90% of the time it isin the same room as youmaking it a powerful, personaldevice that can sense,monitor, and interact with you
  5. 5. sense (infer): activities, social interactions, mobility, ambient sound in the moment
  6. 6. monitor: green transportation habits and modes, fitness levels individuals over time
  7. 7. interact: social network broadcasts, ubiquitous technology evaluation, persuasive interfaces understand & persuade
  8. 8. now: a tool for psychology research“ubiquitous, intimate, sensor-rich, computationally powerful, remotely accessible”
  9. 9. sense infer mental processes interact
  10. 10. inferssensed “in the reportedcontext moment” mood (responds)
  11. 11. inference → challengessystem →challenges user → challenges
  12. 12. system → challenges(kiran rachuri)
  13. 13. battery smartphone processing sensorssystem → werent builtchallenges memory for continuous monitoring network
  14. 14. system → challenges :: adaptive sensor sampling sense sleep co-location -2% accuracy - 40% accuracy -45% battery -5 % batterycontinuous adaptive interval (50%)accelerometer -1% accuracy - 34% accuracy -44% battery -8 % battery
  15. 15. inference → challenges (ubicomp 2010)
  16. 16. inference → challenges :: machine learning {sensed context} → emotion 5 broad emotionsmicrophone emotionalsample prosody-based model MAP likelihood + 71% accuracydaily diary inferred emotion
  17. 17. user →challenges
  18. 18. user → challenges:: protocols for experience sampling experience sampling signal respond compliance, bias, delay
  19. 19. inference → challengessystem → putting itchallenges together user → challenges
  20. 20. emotion conflict? inference learningadaptive putting it conflict?sampling together? conflict? experience sampling
  21. 21. {sensed context} → {current emotion} in the moment
  22. 22. {sensed context} → { } {sensed context} → {current emotion} { } → {current emotion}
  23. 23. {sensed context} →design for sensor data {current emotion} design for participant compliance
  24. 24. design for sensor data {sensed context} →just finishing: a/b {current emotion}test with a variety oftriggers. results? design for participant compliance
  25. 25. so, to conclude..
  26. 26. you who can misinterpret your emotions?a psychologist your social circles
  27. 27. you your phone who can misinterpret your emotions?a psychologist your social circles
  28. 28. inferssensed “in the reportedcontext moment” mood responds
  29. 29. emotionsense.org@neal_lathiauniversity of cambridge

×