Human-Computer Interaction
Master on Software Engineering Human-Computer Interaction   “I believe that logic + emotion are a winningcombination. When...
http://www.flickr.com/photos/sskennel/
Master on Software Engineering Human-Computer InteractionWhat are emotions, feelings and the other affect             rela...
Master on Software Engineering Human-Computer Interaction  Definition: ―Affect is a feeling or emotion asdistinguished fro...
Master on Software Engineering Human-Computer Interaction―Emotion encompasses physiological, affective,behavioral, and cog...
Master on Software Engineering Human-Computer Interaction―Emotion is a reaction to events deemed relevantto the needs, goa...
Master on Software Engineering Human-Computer Interactionneurological structure of emotion (LeDoux, 1996)                 ...
Master on Software Engineering Human-Computer Interaction                 emotion versus moodmoods are not directed at any...
Master on Software Engineering Human-Computer Interaction                emotion versus moodAn emotion can lead to or take...
Master on Software Engineering Human-Computer Interaction               emotion versus feelingFeelings relate more to a pr...
Master on Software Engineering Human-Computer Interaction                emotion versus feelingFeelings are often pointed ...
Master on Software Engineering Human-Computer Interaction                emotion and memory   negative events, which tend ...
Master on Software Engineering Human-Computer Interaction             emotion and performance     keeping a user happy may...
Master on Software Engineering Human-Computer InteractionA Circumplex model of affect (Russell, 1980).                    ...
Master on Software Engineering Human-Computer InteractionRussell’s circumplex remodeled (Desmet, 2002; van Gorp, 2006)    ...
Master on Software Engineering Human-Computer Interaction          emotion dimensions                        Value    plea...
Master on Software Engineering Human-Computer InteractionAnxiety, Boredom and Flow (Csikszentmihalyi, 1990; van Gorp 2006)...
Master on Software Engineering Human-Computer Interaction                                FlowAchieving the desired state a...
Humane interfaces consider emotions
Master on Software Engineering Human-Computer Interaction“Products were once designed for the functions theyperformed. But...
Master on Software Engineering Human-Computer Interactionhttp://www.nbcchicago.com/news/local-beat/Frank_lloyd-wright-fall...
Master on Software Engineering Human-Computer Interactionhttp://getsatisfaction.com/spotify/topics/when_will_we_have_a_bla...
Master on Software Engineering Human-Computer InteractionIt’s all nice, tidy and easy to understand right ?               ...
Master on Software Engineering Human-Computer Interaction                                           Wishful thinkingIt’s a...
Master on Software Engineering Human-Computer Interaction                       Where’s the problem ?                     ...
Master on Software Engineering Human-Computer Interaction                         A few Problems1.   Detecting Emotions2. ...
Master on Software Engineering Human-Computer Interaction          1. Detecting Emotions         Neurological responsesvia...
Master on Software Engineering Human-Computer Interaction             http://www.emotiv.com/   based on electroencephalogr...
Master on Software Engineering Human-Computer Interaction                      ―Lie to me‖– Tv showhttp://www.imdb.com/med...
Master on Software Engineering Human-Computer Interaction        METT – Micro Expression Training Tool        SETT – Subtl...
Master on Software Engineering Human-Computer Interaction              Asking our user how he feels.                      ...
Master on Software Engineering Human-Computer Interaction          2. Labeling Emotions   Which are basic emotions ?      ...
Master on Software Engineering Human-Computer Interaction                    http://wefeelfine.org/12 million human emotio...
Master on Software Engineering Human-Computer Interaction    Emotion-Oriented Systems The Humaine Handbook, Springer 2011 ...
Master on Software Engineering Human-Computer Interaction                    Basic emotionsanger, disgust, fear, happiness...
Master on Software Engineering Human-Computer Interaction                 Labeling emotionsLabeling is important but not f...
Master on Software Engineering Human-Computer InteractionA label for the machine is a x,y coordinate on the circumplex.   ...
Master on Software Engineering Human-Computer Interaction                  Proposal of labeling emotionsFeelTagged an Ardu...
Master on Software Engineering Human-Computer Interaction             3. Processing emotions         Is it a mood/feeling/...
Master on Software Engineering Human-Computer Interaction                   Annotating emotions <emotionml xmlns="http://w...
Master on Software Engineering Human-Computer Interaction     5. Have an unobtrusive interfaceProviding a useful, easy to ...
Master on Software Engineering Human-Computer Interaction             emotion and attentionan interface capable of detecti...
Master on Software Engineering Human-Computer Interaction                     emotion and attention              Disregard...
Master on Software Engineering Human-Computer Interaction                                         Stefan Negru – www.blank...
Master on Software Engineering Human-Computer Interaction           Affective based interactionAffective aspects of intera...
Master on Software Engineering Human-Computer Interaction            Affective based interactionAffective aspects of inter...
http://www.happypills.es/
Master on Software Engineering Human-Computer Interaction                      affective interactionexample: a robot hardw...
Master on Software Engineering Human-Computer Interaction       http://www.research.philips.com/                          ...
Master on Software Engineering Human-Computer Interaction                                       http://pleoworld.com/Pleo ...
Master on Software Engineering Human-Computer Interaction                         Ethical aspects   The goal is not to con...
Master on Software Engineering Human-Computer Interaction             Dark side of emotionsHumans could have an offensive ...
Master on Software Engineering Human-Computer Interaction                  Dark side of emotions    Humans could have an o...
Master on Software Engineering Human-Computer Interaction                Dark side of emotions   Humans could have an offe...
Master on Software Engineering Human-Computer Interaction           Unobtrusive versus InformativeShould users be informed...
Master on Software Engineering Human-Computer Interaction           Questions                                         Stef...
Upcoming SlideShare
Loading in …5
×

Affect and Emotion-Oriented Systems

2,399 views

Published on

Published in: Education
0 Comments
2 Likes
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total views
2,399
On SlideShare
0
From Embeds
0
Number of Embeds
7
Actions
Shares
0
Downloads
87
Comments
0
Likes
2
Embeds 0
No embeds

No notes for slide

Affect and Emotion-Oriented Systems

  1. 1. Human-Computer Interaction
  2. 2. Master on Software Engineering Human-Computer Interaction “I believe that logic + emotion are a winningcombination. When useful and useable meet delight great things happen. It’s about balance.” David Armano Stefan Negru – www.blankdots.com
  3. 3. http://www.flickr.com/photos/sskennel/
  4. 4. Master on Software Engineering Human-Computer InteractionWhat are emotions, feelings and the other affect related concepts ? Stefan Negru – www.blankdots.com
  5. 5. Master on Software Engineering Human-Computer Interaction Definition: ―Affect is a feeling or emotion asdistinguished from cognition, thought, or action.‖ Stefan Negru – www.blankdots.com
  6. 6. Master on Software Engineering Human-Computer Interaction―Emotion encompasses physiological, affective,behavioral, and cognitive components.‖ Scott Brave & Clifford Nass, 2008 Stefan Negru – www.blankdots.com
  7. 7. Master on Software Engineering Human-Computer Interaction―Emotion is a reaction to events deemed relevantto the needs, goals, or concerns of an individual.‖ Scott Brave & Clifford Nass, 2008 Stefan Negru – www.blankdots.com
  8. 8. Master on Software Engineering Human-Computer Interactionneurological structure of emotion (LeDoux, 1996) Stefan Negru – www.blankdots.com
  9. 9. Master on Software Engineering Human-Computer Interaction emotion versus moodmoods are not directed at any object in particular andare experienced as more diffuse, global, and general state a person can be sad about something - an emotion or generally depressed - a mood Stefan Negru – www.blankdots.com
  10. 10. Master on Software Engineering Human-Computer Interaction emotion versus moodAn emotion can lead to or take part in establishing a certain mood Sadness (& other factors) depression Stefan Negru – www.blankdots.com
  11. 11. Master on Software Engineering Human-Computer Interaction emotion versus feelingFeelings relate more to a property associated to and object or being, than to a person’s state of mind.Feeling last more (days/weeks/years) than emotions (seconds) or moods (hours / days) Stefan Negru – www.blankdots.com
  12. 12. Master on Software Engineering Human-Computer Interaction emotion versus feelingFeelings are often pointed towards a class of objects, beings distinguishable through a certain property ―I love Adobe CS applications!‖ ―I hate text-editing applications‖ Stefan Negru – www.blankdots.com
  13. 13. Master on Software Engineering Human-Computer Interaction emotion and memory negative events, which tend to be highlyarousing, are typically remembered better than positive events Stefan Negru – www.blankdots.com
  14. 14. Master on Software Engineering Human-Computer Interaction emotion and performance keeping a user happy may, therefore,not only affect satisfaction, but may also lead to efficiency and creativity Stefan Negru – www.blankdots.com
  15. 15. Master on Software Engineering Human-Computer InteractionA Circumplex model of affect (Russell, 1980). Stefan Negru – www.blankdots.com
  16. 16. Master on Software Engineering Human-Computer InteractionRussell’s circumplex remodeled (Desmet, 2002; van Gorp, 2006) Stefan Negru – www.blankdots.com
  17. 17. Master on Software Engineering Human-Computer Interaction emotion dimensions Value pleasant versus unpleasant Arousal (psychological) anxiety versus boredom Stefan Negru – www.blankdots.com
  18. 18. Master on Software Engineering Human-Computer InteractionAnxiety, Boredom and Flow (Csikszentmihalyi, 1990; van Gorp 2006) Stefan Negru – www.blankdots.com
  19. 19. Master on Software Engineering Human-Computer Interaction FlowAchieving the desired state and keeping the user in that state is our goal. Stefan Negru – www.blankdots.com
  20. 20. Humane interfaces consider emotions
  21. 21. Master on Software Engineering Human-Computer Interaction“Products were once designed for the functions theyperformed. But when all companies can make productsthat perform their functions equally well, the distinctiveadvantage goes to those who provide pleasure andenjoyment while maintaining the power. If functions areequated with cognition, pleasure is equated withemotion; today we want products that appeal to bothcognition and emotion.” Don Norman ―The Transmedia Design Challenge: Technology that is Pleasurable and Satisfying‖, ACM Interactions Volume 17 Issue 1, January + February 2010 Stefan Negru – www.blankdots.com
  22. 22. Master on Software Engineering Human-Computer Interactionhttp://www.nbcchicago.com/news/local-beat/Frank_lloyd-wright-fallingwater-lego.html Stefan Negru – www.blankdots.com
  23. 23. Master on Software Engineering Human-Computer Interactionhttp://getsatisfaction.com/spotify/topics/when_will_we_have_a_blackberry_client Stefan Negru – www.blankdots.com
  24. 24. Master on Software Engineering Human-Computer InteractionIt’s all nice, tidy and easy to understand right ? Stefan Negru – www.blankdots.com
  25. 25. Master on Software Engineering Human-Computer Interaction Wishful thinkingIt’s all nice and easy to understand right ? Stefan Negru – www.blankdots.com
  26. 26. Master on Software Engineering Human-Computer Interaction Where’s the problem ? Stefan Negru – www.blankdots.com
  27. 27. Master on Software Engineering Human-Computer Interaction A few Problems1. Detecting Emotions2. Labeling Emotions3. Processing Emotions4. Have an unobtrusive interface Stefan Negru – www.blankdots.com
  28. 28. Master on Software Engineering Human-Computer Interaction 1. Detecting Emotions Neurological responsesvia electroencephalography (EEG) or magneto‐resonance imaging (MRI) User input Facial expression Voice Stefan Negru – www.blankdots.com
  29. 29. Master on Software Engineering Human-Computer Interaction http://www.emotiv.com/ based on electroencephalography (EEG) technology Stefan Negru – www.blankdots.com
  30. 30. Master on Software Engineering Human-Computer Interaction ―Lie to me‖– Tv showhttp://www.imdb.com/media/rm817007104/tt1235099 Stefan Negru – www.blankdots.com
  31. 31. Master on Software Engineering Human-Computer Interaction METT – Micro Expression Training Tool SETT – Subtle Expression Training Tool Stefan Negru – www.blankdots.com
  32. 32. Master on Software Engineering Human-Computer Interaction Asking our user how he feels. Stefan Negru – www.blankdots.com
  33. 33. Master on Software Engineering Human-Computer Interaction 2. Labeling Emotions Which are basic emotions ? Group Emotions Mixed versus pure emotions Stefan Negru – www.blankdots.com
  34. 34. Master on Software Engineering Human-Computer Interaction http://wefeelfine.org/12 million human emotions recorded since 2005 (2009 statement) Stefan Negru – www.blankdots.com
  35. 35. Master on Software Engineering Human-Computer Interaction Emotion-Oriented Systems The Humaine Handbook, Springer 2011 Stefan Negru – www.blankdots.com
  36. 36. Master on Software Engineering Human-Computer Interaction Basic emotionsanger, disgust, fear, happiness, sadness and surprise Stefan Negru – www.blankdots.com
  37. 37. Master on Software Engineering Human-Computer Interaction Labeling emotionsLabeling is important but not for a machine Stefan Negru – www.blankdots.com
  38. 38. Master on Software Engineering Human-Computer InteractionA label for the machine is a x,y coordinate on the circumplex. Stefan Negru – www.blankdots.com
  39. 39. Master on Software Engineering Human-Computer Interaction Proposal of labeling emotionsFeelTagged an Arduino-based Social-Emotional Interactive System – Stefan Negru 2010 Stefan Negru – www.blankdots.com
  40. 40. Master on Software Engineering Human-Computer Interaction 3. Processing emotions Is it a mood/feeling/emotion ? What category/dimension ? Multiple and/or complex emotionsEmotion intensity, timing and context observed ? etc. Stefan Negru – www.blankdots.com
  41. 41. Master on Software Engineering Human-Computer Interaction Annotating emotions <emotionml xmlns="http://www.w3.org/2009/10/emotionml"> <emotion> <dimensions set="PleasantAnxiety"> <pleasant value="1.3"/> <!—- somewhat positive pleasant state --> <anxiety value="1.9"/> <!-- very high positive anxiety --> <modality set="PersonalContext" mode="face voice" medium="visual acoustic"/> </dimensions> </emotion></emotionml> EmotionML http://www.w3.org/TR/emotionml/ Stefan Negru – www.blankdots.com
  42. 42. Master on Software Engineering Human-Computer Interaction 5. Have an unobtrusive interfaceProviding a useful, easy to understand and adaptive interface – secondary goal Unobtrusive interface- primary goal Stefan Negru – www.blankdots.com
  43. 43. Master on Software Engineering Human-Computer Interaction emotion and attentionan interface capable of detecting, or predicting a user’s emotional or mood state could similarly assume an affect‐regulation role,helping to guide attention away from negative and toward more positive stimuli Stefan Negru – www.blankdots.com
  44. 44. Master on Software Engineering Human-Computer Interaction emotion and attention Disregarding the flow state―This system failed to understand your command.‖ – blaming itself―The command was not understood.‖ – blaming no one―You did not speak clearly enough for your command to beunderstood.‖ – blaming the user Stefan Negru – www.blankdots.com
  45. 45. Master on Software Engineering Human-Computer Interaction Stefan Negru – www.blankdots.com
  46. 46. Master on Software Engineering Human-Computer Interaction Affective based interactionAffective aspects of interaction (Rogers, 2007) frustration how we can detect and reduce it? Stefan Negru – www.blankdots.com
  47. 47. Master on Software Engineering Human-Computer Interaction Affective based interactionAffective aspects of interaction (Rogers, 2007) persuasive technologieshow we can change the user attitude & behavior by using the actual technologies? Stefan Negru – www.blankdots.com
  48. 48. http://www.happypills.es/
  49. 49. Master on Software Engineering Human-Computer Interaction affective interactionexample: a robot hardware platform called iCAT usesa set of logical rules to convey emotional states as itmakes decisions, with the goal of improving human-robot interactionPhilips Research Laboratory 2005 Stefan Negru – www.blankdots.com
  50. 50. Master on Software Engineering Human-Computer Interaction http://www.research.philips.com/ Stefan Negru – www.blankdots.com
  51. 51. Master on Software Engineering Human-Computer Interaction http://pleoworld.com/Pleo is an animatronic dinosaur toy designed to emulate the appearance and(imagined) behavior of a week-old baby Camarasaurus. Stefan Negru – www.blankdots.com
  52. 52. Master on Software Engineering Human-Computer Interaction Ethical aspects The goal is not to control people actions but to support them in order to improve their emotionalstate and to provide a better interaction based on the user’s emotional state Stefan Negru – www.blankdots.com
  53. 53. Master on Software Engineering Human-Computer Interaction Dark side of emotionsHumans could have an offensive behavior regarding the digital entities www.agentabuse.org Stefan Negru – www.blankdots.com
  54. 54. Master on Software Engineering Human-Computer Interaction Dark side of emotions Humans could have an offensive behavior regarding the digital entities example (Tatsuya Nomura, 2005): impolite behavior of the patients,when they discovered that the therapist is a virtual agent Stefan Negru – www.blankdots.com
  55. 55. Master on Software Engineering Human-Computer Interaction Dark side of emotions Humans could have an offensive behavior regarding the digital entities experiment (Christoph Bartneck et al., 2005):humans tend to hurt more easily robots/devices than people Stefan Negru – www.blankdots.com
  56. 56. Master on Software Engineering Human-Computer Interaction Unobtrusive versus InformativeShould users be informed that their affective states are being monitored and adapted to ? Stefan Negru – www.blankdots.com
  57. 57. Master on Software Engineering Human-Computer Interaction Questions Stefan Negru – www.blankdots.com

×