Affect and Emotion-Oriented Systems

Human-Computer Interaction

Master on Software Engineering Human-Computer Interaction “I believe that logic + emotion are a winningcombination. When useful and useable meet delight great things happen. It’s about balance.” David Armano Stefan Negru – www.blankdots.com

http://www.flickr.com/photos/sskennel/

Master on Software Engineering Human-Computer InteractionWhat are emotions, feelings and the other affect related concepts ? Stefan Negru – www.blankdots.com

Master on Software Engineering Human-Computer Interaction Definition: ―Affect is a feeling or emotion asdistinguished from cognition, thought, or action.‖ Stefan Negru – www.blankdots.com

Master on Software Engineering Human-Computer Interaction―Emotion encompasses physiological, affective,behavioral, and cognitive components.‖ Scott Brave & Clifford Nass, 2008 Stefan Negru – www.blankdots.com

Master on Software Engineering Human-Computer Interaction―Emotion is a reaction to events deemed relevantto the needs, goals, or concerns of an individual.‖ Scott Brave & Clifford Nass, 2008 Stefan Negru – www.blankdots.com

Master on Software Engineering Human-Computer Interactionneurological structure of emotion (LeDoux, 1996) Stefan Negru – www.blankdots.com

Master on Software Engineering Human-Computer Interaction emotion versus moodmoods are not directed at any object in particular andare experienced as more diffuse, global, and general state a person can be sad about something - an emotion or generally depressed - a mood Stefan Negru – www.blankdots.com

Master on Software Engineering Human-Computer Interaction emotion versus moodAn emotion can lead to or take part in establishing a certain mood Sadness (& other factors) depression Stefan Negru – www.blankdots.com

Master on Software Engineering Human-Computer Interaction emotion versus feelingFeelings relate more to a property associated to and object or being, than to a person’s state of mind.Feeling last more (days/weeks/years) than emotions (seconds) or moods (hours / days) Stefan Negru – www.blankdots.com

Master on Software Engineering Human-Computer Interaction emotion versus feelingFeelings are often pointed towards a class of objects, beings distinguishable through a certain property ―I love Adobe CS applications!‖ ―I hate text-editing applications‖ Stefan Negru – www.blankdots.com

Master on Software Engineering Human-Computer Interaction emotion and memory negative events, which tend to be highlyarousing, are typically remembered better than positive events Stefan Negru – www.blankdots.com

Master on Software Engineering Human-Computer Interaction emotion and performance keeping a user happy may, therefore,not only affect satisfaction, but may also lead to efficiency and creativity Stefan Negru – www.blankdots.com

Master on Software Engineering Human-Computer InteractionA Circumplex model of affect (Russell, 1980). Stefan Negru – www.blankdots.com

Master on Software Engineering Human-Computer InteractionRussell’s circumplex remodeled (Desmet, 2002; van Gorp, 2006) Stefan Negru – www.blankdots.com

Master on Software Engineering Human-Computer Interaction emotion dimensions Value pleasant versus unpleasant Arousal (psychological) anxiety versus boredom Stefan Negru – www.blankdots.com

Master on Software Engineering Human-Computer InteractionAnxiety, Boredom and Flow (Csikszentmihalyi, 1990; van Gorp 2006) Stefan Negru – www.blankdots.com

Master on Software Engineering Human-Computer Interaction FlowAchieving the desired state and keeping the user in that state is our goal. Stefan Negru – www.blankdots.com

Humane interfaces consider emotions

Master on Software Engineering Human-Computer Interaction“Products were once designed for the functions theyperformed. But when all companies can make productsthat perform their functions equally well, the distinctiveadvantage goes to those who provide pleasure andenjoyment while maintaining the power. If functions areequated with cognition, pleasure is equated withemotion; today we want products that appeal to bothcognition and emotion.” Don Norman ―The Transmedia Design Challenge: Technology that is Pleasurable and Satisfying‖, ACM Interactions Volume 17 Issue 1, January + February 2010 Stefan Negru – www.blankdots.com

Master on Software Engineering Human-Computer Interactionhttp://www.nbcchicago.com/news/local-beat/Frank_lloyd-wright-fallingwater-lego.html Stefan Negru – www.blankdots.com

Master on Software Engineering Human-Computer Interactionhttp://getsatisfaction.com/spotify/topics/when_will_we_have_a_blackberry_client Stefan Negru – www.blankdots.com

Master on Software Engineering Human-Computer InteractionIt’s all nice, tidy and easy to understand right ? Stefan Negru – www.blankdots.com

Master on Software Engineering Human-Computer Interaction Wishful thinkingIt’s all nice and easy to understand right ? Stefan Negru – www.blankdots.com

Master on Software Engineering Human-Computer Interaction Where’s the problem ? Stefan Negru – www.blankdots.com

Master on Software Engineering Human-Computer Interaction A few Problems1. Detecting Emotions2. Labeling Emotions3. Processing Emotions4. Have an unobtrusive interface Stefan Negru – www.blankdots.com

Master on Software Engineering Human-Computer Interaction 1. Detecting Emotions Neurological responsesvia electroencephalography (EEG) or magneto‐resonance imaging (MRI) User input Facial expression Voice Stefan Negru – www.blankdots.com

Master on Software Engineering Human-Computer Interaction http://www.emotiv.com/ based on electroencephalography (EEG) technology Stefan Negru – www.blankdots.com

Master on Software Engineering Human-Computer Interaction ―Lie to me‖– Tv showhttp://www.imdb.com/media/rm817007104/tt1235099 Stefan Negru – www.blankdots.com

Master on Software Engineering Human-Computer Interaction METT – Micro Expression Training Tool SETT – Subtle Expression Training Tool Stefan Negru – www.blankdots.com

Master on Software Engineering Human-Computer Interaction Asking our user how he feels. Stefan Negru – www.blankdots.com

Master on Software Engineering Human-Computer Interaction 2. Labeling Emotions Which are basic emotions ? Group Emotions Mixed versus pure emotions Stefan Negru – www.blankdots.com

Master on Software Engineering Human-Computer Interaction http://wefeelfine.org/12 million human emotions recorded since 2005 (2009 statement) Stefan Negru – www.blankdots.com

Master on Software Engineering Human-Computer Interaction Emotion-Oriented Systems The Humaine Handbook, Springer 2011 Stefan Negru – www.blankdots.com

Master on Software Engineering Human-Computer Interaction Basic emotionsanger, disgust, fear, happiness, sadness and surprise Stefan Negru – www.blankdots.com

Master on Software Engineering Human-Computer Interaction Labeling emotionsLabeling is important but not for a machine Stefan Negru – www.blankdots.com

Master on Software Engineering Human-Computer InteractionA label for the machine is a x,y coordinate on the circumplex. Stefan Negru – www.blankdots.com

Master on Software Engineering Human-Computer Interaction Proposal of labeling emotionsFeelTagged an Arduino-based Social-Emotional Interactive System – Stefan Negru 2010 Stefan Negru – www.blankdots.com

Master on Software Engineering Human-Computer Interaction 3. Processing emotions Is it a mood/feeling/emotion ? What category/dimension ? Multiple and/or complex emotionsEmotion intensity, timing and context observed ? etc. Stefan Negru – www.blankdots.com

Master on Software Engineering Human-Computer Interaction Annotating emotions <emotionml xmlns="http://www.w3.org/2009/10/emotionml"> <emotion> <dimensions set="PleasantAnxiety"> <pleasant value="1.3"/> <!—- somewhat positive pleasant state --> <anxiety value="1.9"/>  <modality set="PersonalContext" mode="face voice" medium="visual acoustic"/> </dimensions> </emotion></emotionml> EmotionML http://www.w3.org/TR/emotionml/ Stefan Negru – www.blankdots.com

Master on Software Engineering Human-Computer Interaction 5. Have an unobtrusive interfaceProviding a useful, easy to understand and adaptive interface – secondary goal Unobtrusive interface- primary goal Stefan Negru – www.blankdots.com

Master on Software Engineering Human-Computer Interaction emotion and attentionan interface capable of detecting, or predicting a user’s emotional or mood state could similarly assume an affect‐regulation role,helping to guide attention away from negative and toward more positive stimuli Stefan Negru – www.blankdots.com

Master on Software Engineering Human-Computer Interaction emotion and attention Disregarding the flow state―This system failed to understand your command.‖ – blaming itself―The command was not understood.‖ – blaming no one―You did not speak clearly enough for your command to beunderstood.‖ – blaming the user Stefan Negru – www.blankdots.com

Master on Software Engineering Human-Computer Interaction Stefan Negru – www.blankdots.com

Master on Software Engineering Human-Computer Interaction Affective based interactionAffective aspects of interaction (Rogers, 2007) frustration how we can detect and reduce it? Stefan Negru – www.blankdots.com

Master on Software Engineering Human-Computer Interaction Affective based interactionAffective aspects of interaction (Rogers, 2007) persuasive technologieshow we can change the user attitude & behavior by using the actual technologies? Stefan Negru – www.blankdots.com

http://www.happypills.es/

Master on Software Engineering Human-Computer Interaction affective interactionexample: a robot hardware platform called iCAT usesa set of logical rules to convey emotional states as itmakes decisions, with the goal of improving human-robot interactionPhilips Research Laboratory 2005 Stefan Negru – www.blankdots.com

Master on Software Engineering Human-Computer Interaction http://www.research.philips.com/ Stefan Negru – www.blankdots.com

Master on Software Engineering Human-Computer Interaction http://pleoworld.com/Pleo is an animatronic dinosaur toy designed to emulate the appearance and(imagined) behavior of a week-old baby Camarasaurus. Stefan Negru – www.blankdots.com

Master on Software Engineering Human-Computer Interaction Ethical aspects The goal is not to control people actions but to support them in order to improve their emotionalstate and to provide a better interaction based on the user’s emotional state Stefan Negru – www.blankdots.com

Master on Software Engineering Human-Computer Interaction Dark side of emotionsHumans could have an offensive behavior regarding the digital entities www.agentabuse.org Stefan Negru – www.blankdots.com

Master on Software Engineering Human-Computer Interaction Dark side of emotions Humans could have an offensive behavior regarding the digital entities example (Tatsuya Nomura, 2005): impolite behavior of the patients,when they discovered that the therapist is a virtual agent Stefan Negru – www.blankdots.com

Master on Software Engineering Human-Computer Interaction Dark side of emotions Humans could have an offensive behavior regarding the digital entities experiment (Christoph Bartneck et al., 2005):humans tend to hurt more easily robots/devices than people Stefan Negru – www.blankdots.com

Master on Software Engineering Human-Computer Interaction Unobtrusive versus InformativeShould users be informed that their affective states are being monitored and adapted to ? Stefan Negru – www.blankdots.com

Master on Software Engineering Human-Computer Interaction Questions Stefan Negru – www.blankdots.com

Affect and Emotion-Oriented Systems

by blank dots on Apr 18, 2011

Accessibility

Categories

Tags

Upload Details

Usage Rights

1 Embed 4

Statistics

Affect and Emotion-Oriented Systems — Presentation Transcript