SlideShare a Scribd company logo
1 of 47
EMOTION RECOGNITION
XingyuWen
xingyu9404@163.com
1
■ Emotion Definition (page 3)
– Basic Emotion
– Dimensional Emotion
■ Social Emotion And Emotion-evoked Theory (p
age 9)
– Social Emotion
– James-lange Theory
– Cannon-bard Theory
– Schatter & Singer Two Factor Theory
■ Bioreaction According To Emotion (page 21)
– Brain
– Heart
– Eye
– Skin
– Facial expression
■ Emotional Issues (page 29)
– Subjectivity And Objectivity
– Moment Emotion
– Fake Emotions
– Temporary And Daily Emotions
– Emotional Consciousness And Unconsci
ous
– Emotional Contagion And Synchronizati
on
– Personal Emotion And Social Emotion
Catalog
■ Emotion Intensity (page 37)
– Definitions
– Features
– Expressions
■ Complex Emotion (page 41)
2
Emotion Definition
- Basic Emotion
- Dimensional Emotion
3
Contents
■ History Of Basic Emotion Research
- Duchenne de Boulogne (1862) identifies 13 major emotions by one or two facial muscle representations;
- Attention, Reflection, Meditation, Intentness of mind, Pain, Aggression or Menace, Weeping with hot tears, Moderate
Weeping, Joy, Laughter, False Laughter, Irony, ironic laughter, Sadness or Despondency
- Charles Darwin (1872) divides emotions into 8 groups and considers them culturally unaffected;
- Silvan Tomkins(1962) divides emotions into 9 emotions based on the same biological response (the Nine effect);
- Positive (Interest-excitement, Enjoyment-joy), Neutral (Surprise-startle), Negative (Distress-anguish, Anger-rage, Fear-
terror, Shame-humiliation, Dissmell (root of contempt), Disgust).
- Paul Ekman (1971), removed three emotions (Contemut, Sham and Inner), and defines six basic emotions based on Tomkins
theory.
- Based on facial expressions (It have no cultural differences)
4
Contents
■ Ekman’s Six Basic Emotion
- Ekman's face expression extraction processes
- Six emotions base on FACS(Facial Action Coding System)
- Ekman’s six basic emotions: happy, sad, anger, surprise, fear, disgust, there is no difference between social, culture and ages;
Emotion AU(Action Unit) Example
Happiness
6 : Cheek Raise
12 : Lip Corner Pull
25 : Lips Part
Sadness
1 : Inner Brow Raise
4 : Brow Lower
17 : Chin Raise
Anger
4 : Brow Lower
7 : Lid Tighten
17 : Chin Raise
24 : Lip Press
Emotion AU(Action Unit) Example
Fear
1 : Inner Brow Raise
2 : Outer Brow Raise
4 : Brow Lower
5 : Upper Lid Raise
20 : Lip Stretch
Surprise
1 : Inner Brow Raise
2 : Outer Borw Raise
5 : Upper Lid Raise
26 : Jaw Drop
Disgust
9 : Nose Wrinkle
10 : Upper Lid Raise
15 : Lid Corner Depress
25 : Lips Part
5
Figures from: Tian, Y. I., Kanade, T., & Cohn, J. F. (2001). Recognizing action units for facial expression analysis. IEEE Transactions on pattern analysis and machine intelligence, 23(2), 97-115.
James A Russell. (1980). Circumplex Model of Affect. Journal of Personality and Social Psychology, 39(6), 1161-1178
Contents
■ Facial Expressions – Au(Action Units)
- The expression and emotion of a person are not based on culture or learning, but is a instinct. So that there's a universality in facial
expressions.
- There are 42 muscles on the human face, Micro-Expression appear and change between 0.5 and 4 seconds in our usual facial expressions.
Moreover, an indescribable expression of true feelings expresses by unconsciousness that appears and disappears momentarily in a very
short time of 0.2 seconds.
- FACS (Facial Action Coding System) each facial expression is given an alphabet and number to sign its type and intensity.
- Alphabetical rating (A-E): the intensity of emotions. It is more intensity from A to E.
■ History Of Dimensional Emotion Research
- Nowlis define emotion in six to twelve independent emotional dimensions, like sadness,
anxiety, aner, elation, tension, etc. based on self-reporting experiment.
- Tomkins, Lzard, Ekman think that each emotional state can be seen as a different
dimension, For example, sadness and great joy can be conjoined together in reverse.
- Schlosberg thinks emotions are not independent of each other, but very systematically
associated with each other. He defines a two-dimensional circle model in pleasantness
– unpleasantness, attention – rejection, and then proposes three dimensional model by
adding dimension of sleepiness – tension.
- Russell defined in a circular form with two-dimensional bipolar properties: valence and
arousal based on Laymen’s Conceptualization of Affect (judgement) and Multivariate
Analysis of Self-reported Affective States (experiences)
6Figures from: Clark, E. A., J'Nai Kessinger, S. E. D., Bell, M. A., Lahne, J., Gallagher, D. L., & O'Keefe, S. F. (2020). The Facial Action Coding System for Characterization of Human Affective Response to Consumer Product-
Based Stimuli: A Systematic Review. Frontiers in Psychology, 11.
Contents
■ Russell’s dimensional circle model
- Russell’ dimensional emotion use two independent dimensions to explain emotional states: valence and arousal;
- Methods
- Circular Scaling of Terms
- Multidimensional Scaling of Terms
- Unidimensional Scaling
- Structure of Self-Reported Affect
- the classification of emotions by a person's judgment is based on the person's cognitive structure
- Dimensional emotion model is defined as valence and arousal
- Neurophysiological interpretation
- Excited, Tense, Angry: sympathetic nerve ↑, parasympathetic nerve ↓, pupil dilation
- Calm, Bored, Tired: sympathetic nerve ↓, parasympathetic nerve ↑, pupil constriction
- Β wave: Rise (cupillary lobe) - Awakening under stress conditions
- Α wave: Low brain activity (hypodiacal lobe) - Stable
- Beta/Alpha: The ratio of two frequencies can be used to determine the awakening
- The frontal lobe plays a crucial role in the experience of sperm control and consciousness.
- Inactivation of the left hemisphere forebrain is associated with negative emotion
- In contrast, inactivation of the right hemisphere forebrain indicates positive
7Figures from: James A Russell. (1980). Circumplex Model of Affect. Journal of Personality and Social Psychology, 39(6), 1161-1178
Reference
- Ekman, P. (1989).The argument and evidence about universals in facial expressions. Handbook of social psychophysiology, 143-164.
- Ekman, P. (1992).An argument for basic emotions. Cognition & emotion, 6(3-4), 169-200.
- Ekman, P., & Friesen,W.V. (1971). Constants across cultures in the face and emotion. Journal of personality and social psychology, 17(2), 124.
- James A Russell. (1980). Circumplex Model of Affect. Journal of Personality and Social Psychology, 39(6), 1161-1178.
- Jonathan Posner. (2009).The Neurophysiological Bases of Emotion:An fMRI Study of theAffective Circumplex Using Emotion-Denoting Words. Hum Brain
Mapp. 30(3). 883-895.
- Ortony,A., &Turner,T. J. (1990).What's basic about basic emotions?. Psychological review, 97(3), 315.
- Ortony,A., &Turner,T. J. (1990).What's basic about basic emotions?. Psychological review, 97(3), 315.
- Rinn,W. E. (1984).The neuropsychology of facial expression: a review of the neurological and psychological mechanisms for producing facial expressions.
Psychological bulletin, 95(1), 52.
- Saarimäki, H., Gotsopoulos, A., Jääskeläinen, I. P., Lampinen, J.,Vuilleumier, P., Hari, R., ... & Nummenmaa, L. (2016). Discrete neural signatures of basic
emotions. Cerebral cortex, 26(6), 2563-2573.
- Wundt,Wilhelm Max. Lectures on human and animal psychology. George Allen, 1896.
- Schlosberg, Harold. "The description of facial expressions in terms of two dimensions." Journal of experimental psychology 44.4 (1952): 229.
- Levenson R W.The autonomic nervous system and emotion[J]. Emotion Review, 2014, 6(2): 100-112.
- Handbook of emotions[M]. Guilford Press, 2010.
- Agrafioti F, Hatzinakos D,Anderson A K. ECG pattern analysis for emotion detection[J]. IEEETransactions on affective computing, 2011, 3(1): 102-115.
- Tomarken, Resting frontal brain asymmetry predicts affective responses to films, 1990
- Davidson, Neuropsychological perspectives on affective styles and their cognitive consequences, 1999
- Davidson, R. J., Ekman, P., Saron, C. D., Senulis, J. A., &Friesen,W.V. (1990). Approach-withdrawal and cerebral asymmetry: Emotional expression and brain
physiology: I. Journal of Personality and Social Psychology, 58 (2), 330–341
- Paul Ekman (2012) , “should we call it expression or communication?”,The European Journal of social science research, Jan 24
8
Social Emotion And Emotion-evoked Theor
y
- Social Emotion
- Emotion-evoked Theory
- Social Emotion - Emotion-evoked Theory
9
Contents
■ Social Emotions
- Social emotions are caused by interactions with others and have important social function, that means social emotions depend on the
thoughts, feelings, and behaviors of others, and relate to interpersonal relationship, institutional system, and culture.
- Definition
- Social emotion are various opinions based on factors and categories;
- Social emotions are complex emotions, in which cognitive factors play an important role;
- Social emotions are influenced by communication, not internal phenomena;
- Social emotions play an important role in moral decision-making, so it is also called moral emotion.
- Opinion 1: Social emotions develop in the later stages of human evolution rather than general emotions
- Buck(1999)
- Emotions are separate from biological mechanism, especially social emotions are developed from basic attachments in
society.
- Oatley(1987)
- All human emotions are social because they believe that the way of evolution takes into account the social perception in
the previous structure to deal with the complexity of social life.
- Even basic emotions such as happiness, sadness, anxiety, anger, and disgust are considered social emotions because they
are mainly related to social objects
- Opinion 2: Social emotions are caused by judgments of facts, imagination and expectations
- Leary(2001)
- Emphasis on relationships of all types of social emotion
- Bennett& Campos(1987)
- Social emotions are classified based on basic principles and goals.
10
Contents
■ Comparison of Group Emotions and Social Emotions
- Group Emotions
- Form emotions in one direction and transfer emotions in a group
- Through the interaction and transmission of emotions among group members, individual emotions are transformed into group
emotions
- Public emotion has the same or similar emotional structure
- Features
- Unity and collective
- With the popularity of social media, the transfer of public sentiment has accelerated.
- Emotion formation process is formed by the same life experience and cultural factors
- The homogenization trend of the spread of individual emotional states among members of a specific group
- Individual emotions or states are ignored by people with greater intensity of sensitivity
- Emotional strength within the group is an important reason for public emotion
- Synchronization between leader and slave
- Social Emotions
- Emotions caused by interaction with others
- Emotions caused by social connection between people the same psychological experience.
- Features
- Based on emotional interaction between two people
- Different people may have different sensitivities
- React to the thoughts, feelings or behavior of others
- The categories of social emotion are comprehensive and diverse: jealousy, guilt, shame, etc.
- Compared with basic emotions, it has a more complex system and develops later 11
Contents
■ Comparison Tabel
Group Emotions Social Emotions
Commons
Emotions may be evoked from others
It is formed by experiences based on social and cultural factors during the process of emotional development.
Difference
same emotional direction May have different emotional direction
the strength of emotion in the group is important Emotional interaction between two people is important
Basing on emotion infection Basing on social relationships
Synchronization between leader and followers Synchronization between two people
Personal emotion is disregarded by others' great intensity
emotion
Form social relations through emotional interaction
12
Contents
■ Social emotions
- Classifications (table 1)
- Moral emotions
- Basing on Social emotions play an important role in moral decision-making, so it is also called moral emotion.
- Closely related to the interests or well-being of the entire society
- Shame, guilt, regret, embarrassment, contempt, anger, disgust, gratitude, jealousy, jealousy, compassion,
empathy
- From self-aware emotions
- Emotions that occur when an individual recognizes that an event or situation may have effect on self-
assessment or happiness.
- For example: Shame, guilt, pride, embarrassment
Author Social Emotions
Adolphs, Baron Cohen & Tranel, 2002 Admiration, arrogance, flirtatiousness, guilt, loyalty
Barbalet, 1996 Confidence, trust
Barrett & Campos, 1987 Envy, guilt, pride, shame
Barrett and Nelson-Goens, 1997 Embarrassment, envy, guilt, pride, shame
Buck, 1999 Arrogance, envy, guilt, jealousy, joy, pity, pride, scorn, shame
Hareli & Weiner, 2002 Admiration, anger, contempt, dislike, distaste, envy, gratitude, guilt, like, pride, respect, schadenfreude, shame, sympathy
Leary, 2000 Admiration, embarrassment, envy, hatred, hurt feelings, jealousy, loneliness, love, pride, shame, social anxiety, social sadness
Oatley & Johnson-Laird, 1987 Bitterness, delight, depression, disappointment, embarrassment, horror, loathing, sexual love, vengefulness
Parkinson, Fischer & Manstead, 2005 Envy, fago, grief, guilt, jealousy, love, shame
different social emotions
13
Contents
■ Emotional intelligence
- A complex of emotional and social abilities/skills that helps people solve everyday problems and improve efficiency in their
personal and social lives
- Self-awareness: the understanding of strengths and limitations, and the desire for continuous improvement;
- Self-management: successfully control own emotions and behaviors, and can achieve a succeed in new or challenging
situations;
- Social-awareness: the ability to interact with others in a social environment through collaboration and tolerance;
- Relationship Skills: the ability to promote and maintain positive relationships with others
- Goal-Directed Behavior: start and insist on completing tasks of various difficulty
- Personal Responsibility: be cautious and reliable, and help collective efforts
- Decision-Making: use your own values to guide actions and take responsibility for your decisions
- Optimistic Thinking: confidence, hope, positive ways of thinking, attitudes towards yourself and past, present and
future living conditions
- Factors
- Self-awareness
- Self-management
- Social awareness
- Relationship management
14
Figure from pinterest: https://www.pinterest.co.uk/pin/298152437802302187/
Contents
■ Social emotions and Emotional intelligence
Social Emotion Social Intelligence
An individual's feelings depending on the thoughts, feelings,
and actions of others
Heavily influenced by communication with others
What’s your emotions under an special circumstances when
you communicate with others?
The ability to socialize and act appropriately to social
situations
Heavily influenced by a given social situation
How do you live and act under a special circumstances?
15
Contents
■ Social emotion and SNS
- The roles of social emotions in SNS
- People share emotions and information in social media as same as in real society;
- Emotional sharing relationship: express your recent situation, mood, emotions, etc. through SNS, and express
and share emotions with offline people.
- Information sharing relationship: sharing information or music, or getting a new perspective from someone with
professional knowledge-compared to emotional sharing, this connection is worse and forms negative social
emotions
- Method of analysis
- Define the representative relationship between SNS users as emotional sharing relationship (variable) and information
sharing relationship (variable);
- Establish model to verify the social emotion model
Social emotional vocabulary
analysis and collection
Verify the suitability of
socially sensitive vocabulary
Chi-square test
Representative social
sensitivity
Correlation analysis and factor analysis
between social sensitivities
Structural analysis of social
emotion model
Building a social emotion
model
Verify social emotion model
Subjective evaluation
16
Contents
■ Social emotion and Parasympathetic nervous systems (PN)
- When activated, it controls the endocrine glands to prepare the body for emergency action and causes the adrenal glands to produce
epinephrine
- increased blood flow to the muscles
- increased heart rate
- Help the body to move more quickly and feel less pain in situations perceived to be dangerous.
- Parasympathetic nervous systems (PN)
- When the body is relaxed or at rest, it helps the body store energy for future use.
- Increased stomach activity and decreased blood flow to the muscles.
limbic system
autonomicnervous
system
reticular activating
system
serotonin
noradrenaline
dopamine
Result pleasant
or unpleasant
mental states
SNS
PN
together with the
hypothalamus,
regulates pulse, blood
pressure, breathing
arousal in
response to
emotional
cues
first arouse the cortex
then maintain its
wakefulness
sensory information and
emotion can be
interpreted more
effectively.
emotion
cerebral cortex
hippocampus
amygdala
grey, folded, outermost
layer of the cerebrum
responsible for higher brain
processes such as sensation,
voluntary muscle movement,
thought, reasoning, and
memory.
in the medial temporal lobe
play a key role in emotion in
both animals and humans,
particularly in the formation
of fear-based memories
in the temporal lobe of the
brain
plays a role in memory and
emotion
17
Contents
■ James-Lange theory
- Emotion is the result of a physiological reaction to an external event
- Physiological changes at first, then emotions
- E.x. Happy because of smile; sad because of crying;
- Detect
- In the majority of emotions, this test is inapplicable
- Only corroborates in emotions that have a distinct bodily expression.
- For many of the manifestations are in organs over which we have no volitional control
■ Cannon-Bard theory
- emotional and physiological responses both happen—but these are two separate processes
- based on thalamic processes which response for emotional responses to experienced stimuli
- when the thalamic discharge occurs, the bodily changes occur almost simultaneously with the emotional experience.
■ Schatter & singer two factor theory
- Emotion = arousal + cognition
- emotions are the result of both physiological and cognitive processes.
- In a famous 1962 study, Schachter and Singer investigated whether people would respond differently to a shot of adrenaline depending on
the context they found themselves in.
- While later research hasn’t always supported Schachter and Singer’s findings, their theory has been incredibly influential and has inspired
many other researchers.
18
Contents
■ Jame-lange Emphasize Emotions are caused by physical reactions to events
■ Cannon-Bard proposes that both of these reactions originate simultaneously in the thalamus
■ Schachter & Singer(Two-factor) theory of emotion Adds onto James-lange Theory of emotion by stating that two factors are needed: physiologic response
and congnitive label, emp Cognition is the main factor determining emotional state
19Figures from internet
Reference
- Buck, R. (1980). Nonverbal behavior and the theory of emotion:The facial feedback hypothesis. Journal of Personality and Social Psychology, 38(5), 811–824.
doi:10.1037/0022-3514.38.5.811
- Strack, Fritz; Martin, Leonard L.; Stepper, Sabine (May 1988). "Inhibiting and FacilitatingConditions of the Human Smile: A NonobtrusiveTest of the Facial
Feedback Hypothesis". Journal of Personality and Social Psychology. 54 (5): 768–777. doi:10.1037/0022-3514.54.5.768. PMID 3379579.
- Cannon,W.B. (1927). "The James-Lange theory of emotions: A critical examination and an alternative theory".TheAmerican Journal of Psychology. 39 (1/4): 106–
124. doi:10.2307/1415404. JSTOR 1415404.
- Cannon,W.B. (1931). "Again the James-Lange and the thalamic theories of emotion". Psychological Review. 38 (4): 281–295. doi:10.1037/h0072957.
- Ye-Sool Cha , Ji-Hye Kim , Jong-Hwa Kim , Song-Yi Kim ,Dong-Keun Kim, Min-CheolWhang (2012), “Validity analysis of the social emotion model based on
relation types in SNS”, 감성과학,Vol.15, No.2, pp.283-296, June 2012
- JF Kihlstrom, N Cantor, “Social Intelligence”
- Brian Parkinson (1996), “Emotions are social”, British journal of psychology, 1996 -WileyOnline Library
- What is Elevation? - https://gostrengths.com/what-is-elevation/
- Social emotions - https://en.wikipedia.org/wiki/Social_emotions
- Embarrass - https://www.psychologytoday.com/us/blog/intense-emotions-and-strong-feelings/201112/embarrassment
- Marinetti,C., Moore, P., Lucas, P., & Parkinson, B. (2010). Emotions in Social Interactions:Unfolding Emotional Experience. Emotion-Oriented Systems, 31–
46. doi:10.1007/978-3-642-15184-2_3
20
Bioreaction According To Emotion
- Brain
- Heart
- Eye
- Skin
- Facial expression
21
Contents
■ Brain
- EEG
- The electroencephalogram (EEG) is a recording of the electrical activity of the brain from the scalp. The recorded waveforms
reflect the cortical electrical activity.
- the main frequencies of the human EEG waves are: Delta(1-3Hz), Theta(3.5-7.5Hz), Alpha(7.5-13Hz), Beta(14-30Hz),
γ(30~80Hz)
- The electric potential generated by an individual neuron is far too small to be picked up by EEG or MEG.[46] EEG activity
therefore always reflects the summation of the synchronous activity of thousands or millions of neurons that have similar spatial
orientation.
- Research results
- In the comparison between the stable state and the emotion-induced state caused by visual stimuli, there are significant
differences in almost all regions.
- Positive and negative
- Positive: Beta and gamma waves are activated in the temporal lobe.
- Neutral: Inactivation of beta wave and gamma wave in temporal lobe, and activation in frontal lobe in delta wave,
theta wave, and alpha wave.
- Negative: Similar to Neutral, but different from Alpha and Delta, showing delta wave activation in parietal lobe.
- Basic emotions
- Alpha power AMUSEMENT <NEUTRAL <DISGUST <SAD
- SAD: activated in the frontal, parietal, and parietal lobes
- DISGUST: activated in the frontal and parietal lobes
- NEUTRAL: activated in the frontal and parietal lobes
- Amusement: activated slightly in the parietal lobe
- Happy: have significant EEG, but similar to sleepy
22
Contents
■ Brain
- EEG
Wave Patterns
Frequency
Range (Hz)
Signal Features Significant
δ
(Delta wave)
~3.5
the highest in amplitude
and the slowest waves
- Infancy or immature intellectual development, extreme fatigue and let
hargy or anesthesia
θ
(Theta wave)
3.5~7 High-amplitude
- frustration or depression
- associated with reports of relaxed, meditative, and creative states
- Gloomy: θ(4-7Hz) lateral brain
α
(Alpha wave)
8~12
the "posterior basic
rhythm“ wave
- awake, quiet when closing eyes
- Active: There are significant differences between the basic emotions in
the left frontal lobe.
- Calm: α (8-13Hz) in Posterior lobe
β
(Beta waveγγ)
13~30
both sides in
symmetrical distribution;
Low-amplitude
- nervous and excited
Γ
(Gamma wave)
31~50 Lowest-amplitude
- Exchange of information between cortical and subcortical areas
- Appears in conscious awakening and dreams during REM sleep.
- It may appear overlapped with beta waves.
- Tense:Γ (30-50Hz) in the forebrain
Information about EEG
23
Contents■ Heart
- ECG (Electrocardiography)
- It is a graph of voltage versus time of the electrical activity of the heart[4] using electrodes placed on the skin.
- Normal rhythm produces four entities – a P wave, a QRS complex, a T wave, and a U wave
- each have a fairly unique pattern
- P wave: atrial depolarization.
- QRS: complex represents ventricular depolarization.
- T wave: ventricular repolarization.
- U wave: papillary muscle repolarization.
- The heart's electrocardiogram declines when you feel sad or stable, but increases when it is excited
- ECG and emotion
- The signals of ECG decrease when nervous, sad and calm
- The signals of ECG increase when excited and anxious
- Research results about EEG
- Anger: acceleration and amplitude are relatively large
- Comfortable: acceleration and amplitude are relatively small
- Sad: acceleration is relatively large, amplitude is relatively small
- Happy: acceleration is relatively small, amplitude is relatively large
- PPG
- used to detect blood volume changes in the microvascular bed of tissue
- most common sites: ear, nasal septum, and forehead, right and left ear lobes, index fingers and great toes
- Heart rate variability measured by PPG divided from HRV to LF/HF and analyzed
- When the LF component increases, the parasympathetic nervous system prevails and is judged to be negative.
- When HF component increases, the sympathetic nervous system prevails and is judged as a positive emotion
- When the LF/HF value was increased, the LF value was relatively increased, and the parasympathetic nerve was dominant.
24
Figures from internet
Contents
■ Eye
- Pupil
- It is an empty space in the center of the eye.
- Through the pupil, light enters the retina and enables visual processing.
- It is black because the space behind the eyes is dark, and it is black regardless of the iris color.
- The pupil diameter is about 2 to 8 mm.
- The pupil's response to light
- Exact response time may vary depending on age, stimulus intensity, etc.
- 0~0.2 sec: pupils do not respond
- 0.2~1.5 sec: Shrinks quickly and strongly until the pupil shrinks to the smallest size
- 1.2~10 sec: The pupil is still deflated and slightly restored
- 10~30 sec: Pupil gradually returns to its original size; expansion by light is slower to recover
- Physiological characteristics (figure 14, table )
Different Social EmotionsPupil sphincter (括约肌) Mydriasis major
Definition Circular muscles around the pupil Radial muscles around the pupil
Autonomic
nervous
system
Parasympathetic nervous system Sympathetic nervous system
Function
- Reduces pupil size when light is bright
- Highly related to rest-storage reactions
- Increases pupil size to receive more light
- Closely related to the fight-run reaction
25Figures from: Mathôt, S. (2018). Pupillometry: Psychology, physiology, and function. Journal of Cognition, 1(1).
Contents
■ Eye
- Pupil
- Amygdala
- The amygdala suppresses the parasympathetic nerve.
- Amygdala activation: pupil dilation
- Amygdala inactivation: pupil contraction
- Path-way : eye to brain
■ Skin
- GSR (Galvanic Skin Resistance)
- Measure sweat gland activity from finger skin which are reflective of the intensity of our emotional state, otherwise known as
emotional arousal.
- scary, threatening, joyful, or otherwise emotionally relevant - increases eccrine sweat gland activity
- The GSR signal is therefore not representative of the type of emotion, but the intensity of it.
- It is noteworthy that both positive (“happy” or “joyful”) and negative (“threatening” or “saddening”) stimuli can result in
an increase in arousal – and in an increase in skin conductance.
- SKT (Skin Temperature)
Retina
Optic
Intersecting
Optic nerves
Right Field Of
View Information
Left Field Of View
Information
EWN :
Edinger –Westphal nucleus
EWN
Laryngeal Lob
e
26
Contents
■ Facial expression
- Facial expression is controlled by the movement and position of the muscles under the skin of the face.
- The muscles involved are divided into 14 muscles.
- EMG (Electrormyogram)
- evaluating and recording the electrical activity produced by skeletal muscles
- use as middleware in gesture recognition towards allowing the input of physical action to a computer as a form of Human-
computer interaction
- two kinds of EMG: surface EMG and intramuscular EMG
- FEMG is a face electromyography test.
27
Figures from: Gibert, G., Pruzinec, M., Schultz, T., & Stevens, C. (2009, November). Enhancement of human computer interaction with facial electromyographic sensors. In Proceedings of the 21st Annual Conference of the
Australian Computer-Human Interaction Special Interest Group: Design: Open 24/7 (pp. 421-424).
https://imotions.com/blog/facial-expression-pictures/
Reference
1. Babiker, A., Faye, I., & Malik, A. (2013). Pupillary behavior in positive and negative emotions. 2013 IEEE International Conference on Signal and Image
Processing Applications.
2. Geangu, E., Hauf, P., Bhardwaj, R., & Bentz, W. (2011). Infant pupil diameter changes in response to others' positive and negative emotions. PloS one, 6(11),
e27132.
3. Ho, C. H., & Lu, Y. N. (2014). Can pupil size be measured to assess design products?. International Journal of Industrial Ergonomics, 44(3), 436-441
4. Oliva, M., & Anikin, A. (2018). Pupil dilation reflects the time course of emotion recognition in human vocalizations. Scientific reports, 8(1), 4871.
5. Somchanok T, Michiko O. (2015). Emotion Recognition using ECG Signals with Local Pattern Description Methods. International Journal of Affective
Engineering,
6. Valenzi, S., Islam, T., Jurica, P., & Cichocki, A. (2014). Individual classification of emotions using EEG. Journal of Biomedical Science and Engineering, 2014.
7. Van Steenbergen, H., Band, G. P., & Hommel, B. (2011). Threat but not arousal narrows attention: evidence from pupil dilation and saccade control. Frontiers in
psychology, 2, 281.
8. Zheng, W. L., Zhu, J. Y., & Lu, B. L. (2017). Identifying stable patterns over time for emotion recognition from EEG. IEEE Transactions on Affective Computing.
28
Emotional Issues
– Subjectivity And Objectivity
– Moment Emotion
– Fake Emotions
– Temporary And Daily Emotions
– Emotional Consciousness And Unconscious
– Emotional Contagion And Synchronization
– Personal Emotion And Social Emotion
29
Contents
■ Emotional Subjectivity and Objectivity
- Objective Or Subjective
- Emotions are subjective because they are influenced by personal, social, and cultural environments.
- Physiological indicators reveal more obvious differences depending on the emotional experience as they become more
physically excited.
- Conversely, if the level of excitement is low, it is difficult to predict the emotional experience with only physiological
indicators.
- Subjective evaluation method
- There is a delay of around 10 seconds in the brain immediately after presenting visual stimuli and the subject expresses the
highest emotional value
- Real-time subjective evaluation and non-real-time subjective evaluation
- Measurements through questionnaires, such as the cut scale and the semantic scale.
- Emotions are considered subjective because its process of generation varies depending on personal, social, and cultural
differences
- Emotion are objective because that it happens with physiological changes in the body and can be objectively measured
- Measurements through biometric signals (EEG, ECG, GSR, EMG, etc.).
- Evaluate false emotions resulting from the discrepancy between actual feelings and expressions through brain wave response
analysis
■ Moment Emotion
- Ekman's Micro-Expression captures the moment of emotion according to the expression that should pay attention to the
persistence of emotion and the change of emotion with time
- The persistence of emotions is mainly divided into negative emotions and positive emotions
- Emotions often cause other emotions to motivate the expression of emotions. For example, the continuation of a negative
emotional state stimulates the expression of positive emotions, leading to escape from negative emotions.
30
Contents
■ Fake Emotions
- It can be detected form objective methods
- based on facial micro stress, body language, and interrogation language analysis.
- facial EMG response
- E.x. body behavior
- Lying smile, paraphrase behavior, grooming behavior, hesitation, increased frequency of eye blinking, speechlessness,
decreased hand, foot, and body movement.
- E.x. facial expression
- Dull smile-periocular area: shows a significant difference between a neutral expression and a dull smile-Ball muscle
area: strong response when a dull smile, a non-dull smile does not differ from a neutral expression-affects altruism: see a
dull smile or open mouth Subjects who saw a smile showed positive behavior to share money.
- E.x. pupil change
- Reduced pupil size in a stiff smile
- Women increased pupil size in a dull smile; Male increased pupil size in a an-stiff smile
- The eye blink rate of a person increases to eight times the normal rate after lying
- E.x. EEG signal
- The signals in F3, F4, C4, P3, P4, O1, O2 of brain have significant differences between actual and false emotions
- E.x. ECG signal
- looking at a back-to-back smile (true smile) has resulted in much stronger fascia and cheek muscle EMG activity
compared to the activity gained by looking at a neutral face
- others
- the EMG reaction of the pericardial and ball muscle region to Non Dussen smile was no different from that of the
neutral face
- the intensity was more significant in a happy expression than in an angry expression.
31
Contents
■ Temporary And Daily Emotions
- Temporary emotion
- Memory-based emotion
- Memory is stimulated by instantaneous stimuli
- The ability to remember varies by emotion
- Daily emotion
- Described as Mood
- Development into everyday emotions as the continuation of temporary emotions
- Deriving various everyday emotions depending on context or by differences in persistence by emotion
■ Emotional Consciousness And Unconscious
- Conscious emotion
- This is all the emotional experience we perceive in our daily lives.
- If you consciously perform facial mimicry instead of distinguishing emotions, the ability is poor.
- Unconscious emotion
- It is an emotional experience that we do not recognize in our daily life.
- Facial express micro-movement rises from the face when unfair things happen: the psoas muscles and the cheek muscles
- empathy More empathy for someone imitating their behavior.
- Self-esteem Self-esteem suppresses acts that imitate others (unknowingly)
- Cheers to try to imitate someone unconsciously in order to buy someone else's cheers.
- When imitating a variety of emotional facial stimuli, the facial muscles are involuntarily moved in a micro-movement like the
suggested expression.
- The act of imitating someone increases the likelihood of the person unconsciously.
32
Contents
■ Emotional Contagion And Synchronization
- Contagion
- Positive emotions - the frequency of the frontal lobe (F7), anterior lobe (T3, T4, T5, T6) and larynx (O2) vary significantly.
- Negative emotions - a significant difference between the amount of frequency changes in the frontal lobe (F3), anterior lobe (T4)
and posterior lobe (I2)
- Empathy: a significant difference in frequency was observed in the temporal lobe (T4).
- non-empathy: a significant difference in the amount of frequency change in the parietal lobe (P3, P4) and the central sphere (c3)
can be confirmed.
- Synchronization
- Empathy is a person's stand, feeling and thinking about his emotions, which is spread by others' emotions
- Everything that explains and reflects the world is related to emotions, and they affect and spread each other.
■ Personal Emotion And Social Emotion
- Personal sensibility
- Stimulation triggers your own sensibility
- Emotional reactions are not the same for everyone.
- In order to properly analyze biosignals, which is a means to objectively classify individual emotions, a method of reducing
individual differences is needed.
- When a stable state is used, a reference to be used as a reference is measured together, and a biosignal that changes according to
emotion is calculated and normalized as a rate of change to overcome individual differences.
- Social sentiment
- A society where individuals form a social relationship
- Sensibility plays a decisive role as a medium to form social ties
- Social sentiment should be measured not by individual, but by relationship with others.
- Intimacy, empathy, etc. 33
Reference
1. Strike, P. C., Wardle, J., & Steptoe, A. (2004). Mild acute inflammatory stimulation induces transient negative mood. Journal of psychosomatic
research, 57(2), 189-194.
2. Bouhuys, A. L., Bloem, G. M., & Groothuis, T. G. (1995). Induction of depressed and elated mood by music influences the perception of facial
emotional expressions in healthy subjects. Journal of affective disorders, 33(4), 215-226.
3. Strike, P. C., Wardle, J., & Steptoe, A. (2004). Mild acute inflammatory stimulation induces transient negative mood. Journal of psychosomatic
research, 57(2), 189-194.
4. Strike, P. C., Wardle, J., & Steptoe, A. (2004). Mild acute inflammatory stimulation induces transient negative mood. Journal of psychosomatic
research, 57(2), 189-194.
5. Hayakawa, Y., Takada, K., Miki, H., & Tanaka, K. (2000). Effects of music on mood during bench stepping exercise. Perceptual and motor skills,
90(1), 307-314..
6. Balteș, F. R., & Miu, A. C. (2014). Emotions during live music performance: Links with individual differences in empathy, visual imagery, and
mood. Psychomusicology: Music, Mind, and Brain, 24(1), 58..
7. Mathews, A., & Bradle, B. (1983). Mood and the self-reference bias in recall. Behaviour research and therapy, 21(3), 233-239.
8. George, M. S., Ketter, T. A., Parekh, P. I., Horwitz, B., Herscovitch, P., & Post, R. M. (1995). Brain activity during transient sadness and happiness
in healthy women. American Journal of Psychiatry, 152(3), 341-351
9. Hammersley, R., & Reid, M. (2009). Theorising transient mood after ingestion. Neuroscience & Biobehavioral Reviews, 33(3), 213-222.
10. Barabasz, M. (1991). Effects of aerobic exercise on transient mood state. Perceptual and motor skills, 73(2), 657-658.
11. Winkielman, P., & Berridge, K. C. (2004). Unconscious Emotion. Current Directions in Psychological Science, 13(3), 120–123.
12. 안호석, 최진영, 이동욱. (2012). 의식과 무의식을 구분하는 감성 로봇 시스템. 제어로봇시스템학회 국내학술대회 논문집, (), 186-187.
13. Um, Z.-S., Yang, J.-C., Park, J.-I., & Kim, G.-W. (2019). 유년기 정신적 외상을 경험한 외상후 스트레스장애 환자에서 무의식적 감정 자극이 의식적
작업기억 수행에 미치는 영향에 관한 기능적 자기공명영상 연구. Psychoanalysis, 30(4), 114-123.
14. 김민정, 이영애 (2011). 목표지향적 정보처리에서 무의식적 사고의 효과. 인지과학, 22(4), 405-427
15. 손민정, 남택진 (2010). 지속가능한 인터랙션 디자인에 적용하기 위한 인간의 무의식적인 행동에 관 한 연구. 한국HCI학회 학술대회, 456-459
34
Reference
16. Dimberg, U., Thunberg, M., & Elmehed, K. (2000). Unconscious Facial Reactions to Emotional Facial Expressions. Psychological Science, 11(1),
86–89. doi:10.1111/1467-9280.00221
17. 조덕기, 이은주, 방성근, 권오재, 임인종, 김만영, 김진희 (2011). Wavelet cross correlation을 이용한 의식 적인 의도와 무의식적인 의도에 따른
뇌활성 신호의 특징 추출. 정보과학회논문지 : 컴퓨팅의 실제 및 레터, 17(12), 613-621
18. 정진복, 안창일 (2000). 식역하 ERP 를 통한 정서적 자극의 무의식 처리. 한국심리학회지: 건강, 5(2), 304-315
19. Ivonin, L., Chang, H.-M., Chen, W., & Rauterberg, M. (2012). Unconscious emotions: quantifying and logging something we are not aware of.
Personal and Ubiquitous Computing, 17(4), 663–673. doi:10.1007/s00779-012-0514-5
20. Jessen, S., & Grossmann, T. (2015). Neural signatures of conscious and unconscious emotional face processing in human infants. Cortex, 64,
260–270. doi:10.1016/j.cortex.2014.11.007
21. Kramer,A. D.,Guillory, J. E., & Hancock, J.T. (2014). Experimental evidence of massive-scale emotional contagion through social networks. Proceedings of the
NationalAcademy of Sciences, 111(24), 8788-8790.
22. Coviello, L., Sohn,Y., Kramer,A. D., Marlow,C., Franceschetti, M., Christakis, N.A., & Fowler, J. H. (2014). Detecting emotional contagion in massive social
networks. PloS one, 9(3).
23. Manera,V., Grandi, E., & Colle, L. (2013). Susceptibility to emotional contagion for negative emotions improves detection of smile authenticity. Frontiers in
Human Neuroscience, 7, 6.
24. Ferrara, E., &Yang, Z. (2015). Measuring emotional contagion in social media. PloS one, 10(11), e0142390.
25. Xiong, X., Li,Y., Qiao, S., Han, N.,Wu,Y., Peng, J., & Li, B. (2018). An emotional contagion model for heterogeneous social media with multiple
behaviors. Physica A: Statistical Mechanics and its Applications, 490, 185-202.
26. Hashimoto, M.,Yamano, M., & Usui,T. (2009, September). Effects of emotional synchronization in human-robot KANSEI communications. In RO-MAN 2009-
The 18th IEEE InternationalSymposium on Robot and Human InteractiveCommunication (pp. 52-57). IEEE.
35
Reference
27. Grandjean, D., Sander, D., & Scherer, K. R. (2008). Conscious emotional experience emerges as a function of multilevel, appraisal-driven response
synchronization. Consciousness and cognition, 17(2), 484-495.
28. Li,Y., & Hashimoto, M. (2011, December). Effect of emotional synchronization using facial expression recognition in human-robot communication. In 2011 IEEE
InternationalConference on Robotics and Biomimetics (pp. 2872-2877). IEEE.
29. Osvath, M., & Sima, M. (2014). Sub-adult ravens synchronize their play: a case of emotional contagion. Anim Behav Cogn, 2, 197.
30.Wiss, M., &Tordjman,S. (2016). Creating a ‘social zeitgeber’to synchronize family emotional rhythms:A new therapeutic approach in child and adolescent
psychiatry. Journal of Physiology-Paris, 110(4), 480-486.
31. 강유원(2010), “사회적감성, 정치적의식, 정치적행위”, 감성연구1권,0호,69-83.
32. 신승섭, 노수진, 차예술, 김종화, 황민철(2012), “사랑과 우정에 대한 사회감성 모델에 관한 연구”, 한국 감성과학회 춘계학술대회 2012권, 0호, 71-72.
33. 이구형(1998), “감성과 감정의 이해를 통한 감성의 체계적 측정 평가”, 감성과학1권,1호,113-122.
34. J. M. Barbalet, Social emotions: confidence, trust and loyalty, International Journal of Sociology and Social Policy, 16(9/10), 1996, 75–96.
35. Hareli, S., & Parkinson, B. (2008).What’s social about social emotions?, Journal for theTheory of Social Bevaviour, 38, 131–156.
36. Seyfert, R. (2012) ‘Beyond Person Feelings and Collective Emotions:Toward aTheory of SocialAffect’,Theory,Culture and Society 29(6): 27–46.
37. Parkinson,B., & Lea, M. E (1991). Investigating personalconstructs of emotion.British Journal of Psychology,82, 73-86.
38. Cavalera,C., & Pepe,A. (2014). Social emotions and cognition: Shame, guilt and working memory. Social and Behavioral Sciences, 112, 457-464.
39. Parkinson, B.(1996). "Emotions are social." British,Journal of Psychology, 87: 663-683.
40. L. J. Chang, andA. Smith, “Social emotions and psychological games,” Curr.Opin. Behav. Sci., vol. 5, pp. 133-140, Oct. 2015.
36
Emotion Intensity
– Definitions
– Features
– Expressions
37
Contents
■ Definition
- Difference in feeling or expression of emotion
- Experienced by individuals in response to emotion-provoking stimuli – Larsen (1984)
- It is stable experienced by individuals during centuries– Larsen and Diener (1987)
- Personal characteristics that indicate the degree of emotion experienced by individuals for a particular object
■ Features
- Even if they feel the same, different intensity may be different emotions
- An emotion can be expressed in many forms based on intensity
- Factors such as duration of emotion, individual psychological factors, bioreaction, cultural differences, and gender are related to the
strength of emotion
- Emotional intensity and classification of emotion
- Y axis: high intensity-low intensity
- X axis: negative emotions-positive emotions
- Low intensity feeling is mostly gloomy or quiet, calm feeling
- High-intensity emotions are anger and excitement
38Figures from: Seppälä, E. (2016). The happiness track: How to apply the science of happiness to accelerate your success. Hachette UK.
Contents
■ Expression
- FACS (Facial Action Coding System)
- Models with angry or happy expressions get a higher intensity level than models with neutral expressions.
- Compared with male models who portray the same expressions, the expressions on female models' faces are more strongly
evaluated.
- Facial expressions vary according to emotional intensity
- Body response changes with changes in emotional intensity
39
Reference
1. Chen, Y., Lee, S. Y. M., & Huang, C. R. (2011). Automatic Recognition of Emotion based on a Cognitively Motivated Emotion Annotation System. Journal of
Cognitive Science, 12(3), 277-296.
2. Li, Y., Mavadati, S. M., Mahoor, M. H., Zhao, Y., & Ji, Q. (2015). Measuring the intensity of spontaneous facial action units with dynamic Bayesian
network. Pattern Recognition, 48(11), 3417-3427.
3. Spignesi, A., & Shor, R. E. (1981). The judgment of emotion from facial expressions, contexts, and their combination. The Journal of General Psychology, 104(1),
41-58.
4. Para citar este artículo: Alves, N. T., Bezerra, I. A. O., Claudino, R. G., & Pereira, T. C. L. (2013). Recognition of static and dynamic facial expressions: Influences
of sex, type and intensity of emotion. Avances en Psicología Latinoamericana, 31 (1), pp. 192-199.
5. David I Perrett, Reiner Sprengelmeyer.(2002). Facial expressions of emotion: Stiumli and tests(FEEST).Psychology manual,1
6. Camille D, Helene F, Caroline B, Andrea D & Daniel F(2017). The effect of acute social stress on the recognition of facial expression of emotions. Scientific
Reports
7. Kam, C. C.-S., & Bond, M. H. (2008). Role of emotions and behavioural responses in mediating the impact of face loss on relationship deterioration: Are Chinese
more face-sensitive than Americans? Asian Journal Of Social Psychology, 11(2), 175–184. doi:10.1111/j.1467-839x.2008.00254.x
8. Lien, J. J., Kanade, T., Cohn, J. F., & Ching-Chung Li. (n.d.). Automated facial expression recognition based on FACS action units. Proceedings Third IEEE
International Conference on Automatic Face and Gesture Recognition. doi:10.1109/afgr.1998.670980
9. Biele, C., & Grabowska, A. (2006). Sex differences in perception of emotion intensity in dynamic and static facial expressions. Experimental Brain Research,
171(1), 1–6.
10. Juslin, P. N., & Laukka, P. (2001). Impact of intended emotion intensity on cue utilization and decoding accuracy in vocal expression of emotion. Emotion, 1(4),
381–412.
11. N’Diaye, K., Sander, D., & Vuilleumier, P. (2009). Self-relevance processing in the human amygdala: Gaze direction, facial expression, and emotion intensity.
Emotion, 9(6), 798–806
40
Complex Emotion
– Definitions
– Features
– Expressions
41
Contents
■ Definitions ((Carrera, P., & Oceja, L. (2007))
- any emotion that is an aggregate of two or more others.(contrast to simple emotions which are those that are irreducible by analysis to
any other emotion.)
- e.x. hate=anger + fear + disgust
- love = tenderness + pleasure + devotion + passion
- other like: awe, disgust, embarrassment, envy, gratitude, guilt, jealousy, pride, remorse, shame, and worry
- Definition 1
- Affective experiences can fluctuate, be combined, and fused, resulting in various phenomena labeled as being emotionally
complex
- complex emotions insofar as the single components of the affect system (i.e., emotional adjectives) interact forming patterns or
categories that are integrated into systems which do not resemble the constituent emotions permitting adaptive functions.
- Different of Emotional Complexity: based on different emotions establish different interrelations between them
- emotional differentiation
- emotional granularity
- implies discerning among many positive and negative emotions (Grossman et al., 2016)
- emotional granularity, make finer distinctions and well-differentiated reports of emotional experience
- language contributes to the perception of emotions (Lindquist et al., 2006; Gendron et al., 2012).
- emodiversity
- The degree to which people can experience a diverse and abundant set of emotional experiences is a form of
emotional complexity.
- Emodiversity is a measure of the richness of emotional complexity and the proportionality of experiences about a
wide number of emotions (Quoidbach et al., 2014).
- emodiversity and emotional granularity are at opposite sides of a hypothetical differentiation continuum, ranging from
making thin distinctions between different emotions (emotional granularity) to experiencing an abundant and diverse
range of emotions (emodiversity). 42
Figures from:
https://redpenpalsblog.com/how-
to-write-complex-emotions/
Contents
■ Definitions
- Emotional interdependence
- Emotions mutually influence each other throughout an event, altering the intensity of subsequent affects, modifying the hedonic valence
of ongoing experiences, coupling multiple emotional experiences as a consequence of similar appraisals, or changing the behaviors to be
deployed at a given moment.
- Co-occurrence of emotional experiences of positive and negative valence (subjective experience)
- E.X. Happy-sad; fear-hope: graduate experience more positive (happiness) and negative (sadness) emotions at the same time,
compared to the same students surveyed at distant time points from graduation (larsen et al., 2001; hershfield et al., 2008).
- Affective dynamics (flow of the everyday emotional experience )
- Changes in emotion can result in diverse processes defined by the individuals’ fluctuations in emotion (davidson, 1998). Mixed
emotions: the co-activation of opposite emotions at the same time
- E.X. Feeling excited and, not very long after, feeling blue. Emotions change dramatically from one moment to another.
- Meta-emotions (a causal relation between a pair of different emotions)
- One emotion prompting a secondary emotion (gottman et al., 1996; norman and furnes, 2016).
- Experiencing a meta-emotion requires that one emotion (e.G., Sadness) triggers a secondary emotion (e.G., Anger).
Fundamental in the understanding of meta-emotions as a complex emotional experience is that emotions can be hierarchically
organized, forming finite layers of emotions
- Emotions are aggregated on top of each other.
- Aesthetic emotions
- A group of affective experiences felt during aesthetic appreciation, including stimuli from nature (e.G., Natural wonders) and human creation
(e.G., Painting or music), as well as emotional reactions that follow religious experiences or epiphanies (keltner and haidt, 2003; gordon et al.,
2016).
- E.X. Awe involves a mixture of surprise, pleasure, elevation, and astonishment (keltner and haidt, 2003).
- First being-moved
- Includes the emotional experiences of sadness and joy (menninghaus et al. (2015))
- The most common scenarios: deaths and births, and significant relationship events (reunions) (kuehnast et al., 2014).
- High levels of compatibility with social norms and self-ideals.
- Second awe
- A mixture of surprise, pleasure, elevation, and astonishment (keltner and haidt, 2003). 43
Contents
■ Definitions
- Definition 2 : Primary And Secondary Emotions (figure 22 )
- A tree-structured list of emotions was described in Shaver et al. (1987), and also featured in Parrott (2001).
- Definition 3 Emotional equations​ (figure 23)
- Chip Conley showed how emotions and feelings are organised using mathematical.
44Figures from: https://en.wikipedia.org/wiki/Emotion
Contents
■ Definitions
- Definition 3 : Plutchik’s Wheel of Emotions
- In 1980, Robert Plutchik diagrammed a wheel of eight emotions: joy, trust, fear, surprise, sadness, disgust, anger and anticipation.
- And then Plutchik also theorized twenty-four "Primary", "Secondary", and "Tertiary" dyads (feelings composed of two emotions).
- First, the eight primary emotions in this model are the basis for all others and are grouped into polar opposites (figure 24):
- joy and sadness
- acceptance and disgust
- fear and anger
- surprise and anticipation
- inner circles are more basic and outer circles more complex, which are also formed by blending the inner circle emotions.
- Containing mild emotion, mild opposite emotion, basic emotion, basic opposite emotion, intense emotion and intense opposite
emotion
- mild emotion: Serenity, Acceptance, Apprehension, Distraction
- mild opposite emotion: Pensiveness, Boredom, Annoy, Interest
- Basic emotion: Joy, Trust, Fear, Surprise
- basic opposite emotion: Sadness, Disgust, Anger, Anticipation
- intense emotion: Ecstasy, Admiration, Terror, Amazement
- intense opposite emotion: Grief, Loathing, Rage, Vigilance
- Second, the improving model contains the following information (figure 25):
- Primary dyad = one petal apart = Love = Joy + Trust
- Secondary dyad = two petals apart = Envy = Sadness + Anger
- Tertiary dyad = three petals apart = Shame = Fear + Disgust
- Opposite emotions = four petals apart = Anticipation - Surprise
- (Anger is classified as a "positive" emotion because it involves "moving toward" a goal,[58] while surprise is negative because it is a
violation of someone's territory.[)
-
-
45Figures from: https://en.wikipedia.org/wiki/Emotion
Reference
1. Carrera, P., & Oceja, L. (2007). Drawing mixed emotions: Sequential or simultaneous experiences?. Cognition and emotion, 21(2), 422-441.
2. Oceja, L., & Carrera, P. (2003, February). Mixed emotional experience. Poster presented at the Annual Meeting of the Society for Personality and Social
Psychology, Los Angeles, USA
3. Larsen, J. T., & McGraw, A. P. (2011). Further evidence for mixed emotions. Journal of Personality and Social Psychology, 100(6), 1095–1110.
doi:10.1037/a0021846
4. Patwardhan, A. S. (2017). Multimodal mixed emotion detection. 2017 2nd International Conference on Communication and Electronics Systems
5. Fernando, J. W., Kashima, Y., & Laham, S. M. (2014). Multiple emotions: A person-centered approach to the relationship between intergroup emotion and action
orientation. Emotion, 14(4), 722–732.
46
Thank you!
47

More Related Content

What's hot

Emotional intelligence
Emotional intelligenceEmotional intelligence
Emotional intelligenceDeepaMurali3
 
Mindfulness in Clinical Practice - Rick Hanson, PhD
Mindfulness in Clinical Practice - Rick Hanson, PhDMindfulness in Clinical Practice - Rick Hanson, PhD
Mindfulness in Clinical Practice - Rick Hanson, PhDRick Hanson
 
What is Spirituality?
What is Spirituality?What is Spirituality?
What is Spirituality?Asad Zaman
 
Emotional Intelligence Presentation Final
Emotional Intelligence Presentation FinalEmotional Intelligence Presentation Final
Emotional Intelligence Presentation FinalDr. Christine Dickson
 
Emdr Presentation
Emdr PresentationEmdr Presentation
Emdr PresentationJayFellers
 
Increase Your Emotional intelligence-Basics for Beginners
Increase Your Emotional intelligence-Basics for BeginnersIncrease Your Emotional intelligence-Basics for Beginners
Increase Your Emotional intelligence-Basics for BeginnersJoan Mullally
 
Emotional Intelligence
Emotional IntelligenceEmotional Intelligence
Emotional IntelligenceRajThilak
 
Positive Emotions and Cognition
Positive Emotions and CognitionPositive Emotions and Cognition
Positive Emotions and CognitionDokka Srinivasu
 
Emotional intelligence manager's
Emotional intelligence  manager'sEmotional intelligence  manager's
Emotional intelligence manager'sRam narayanan
 
Modern Mindfulness
Modern MindfulnessModern Mindfulness
Modern Mindfulnesskguent
 
Positive psychology
Positive psychologyPositive psychology
Positive psychologyNourAlsoufi
 
Pro social behavior
Pro social behaviorPro social behavior
Pro social behaviorAQSA SHAHID
 
Forgiveness
ForgivenessForgiveness
Forgivenessmukhsana
 
Lecture 8: Stress and coping - Dr.Reem AlSabah
Lecture 8: Stress and coping - Dr.Reem AlSabahLecture 8: Stress and coping - Dr.Reem AlSabah
Lecture 8: Stress and coping - Dr.Reem AlSabahAHS_student
 
Mindfulness and leadership final 5.12.2016 aa
Mindfulness and leadership   final 5.12.2016  aaMindfulness and leadership   final 5.12.2016  aa
Mindfulness and leadership final 5.12.2016 aaBill M Wooten, PhD
 

What's hot (20)

Emotional intelligence
Emotional intelligenceEmotional intelligence
Emotional intelligence
 
Mindfulness in Clinical Practice - Rick Hanson, PhD
Mindfulness in Clinical Practice - Rick Hanson, PhDMindfulness in Clinical Practice - Rick Hanson, PhD
Mindfulness in Clinical Practice - Rick Hanson, PhD
 
Emotional intelligence
Emotional intelligenceEmotional intelligence
Emotional intelligence
 
What is Spirituality?
What is Spirituality?What is Spirituality?
What is Spirituality?
 
Emotional Intelligence Presentation Final
Emotional Intelligence Presentation FinalEmotional Intelligence Presentation Final
Emotional Intelligence Presentation Final
 
Emdr Presentation
Emdr PresentationEmdr Presentation
Emdr Presentation
 
Compassion
CompassionCompassion
Compassion
 
Increase Your Emotional intelligence-Basics for Beginners
Increase Your Emotional intelligence-Basics for BeginnersIncrease Your Emotional intelligence-Basics for Beginners
Increase Your Emotional intelligence-Basics for Beginners
 
Emotional Intelligence
Emotional IntelligenceEmotional Intelligence
Emotional Intelligence
 
Positive Emotions and Cognition
Positive Emotions and CognitionPositive Emotions and Cognition
Positive Emotions and Cognition
 
Emotional intelligence
Emotional intelligenceEmotional intelligence
Emotional intelligence
 
Emotional intelligence manager's
Emotional intelligence  manager'sEmotional intelligence  manager's
Emotional intelligence manager's
 
Modern Mindfulness
Modern MindfulnessModern Mindfulness
Modern Mindfulness
 
Positive psychology
Positive psychologyPositive psychology
Positive psychology
 
Pro social behavior
Pro social behaviorPro social behavior
Pro social behavior
 
Forgiveness
ForgivenessForgiveness
Forgiveness
 
Lecture 8: Stress and coping - Dr.Reem AlSabah
Lecture 8: Stress and coping - Dr.Reem AlSabahLecture 8: Stress and coping - Dr.Reem AlSabah
Lecture 8: Stress and coping - Dr.Reem AlSabah
 
Empathy
EmpathyEmpathy
Empathy
 
Positive psychology
Positive psychologyPositive psychology
Positive psychology
 
Mindfulness and leadership final 5.12.2016 aa
Mindfulness and leadership   final 5.12.2016  aaMindfulness and leadership   final 5.12.2016  aa
Mindfulness and leadership final 5.12.2016 aa
 

Similar to Emotion recognition

Processing Emotions - Happiness
Processing Emotions - HappinessProcessing Emotions - Happiness
Processing Emotions - HappinessNicolae Sfetcu
 
Damasio antonio subcortical and cortical brain activity during the feeling ...
Damasio antonio   subcortical and cortical brain activity during the feeling ...Damasio antonio   subcortical and cortical brain activity during the feeling ...
Damasio antonio subcortical and cortical brain activity during the feeling ...Jorge Alberto Khouri
 
Chapter 4 pwrpt
Chapter 4 pwrptChapter 4 pwrpt
Chapter 4 pwrptjamiesamel
 
[系列活動] Emotion-AI: 運用人工智慧實現情緒辨識
[系列活動] Emotion-AI: 運用人工智慧實現情緒辨識[系列活動] Emotion-AI: 運用人工智慧實現情緒辨識
[系列活動] Emotion-AI: 運用人工智慧實現情緒辨識台灣資料科學年會
 
EMOTIONS and INTELLIGENCE in Psychology
EMOTIONS and INTELLIGENCE in PsychologyEMOTIONS and INTELLIGENCE in Psychology
EMOTIONS and INTELLIGENCE in Psychologyitsennyl_
 
Ch. 12: Emotions, Stress, & Health
Ch. 12: Emotions, Stress, & HealthCh. 12: Emotions, Stress, & Health
Ch. 12: Emotions, Stress, & Healthkbolinsky
 
Emotions and Types of Emotional Responses.pptx
Emotions and Types of Emotional Responses.pptxEmotions and Types of Emotional Responses.pptx
Emotions and Types of Emotional Responses.pptxCol Mukteshwar Prasad
 
Components and Competency of Emotions
Components and Competency of EmotionsComponents and Competency of Emotions
Components and Competency of Emotionscognitomeprogram
 
Motivation and Emotions
Motivation and EmotionsMotivation and Emotions
Motivation and EmotionsShiva Kakkar
 
Cognition, biology and emotion pp
Cognition, biology and emotion ppCognition, biology and emotion pp
Cognition, biology and emotion ppabonica
 

Similar to Emotion recognition (20)

Emotions
EmotionsEmotions
Emotions
 
EMOTIONS
EMOTIONSEMOTIONS
EMOTIONS
 
Processing Emotions - Happiness
Processing Emotions - HappinessProcessing Emotions - Happiness
Processing Emotions - Happiness
 
Social emotions
Social emotionsSocial emotions
Social emotions
 
Artificial Emotion
Artificial EmotionArtificial Emotion
Artificial Emotion
 
Damasio antonio subcortical and cortical brain activity during the feeling ...
Damasio antonio   subcortical and cortical brain activity during the feeling ...Damasio antonio   subcortical and cortical brain activity during the feeling ...
Damasio antonio subcortical and cortical brain activity during the feeling ...
 
Chapter 4 pwrpt
Chapter 4 pwrptChapter 4 pwrpt
Chapter 4 pwrpt
 
Emotions
EmotionsEmotions
Emotions
 
[系列活動] Emotion-AI: 運用人工智慧實現情緒辨識
[系列活動] Emotion-AI: 運用人工智慧實現情緒辨識[系列活動] Emotion-AI: 運用人工智慧實現情緒辨識
[系列活動] Emotion-AI: 運用人工智慧實現情緒辨識
 
EMOTIONS and INTELLIGENCE in Psychology
EMOTIONS and INTELLIGENCE in PsychologyEMOTIONS and INTELLIGENCE in Psychology
EMOTIONS and INTELLIGENCE in Psychology
 
Ch. 12: Emotions, Stress, & Health
Ch. 12: Emotions, Stress, & HealthCh. 12: Emotions, Stress, & Health
Ch. 12: Emotions, Stress, & Health
 
Emotion
EmotionEmotion
Emotion
 
Emotion Introduction
Emotion IntroductionEmotion Introduction
Emotion Introduction
 
Emotions and Types of Emotional Responses.pptx
Emotions and Types of Emotional Responses.pptxEmotions and Types of Emotional Responses.pptx
Emotions and Types of Emotional Responses.pptx
 
Components and Competency of Emotions
Components and Competency of EmotionsComponents and Competency of Emotions
Components and Competency of Emotions
 
Emotion annesley 2010
Emotion annesley 2010Emotion annesley 2010
Emotion annesley 2010
 
Emotion
EmotionEmotion
Emotion
 
Authentic Joy
Authentic JoyAuthentic Joy
Authentic Joy
 
Motivation and Emotions
Motivation and EmotionsMotivation and Emotions
Motivation and Emotions
 
Cognition, biology and emotion pp
Cognition, biology and emotion ppCognition, biology and emotion pp
Cognition, biology and emotion pp
 

Recently uploaded

Sheet Pile Wall Design and Construction: A Practical Guide for Civil Engineer...
Sheet Pile Wall Design and Construction: A Practical Guide for Civil Engineer...Sheet Pile Wall Design and Construction: A Practical Guide for Civil Engineer...
Sheet Pile Wall Design and Construction: A Practical Guide for Civil Engineer...Dr.Costas Sachpazis
 
AKTU Computer Networks notes --- Unit 3.pdf
AKTU Computer Networks notes ---  Unit 3.pdfAKTU Computer Networks notes ---  Unit 3.pdf
AKTU Computer Networks notes --- Unit 3.pdfankushspencer015
 
College Call Girls Nashik Nehal 7001305949 Independent Escort Service Nashik
College Call Girls Nashik Nehal 7001305949 Independent Escort Service NashikCollege Call Girls Nashik Nehal 7001305949 Independent Escort Service Nashik
College Call Girls Nashik Nehal 7001305949 Independent Escort Service NashikCall Girls in Nagpur High Profile
 
Extrusion Processes and Their Limitations
Extrusion Processes and Their LimitationsExtrusion Processes and Their Limitations
Extrusion Processes and Their Limitations120cr0395
 
Porous Ceramics seminar and technical writing
Porous Ceramics seminar and technical writingPorous Ceramics seminar and technical writing
Porous Ceramics seminar and technical writingrakeshbaidya232001
 
(ANJALI) Dange Chowk Call Girls Just Call 7001035870 [ Cash on Delivery ] Pun...
(ANJALI) Dange Chowk Call Girls Just Call 7001035870 [ Cash on Delivery ] Pun...(ANJALI) Dange Chowk Call Girls Just Call 7001035870 [ Cash on Delivery ] Pun...
(ANJALI) Dange Chowk Call Girls Just Call 7001035870 [ Cash on Delivery ] Pun...ranjana rawat
 
MANUFACTURING PROCESS-II UNIT-2 LATHE MACHINE
MANUFACTURING PROCESS-II UNIT-2 LATHE MACHINEMANUFACTURING PROCESS-II UNIT-2 LATHE MACHINE
MANUFACTURING PROCESS-II UNIT-2 LATHE MACHINESIVASHANKAR N
 
KubeKraft presentation @CloudNativeHooghly
KubeKraft presentation @CloudNativeHooghlyKubeKraft presentation @CloudNativeHooghly
KubeKraft presentation @CloudNativeHooghlysanyuktamishra911
 
Processing & Properties of Floor and Wall Tiles.pptx
Processing & Properties of Floor and Wall Tiles.pptxProcessing & Properties of Floor and Wall Tiles.pptx
Processing & Properties of Floor and Wall Tiles.pptxpranjaldaimarysona
 
(PRIYA) Rajgurunagar Call Girls Just Call 7001035870 [ Cash on Delivery ] Pun...
(PRIYA) Rajgurunagar Call Girls Just Call 7001035870 [ Cash on Delivery ] Pun...(PRIYA) Rajgurunagar Call Girls Just Call 7001035870 [ Cash on Delivery ] Pun...
(PRIYA) Rajgurunagar Call Girls Just Call 7001035870 [ Cash on Delivery ] Pun...ranjana rawat
 
result management system report for college project
result management system report for college projectresult management system report for college project
result management system report for college projectTonystark477637
 
VIP Call Girls Ankleshwar 7001035870 Whatsapp Number, 24/07 Booking
VIP Call Girls Ankleshwar 7001035870 Whatsapp Number, 24/07 BookingVIP Call Girls Ankleshwar 7001035870 Whatsapp Number, 24/07 Booking
VIP Call Girls Ankleshwar 7001035870 Whatsapp Number, 24/07 Bookingdharasingh5698
 
Java Programming :Event Handling(Types of Events)
Java Programming :Event Handling(Types of Events)Java Programming :Event Handling(Types of Events)
Java Programming :Event Handling(Types of Events)simmis5
 
Call Girls in Nagpur Suman Call 7001035870 Meet With Nagpur Escorts
Call Girls in Nagpur Suman Call 7001035870 Meet With Nagpur EscortsCall Girls in Nagpur Suman Call 7001035870 Meet With Nagpur Escorts
Call Girls in Nagpur Suman Call 7001035870 Meet With Nagpur EscortsCall Girls in Nagpur High Profile
 
Structural Analysis and Design of Foundations: A Comprehensive Handbook for S...
Structural Analysis and Design of Foundations: A Comprehensive Handbook for S...Structural Analysis and Design of Foundations: A Comprehensive Handbook for S...
Structural Analysis and Design of Foundations: A Comprehensive Handbook for S...Dr.Costas Sachpazis
 
Booking open Available Pune Call Girls Pargaon 6297143586 Call Hot Indian Gi...
Booking open Available Pune Call Girls Pargaon  6297143586 Call Hot Indian Gi...Booking open Available Pune Call Girls Pargaon  6297143586 Call Hot Indian Gi...
Booking open Available Pune Call Girls Pargaon 6297143586 Call Hot Indian Gi...Call Girls in Nagpur High Profile
 
Top Rated Pune Call Girls Budhwar Peth ⟟ 6297143586 ⟟ Call Me For Genuine Se...
Top Rated  Pune Call Girls Budhwar Peth ⟟ 6297143586 ⟟ Call Me For Genuine Se...Top Rated  Pune Call Girls Budhwar Peth ⟟ 6297143586 ⟟ Call Me For Genuine Se...
Top Rated Pune Call Girls Budhwar Peth ⟟ 6297143586 ⟟ Call Me For Genuine Se...Call Girls in Nagpur High Profile
 
Coefficient of Thermal Expansion and their Importance.pptx
Coefficient of Thermal Expansion and their Importance.pptxCoefficient of Thermal Expansion and their Importance.pptx
Coefficient of Thermal Expansion and their Importance.pptxAsutosh Ranjan
 
BSides Seattle 2024 - Stopping Ethan Hunt From Taking Your Data.pptx
BSides Seattle 2024 - Stopping Ethan Hunt From Taking Your Data.pptxBSides Seattle 2024 - Stopping Ethan Hunt From Taking Your Data.pptx
BSides Seattle 2024 - Stopping Ethan Hunt From Taking Your Data.pptxfenichawla
 

Recently uploaded (20)

(INDIRA) Call Girl Aurangabad Call Now 8617697112 Aurangabad Escorts 24x7
(INDIRA) Call Girl Aurangabad Call Now 8617697112 Aurangabad Escorts 24x7(INDIRA) Call Girl Aurangabad Call Now 8617697112 Aurangabad Escorts 24x7
(INDIRA) Call Girl Aurangabad Call Now 8617697112 Aurangabad Escorts 24x7
 
Sheet Pile Wall Design and Construction: A Practical Guide for Civil Engineer...
Sheet Pile Wall Design and Construction: A Practical Guide for Civil Engineer...Sheet Pile Wall Design and Construction: A Practical Guide for Civil Engineer...
Sheet Pile Wall Design and Construction: A Practical Guide for Civil Engineer...
 
AKTU Computer Networks notes --- Unit 3.pdf
AKTU Computer Networks notes ---  Unit 3.pdfAKTU Computer Networks notes ---  Unit 3.pdf
AKTU Computer Networks notes --- Unit 3.pdf
 
College Call Girls Nashik Nehal 7001305949 Independent Escort Service Nashik
College Call Girls Nashik Nehal 7001305949 Independent Escort Service NashikCollege Call Girls Nashik Nehal 7001305949 Independent Escort Service Nashik
College Call Girls Nashik Nehal 7001305949 Independent Escort Service Nashik
 
Extrusion Processes and Their Limitations
Extrusion Processes and Their LimitationsExtrusion Processes and Their Limitations
Extrusion Processes and Their Limitations
 
Porous Ceramics seminar and technical writing
Porous Ceramics seminar and technical writingPorous Ceramics seminar and technical writing
Porous Ceramics seminar and technical writing
 
(ANJALI) Dange Chowk Call Girls Just Call 7001035870 [ Cash on Delivery ] Pun...
(ANJALI) Dange Chowk Call Girls Just Call 7001035870 [ Cash on Delivery ] Pun...(ANJALI) Dange Chowk Call Girls Just Call 7001035870 [ Cash on Delivery ] Pun...
(ANJALI) Dange Chowk Call Girls Just Call 7001035870 [ Cash on Delivery ] Pun...
 
MANUFACTURING PROCESS-II UNIT-2 LATHE MACHINE
MANUFACTURING PROCESS-II UNIT-2 LATHE MACHINEMANUFACTURING PROCESS-II UNIT-2 LATHE MACHINE
MANUFACTURING PROCESS-II UNIT-2 LATHE MACHINE
 
KubeKraft presentation @CloudNativeHooghly
KubeKraft presentation @CloudNativeHooghlyKubeKraft presentation @CloudNativeHooghly
KubeKraft presentation @CloudNativeHooghly
 
Processing & Properties of Floor and Wall Tiles.pptx
Processing & Properties of Floor and Wall Tiles.pptxProcessing & Properties of Floor and Wall Tiles.pptx
Processing & Properties of Floor and Wall Tiles.pptx
 
(PRIYA) Rajgurunagar Call Girls Just Call 7001035870 [ Cash on Delivery ] Pun...
(PRIYA) Rajgurunagar Call Girls Just Call 7001035870 [ Cash on Delivery ] Pun...(PRIYA) Rajgurunagar Call Girls Just Call 7001035870 [ Cash on Delivery ] Pun...
(PRIYA) Rajgurunagar Call Girls Just Call 7001035870 [ Cash on Delivery ] Pun...
 
result management system report for college project
result management system report for college projectresult management system report for college project
result management system report for college project
 
VIP Call Girls Ankleshwar 7001035870 Whatsapp Number, 24/07 Booking
VIP Call Girls Ankleshwar 7001035870 Whatsapp Number, 24/07 BookingVIP Call Girls Ankleshwar 7001035870 Whatsapp Number, 24/07 Booking
VIP Call Girls Ankleshwar 7001035870 Whatsapp Number, 24/07 Booking
 
Java Programming :Event Handling(Types of Events)
Java Programming :Event Handling(Types of Events)Java Programming :Event Handling(Types of Events)
Java Programming :Event Handling(Types of Events)
 
Call Girls in Nagpur Suman Call 7001035870 Meet With Nagpur Escorts
Call Girls in Nagpur Suman Call 7001035870 Meet With Nagpur EscortsCall Girls in Nagpur Suman Call 7001035870 Meet With Nagpur Escorts
Call Girls in Nagpur Suman Call 7001035870 Meet With Nagpur Escorts
 
Structural Analysis and Design of Foundations: A Comprehensive Handbook for S...
Structural Analysis and Design of Foundations: A Comprehensive Handbook for S...Structural Analysis and Design of Foundations: A Comprehensive Handbook for S...
Structural Analysis and Design of Foundations: A Comprehensive Handbook for S...
 
Booking open Available Pune Call Girls Pargaon 6297143586 Call Hot Indian Gi...
Booking open Available Pune Call Girls Pargaon  6297143586 Call Hot Indian Gi...Booking open Available Pune Call Girls Pargaon  6297143586 Call Hot Indian Gi...
Booking open Available Pune Call Girls Pargaon 6297143586 Call Hot Indian Gi...
 
Top Rated Pune Call Girls Budhwar Peth ⟟ 6297143586 ⟟ Call Me For Genuine Se...
Top Rated  Pune Call Girls Budhwar Peth ⟟ 6297143586 ⟟ Call Me For Genuine Se...Top Rated  Pune Call Girls Budhwar Peth ⟟ 6297143586 ⟟ Call Me For Genuine Se...
Top Rated Pune Call Girls Budhwar Peth ⟟ 6297143586 ⟟ Call Me For Genuine Se...
 
Coefficient of Thermal Expansion and their Importance.pptx
Coefficient of Thermal Expansion and their Importance.pptxCoefficient of Thermal Expansion and their Importance.pptx
Coefficient of Thermal Expansion and their Importance.pptx
 
BSides Seattle 2024 - Stopping Ethan Hunt From Taking Your Data.pptx
BSides Seattle 2024 - Stopping Ethan Hunt From Taking Your Data.pptxBSides Seattle 2024 - Stopping Ethan Hunt From Taking Your Data.pptx
BSides Seattle 2024 - Stopping Ethan Hunt From Taking Your Data.pptx
 

Emotion recognition

  • 2. ■ Emotion Definition (page 3) – Basic Emotion – Dimensional Emotion ■ Social Emotion And Emotion-evoked Theory (p age 9) – Social Emotion – James-lange Theory – Cannon-bard Theory – Schatter & Singer Two Factor Theory ■ Bioreaction According To Emotion (page 21) – Brain – Heart – Eye – Skin – Facial expression ■ Emotional Issues (page 29) – Subjectivity And Objectivity – Moment Emotion – Fake Emotions – Temporary And Daily Emotions – Emotional Consciousness And Unconsci ous – Emotional Contagion And Synchronizati on – Personal Emotion And Social Emotion Catalog ■ Emotion Intensity (page 37) – Definitions – Features – Expressions ■ Complex Emotion (page 41) 2
  • 3. Emotion Definition - Basic Emotion - Dimensional Emotion 3
  • 4. Contents ■ History Of Basic Emotion Research - Duchenne de Boulogne (1862) identifies 13 major emotions by one or two facial muscle representations; - Attention, Reflection, Meditation, Intentness of mind, Pain, Aggression or Menace, Weeping with hot tears, Moderate Weeping, Joy, Laughter, False Laughter, Irony, ironic laughter, Sadness or Despondency - Charles Darwin (1872) divides emotions into 8 groups and considers them culturally unaffected; - Silvan Tomkins(1962) divides emotions into 9 emotions based on the same biological response (the Nine effect); - Positive (Interest-excitement, Enjoyment-joy), Neutral (Surprise-startle), Negative (Distress-anguish, Anger-rage, Fear- terror, Shame-humiliation, Dissmell (root of contempt), Disgust). - Paul Ekman (1971), removed three emotions (Contemut, Sham and Inner), and defines six basic emotions based on Tomkins theory. - Based on facial expressions (It have no cultural differences) 4
  • 5. Contents ■ Ekman’s Six Basic Emotion - Ekman's face expression extraction processes - Six emotions base on FACS(Facial Action Coding System) - Ekman’s six basic emotions: happy, sad, anger, surprise, fear, disgust, there is no difference between social, culture and ages; Emotion AU(Action Unit) Example Happiness 6 : Cheek Raise 12 : Lip Corner Pull 25 : Lips Part Sadness 1 : Inner Brow Raise 4 : Brow Lower 17 : Chin Raise Anger 4 : Brow Lower 7 : Lid Tighten 17 : Chin Raise 24 : Lip Press Emotion AU(Action Unit) Example Fear 1 : Inner Brow Raise 2 : Outer Brow Raise 4 : Brow Lower 5 : Upper Lid Raise 20 : Lip Stretch Surprise 1 : Inner Brow Raise 2 : Outer Borw Raise 5 : Upper Lid Raise 26 : Jaw Drop Disgust 9 : Nose Wrinkle 10 : Upper Lid Raise 15 : Lid Corner Depress 25 : Lips Part 5 Figures from: Tian, Y. I., Kanade, T., & Cohn, J. F. (2001). Recognizing action units for facial expression analysis. IEEE Transactions on pattern analysis and machine intelligence, 23(2), 97-115. James A Russell. (1980). Circumplex Model of Affect. Journal of Personality and Social Psychology, 39(6), 1161-1178
  • 6. Contents ■ Facial Expressions – Au(Action Units) - The expression and emotion of a person are not based on culture or learning, but is a instinct. So that there's a universality in facial expressions. - There are 42 muscles on the human face, Micro-Expression appear and change between 0.5 and 4 seconds in our usual facial expressions. Moreover, an indescribable expression of true feelings expresses by unconsciousness that appears and disappears momentarily in a very short time of 0.2 seconds. - FACS (Facial Action Coding System) each facial expression is given an alphabet and number to sign its type and intensity. - Alphabetical rating (A-E): the intensity of emotions. It is more intensity from A to E. ■ History Of Dimensional Emotion Research - Nowlis define emotion in six to twelve independent emotional dimensions, like sadness, anxiety, aner, elation, tension, etc. based on self-reporting experiment. - Tomkins, Lzard, Ekman think that each emotional state can be seen as a different dimension, For example, sadness and great joy can be conjoined together in reverse. - Schlosberg thinks emotions are not independent of each other, but very systematically associated with each other. He defines a two-dimensional circle model in pleasantness – unpleasantness, attention – rejection, and then proposes three dimensional model by adding dimension of sleepiness – tension. - Russell defined in a circular form with two-dimensional bipolar properties: valence and arousal based on Laymen’s Conceptualization of Affect (judgement) and Multivariate Analysis of Self-reported Affective States (experiences) 6Figures from: Clark, E. A., J'Nai Kessinger, S. E. D., Bell, M. A., Lahne, J., Gallagher, D. L., & O'Keefe, S. F. (2020). The Facial Action Coding System for Characterization of Human Affective Response to Consumer Product- Based Stimuli: A Systematic Review. Frontiers in Psychology, 11.
  • 7. Contents ■ Russell’s dimensional circle model - Russell’ dimensional emotion use two independent dimensions to explain emotional states: valence and arousal; - Methods - Circular Scaling of Terms - Multidimensional Scaling of Terms - Unidimensional Scaling - Structure of Self-Reported Affect - the classification of emotions by a person's judgment is based on the person's cognitive structure - Dimensional emotion model is defined as valence and arousal - Neurophysiological interpretation - Excited, Tense, Angry: sympathetic nerve ↑, parasympathetic nerve ↓, pupil dilation - Calm, Bored, Tired: sympathetic nerve ↓, parasympathetic nerve ↑, pupil constriction - Β wave: Rise (cupillary lobe) - Awakening under stress conditions - Α wave: Low brain activity (hypodiacal lobe) - Stable - Beta/Alpha: The ratio of two frequencies can be used to determine the awakening - The frontal lobe plays a crucial role in the experience of sperm control and consciousness. - Inactivation of the left hemisphere forebrain is associated with negative emotion - In contrast, inactivation of the right hemisphere forebrain indicates positive 7Figures from: James A Russell. (1980). Circumplex Model of Affect. Journal of Personality and Social Psychology, 39(6), 1161-1178
  • 8. Reference - Ekman, P. (1989).The argument and evidence about universals in facial expressions. Handbook of social psychophysiology, 143-164. - Ekman, P. (1992).An argument for basic emotions. Cognition & emotion, 6(3-4), 169-200. - Ekman, P., & Friesen,W.V. (1971). Constants across cultures in the face and emotion. Journal of personality and social psychology, 17(2), 124. - James A Russell. (1980). Circumplex Model of Affect. Journal of Personality and Social Psychology, 39(6), 1161-1178. - Jonathan Posner. (2009).The Neurophysiological Bases of Emotion:An fMRI Study of theAffective Circumplex Using Emotion-Denoting Words. Hum Brain Mapp. 30(3). 883-895. - Ortony,A., &Turner,T. J. (1990).What's basic about basic emotions?. Psychological review, 97(3), 315. - Ortony,A., &Turner,T. J. (1990).What's basic about basic emotions?. Psychological review, 97(3), 315. - Rinn,W. E. (1984).The neuropsychology of facial expression: a review of the neurological and psychological mechanisms for producing facial expressions. Psychological bulletin, 95(1), 52. - Saarimäki, H., Gotsopoulos, A., Jääskeläinen, I. P., Lampinen, J.,Vuilleumier, P., Hari, R., ... & Nummenmaa, L. (2016). Discrete neural signatures of basic emotions. Cerebral cortex, 26(6), 2563-2573. - Wundt,Wilhelm Max. Lectures on human and animal psychology. George Allen, 1896. - Schlosberg, Harold. "The description of facial expressions in terms of two dimensions." Journal of experimental psychology 44.4 (1952): 229. - Levenson R W.The autonomic nervous system and emotion[J]. Emotion Review, 2014, 6(2): 100-112. - Handbook of emotions[M]. Guilford Press, 2010. - Agrafioti F, Hatzinakos D,Anderson A K. ECG pattern analysis for emotion detection[J]. IEEETransactions on affective computing, 2011, 3(1): 102-115. - Tomarken, Resting frontal brain asymmetry predicts affective responses to films, 1990 - Davidson, Neuropsychological perspectives on affective styles and their cognitive consequences, 1999 - Davidson, R. J., Ekman, P., Saron, C. D., Senulis, J. A., &Friesen,W.V. (1990). Approach-withdrawal and cerebral asymmetry: Emotional expression and brain physiology: I. Journal of Personality and Social Psychology, 58 (2), 330–341 - Paul Ekman (2012) , “should we call it expression or communication?”,The European Journal of social science research, Jan 24 8
  • 9. Social Emotion And Emotion-evoked Theor y - Social Emotion - Emotion-evoked Theory - Social Emotion - Emotion-evoked Theory 9
  • 10. Contents ■ Social Emotions - Social emotions are caused by interactions with others and have important social function, that means social emotions depend on the thoughts, feelings, and behaviors of others, and relate to interpersonal relationship, institutional system, and culture. - Definition - Social emotion are various opinions based on factors and categories; - Social emotions are complex emotions, in which cognitive factors play an important role; - Social emotions are influenced by communication, not internal phenomena; - Social emotions play an important role in moral decision-making, so it is also called moral emotion. - Opinion 1: Social emotions develop in the later stages of human evolution rather than general emotions - Buck(1999) - Emotions are separate from biological mechanism, especially social emotions are developed from basic attachments in society. - Oatley(1987) - All human emotions are social because they believe that the way of evolution takes into account the social perception in the previous structure to deal with the complexity of social life. - Even basic emotions such as happiness, sadness, anxiety, anger, and disgust are considered social emotions because they are mainly related to social objects - Opinion 2: Social emotions are caused by judgments of facts, imagination and expectations - Leary(2001) - Emphasis on relationships of all types of social emotion - Bennett& Campos(1987) - Social emotions are classified based on basic principles and goals. 10
  • 11. Contents ■ Comparison of Group Emotions and Social Emotions - Group Emotions - Form emotions in one direction and transfer emotions in a group - Through the interaction and transmission of emotions among group members, individual emotions are transformed into group emotions - Public emotion has the same or similar emotional structure - Features - Unity and collective - With the popularity of social media, the transfer of public sentiment has accelerated. - Emotion formation process is formed by the same life experience and cultural factors - The homogenization trend of the spread of individual emotional states among members of a specific group - Individual emotions or states are ignored by people with greater intensity of sensitivity - Emotional strength within the group is an important reason for public emotion - Synchronization between leader and slave - Social Emotions - Emotions caused by interaction with others - Emotions caused by social connection between people the same psychological experience. - Features - Based on emotional interaction between two people - Different people may have different sensitivities - React to the thoughts, feelings or behavior of others - The categories of social emotion are comprehensive and diverse: jealousy, guilt, shame, etc. - Compared with basic emotions, it has a more complex system and develops later 11
  • 12. Contents ■ Comparison Tabel Group Emotions Social Emotions Commons Emotions may be evoked from others It is formed by experiences based on social and cultural factors during the process of emotional development. Difference same emotional direction May have different emotional direction the strength of emotion in the group is important Emotional interaction between two people is important Basing on emotion infection Basing on social relationships Synchronization between leader and followers Synchronization between two people Personal emotion is disregarded by others' great intensity emotion Form social relations through emotional interaction 12
  • 13. Contents ■ Social emotions - Classifications (table 1) - Moral emotions - Basing on Social emotions play an important role in moral decision-making, so it is also called moral emotion. - Closely related to the interests or well-being of the entire society - Shame, guilt, regret, embarrassment, contempt, anger, disgust, gratitude, jealousy, jealousy, compassion, empathy - From self-aware emotions - Emotions that occur when an individual recognizes that an event or situation may have effect on self- assessment or happiness. - For example: Shame, guilt, pride, embarrassment Author Social Emotions Adolphs, Baron Cohen & Tranel, 2002 Admiration, arrogance, flirtatiousness, guilt, loyalty Barbalet, 1996 Confidence, trust Barrett & Campos, 1987 Envy, guilt, pride, shame Barrett and Nelson-Goens, 1997 Embarrassment, envy, guilt, pride, shame Buck, 1999 Arrogance, envy, guilt, jealousy, joy, pity, pride, scorn, shame Hareli & Weiner, 2002 Admiration, anger, contempt, dislike, distaste, envy, gratitude, guilt, like, pride, respect, schadenfreude, shame, sympathy Leary, 2000 Admiration, embarrassment, envy, hatred, hurt feelings, jealousy, loneliness, love, pride, shame, social anxiety, social sadness Oatley & Johnson-Laird, 1987 Bitterness, delight, depression, disappointment, embarrassment, horror, loathing, sexual love, vengefulness Parkinson, Fischer & Manstead, 2005 Envy, fago, grief, guilt, jealousy, love, shame different social emotions 13
  • 14. Contents ■ Emotional intelligence - A complex of emotional and social abilities/skills that helps people solve everyday problems and improve efficiency in their personal and social lives - Self-awareness: the understanding of strengths and limitations, and the desire for continuous improvement; - Self-management: successfully control own emotions and behaviors, and can achieve a succeed in new or challenging situations; - Social-awareness: the ability to interact with others in a social environment through collaboration and tolerance; - Relationship Skills: the ability to promote and maintain positive relationships with others - Goal-Directed Behavior: start and insist on completing tasks of various difficulty - Personal Responsibility: be cautious and reliable, and help collective efforts - Decision-Making: use your own values to guide actions and take responsibility for your decisions - Optimistic Thinking: confidence, hope, positive ways of thinking, attitudes towards yourself and past, present and future living conditions - Factors - Self-awareness - Self-management - Social awareness - Relationship management 14 Figure from pinterest: https://www.pinterest.co.uk/pin/298152437802302187/
  • 15. Contents ■ Social emotions and Emotional intelligence Social Emotion Social Intelligence An individual's feelings depending on the thoughts, feelings, and actions of others Heavily influenced by communication with others What’s your emotions under an special circumstances when you communicate with others? The ability to socialize and act appropriately to social situations Heavily influenced by a given social situation How do you live and act under a special circumstances? 15
  • 16. Contents ■ Social emotion and SNS - The roles of social emotions in SNS - People share emotions and information in social media as same as in real society; - Emotional sharing relationship: express your recent situation, mood, emotions, etc. through SNS, and express and share emotions with offline people. - Information sharing relationship: sharing information or music, or getting a new perspective from someone with professional knowledge-compared to emotional sharing, this connection is worse and forms negative social emotions - Method of analysis - Define the representative relationship between SNS users as emotional sharing relationship (variable) and information sharing relationship (variable); - Establish model to verify the social emotion model Social emotional vocabulary analysis and collection Verify the suitability of socially sensitive vocabulary Chi-square test Representative social sensitivity Correlation analysis and factor analysis between social sensitivities Structural analysis of social emotion model Building a social emotion model Verify social emotion model Subjective evaluation 16
  • 17. Contents ■ Social emotion and Parasympathetic nervous systems (PN) - When activated, it controls the endocrine glands to prepare the body for emergency action and causes the adrenal glands to produce epinephrine - increased blood flow to the muscles - increased heart rate - Help the body to move more quickly and feel less pain in situations perceived to be dangerous. - Parasympathetic nervous systems (PN) - When the body is relaxed or at rest, it helps the body store energy for future use. - Increased stomach activity and decreased blood flow to the muscles. limbic system autonomicnervous system reticular activating system serotonin noradrenaline dopamine Result pleasant or unpleasant mental states SNS PN together with the hypothalamus, regulates pulse, blood pressure, breathing arousal in response to emotional cues first arouse the cortex then maintain its wakefulness sensory information and emotion can be interpreted more effectively. emotion cerebral cortex hippocampus amygdala grey, folded, outermost layer of the cerebrum responsible for higher brain processes such as sensation, voluntary muscle movement, thought, reasoning, and memory. in the medial temporal lobe play a key role in emotion in both animals and humans, particularly in the formation of fear-based memories in the temporal lobe of the brain plays a role in memory and emotion 17
  • 18. Contents ■ James-Lange theory - Emotion is the result of a physiological reaction to an external event - Physiological changes at first, then emotions - E.x. Happy because of smile; sad because of crying; - Detect - In the majority of emotions, this test is inapplicable - Only corroborates in emotions that have a distinct bodily expression. - For many of the manifestations are in organs over which we have no volitional control ■ Cannon-Bard theory - emotional and physiological responses both happen—but these are two separate processes - based on thalamic processes which response for emotional responses to experienced stimuli - when the thalamic discharge occurs, the bodily changes occur almost simultaneously with the emotional experience. ■ Schatter & singer two factor theory - Emotion = arousal + cognition - emotions are the result of both physiological and cognitive processes. - In a famous 1962 study, Schachter and Singer investigated whether people would respond differently to a shot of adrenaline depending on the context they found themselves in. - While later research hasn’t always supported Schachter and Singer’s findings, their theory has been incredibly influential and has inspired many other researchers. 18
  • 19. Contents ■ Jame-lange Emphasize Emotions are caused by physical reactions to events ■ Cannon-Bard proposes that both of these reactions originate simultaneously in the thalamus ■ Schachter & Singer(Two-factor) theory of emotion Adds onto James-lange Theory of emotion by stating that two factors are needed: physiologic response and congnitive label, emp Cognition is the main factor determining emotional state 19Figures from internet
  • 20. Reference - Buck, R. (1980). Nonverbal behavior and the theory of emotion:The facial feedback hypothesis. Journal of Personality and Social Psychology, 38(5), 811–824. doi:10.1037/0022-3514.38.5.811 - Strack, Fritz; Martin, Leonard L.; Stepper, Sabine (May 1988). "Inhibiting and FacilitatingConditions of the Human Smile: A NonobtrusiveTest of the Facial Feedback Hypothesis". Journal of Personality and Social Psychology. 54 (5): 768–777. doi:10.1037/0022-3514.54.5.768. PMID 3379579. - Cannon,W.B. (1927). "The James-Lange theory of emotions: A critical examination and an alternative theory".TheAmerican Journal of Psychology. 39 (1/4): 106– 124. doi:10.2307/1415404. JSTOR 1415404. - Cannon,W.B. (1931). "Again the James-Lange and the thalamic theories of emotion". Psychological Review. 38 (4): 281–295. doi:10.1037/h0072957. - Ye-Sool Cha , Ji-Hye Kim , Jong-Hwa Kim , Song-Yi Kim ,Dong-Keun Kim, Min-CheolWhang (2012), “Validity analysis of the social emotion model based on relation types in SNS”, 감성과학,Vol.15, No.2, pp.283-296, June 2012 - JF Kihlstrom, N Cantor, “Social Intelligence” - Brian Parkinson (1996), “Emotions are social”, British journal of psychology, 1996 -WileyOnline Library - What is Elevation? - https://gostrengths.com/what-is-elevation/ - Social emotions - https://en.wikipedia.org/wiki/Social_emotions - Embarrass - https://www.psychologytoday.com/us/blog/intense-emotions-and-strong-feelings/201112/embarrassment - Marinetti,C., Moore, P., Lucas, P., & Parkinson, B. (2010). Emotions in Social Interactions:Unfolding Emotional Experience. Emotion-Oriented Systems, 31– 46. doi:10.1007/978-3-642-15184-2_3 20
  • 21. Bioreaction According To Emotion - Brain - Heart - Eye - Skin - Facial expression 21
  • 22. Contents ■ Brain - EEG - The electroencephalogram (EEG) is a recording of the electrical activity of the brain from the scalp. The recorded waveforms reflect the cortical electrical activity. - the main frequencies of the human EEG waves are: Delta(1-3Hz), Theta(3.5-7.5Hz), Alpha(7.5-13Hz), Beta(14-30Hz), γ(30~80Hz) - The electric potential generated by an individual neuron is far too small to be picked up by EEG or MEG.[46] EEG activity therefore always reflects the summation of the synchronous activity of thousands or millions of neurons that have similar spatial orientation. - Research results - In the comparison between the stable state and the emotion-induced state caused by visual stimuli, there are significant differences in almost all regions. - Positive and negative - Positive: Beta and gamma waves are activated in the temporal lobe. - Neutral: Inactivation of beta wave and gamma wave in temporal lobe, and activation in frontal lobe in delta wave, theta wave, and alpha wave. - Negative: Similar to Neutral, but different from Alpha and Delta, showing delta wave activation in parietal lobe. - Basic emotions - Alpha power AMUSEMENT <NEUTRAL <DISGUST <SAD - SAD: activated in the frontal, parietal, and parietal lobes - DISGUST: activated in the frontal and parietal lobes - NEUTRAL: activated in the frontal and parietal lobes - Amusement: activated slightly in the parietal lobe - Happy: have significant EEG, but similar to sleepy 22
  • 23. Contents ■ Brain - EEG Wave Patterns Frequency Range (Hz) Signal Features Significant δ (Delta wave) ~3.5 the highest in amplitude and the slowest waves - Infancy or immature intellectual development, extreme fatigue and let hargy or anesthesia θ (Theta wave) 3.5~7 High-amplitude - frustration or depression - associated with reports of relaxed, meditative, and creative states - Gloomy: θ(4-7Hz) lateral brain α (Alpha wave) 8~12 the "posterior basic rhythm“ wave - awake, quiet when closing eyes - Active: There are significant differences between the basic emotions in the left frontal lobe. - Calm: α (8-13Hz) in Posterior lobe β (Beta waveγγ) 13~30 both sides in symmetrical distribution; Low-amplitude - nervous and excited Γ (Gamma wave) 31~50 Lowest-amplitude - Exchange of information between cortical and subcortical areas - Appears in conscious awakening and dreams during REM sleep. - It may appear overlapped with beta waves. - Tense:Γ (30-50Hz) in the forebrain Information about EEG 23
  • 24. Contents■ Heart - ECG (Electrocardiography) - It is a graph of voltage versus time of the electrical activity of the heart[4] using electrodes placed on the skin. - Normal rhythm produces four entities – a P wave, a QRS complex, a T wave, and a U wave - each have a fairly unique pattern - P wave: atrial depolarization. - QRS: complex represents ventricular depolarization. - T wave: ventricular repolarization. - U wave: papillary muscle repolarization. - The heart's electrocardiogram declines when you feel sad or stable, but increases when it is excited - ECG and emotion - The signals of ECG decrease when nervous, sad and calm - The signals of ECG increase when excited and anxious - Research results about EEG - Anger: acceleration and amplitude are relatively large - Comfortable: acceleration and amplitude are relatively small - Sad: acceleration is relatively large, amplitude is relatively small - Happy: acceleration is relatively small, amplitude is relatively large - PPG - used to detect blood volume changes in the microvascular bed of tissue - most common sites: ear, nasal septum, and forehead, right and left ear lobes, index fingers and great toes - Heart rate variability measured by PPG divided from HRV to LF/HF and analyzed - When the LF component increases, the parasympathetic nervous system prevails and is judged to be negative. - When HF component increases, the sympathetic nervous system prevails and is judged as a positive emotion - When the LF/HF value was increased, the LF value was relatively increased, and the parasympathetic nerve was dominant. 24 Figures from internet
  • 25. Contents ■ Eye - Pupil - It is an empty space in the center of the eye. - Through the pupil, light enters the retina and enables visual processing. - It is black because the space behind the eyes is dark, and it is black regardless of the iris color. - The pupil diameter is about 2 to 8 mm. - The pupil's response to light - Exact response time may vary depending on age, stimulus intensity, etc. - 0~0.2 sec: pupils do not respond - 0.2~1.5 sec: Shrinks quickly and strongly until the pupil shrinks to the smallest size - 1.2~10 sec: The pupil is still deflated and slightly restored - 10~30 sec: Pupil gradually returns to its original size; expansion by light is slower to recover - Physiological characteristics (figure 14, table ) Different Social EmotionsPupil sphincter (括约肌) Mydriasis major Definition Circular muscles around the pupil Radial muscles around the pupil Autonomic nervous system Parasympathetic nervous system Sympathetic nervous system Function - Reduces pupil size when light is bright - Highly related to rest-storage reactions - Increases pupil size to receive more light - Closely related to the fight-run reaction 25Figures from: Mathôt, S. (2018). Pupillometry: Psychology, physiology, and function. Journal of Cognition, 1(1).
  • 26. Contents ■ Eye - Pupil - Amygdala - The amygdala suppresses the parasympathetic nerve. - Amygdala activation: pupil dilation - Amygdala inactivation: pupil contraction - Path-way : eye to brain ■ Skin - GSR (Galvanic Skin Resistance) - Measure sweat gland activity from finger skin which are reflective of the intensity of our emotional state, otherwise known as emotional arousal. - scary, threatening, joyful, or otherwise emotionally relevant - increases eccrine sweat gland activity - The GSR signal is therefore not representative of the type of emotion, but the intensity of it. - It is noteworthy that both positive (“happy” or “joyful”) and negative (“threatening” or “saddening”) stimuli can result in an increase in arousal – and in an increase in skin conductance. - SKT (Skin Temperature) Retina Optic Intersecting Optic nerves Right Field Of View Information Left Field Of View Information EWN : Edinger –Westphal nucleus EWN Laryngeal Lob e 26
  • 27. Contents ■ Facial expression - Facial expression is controlled by the movement and position of the muscles under the skin of the face. - The muscles involved are divided into 14 muscles. - EMG (Electrormyogram) - evaluating and recording the electrical activity produced by skeletal muscles - use as middleware in gesture recognition towards allowing the input of physical action to a computer as a form of Human- computer interaction - two kinds of EMG: surface EMG and intramuscular EMG - FEMG is a face electromyography test. 27 Figures from: Gibert, G., Pruzinec, M., Schultz, T., & Stevens, C. (2009, November). Enhancement of human computer interaction with facial electromyographic sensors. In Proceedings of the 21st Annual Conference of the Australian Computer-Human Interaction Special Interest Group: Design: Open 24/7 (pp. 421-424). https://imotions.com/blog/facial-expression-pictures/
  • 28. Reference 1. Babiker, A., Faye, I., & Malik, A. (2013). Pupillary behavior in positive and negative emotions. 2013 IEEE International Conference on Signal and Image Processing Applications. 2. Geangu, E., Hauf, P., Bhardwaj, R., & Bentz, W. (2011). Infant pupil diameter changes in response to others' positive and negative emotions. PloS one, 6(11), e27132. 3. Ho, C. H., & Lu, Y. N. (2014). Can pupil size be measured to assess design products?. International Journal of Industrial Ergonomics, 44(3), 436-441 4. Oliva, M., & Anikin, A. (2018). Pupil dilation reflects the time course of emotion recognition in human vocalizations. Scientific reports, 8(1), 4871. 5. Somchanok T, Michiko O. (2015). Emotion Recognition using ECG Signals with Local Pattern Description Methods. International Journal of Affective Engineering, 6. Valenzi, S., Islam, T., Jurica, P., & Cichocki, A. (2014). Individual classification of emotions using EEG. Journal of Biomedical Science and Engineering, 2014. 7. Van Steenbergen, H., Band, G. P., & Hommel, B. (2011). Threat but not arousal narrows attention: evidence from pupil dilation and saccade control. Frontiers in psychology, 2, 281. 8. Zheng, W. L., Zhu, J. Y., & Lu, B. L. (2017). Identifying stable patterns over time for emotion recognition from EEG. IEEE Transactions on Affective Computing. 28
  • 29. Emotional Issues – Subjectivity And Objectivity – Moment Emotion – Fake Emotions – Temporary And Daily Emotions – Emotional Consciousness And Unconscious – Emotional Contagion And Synchronization – Personal Emotion And Social Emotion 29
  • 30. Contents ■ Emotional Subjectivity and Objectivity - Objective Or Subjective - Emotions are subjective because they are influenced by personal, social, and cultural environments. - Physiological indicators reveal more obvious differences depending on the emotional experience as they become more physically excited. - Conversely, if the level of excitement is low, it is difficult to predict the emotional experience with only physiological indicators. - Subjective evaluation method - There is a delay of around 10 seconds in the brain immediately after presenting visual stimuli and the subject expresses the highest emotional value - Real-time subjective evaluation and non-real-time subjective evaluation - Measurements through questionnaires, such as the cut scale and the semantic scale. - Emotions are considered subjective because its process of generation varies depending on personal, social, and cultural differences - Emotion are objective because that it happens with physiological changes in the body and can be objectively measured - Measurements through biometric signals (EEG, ECG, GSR, EMG, etc.). - Evaluate false emotions resulting from the discrepancy between actual feelings and expressions through brain wave response analysis ■ Moment Emotion - Ekman's Micro-Expression captures the moment of emotion according to the expression that should pay attention to the persistence of emotion and the change of emotion with time - The persistence of emotions is mainly divided into negative emotions and positive emotions - Emotions often cause other emotions to motivate the expression of emotions. For example, the continuation of a negative emotional state stimulates the expression of positive emotions, leading to escape from negative emotions. 30
  • 31. Contents ■ Fake Emotions - It can be detected form objective methods - based on facial micro stress, body language, and interrogation language analysis. - facial EMG response - E.x. body behavior - Lying smile, paraphrase behavior, grooming behavior, hesitation, increased frequency of eye blinking, speechlessness, decreased hand, foot, and body movement. - E.x. facial expression - Dull smile-periocular area: shows a significant difference between a neutral expression and a dull smile-Ball muscle area: strong response when a dull smile, a non-dull smile does not differ from a neutral expression-affects altruism: see a dull smile or open mouth Subjects who saw a smile showed positive behavior to share money. - E.x. pupil change - Reduced pupil size in a stiff smile - Women increased pupil size in a dull smile; Male increased pupil size in a an-stiff smile - The eye blink rate of a person increases to eight times the normal rate after lying - E.x. EEG signal - The signals in F3, F4, C4, P3, P4, O1, O2 of brain have significant differences between actual and false emotions - E.x. ECG signal - looking at a back-to-back smile (true smile) has resulted in much stronger fascia and cheek muscle EMG activity compared to the activity gained by looking at a neutral face - others - the EMG reaction of the pericardial and ball muscle region to Non Dussen smile was no different from that of the neutral face - the intensity was more significant in a happy expression than in an angry expression. 31
  • 32. Contents ■ Temporary And Daily Emotions - Temporary emotion - Memory-based emotion - Memory is stimulated by instantaneous stimuli - The ability to remember varies by emotion - Daily emotion - Described as Mood - Development into everyday emotions as the continuation of temporary emotions - Deriving various everyday emotions depending on context or by differences in persistence by emotion ■ Emotional Consciousness And Unconscious - Conscious emotion - This is all the emotional experience we perceive in our daily lives. - If you consciously perform facial mimicry instead of distinguishing emotions, the ability is poor. - Unconscious emotion - It is an emotional experience that we do not recognize in our daily life. - Facial express micro-movement rises from the face when unfair things happen: the psoas muscles and the cheek muscles - empathy More empathy for someone imitating their behavior. - Self-esteem Self-esteem suppresses acts that imitate others (unknowingly) - Cheers to try to imitate someone unconsciously in order to buy someone else's cheers. - When imitating a variety of emotional facial stimuli, the facial muscles are involuntarily moved in a micro-movement like the suggested expression. - The act of imitating someone increases the likelihood of the person unconsciously. 32
  • 33. Contents ■ Emotional Contagion And Synchronization - Contagion - Positive emotions - the frequency of the frontal lobe (F7), anterior lobe (T3, T4, T5, T6) and larynx (O2) vary significantly. - Negative emotions - a significant difference between the amount of frequency changes in the frontal lobe (F3), anterior lobe (T4) and posterior lobe (I2) - Empathy: a significant difference in frequency was observed in the temporal lobe (T4). - non-empathy: a significant difference in the amount of frequency change in the parietal lobe (P3, P4) and the central sphere (c3) can be confirmed. - Synchronization - Empathy is a person's stand, feeling and thinking about his emotions, which is spread by others' emotions - Everything that explains and reflects the world is related to emotions, and they affect and spread each other. ■ Personal Emotion And Social Emotion - Personal sensibility - Stimulation triggers your own sensibility - Emotional reactions are not the same for everyone. - In order to properly analyze biosignals, which is a means to objectively classify individual emotions, a method of reducing individual differences is needed. - When a stable state is used, a reference to be used as a reference is measured together, and a biosignal that changes according to emotion is calculated and normalized as a rate of change to overcome individual differences. - Social sentiment - A society where individuals form a social relationship - Sensibility plays a decisive role as a medium to form social ties - Social sentiment should be measured not by individual, but by relationship with others. - Intimacy, empathy, etc. 33
  • 34. Reference 1. Strike, P. C., Wardle, J., & Steptoe, A. (2004). Mild acute inflammatory stimulation induces transient negative mood. Journal of psychosomatic research, 57(2), 189-194. 2. Bouhuys, A. L., Bloem, G. M., & Groothuis, T. G. (1995). Induction of depressed and elated mood by music influences the perception of facial emotional expressions in healthy subjects. Journal of affective disorders, 33(4), 215-226. 3. Strike, P. C., Wardle, J., & Steptoe, A. (2004). Mild acute inflammatory stimulation induces transient negative mood. Journal of psychosomatic research, 57(2), 189-194. 4. Strike, P. C., Wardle, J., & Steptoe, A. (2004). Mild acute inflammatory stimulation induces transient negative mood. Journal of psychosomatic research, 57(2), 189-194. 5. Hayakawa, Y., Takada, K., Miki, H., & Tanaka, K. (2000). Effects of music on mood during bench stepping exercise. Perceptual and motor skills, 90(1), 307-314.. 6. Balteș, F. R., & Miu, A. C. (2014). Emotions during live music performance: Links with individual differences in empathy, visual imagery, and mood. Psychomusicology: Music, Mind, and Brain, 24(1), 58.. 7. Mathews, A., & Bradle, B. (1983). Mood and the self-reference bias in recall. Behaviour research and therapy, 21(3), 233-239. 8. George, M. S., Ketter, T. A., Parekh, P. I., Horwitz, B., Herscovitch, P., & Post, R. M. (1995). Brain activity during transient sadness and happiness in healthy women. American Journal of Psychiatry, 152(3), 341-351 9. Hammersley, R., & Reid, M. (2009). Theorising transient mood after ingestion. Neuroscience & Biobehavioral Reviews, 33(3), 213-222. 10. Barabasz, M. (1991). Effects of aerobic exercise on transient mood state. Perceptual and motor skills, 73(2), 657-658. 11. Winkielman, P., & Berridge, K. C. (2004). Unconscious Emotion. Current Directions in Psychological Science, 13(3), 120–123. 12. 안호석, 최진영, 이동욱. (2012). 의식과 무의식을 구분하는 감성 로봇 시스템. 제어로봇시스템학회 국내학술대회 논문집, (), 186-187. 13. Um, Z.-S., Yang, J.-C., Park, J.-I., & Kim, G.-W. (2019). 유년기 정신적 외상을 경험한 외상후 스트레스장애 환자에서 무의식적 감정 자극이 의식적 작업기억 수행에 미치는 영향에 관한 기능적 자기공명영상 연구. Psychoanalysis, 30(4), 114-123. 14. 김민정, 이영애 (2011). 목표지향적 정보처리에서 무의식적 사고의 효과. 인지과학, 22(4), 405-427 15. 손민정, 남택진 (2010). 지속가능한 인터랙션 디자인에 적용하기 위한 인간의 무의식적인 행동에 관 한 연구. 한국HCI학회 학술대회, 456-459 34
  • 35. Reference 16. Dimberg, U., Thunberg, M., & Elmehed, K. (2000). Unconscious Facial Reactions to Emotional Facial Expressions. Psychological Science, 11(1), 86–89. doi:10.1111/1467-9280.00221 17. 조덕기, 이은주, 방성근, 권오재, 임인종, 김만영, 김진희 (2011). Wavelet cross correlation을 이용한 의식 적인 의도와 무의식적인 의도에 따른 뇌활성 신호의 특징 추출. 정보과학회논문지 : 컴퓨팅의 실제 및 레터, 17(12), 613-621 18. 정진복, 안창일 (2000). 식역하 ERP 를 통한 정서적 자극의 무의식 처리. 한국심리학회지: 건강, 5(2), 304-315 19. Ivonin, L., Chang, H.-M., Chen, W., & Rauterberg, M. (2012). Unconscious emotions: quantifying and logging something we are not aware of. Personal and Ubiquitous Computing, 17(4), 663–673. doi:10.1007/s00779-012-0514-5 20. Jessen, S., & Grossmann, T. (2015). Neural signatures of conscious and unconscious emotional face processing in human infants. Cortex, 64, 260–270. doi:10.1016/j.cortex.2014.11.007 21. Kramer,A. D.,Guillory, J. E., & Hancock, J.T. (2014). Experimental evidence of massive-scale emotional contagion through social networks. Proceedings of the NationalAcademy of Sciences, 111(24), 8788-8790. 22. Coviello, L., Sohn,Y., Kramer,A. D., Marlow,C., Franceschetti, M., Christakis, N.A., & Fowler, J. H. (2014). Detecting emotional contagion in massive social networks. PloS one, 9(3). 23. Manera,V., Grandi, E., & Colle, L. (2013). Susceptibility to emotional contagion for negative emotions improves detection of smile authenticity. Frontiers in Human Neuroscience, 7, 6. 24. Ferrara, E., &Yang, Z. (2015). Measuring emotional contagion in social media. PloS one, 10(11), e0142390. 25. Xiong, X., Li,Y., Qiao, S., Han, N.,Wu,Y., Peng, J., & Li, B. (2018). An emotional contagion model for heterogeneous social media with multiple behaviors. Physica A: Statistical Mechanics and its Applications, 490, 185-202. 26. Hashimoto, M.,Yamano, M., & Usui,T. (2009, September). Effects of emotional synchronization in human-robot KANSEI communications. In RO-MAN 2009- The 18th IEEE InternationalSymposium on Robot and Human InteractiveCommunication (pp. 52-57). IEEE. 35
  • 36. Reference 27. Grandjean, D., Sander, D., & Scherer, K. R. (2008). Conscious emotional experience emerges as a function of multilevel, appraisal-driven response synchronization. Consciousness and cognition, 17(2), 484-495. 28. Li,Y., & Hashimoto, M. (2011, December). Effect of emotional synchronization using facial expression recognition in human-robot communication. In 2011 IEEE InternationalConference on Robotics and Biomimetics (pp. 2872-2877). IEEE. 29. Osvath, M., & Sima, M. (2014). Sub-adult ravens synchronize their play: a case of emotional contagion. Anim Behav Cogn, 2, 197. 30.Wiss, M., &Tordjman,S. (2016). Creating a ‘social zeitgeber’to synchronize family emotional rhythms:A new therapeutic approach in child and adolescent psychiatry. Journal of Physiology-Paris, 110(4), 480-486. 31. 강유원(2010), “사회적감성, 정치적의식, 정치적행위”, 감성연구1권,0호,69-83. 32. 신승섭, 노수진, 차예술, 김종화, 황민철(2012), “사랑과 우정에 대한 사회감성 모델에 관한 연구”, 한국 감성과학회 춘계학술대회 2012권, 0호, 71-72. 33. 이구형(1998), “감성과 감정의 이해를 통한 감성의 체계적 측정 평가”, 감성과학1권,1호,113-122. 34. J. M. Barbalet, Social emotions: confidence, trust and loyalty, International Journal of Sociology and Social Policy, 16(9/10), 1996, 75–96. 35. Hareli, S., & Parkinson, B. (2008).What’s social about social emotions?, Journal for theTheory of Social Bevaviour, 38, 131–156. 36. Seyfert, R. (2012) ‘Beyond Person Feelings and Collective Emotions:Toward aTheory of SocialAffect’,Theory,Culture and Society 29(6): 27–46. 37. Parkinson,B., & Lea, M. E (1991). Investigating personalconstructs of emotion.British Journal of Psychology,82, 73-86. 38. Cavalera,C., & Pepe,A. (2014). Social emotions and cognition: Shame, guilt and working memory. Social and Behavioral Sciences, 112, 457-464. 39. Parkinson, B.(1996). "Emotions are social." British,Journal of Psychology, 87: 663-683. 40. L. J. Chang, andA. Smith, “Social emotions and psychological games,” Curr.Opin. Behav. Sci., vol. 5, pp. 133-140, Oct. 2015. 36
  • 37. Emotion Intensity – Definitions – Features – Expressions 37
  • 38. Contents ■ Definition - Difference in feeling or expression of emotion - Experienced by individuals in response to emotion-provoking stimuli – Larsen (1984) - It is stable experienced by individuals during centuries– Larsen and Diener (1987) - Personal characteristics that indicate the degree of emotion experienced by individuals for a particular object ■ Features - Even if they feel the same, different intensity may be different emotions - An emotion can be expressed in many forms based on intensity - Factors such as duration of emotion, individual psychological factors, bioreaction, cultural differences, and gender are related to the strength of emotion - Emotional intensity and classification of emotion - Y axis: high intensity-low intensity - X axis: negative emotions-positive emotions - Low intensity feeling is mostly gloomy or quiet, calm feeling - High-intensity emotions are anger and excitement 38Figures from: Seppälä, E. (2016). The happiness track: How to apply the science of happiness to accelerate your success. Hachette UK.
  • 39. Contents ■ Expression - FACS (Facial Action Coding System) - Models with angry or happy expressions get a higher intensity level than models with neutral expressions. - Compared with male models who portray the same expressions, the expressions on female models' faces are more strongly evaluated. - Facial expressions vary according to emotional intensity - Body response changes with changes in emotional intensity 39
  • 40. Reference 1. Chen, Y., Lee, S. Y. M., & Huang, C. R. (2011). Automatic Recognition of Emotion based on a Cognitively Motivated Emotion Annotation System. Journal of Cognitive Science, 12(3), 277-296. 2. Li, Y., Mavadati, S. M., Mahoor, M. H., Zhao, Y., & Ji, Q. (2015). Measuring the intensity of spontaneous facial action units with dynamic Bayesian network. Pattern Recognition, 48(11), 3417-3427. 3. Spignesi, A., & Shor, R. E. (1981). The judgment of emotion from facial expressions, contexts, and their combination. The Journal of General Psychology, 104(1), 41-58. 4. Para citar este artículo: Alves, N. T., Bezerra, I. A. O., Claudino, R. G., & Pereira, T. C. L. (2013). Recognition of static and dynamic facial expressions: Influences of sex, type and intensity of emotion. Avances en Psicología Latinoamericana, 31 (1), pp. 192-199. 5. David I Perrett, Reiner Sprengelmeyer.(2002). Facial expressions of emotion: Stiumli and tests(FEEST).Psychology manual,1 6. Camille D, Helene F, Caroline B, Andrea D & Daniel F(2017). The effect of acute social stress on the recognition of facial expression of emotions. Scientific Reports 7. Kam, C. C.-S., & Bond, M. H. (2008). Role of emotions and behavioural responses in mediating the impact of face loss on relationship deterioration: Are Chinese more face-sensitive than Americans? Asian Journal Of Social Psychology, 11(2), 175–184. doi:10.1111/j.1467-839x.2008.00254.x 8. Lien, J. J., Kanade, T., Cohn, J. F., & Ching-Chung Li. (n.d.). Automated facial expression recognition based on FACS action units. Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition. doi:10.1109/afgr.1998.670980 9. Biele, C., & Grabowska, A. (2006). Sex differences in perception of emotion intensity in dynamic and static facial expressions. Experimental Brain Research, 171(1), 1–6. 10. Juslin, P. N., & Laukka, P. (2001). Impact of intended emotion intensity on cue utilization and decoding accuracy in vocal expression of emotion. Emotion, 1(4), 381–412. 11. N’Diaye, K., Sander, D., & Vuilleumier, P. (2009). Self-relevance processing in the human amygdala: Gaze direction, facial expression, and emotion intensity. Emotion, 9(6), 798–806 40
  • 41. Complex Emotion – Definitions – Features – Expressions 41
  • 42. Contents ■ Definitions ((Carrera, P., & Oceja, L. (2007)) - any emotion that is an aggregate of two or more others.(contrast to simple emotions which are those that are irreducible by analysis to any other emotion.) - e.x. hate=anger + fear + disgust - love = tenderness + pleasure + devotion + passion - other like: awe, disgust, embarrassment, envy, gratitude, guilt, jealousy, pride, remorse, shame, and worry - Definition 1 - Affective experiences can fluctuate, be combined, and fused, resulting in various phenomena labeled as being emotionally complex - complex emotions insofar as the single components of the affect system (i.e., emotional adjectives) interact forming patterns or categories that are integrated into systems which do not resemble the constituent emotions permitting adaptive functions. - Different of Emotional Complexity: based on different emotions establish different interrelations between them - emotional differentiation - emotional granularity - implies discerning among many positive and negative emotions (Grossman et al., 2016) - emotional granularity, make finer distinctions and well-differentiated reports of emotional experience - language contributes to the perception of emotions (Lindquist et al., 2006; Gendron et al., 2012). - emodiversity - The degree to which people can experience a diverse and abundant set of emotional experiences is a form of emotional complexity. - Emodiversity is a measure of the richness of emotional complexity and the proportionality of experiences about a wide number of emotions (Quoidbach et al., 2014). - emodiversity and emotional granularity are at opposite sides of a hypothetical differentiation continuum, ranging from making thin distinctions between different emotions (emotional granularity) to experiencing an abundant and diverse range of emotions (emodiversity). 42 Figures from: https://redpenpalsblog.com/how- to-write-complex-emotions/
  • 43. Contents ■ Definitions - Emotional interdependence - Emotions mutually influence each other throughout an event, altering the intensity of subsequent affects, modifying the hedonic valence of ongoing experiences, coupling multiple emotional experiences as a consequence of similar appraisals, or changing the behaviors to be deployed at a given moment. - Co-occurrence of emotional experiences of positive and negative valence (subjective experience) - E.X. Happy-sad; fear-hope: graduate experience more positive (happiness) and negative (sadness) emotions at the same time, compared to the same students surveyed at distant time points from graduation (larsen et al., 2001; hershfield et al., 2008). - Affective dynamics (flow of the everyday emotional experience ) - Changes in emotion can result in diverse processes defined by the individuals’ fluctuations in emotion (davidson, 1998). Mixed emotions: the co-activation of opposite emotions at the same time - E.X. Feeling excited and, not very long after, feeling blue. Emotions change dramatically from one moment to another. - Meta-emotions (a causal relation between a pair of different emotions) - One emotion prompting a secondary emotion (gottman et al., 1996; norman and furnes, 2016). - Experiencing a meta-emotion requires that one emotion (e.G., Sadness) triggers a secondary emotion (e.G., Anger). Fundamental in the understanding of meta-emotions as a complex emotional experience is that emotions can be hierarchically organized, forming finite layers of emotions - Emotions are aggregated on top of each other. - Aesthetic emotions - A group of affective experiences felt during aesthetic appreciation, including stimuli from nature (e.G., Natural wonders) and human creation (e.G., Painting or music), as well as emotional reactions that follow religious experiences or epiphanies (keltner and haidt, 2003; gordon et al., 2016). - E.X. Awe involves a mixture of surprise, pleasure, elevation, and astonishment (keltner and haidt, 2003). - First being-moved - Includes the emotional experiences of sadness and joy (menninghaus et al. (2015)) - The most common scenarios: deaths and births, and significant relationship events (reunions) (kuehnast et al., 2014). - High levels of compatibility with social norms and self-ideals. - Second awe - A mixture of surprise, pleasure, elevation, and astonishment (keltner and haidt, 2003). 43
  • 44. Contents ■ Definitions - Definition 2 : Primary And Secondary Emotions (figure 22 ) - A tree-structured list of emotions was described in Shaver et al. (1987), and also featured in Parrott (2001). - Definition 3 Emotional equations​ (figure 23) - Chip Conley showed how emotions and feelings are organised using mathematical. 44Figures from: https://en.wikipedia.org/wiki/Emotion
  • 45. Contents ■ Definitions - Definition 3 : Plutchik’s Wheel of Emotions - In 1980, Robert Plutchik diagrammed a wheel of eight emotions: joy, trust, fear, surprise, sadness, disgust, anger and anticipation. - And then Plutchik also theorized twenty-four "Primary", "Secondary", and "Tertiary" dyads (feelings composed of two emotions). - First, the eight primary emotions in this model are the basis for all others and are grouped into polar opposites (figure 24): - joy and sadness - acceptance and disgust - fear and anger - surprise and anticipation - inner circles are more basic and outer circles more complex, which are also formed by blending the inner circle emotions. - Containing mild emotion, mild opposite emotion, basic emotion, basic opposite emotion, intense emotion and intense opposite emotion - mild emotion: Serenity, Acceptance, Apprehension, Distraction - mild opposite emotion: Pensiveness, Boredom, Annoy, Interest - Basic emotion: Joy, Trust, Fear, Surprise - basic opposite emotion: Sadness, Disgust, Anger, Anticipation - intense emotion: Ecstasy, Admiration, Terror, Amazement - intense opposite emotion: Grief, Loathing, Rage, Vigilance - Second, the improving model contains the following information (figure 25): - Primary dyad = one petal apart = Love = Joy + Trust - Secondary dyad = two petals apart = Envy = Sadness + Anger - Tertiary dyad = three petals apart = Shame = Fear + Disgust - Opposite emotions = four petals apart = Anticipation - Surprise - (Anger is classified as a "positive" emotion because it involves "moving toward" a goal,[58] while surprise is negative because it is a violation of someone's territory.[) - - 45Figures from: https://en.wikipedia.org/wiki/Emotion
  • 46. Reference 1. Carrera, P., & Oceja, L. (2007). Drawing mixed emotions: Sequential or simultaneous experiences?. Cognition and emotion, 21(2), 422-441. 2. Oceja, L., & Carrera, P. (2003, February). Mixed emotional experience. Poster presented at the Annual Meeting of the Society for Personality and Social Psychology, Los Angeles, USA 3. Larsen, J. T., & McGraw, A. P. (2011). Further evidence for mixed emotions. Journal of Personality and Social Psychology, 100(6), 1095–1110. doi:10.1037/a0021846 4. Patwardhan, A. S. (2017). Multimodal mixed emotion detection. 2017 2nd International Conference on Communication and Electronics Systems 5. Fernando, J. W., Kashima, Y., & Laham, S. M. (2014). Multiple emotions: A person-centered approach to the relationship between intergroup emotion and action orientation. Emotion, 14(4), 722–732. 46