SlideShare a Scribd company logo
EMOTION RECOGNITION
XingyuWen
xingyu9404@163.com
1
■ Emotion Definition (page 3)
– Basic Emotion
– Dimensional Emotion
■ Social Emotion And Emotion-evoked Theory (p
age 9)
– Social Emotion
– James-lange Theory
– Cannon-bard Theory
– Schatter & Singer Two Factor Theory
■ Bioreaction According To Emotion (page 21)
– Brain
– Heart
– Eye
– Skin
– Facial expression
■ Emotional Issues (page 29)
– Subjectivity And Objectivity
– Moment Emotion
– Fake Emotions
– Temporary And Daily Emotions
– Emotional Consciousness And Unconsci
ous
– Emotional Contagion And Synchronizati
on
– Personal Emotion And Social Emotion
Catalog
■ Emotion Intensity (page 37)
– Definitions
– Features
– Expressions
■ Complex Emotion (page 41)
2
Emotion Definition
- Basic Emotion
- Dimensional Emotion
3
Contents
■ History Of Basic Emotion Research
- Duchenne de Boulogne (1862) identifies 13 major emotions by one or two facial muscle representations;
- Attention, Reflection, Meditation, Intentness of mind, Pain, Aggression or Menace, Weeping with hot tears, Moderate
Weeping, Joy, Laughter, False Laughter, Irony, ironic laughter, Sadness or Despondency
- Charles Darwin (1872) divides emotions into 8 groups and considers them culturally unaffected;
- Silvan Tomkins(1962) divides emotions into 9 emotions based on the same biological response (the Nine effect);
- Positive (Interest-excitement, Enjoyment-joy), Neutral (Surprise-startle), Negative (Distress-anguish, Anger-rage, Fear-
terror, Shame-humiliation, Dissmell (root of contempt), Disgust).
- Paul Ekman (1971), removed three emotions (Contemut, Sham and Inner), and defines six basic emotions based on Tomkins
theory.
- Based on facial expressions (It have no cultural differences)
4
Contents
■ Ekman’s Six Basic Emotion
- Ekman's face expression extraction processes
- Six emotions base on FACS(Facial Action Coding System)
- Ekman’s six basic emotions: happy, sad, anger, surprise, fear, disgust, there is no difference between social, culture and ages;
Emotion AU(Action Unit) Example
Happiness
6 : Cheek Raise
12 : Lip Corner Pull
25 : Lips Part
Sadness
1 : Inner Brow Raise
4 : Brow Lower
17 : Chin Raise
Anger
4 : Brow Lower
7 : Lid Tighten
17 : Chin Raise
24 : Lip Press
Emotion AU(Action Unit) Example
Fear
1 : Inner Brow Raise
2 : Outer Brow Raise
4 : Brow Lower
5 : Upper Lid Raise
20 : Lip Stretch
Surprise
1 : Inner Brow Raise
2 : Outer Borw Raise
5 : Upper Lid Raise
26 : Jaw Drop
Disgust
9 : Nose Wrinkle
10 : Upper Lid Raise
15 : Lid Corner Depress
25 : Lips Part
5
Figures from: Tian, Y. I., Kanade, T., & Cohn, J. F. (2001). Recognizing action units for facial expression analysis. IEEE Transactions on pattern analysis and machine intelligence, 23(2), 97-115.
James A Russell. (1980). Circumplex Model of Affect. Journal of Personality and Social Psychology, 39(6), 1161-1178
Contents
■ Facial Expressions – Au(Action Units)
- The expression and emotion of a person are not based on culture or learning, but is a instinct. So that there's a universality in facial
expressions.
- There are 42 muscles on the human face, Micro-Expression appear and change between 0.5 and 4 seconds in our usual facial expressions.
Moreover, an indescribable expression of true feelings expresses by unconsciousness that appears and disappears momentarily in a very
short time of 0.2 seconds.
- FACS (Facial Action Coding System) each facial expression is given an alphabet and number to sign its type and intensity.
- Alphabetical rating (A-E): the intensity of emotions. It is more intensity from A to E.
■ History Of Dimensional Emotion Research
- Nowlis define emotion in six to twelve independent emotional dimensions, like sadness,
anxiety, aner, elation, tension, etc. based on self-reporting experiment.
- Tomkins, Lzard, Ekman think that each emotional state can be seen as a different
dimension, For example, sadness and great joy can be conjoined together in reverse.
- Schlosberg thinks emotions are not independent of each other, but very systematically
associated with each other. He defines a two-dimensional circle model in pleasantness
– unpleasantness, attention – rejection, and then proposes three dimensional model by
adding dimension of sleepiness – tension.
- Russell defined in a circular form with two-dimensional bipolar properties: valence and
arousal based on Laymen’s Conceptualization of Affect (judgement) and Multivariate
Analysis of Self-reported Affective States (experiences)
6Figures from: Clark, E. A., J'Nai Kessinger, S. E. D., Bell, M. A., Lahne, J., Gallagher, D. L., & O'Keefe, S. F. (2020). The Facial Action Coding System for Characterization of Human Affective Response to Consumer Product-
Based Stimuli: A Systematic Review. Frontiers in Psychology, 11.
Contents
■ Russell’s dimensional circle model
- Russell’ dimensional emotion use two independent dimensions to explain emotional states: valence and arousal;
- Methods
- Circular Scaling of Terms
- Multidimensional Scaling of Terms
- Unidimensional Scaling
- Structure of Self-Reported Affect
- the classification of emotions by a person's judgment is based on the person's cognitive structure
- Dimensional emotion model is defined as valence and arousal
- Neurophysiological interpretation
- Excited, Tense, Angry: sympathetic nerve ↑, parasympathetic nerve ↓, pupil dilation
- Calm, Bored, Tired: sympathetic nerve ↓, parasympathetic nerve ↑, pupil constriction
- Β wave: Rise (cupillary lobe) - Awakening under stress conditions
- Α wave: Low brain activity (hypodiacal lobe) - Stable
- Beta/Alpha: The ratio of two frequencies can be used to determine the awakening
- The frontal lobe plays a crucial role in the experience of sperm control and consciousness.
- Inactivation of the left hemisphere forebrain is associated with negative emotion
- In contrast, inactivation of the right hemisphere forebrain indicates positive
7Figures from: James A Russell. (1980). Circumplex Model of Affect. Journal of Personality and Social Psychology, 39(6), 1161-1178
Reference
- Ekman, P. (1989).The argument and evidence about universals in facial expressions. Handbook of social psychophysiology, 143-164.
- Ekman, P. (1992).An argument for basic emotions. Cognition & emotion, 6(3-4), 169-200.
- Ekman, P., & Friesen,W.V. (1971). Constants across cultures in the face and emotion. Journal of personality and social psychology, 17(2), 124.
- James A Russell. (1980). Circumplex Model of Affect. Journal of Personality and Social Psychology, 39(6), 1161-1178.
- Jonathan Posner. (2009).The Neurophysiological Bases of Emotion:An fMRI Study of theAffective Circumplex Using Emotion-Denoting Words. Hum Brain
Mapp. 30(3). 883-895.
- Ortony,A., &Turner,T. J. (1990).What's basic about basic emotions?. Psychological review, 97(3), 315.
- Ortony,A., &Turner,T. J. (1990).What's basic about basic emotions?. Psychological review, 97(3), 315.
- Rinn,W. E. (1984).The neuropsychology of facial expression: a review of the neurological and psychological mechanisms for producing facial expressions.
Psychological bulletin, 95(1), 52.
- Saarimäki, H., Gotsopoulos, A., Jääskeläinen, I. P., Lampinen, J.,Vuilleumier, P., Hari, R., ... & Nummenmaa, L. (2016). Discrete neural signatures of basic
emotions. Cerebral cortex, 26(6), 2563-2573.
- Wundt,Wilhelm Max. Lectures on human and animal psychology. George Allen, 1896.
- Schlosberg, Harold. "The description of facial expressions in terms of two dimensions." Journal of experimental psychology 44.4 (1952): 229.
- Levenson R W.The autonomic nervous system and emotion[J]. Emotion Review, 2014, 6(2): 100-112.
- Handbook of emotions[M]. Guilford Press, 2010.
- Agrafioti F, Hatzinakos D,Anderson A K. ECG pattern analysis for emotion detection[J]. IEEETransactions on affective computing, 2011, 3(1): 102-115.
- Tomarken, Resting frontal brain asymmetry predicts affective responses to films, 1990
- Davidson, Neuropsychological perspectives on affective styles and their cognitive consequences, 1999
- Davidson, R. J., Ekman, P., Saron, C. D., Senulis, J. A., &Friesen,W.V. (1990). Approach-withdrawal and cerebral asymmetry: Emotional expression and brain
physiology: I. Journal of Personality and Social Psychology, 58 (2), 330–341
- Paul Ekman (2012) , “should we call it expression or communication?”,The European Journal of social science research, Jan 24
8
Social Emotion And Emotion-evoked Theor
y
- Social Emotion
- Emotion-evoked Theory
- Social Emotion - Emotion-evoked Theory
9
Contents
■ Social Emotions
- Social emotions are caused by interactions with others and have important social function, that means social emotions depend on the
thoughts, feelings, and behaviors of others, and relate to interpersonal relationship, institutional system, and culture.
- Definition
- Social emotion are various opinions based on factors and categories;
- Social emotions are complex emotions, in which cognitive factors play an important role;
- Social emotions are influenced by communication, not internal phenomena;
- Social emotions play an important role in moral decision-making, so it is also called moral emotion.
- Opinion 1: Social emotions develop in the later stages of human evolution rather than general emotions
- Buck(1999)
- Emotions are separate from biological mechanism, especially social emotions are developed from basic attachments in
society.
- Oatley(1987)
- All human emotions are social because they believe that the way of evolution takes into account the social perception in
the previous structure to deal with the complexity of social life.
- Even basic emotions such as happiness, sadness, anxiety, anger, and disgust are considered social emotions because they
are mainly related to social objects
- Opinion 2: Social emotions are caused by judgments of facts, imagination and expectations
- Leary(2001)
- Emphasis on relationships of all types of social emotion
- Bennett& Campos(1987)
- Social emotions are classified based on basic principles and goals.
10
Contents
■ Comparison of Group Emotions and Social Emotions
- Group Emotions
- Form emotions in one direction and transfer emotions in a group
- Through the interaction and transmission of emotions among group members, individual emotions are transformed into group
emotions
- Public emotion has the same or similar emotional structure
- Features
- Unity and collective
- With the popularity of social media, the transfer of public sentiment has accelerated.
- Emotion formation process is formed by the same life experience and cultural factors
- The homogenization trend of the spread of individual emotional states among members of a specific group
- Individual emotions or states are ignored by people with greater intensity of sensitivity
- Emotional strength within the group is an important reason for public emotion
- Synchronization between leader and slave
- Social Emotions
- Emotions caused by interaction with others
- Emotions caused by social connection between people the same psychological experience.
- Features
- Based on emotional interaction between two people
- Different people may have different sensitivities
- React to the thoughts, feelings or behavior of others
- The categories of social emotion are comprehensive and diverse: jealousy, guilt, shame, etc.
- Compared with basic emotions, it has a more complex system and develops later 11
Contents
■ Comparison Tabel
Group Emotions Social Emotions
Commons
Emotions may be evoked from others
It is formed by experiences based on social and cultural factors during the process of emotional development.
Difference
same emotional direction May have different emotional direction
the strength of emotion in the group is important Emotional interaction between two people is important
Basing on emotion infection Basing on social relationships
Synchronization between leader and followers Synchronization between two people
Personal emotion is disregarded by others' great intensity
emotion
Form social relations through emotional interaction
12
Contents
■ Social emotions
- Classifications (table 1)
- Moral emotions
- Basing on Social emotions play an important role in moral decision-making, so it is also called moral emotion.
- Closely related to the interests or well-being of the entire society
- Shame, guilt, regret, embarrassment, contempt, anger, disgust, gratitude, jealousy, jealousy, compassion,
empathy
- From self-aware emotions
- Emotions that occur when an individual recognizes that an event or situation may have effect on self-
assessment or happiness.
- For example: Shame, guilt, pride, embarrassment
Author Social Emotions
Adolphs, Baron Cohen & Tranel, 2002 Admiration, arrogance, flirtatiousness, guilt, loyalty
Barbalet, 1996 Confidence, trust
Barrett & Campos, 1987 Envy, guilt, pride, shame
Barrett and Nelson-Goens, 1997 Embarrassment, envy, guilt, pride, shame
Buck, 1999 Arrogance, envy, guilt, jealousy, joy, pity, pride, scorn, shame
Hareli & Weiner, 2002 Admiration, anger, contempt, dislike, distaste, envy, gratitude, guilt, like, pride, respect, schadenfreude, shame, sympathy
Leary, 2000 Admiration, embarrassment, envy, hatred, hurt feelings, jealousy, loneliness, love, pride, shame, social anxiety, social sadness
Oatley & Johnson-Laird, 1987 Bitterness, delight, depression, disappointment, embarrassment, horror, loathing, sexual love, vengefulness
Parkinson, Fischer & Manstead, 2005 Envy, fago, grief, guilt, jealousy, love, shame
different social emotions
13
Contents
■ Emotional intelligence
- A complex of emotional and social abilities/skills that helps people solve everyday problems and improve efficiency in their
personal and social lives
- Self-awareness: the understanding of strengths and limitations, and the desire for continuous improvement;
- Self-management: successfully control own emotions and behaviors, and can achieve a succeed in new or challenging
situations;
- Social-awareness: the ability to interact with others in a social environment through collaboration and tolerance;
- Relationship Skills: the ability to promote and maintain positive relationships with others
- Goal-Directed Behavior: start and insist on completing tasks of various difficulty
- Personal Responsibility: be cautious and reliable, and help collective efforts
- Decision-Making: use your own values to guide actions and take responsibility for your decisions
- Optimistic Thinking: confidence, hope, positive ways of thinking, attitudes towards yourself and past, present and
future living conditions
- Factors
- Self-awareness
- Self-management
- Social awareness
- Relationship management
14
Figure from pinterest: https://www.pinterest.co.uk/pin/298152437802302187/
Contents
■ Social emotions and Emotional intelligence
Social Emotion Social Intelligence
An individual's feelings depending on the thoughts, feelings,
and actions of others
Heavily influenced by communication with others
What’s your emotions under an special circumstances when
you communicate with others?
The ability to socialize and act appropriately to social
situations
Heavily influenced by a given social situation
How do you live and act under a special circumstances?
15
Contents
■ Social emotion and SNS
- The roles of social emotions in SNS
- People share emotions and information in social media as same as in real society;
- Emotional sharing relationship: express your recent situation, mood, emotions, etc. through SNS, and express
and share emotions with offline people.
- Information sharing relationship: sharing information or music, or getting a new perspective from someone with
professional knowledge-compared to emotional sharing, this connection is worse and forms negative social
emotions
- Method of analysis
- Define the representative relationship between SNS users as emotional sharing relationship (variable) and information
sharing relationship (variable);
- Establish model to verify the social emotion model
Social emotional vocabulary
analysis and collection
Verify the suitability of
socially sensitive vocabulary
Chi-square test
Representative social
sensitivity
Correlation analysis and factor analysis
between social sensitivities
Structural analysis of social
emotion model
Building a social emotion
model
Verify social emotion model
Subjective evaluation
16
Contents
■ Social emotion and Parasympathetic nervous systems (PN)
- When activated, it controls the endocrine glands to prepare the body for emergency action and causes the adrenal glands to produce
epinephrine
- increased blood flow to the muscles
- increased heart rate
- Help the body to move more quickly and feel less pain in situations perceived to be dangerous.
- Parasympathetic nervous systems (PN)
- When the body is relaxed or at rest, it helps the body store energy for future use.
- Increased stomach activity and decreased blood flow to the muscles.
limbic system
autonomicnervous
system
reticular activating
system
serotonin
noradrenaline
dopamine
Result pleasant
or unpleasant
mental states
SNS
PN
together with the
hypothalamus,
regulates pulse, blood
pressure, breathing
arousal in
response to
emotional
cues
first arouse the cortex
then maintain its
wakefulness
sensory information and
emotion can be
interpreted more
effectively.
emotion
cerebral cortex
hippocampus
amygdala
grey, folded, outermost
layer of the cerebrum
responsible for higher brain
processes such as sensation,
voluntary muscle movement,
thought, reasoning, and
memory.
in the medial temporal lobe
play a key role in emotion in
both animals and humans,
particularly in the formation
of fear-based memories
in the temporal lobe of the
brain
plays a role in memory and
emotion
17
Contents
■ James-Lange theory
- Emotion is the result of a physiological reaction to an external event
- Physiological changes at first, then emotions
- E.x. Happy because of smile; sad because of crying;
- Detect
- In the majority of emotions, this test is inapplicable
- Only corroborates in emotions that have a distinct bodily expression.
- For many of the manifestations are in organs over which we have no volitional control
■ Cannon-Bard theory
- emotional and physiological responses both happen—but these are two separate processes
- based on thalamic processes which response for emotional responses to experienced stimuli
- when the thalamic discharge occurs, the bodily changes occur almost simultaneously with the emotional experience.
■ Schatter & singer two factor theory
- Emotion = arousal + cognition
- emotions are the result of both physiological and cognitive processes.
- In a famous 1962 study, Schachter and Singer investigated whether people would respond differently to a shot of adrenaline depending on
the context they found themselves in.
- While later research hasn’t always supported Schachter and Singer’s findings, their theory has been incredibly influential and has inspired
many other researchers.
18
Contents
■ Jame-lange Emphasize Emotions are caused by physical reactions to events
■ Cannon-Bard proposes that both of these reactions originate simultaneously in the thalamus
■ Schachter & Singer(Two-factor) theory of emotion Adds onto James-lange Theory of emotion by stating that two factors are needed: physiologic response
and congnitive label, emp Cognition is the main factor determining emotional state
19Figures from internet
Reference
- Buck, R. (1980). Nonverbal behavior and the theory of emotion:The facial feedback hypothesis. Journal of Personality and Social Psychology, 38(5), 811–824.
doi:10.1037/0022-3514.38.5.811
- Strack, Fritz; Martin, Leonard L.; Stepper, Sabine (May 1988). "Inhibiting and FacilitatingConditions of the Human Smile: A NonobtrusiveTest of the Facial
Feedback Hypothesis". Journal of Personality and Social Psychology. 54 (5): 768–777. doi:10.1037/0022-3514.54.5.768. PMID 3379579.
- Cannon,W.B. (1927). "The James-Lange theory of emotions: A critical examination and an alternative theory".TheAmerican Journal of Psychology. 39 (1/4): 106–
124. doi:10.2307/1415404. JSTOR 1415404.
- Cannon,W.B. (1931). "Again the James-Lange and the thalamic theories of emotion". Psychological Review. 38 (4): 281–295. doi:10.1037/h0072957.
- Ye-Sool Cha , Ji-Hye Kim , Jong-Hwa Kim , Song-Yi Kim ,Dong-Keun Kim, Min-CheolWhang (2012), “Validity analysis of the social emotion model based on
relation types in SNS”, 감성과학,Vol.15, No.2, pp.283-296, June 2012
- JF Kihlstrom, N Cantor, “Social Intelligence”
- Brian Parkinson (1996), “Emotions are social”, British journal of psychology, 1996 -WileyOnline Library
- What is Elevation? - https://gostrengths.com/what-is-elevation/
- Social emotions - https://en.wikipedia.org/wiki/Social_emotions
- Embarrass - https://www.psychologytoday.com/us/blog/intense-emotions-and-strong-feelings/201112/embarrassment
- Marinetti,C., Moore, P., Lucas, P., & Parkinson, B. (2010). Emotions in Social Interactions:Unfolding Emotional Experience. Emotion-Oriented Systems, 31–
46. doi:10.1007/978-3-642-15184-2_3
20
Bioreaction According To Emotion
- Brain
- Heart
- Eye
- Skin
- Facial expression
21
Contents
■ Brain
- EEG
- The electroencephalogram (EEG) is a recording of the electrical activity of the brain from the scalp. The recorded waveforms
reflect the cortical electrical activity.
- the main frequencies of the human EEG waves are: Delta(1-3Hz), Theta(3.5-7.5Hz), Alpha(7.5-13Hz), Beta(14-30Hz),
γ(30~80Hz)
- The electric potential generated by an individual neuron is far too small to be picked up by EEG or MEG.[46] EEG activity
therefore always reflects the summation of the synchronous activity of thousands or millions of neurons that have similar spatial
orientation.
- Research results
- In the comparison between the stable state and the emotion-induced state caused by visual stimuli, there are significant
differences in almost all regions.
- Positive and negative
- Positive: Beta and gamma waves are activated in the temporal lobe.
- Neutral: Inactivation of beta wave and gamma wave in temporal lobe, and activation in frontal lobe in delta wave,
theta wave, and alpha wave.
- Negative: Similar to Neutral, but different from Alpha and Delta, showing delta wave activation in parietal lobe.
- Basic emotions
- Alpha power AMUSEMENT <NEUTRAL <DISGUST <SAD
- SAD: activated in the frontal, parietal, and parietal lobes
- DISGUST: activated in the frontal and parietal lobes
- NEUTRAL: activated in the frontal and parietal lobes
- Amusement: activated slightly in the parietal lobe
- Happy: have significant EEG, but similar to sleepy
22
Contents
■ Brain
- EEG
Wave Patterns
Frequency
Range (Hz)
Signal Features Significant
δ
(Delta wave)
~3.5
the highest in amplitude
and the slowest waves
- Infancy or immature intellectual development, extreme fatigue and let
hargy or anesthesia
θ
(Theta wave)
3.5~7 High-amplitude
- frustration or depression
- associated with reports of relaxed, meditative, and creative states
- Gloomy: θ(4-7Hz) lateral brain
α
(Alpha wave)
8~12
the "posterior basic
rhythm“ wave
- awake, quiet when closing eyes
- Active: There are significant differences between the basic emotions in
the left frontal lobe.
- Calm: α (8-13Hz) in Posterior lobe
β
(Beta waveγγ)
13~30
both sides in
symmetrical distribution;
Low-amplitude
- nervous and excited
Γ
(Gamma wave)
31~50 Lowest-amplitude
- Exchange of information between cortical and subcortical areas
- Appears in conscious awakening and dreams during REM sleep.
- It may appear overlapped with beta waves.
- Tense:Γ (30-50Hz) in the forebrain
Information about EEG
23
Contents■ Heart
- ECG (Electrocardiography)
- It is a graph of voltage versus time of the electrical activity of the heart[4] using electrodes placed on the skin.
- Normal rhythm produces four entities – a P wave, a QRS complex, a T wave, and a U wave
- each have a fairly unique pattern
- P wave: atrial depolarization.
- QRS: complex represents ventricular depolarization.
- T wave: ventricular repolarization.
- U wave: papillary muscle repolarization.
- The heart's electrocardiogram declines when you feel sad or stable, but increases when it is excited
- ECG and emotion
- The signals of ECG decrease when nervous, sad and calm
- The signals of ECG increase when excited and anxious
- Research results about EEG
- Anger: acceleration and amplitude are relatively large
- Comfortable: acceleration and amplitude are relatively small
- Sad: acceleration is relatively large, amplitude is relatively small
- Happy: acceleration is relatively small, amplitude is relatively large
- PPG
- used to detect blood volume changes in the microvascular bed of tissue
- most common sites: ear, nasal septum, and forehead, right and left ear lobes, index fingers and great toes
- Heart rate variability measured by PPG divided from HRV to LF/HF and analyzed
- When the LF component increases, the parasympathetic nervous system prevails and is judged to be negative.
- When HF component increases, the sympathetic nervous system prevails and is judged as a positive emotion
- When the LF/HF value was increased, the LF value was relatively increased, and the parasympathetic nerve was dominant.
24
Figures from internet
Contents
■ Eye
- Pupil
- It is an empty space in the center of the eye.
- Through the pupil, light enters the retina and enables visual processing.
- It is black because the space behind the eyes is dark, and it is black regardless of the iris color.
- The pupil diameter is about 2 to 8 mm.
- The pupil's response to light
- Exact response time may vary depending on age, stimulus intensity, etc.
- 0~0.2 sec: pupils do not respond
- 0.2~1.5 sec: Shrinks quickly and strongly until the pupil shrinks to the smallest size
- 1.2~10 sec: The pupil is still deflated and slightly restored
- 10~30 sec: Pupil gradually returns to its original size; expansion by light is slower to recover
- Physiological characteristics (figure 14, table )
Different Social EmotionsPupil sphincter (括约肌) Mydriasis major
Definition Circular muscles around the pupil Radial muscles around the pupil
Autonomic
nervous
system
Parasympathetic nervous system Sympathetic nervous system
Function
- Reduces pupil size when light is bright
- Highly related to rest-storage reactions
- Increases pupil size to receive more light
- Closely related to the fight-run reaction
25Figures from: Mathôt, S. (2018). Pupillometry: Psychology, physiology, and function. Journal of Cognition, 1(1).
Contents
■ Eye
- Pupil
- Amygdala
- The amygdala suppresses the parasympathetic nerve.
- Amygdala activation: pupil dilation
- Amygdala inactivation: pupil contraction
- Path-way : eye to brain
■ Skin
- GSR (Galvanic Skin Resistance)
- Measure sweat gland activity from finger skin which are reflective of the intensity of our emotional state, otherwise known as
emotional arousal.
- scary, threatening, joyful, or otherwise emotionally relevant - increases eccrine sweat gland activity
- The GSR signal is therefore not representative of the type of emotion, but the intensity of it.
- It is noteworthy that both positive (“happy” or “joyful”) and negative (“threatening” or “saddening”) stimuli can result in
an increase in arousal – and in an increase in skin conductance.
- SKT (Skin Temperature)
Retina
Optic
Intersecting
Optic nerves
Right Field Of
View Information
Left Field Of View
Information
EWN :
Edinger –Westphal nucleus
EWN
Laryngeal Lob
e
26
Contents
■ Facial expression
- Facial expression is controlled by the movement and position of the muscles under the skin of the face.
- The muscles involved are divided into 14 muscles.
- EMG (Electrormyogram)
- evaluating and recording the electrical activity produced by skeletal muscles
- use as middleware in gesture recognition towards allowing the input of physical action to a computer as a form of Human-
computer interaction
- two kinds of EMG: surface EMG and intramuscular EMG
- FEMG is a face electromyography test.
27
Figures from: Gibert, G., Pruzinec, M., Schultz, T., & Stevens, C. (2009, November). Enhancement of human computer interaction with facial electromyographic sensors. In Proceedings of the 21st Annual Conference of the
Australian Computer-Human Interaction Special Interest Group: Design: Open 24/7 (pp. 421-424).
https://imotions.com/blog/facial-expression-pictures/
Reference
1. Babiker, A., Faye, I., & Malik, A. (2013). Pupillary behavior in positive and negative emotions. 2013 IEEE International Conference on Signal and Image
Processing Applications.
2. Geangu, E., Hauf, P., Bhardwaj, R., & Bentz, W. (2011). Infant pupil diameter changes in response to others' positive and negative emotions. PloS one, 6(11),
e27132.
3. Ho, C. H., & Lu, Y. N. (2014). Can pupil size be measured to assess design products?. International Journal of Industrial Ergonomics, 44(3), 436-441
4. Oliva, M., & Anikin, A. (2018). Pupil dilation reflects the time course of emotion recognition in human vocalizations. Scientific reports, 8(1), 4871.
5. Somchanok T, Michiko O. (2015). Emotion Recognition using ECG Signals with Local Pattern Description Methods. International Journal of Affective
Engineering,
6. Valenzi, S., Islam, T., Jurica, P., & Cichocki, A. (2014). Individual classification of emotions using EEG. Journal of Biomedical Science and Engineering, 2014.
7. Van Steenbergen, H., Band, G. P., & Hommel, B. (2011). Threat but not arousal narrows attention: evidence from pupil dilation and saccade control. Frontiers in
psychology, 2, 281.
8. Zheng, W. L., Zhu, J. Y., & Lu, B. L. (2017). Identifying stable patterns over time for emotion recognition from EEG. IEEE Transactions on Affective Computing.
28
Emotional Issues
– Subjectivity And Objectivity
– Moment Emotion
– Fake Emotions
– Temporary And Daily Emotions
– Emotional Consciousness And Unconscious
– Emotional Contagion And Synchronization
– Personal Emotion And Social Emotion
29
Contents
■ Emotional Subjectivity and Objectivity
- Objective Or Subjective
- Emotions are subjective because they are influenced by personal, social, and cultural environments.
- Physiological indicators reveal more obvious differences depending on the emotional experience as they become more
physically excited.
- Conversely, if the level of excitement is low, it is difficult to predict the emotional experience with only physiological
indicators.
- Subjective evaluation method
- There is a delay of around 10 seconds in the brain immediately after presenting visual stimuli and the subject expresses the
highest emotional value
- Real-time subjective evaluation and non-real-time subjective evaluation
- Measurements through questionnaires, such as the cut scale and the semantic scale.
- Emotions are considered subjective because its process of generation varies depending on personal, social, and cultural
differences
- Emotion are objective because that it happens with physiological changes in the body and can be objectively measured
- Measurements through biometric signals (EEG, ECG, GSR, EMG, etc.).
- Evaluate false emotions resulting from the discrepancy between actual feelings and expressions through brain wave response
analysis
■ Moment Emotion
- Ekman's Micro-Expression captures the moment of emotion according to the expression that should pay attention to the
persistence of emotion and the change of emotion with time
- The persistence of emotions is mainly divided into negative emotions and positive emotions
- Emotions often cause other emotions to motivate the expression of emotions. For example, the continuation of a negative
emotional state stimulates the expression of positive emotions, leading to escape from negative emotions.
30
Contents
■ Fake Emotions
- It can be detected form objective methods
- based on facial micro stress, body language, and interrogation language analysis.
- facial EMG response
- E.x. body behavior
- Lying smile, paraphrase behavior, grooming behavior, hesitation, increased frequency of eye blinking, speechlessness,
decreased hand, foot, and body movement.
- E.x. facial expression
- Dull smile-periocular area: shows a significant difference between a neutral expression and a dull smile-Ball muscle
area: strong response when a dull smile, a non-dull smile does not differ from a neutral expression-affects altruism: see a
dull smile or open mouth Subjects who saw a smile showed positive behavior to share money.
- E.x. pupil change
- Reduced pupil size in a stiff smile
- Women increased pupil size in a dull smile; Male increased pupil size in a an-stiff smile
- The eye blink rate of a person increases to eight times the normal rate after lying
- E.x. EEG signal
- The signals in F3, F4, C4, P3, P4, O1, O2 of brain have significant differences between actual and false emotions
- E.x. ECG signal
- looking at a back-to-back smile (true smile) has resulted in much stronger fascia and cheek muscle EMG activity
compared to the activity gained by looking at a neutral face
- others
- the EMG reaction of the pericardial and ball muscle region to Non Dussen smile was no different from that of the
neutral face
- the intensity was more significant in a happy expression than in an angry expression.
31
Contents
■ Temporary And Daily Emotions
- Temporary emotion
- Memory-based emotion
- Memory is stimulated by instantaneous stimuli
- The ability to remember varies by emotion
- Daily emotion
- Described as Mood
- Development into everyday emotions as the continuation of temporary emotions
- Deriving various everyday emotions depending on context or by differences in persistence by emotion
■ Emotional Consciousness And Unconscious
- Conscious emotion
- This is all the emotional experience we perceive in our daily lives.
- If you consciously perform facial mimicry instead of distinguishing emotions, the ability is poor.
- Unconscious emotion
- It is an emotional experience that we do not recognize in our daily life.
- Facial express micro-movement rises from the face when unfair things happen: the psoas muscles and the cheek muscles
- empathy More empathy for someone imitating their behavior.
- Self-esteem Self-esteem suppresses acts that imitate others (unknowingly)
- Cheers to try to imitate someone unconsciously in order to buy someone else's cheers.
- When imitating a variety of emotional facial stimuli, the facial muscles are involuntarily moved in a micro-movement like the
suggested expression.
- The act of imitating someone increases the likelihood of the person unconsciously.
32
Contents
■ Emotional Contagion And Synchronization
- Contagion
- Positive emotions - the frequency of the frontal lobe (F7), anterior lobe (T3, T4, T5, T6) and larynx (O2) vary significantly.
- Negative emotions - a significant difference between the amount of frequency changes in the frontal lobe (F3), anterior lobe (T4)
and posterior lobe (I2)
- Empathy: a significant difference in frequency was observed in the temporal lobe (T4).
- non-empathy: a significant difference in the amount of frequency change in the parietal lobe (P3, P4) and the central sphere (c3)
can be confirmed.
- Synchronization
- Empathy is a person's stand, feeling and thinking about his emotions, which is spread by others' emotions
- Everything that explains and reflects the world is related to emotions, and they affect and spread each other.
■ Personal Emotion And Social Emotion
- Personal sensibility
- Stimulation triggers your own sensibility
- Emotional reactions are not the same for everyone.
- In order to properly analyze biosignals, which is a means to objectively classify individual emotions, a method of reducing
individual differences is needed.
- When a stable state is used, a reference to be used as a reference is measured together, and a biosignal that changes according to
emotion is calculated and normalized as a rate of change to overcome individual differences.
- Social sentiment
- A society where individuals form a social relationship
- Sensibility plays a decisive role as a medium to form social ties
- Social sentiment should be measured not by individual, but by relationship with others.
- Intimacy, empathy, etc. 33
Reference
1. Strike, P. C., Wardle, J., & Steptoe, A. (2004). Mild acute inflammatory stimulation induces transient negative mood. Journal of psychosomatic
research, 57(2), 189-194.
2. Bouhuys, A. L., Bloem, G. M., & Groothuis, T. G. (1995). Induction of depressed and elated mood by music influences the perception of facial
emotional expressions in healthy subjects. Journal of affective disorders, 33(4), 215-226.
3. Strike, P. C., Wardle, J., & Steptoe, A. (2004). Mild acute inflammatory stimulation induces transient negative mood. Journal of psychosomatic
research, 57(2), 189-194.
4. Strike, P. C., Wardle, J., & Steptoe, A. (2004). Mild acute inflammatory stimulation induces transient negative mood. Journal of psychosomatic
research, 57(2), 189-194.
5. Hayakawa, Y., Takada, K., Miki, H., & Tanaka, K. (2000). Effects of music on mood during bench stepping exercise. Perceptual and motor skills,
90(1), 307-314..
6. Balteș, F. R., & Miu, A. C. (2014). Emotions during live music performance: Links with individual differences in empathy, visual imagery, and
mood. Psychomusicology: Music, Mind, and Brain, 24(1), 58..
7. Mathews, A., & Bradle, B. (1983). Mood and the self-reference bias in recall. Behaviour research and therapy, 21(3), 233-239.
8. George, M. S., Ketter, T. A., Parekh, P. I., Horwitz, B., Herscovitch, P., & Post, R. M. (1995). Brain activity during transient sadness and happiness
in healthy women. American Journal of Psychiatry, 152(3), 341-351
9. Hammersley, R., & Reid, M. (2009). Theorising transient mood after ingestion. Neuroscience & Biobehavioral Reviews, 33(3), 213-222.
10. Barabasz, M. (1991). Effects of aerobic exercise on transient mood state. Perceptual and motor skills, 73(2), 657-658.
11. Winkielman, P., & Berridge, K. C. (2004). Unconscious Emotion. Current Directions in Psychological Science, 13(3), 120–123.
12. 안호석, 최진영, 이동욱. (2012). 의식과 무의식을 구분하는 감성 로봇 시스템. 제어로봇시스템학회 국내학술대회 논문집, (), 186-187.
13. Um, Z.-S., Yang, J.-C., Park, J.-I., & Kim, G.-W. (2019). 유년기 정신적 외상을 경험한 외상후 스트레스장애 환자에서 무의식적 감정 자극이 의식적
작업기억 수행에 미치는 영향에 관한 기능적 자기공명영상 연구. Psychoanalysis, 30(4), 114-123.
14. 김민정, 이영애 (2011). 목표지향적 정보처리에서 무의식적 사고의 효과. 인지과학, 22(4), 405-427
15. 손민정, 남택진 (2010). 지속가능한 인터랙션 디자인에 적용하기 위한 인간의 무의식적인 행동에 관 한 연구. 한국HCI학회 학술대회, 456-459
34
Reference
16. Dimberg, U., Thunberg, M., & Elmehed, K. (2000). Unconscious Facial Reactions to Emotional Facial Expressions. Psychological Science, 11(1),
86–89. doi:10.1111/1467-9280.00221
17. 조덕기, 이은주, 방성근, 권오재, 임인종, 김만영, 김진희 (2011). Wavelet cross correlation을 이용한 의식 적인 의도와 무의식적인 의도에 따른
뇌활성 신호의 특징 추출. 정보과학회논문지 : 컴퓨팅의 실제 및 레터, 17(12), 613-621
18. 정진복, 안창일 (2000). 식역하 ERP 를 통한 정서적 자극의 무의식 처리. 한국심리학회지: 건강, 5(2), 304-315
19. Ivonin, L., Chang, H.-M., Chen, W., & Rauterberg, M. (2012). Unconscious emotions: quantifying and logging something we are not aware of.
Personal and Ubiquitous Computing, 17(4), 663–673. doi:10.1007/s00779-012-0514-5
20. Jessen, S., & Grossmann, T. (2015). Neural signatures of conscious and unconscious emotional face processing in human infants. Cortex, 64,
260–270. doi:10.1016/j.cortex.2014.11.007
21. Kramer,A. D.,Guillory, J. E., & Hancock, J.T. (2014). Experimental evidence of massive-scale emotional contagion through social networks. Proceedings of the
NationalAcademy of Sciences, 111(24), 8788-8790.
22. Coviello, L., Sohn,Y., Kramer,A. D., Marlow,C., Franceschetti, M., Christakis, N.A., & Fowler, J. H. (2014). Detecting emotional contagion in massive social
networks. PloS one, 9(3).
23. Manera,V., Grandi, E., & Colle, L. (2013). Susceptibility to emotional contagion for negative emotions improves detection of smile authenticity. Frontiers in
Human Neuroscience, 7, 6.
24. Ferrara, E., &Yang, Z. (2015). Measuring emotional contagion in social media. PloS one, 10(11), e0142390.
25. Xiong, X., Li,Y., Qiao, S., Han, N.,Wu,Y., Peng, J., & Li, B. (2018). An emotional contagion model for heterogeneous social media with multiple
behaviors. Physica A: Statistical Mechanics and its Applications, 490, 185-202.
26. Hashimoto, M.,Yamano, M., & Usui,T. (2009, September). Effects of emotional synchronization in human-robot KANSEI communications. In RO-MAN 2009-
The 18th IEEE InternationalSymposium on Robot and Human InteractiveCommunication (pp. 52-57). IEEE.
35
Reference
27. Grandjean, D., Sander, D., & Scherer, K. R. (2008). Conscious emotional experience emerges as a function of multilevel, appraisal-driven response
synchronization. Consciousness and cognition, 17(2), 484-495.
28. Li,Y., & Hashimoto, M. (2011, December). Effect of emotional synchronization using facial expression recognition in human-robot communication. In 2011 IEEE
InternationalConference on Robotics and Biomimetics (pp. 2872-2877). IEEE.
29. Osvath, M., & Sima, M. (2014). Sub-adult ravens synchronize their play: a case of emotional contagion. Anim Behav Cogn, 2, 197.
30.Wiss, M., &Tordjman,S. (2016). Creating a ‘social zeitgeber’to synchronize family emotional rhythms:A new therapeutic approach in child and adolescent
psychiatry. Journal of Physiology-Paris, 110(4), 480-486.
31. 강유원(2010), “사회적감성, 정치적의식, 정치적행위”, 감성연구1권,0호,69-83.
32. 신승섭, 노수진, 차예술, 김종화, 황민철(2012), “사랑과 우정에 대한 사회감성 모델에 관한 연구”, 한국 감성과학회 춘계학술대회 2012권, 0호, 71-72.
33. 이구형(1998), “감성과 감정의 이해를 통한 감성의 체계적 측정 평가”, 감성과학1권,1호,113-122.
34. J. M. Barbalet, Social emotions: confidence, trust and loyalty, International Journal of Sociology and Social Policy, 16(9/10), 1996, 75–96.
35. Hareli, S., & Parkinson, B. (2008).What’s social about social emotions?, Journal for theTheory of Social Bevaviour, 38, 131–156.
36. Seyfert, R. (2012) ‘Beyond Person Feelings and Collective Emotions:Toward aTheory of SocialAffect’,Theory,Culture and Society 29(6): 27–46.
37. Parkinson,B., & Lea, M. E (1991). Investigating personalconstructs of emotion.British Journal of Psychology,82, 73-86.
38. Cavalera,C., & Pepe,A. (2014). Social emotions and cognition: Shame, guilt and working memory. Social and Behavioral Sciences, 112, 457-464.
39. Parkinson, B.(1996). "Emotions are social." British,Journal of Psychology, 87: 663-683.
40. L. J. Chang, andA. Smith, “Social emotions and psychological games,” Curr.Opin. Behav. Sci., vol. 5, pp. 133-140, Oct. 2015.
36
Emotion Intensity
– Definitions
– Features
– Expressions
37
Contents
■ Definition
- Difference in feeling or expression of emotion
- Experienced by individuals in response to emotion-provoking stimuli – Larsen (1984)
- It is stable experienced by individuals during centuries– Larsen and Diener (1987)
- Personal characteristics that indicate the degree of emotion experienced by individuals for a particular object
■ Features
- Even if they feel the same, different intensity may be different emotions
- An emotion can be expressed in many forms based on intensity
- Factors such as duration of emotion, individual psychological factors, bioreaction, cultural differences, and gender are related to the
strength of emotion
- Emotional intensity and classification of emotion
- Y axis: high intensity-low intensity
- X axis: negative emotions-positive emotions
- Low intensity feeling is mostly gloomy or quiet, calm feeling
- High-intensity emotions are anger and excitement
38Figures from: Seppälä, E. (2016). The happiness track: How to apply the science of happiness to accelerate your success. Hachette UK.
Contents
■ Expression
- FACS (Facial Action Coding System)
- Models with angry or happy expressions get a higher intensity level than models with neutral expressions.
- Compared with male models who portray the same expressions, the expressions on female models' faces are more strongly
evaluated.
- Facial expressions vary according to emotional intensity
- Body response changes with changes in emotional intensity
39
Reference
1. Chen, Y., Lee, S. Y. M., & Huang, C. R. (2011). Automatic Recognition of Emotion based on a Cognitively Motivated Emotion Annotation System. Journal of
Cognitive Science, 12(3), 277-296.
2. Li, Y., Mavadati, S. M., Mahoor, M. H., Zhao, Y., & Ji, Q. (2015). Measuring the intensity of spontaneous facial action units with dynamic Bayesian
network. Pattern Recognition, 48(11), 3417-3427.
3. Spignesi, A., & Shor, R. E. (1981). The judgment of emotion from facial expressions, contexts, and their combination. The Journal of General Psychology, 104(1),
41-58.
4. Para citar este artículo: Alves, N. T., Bezerra, I. A. O., Claudino, R. G., & Pereira, T. C. L. (2013). Recognition of static and dynamic facial expressions: Influences
of sex, type and intensity of emotion. Avances en Psicología Latinoamericana, 31 (1), pp. 192-199.
5. David I Perrett, Reiner Sprengelmeyer.(2002). Facial expressions of emotion: Stiumli and tests(FEEST).Psychology manual,1
6. Camille D, Helene F, Caroline B, Andrea D & Daniel F(2017). The effect of acute social stress on the recognition of facial expression of emotions. Scientific
Reports
7. Kam, C. C.-S., & Bond, M. H. (2008). Role of emotions and behavioural responses in mediating the impact of face loss on relationship deterioration: Are Chinese
more face-sensitive than Americans? Asian Journal Of Social Psychology, 11(2), 175–184. doi:10.1111/j.1467-839x.2008.00254.x
8. Lien, J. J., Kanade, T., Cohn, J. F., & Ching-Chung Li. (n.d.). Automated facial expression recognition based on FACS action units. Proceedings Third IEEE
International Conference on Automatic Face and Gesture Recognition. doi:10.1109/afgr.1998.670980
9. Biele, C., & Grabowska, A. (2006). Sex differences in perception of emotion intensity in dynamic and static facial expressions. Experimental Brain Research,
171(1), 1–6.
10. Juslin, P. N., & Laukka, P. (2001). Impact of intended emotion intensity on cue utilization and decoding accuracy in vocal expression of emotion. Emotion, 1(4),
381–412.
11. N’Diaye, K., Sander, D., & Vuilleumier, P. (2009). Self-relevance processing in the human amygdala: Gaze direction, facial expression, and emotion intensity.
Emotion, 9(6), 798–806
40
Complex Emotion
– Definitions
– Features
– Expressions
41
Contents
■ Definitions ((Carrera, P., & Oceja, L. (2007))
- any emotion that is an aggregate of two or more others.(contrast to simple emotions which are those that are irreducible by analysis to
any other emotion.)
- e.x. hate=anger + fear + disgust
- love = tenderness + pleasure + devotion + passion
- other like: awe, disgust, embarrassment, envy, gratitude, guilt, jealousy, pride, remorse, shame, and worry
- Definition 1
- Affective experiences can fluctuate, be combined, and fused, resulting in various phenomena labeled as being emotionally
complex
- complex emotions insofar as the single components of the affect system (i.e., emotional adjectives) interact forming patterns or
categories that are integrated into systems which do not resemble the constituent emotions permitting adaptive functions.
- Different of Emotional Complexity: based on different emotions establish different interrelations between them
- emotional differentiation
- emotional granularity
- implies discerning among many positive and negative emotions (Grossman et al., 2016)
- emotional granularity, make finer distinctions and well-differentiated reports of emotional experience
- language contributes to the perception of emotions (Lindquist et al., 2006; Gendron et al., 2012).
- emodiversity
- The degree to which people can experience a diverse and abundant set of emotional experiences is a form of
emotional complexity.
- Emodiversity is a measure of the richness of emotional complexity and the proportionality of experiences about a
wide number of emotions (Quoidbach et al., 2014).
- emodiversity and emotional granularity are at opposite sides of a hypothetical differentiation continuum, ranging from
making thin distinctions between different emotions (emotional granularity) to experiencing an abundant and diverse
range of emotions (emodiversity). 42
Figures from:
https://redpenpalsblog.com/how-
to-write-complex-emotions/
Contents
■ Definitions
- Emotional interdependence
- Emotions mutually influence each other throughout an event, altering the intensity of subsequent affects, modifying the hedonic valence
of ongoing experiences, coupling multiple emotional experiences as a consequence of similar appraisals, or changing the behaviors to be
deployed at a given moment.
- Co-occurrence of emotional experiences of positive and negative valence (subjective experience)
- E.X. Happy-sad; fear-hope: graduate experience more positive (happiness) and negative (sadness) emotions at the same time,
compared to the same students surveyed at distant time points from graduation (larsen et al., 2001; hershfield et al., 2008).
- Affective dynamics (flow of the everyday emotional experience )
- Changes in emotion can result in diverse processes defined by the individuals’ fluctuations in emotion (davidson, 1998). Mixed
emotions: the co-activation of opposite emotions at the same time
- E.X. Feeling excited and, not very long after, feeling blue. Emotions change dramatically from one moment to another.
- Meta-emotions (a causal relation between a pair of different emotions)
- One emotion prompting a secondary emotion (gottman et al., 1996; norman and furnes, 2016).
- Experiencing a meta-emotion requires that one emotion (e.G., Sadness) triggers a secondary emotion (e.G., Anger).
Fundamental in the understanding of meta-emotions as a complex emotional experience is that emotions can be hierarchically
organized, forming finite layers of emotions
- Emotions are aggregated on top of each other.
- Aesthetic emotions
- A group of affective experiences felt during aesthetic appreciation, including stimuli from nature (e.G., Natural wonders) and human creation
(e.G., Painting or music), as well as emotional reactions that follow religious experiences or epiphanies (keltner and haidt, 2003; gordon et al.,
2016).
- E.X. Awe involves a mixture of surprise, pleasure, elevation, and astonishment (keltner and haidt, 2003).
- First being-moved
- Includes the emotional experiences of sadness and joy (menninghaus et al. (2015))
- The most common scenarios: deaths and births, and significant relationship events (reunions) (kuehnast et al., 2014).
- High levels of compatibility with social norms and self-ideals.
- Second awe
- A mixture of surprise, pleasure, elevation, and astonishment (keltner and haidt, 2003). 43
Contents
■ Definitions
- Definition 2 : Primary And Secondary Emotions (figure 22 )
- A tree-structured list of emotions was described in Shaver et al. (1987), and also featured in Parrott (2001).
- Definition 3 Emotional equations​ (figure 23)
- Chip Conley showed how emotions and feelings are organised using mathematical.
44Figures from: https://en.wikipedia.org/wiki/Emotion
Contents
■ Definitions
- Definition 3 : Plutchik’s Wheel of Emotions
- In 1980, Robert Plutchik diagrammed a wheel of eight emotions: joy, trust, fear, surprise, sadness, disgust, anger and anticipation.
- And then Plutchik also theorized twenty-four "Primary", "Secondary", and "Tertiary" dyads (feelings composed of two emotions).
- First, the eight primary emotions in this model are the basis for all others and are grouped into polar opposites (figure 24):
- joy and sadness
- acceptance and disgust
- fear and anger
- surprise and anticipation
- inner circles are more basic and outer circles more complex, which are also formed by blending the inner circle emotions.
- Containing mild emotion, mild opposite emotion, basic emotion, basic opposite emotion, intense emotion and intense opposite
emotion
- mild emotion: Serenity, Acceptance, Apprehension, Distraction
- mild opposite emotion: Pensiveness, Boredom, Annoy, Interest
- Basic emotion: Joy, Trust, Fear, Surprise
- basic opposite emotion: Sadness, Disgust, Anger, Anticipation
- intense emotion: Ecstasy, Admiration, Terror, Amazement
- intense opposite emotion: Grief, Loathing, Rage, Vigilance
- Second, the improving model contains the following information (figure 25):
- Primary dyad = one petal apart = Love = Joy + Trust
- Secondary dyad = two petals apart = Envy = Sadness + Anger
- Tertiary dyad = three petals apart = Shame = Fear + Disgust
- Opposite emotions = four petals apart = Anticipation - Surprise
- (Anger is classified as a "positive" emotion because it involves "moving toward" a goal,[58] while surprise is negative because it is a
violation of someone's territory.[)
-
-
45Figures from: https://en.wikipedia.org/wiki/Emotion
Reference
1. Carrera, P., & Oceja, L. (2007). Drawing mixed emotions: Sequential or simultaneous experiences?. Cognition and emotion, 21(2), 422-441.
2. Oceja, L., & Carrera, P. (2003, February). Mixed emotional experience. Poster presented at the Annual Meeting of the Society for Personality and Social
Psychology, Los Angeles, USA
3. Larsen, J. T., & McGraw, A. P. (2011). Further evidence for mixed emotions. Journal of Personality and Social Psychology, 100(6), 1095–1110.
doi:10.1037/a0021846
4. Patwardhan, A. S. (2017). Multimodal mixed emotion detection. 2017 2nd International Conference on Communication and Electronics Systems
5. Fernando, J. W., Kashima, Y., & Laham, S. M. (2014). Multiple emotions: A person-centered approach to the relationship between intergroup emotion and action
orientation. Emotion, 14(4), 722–732.
46
Thank you!
47

More Related Content

What's hot

What's hot (20)

Positive psychology
Positive psychologyPositive psychology
Positive psychology
 
Emotional intelligence ppt
Emotional intelligence pptEmotional intelligence ppt
Emotional intelligence ppt
 
Positive Psychology 2
Positive Psychology 2Positive Psychology 2
Positive Psychology 2
 
Positive psychology
Positive psychologyPositive psychology
Positive psychology
 
EPQ
EPQEPQ
EPQ
 
positive emotions
positive emotionspositive emotions
positive emotions
 
Introducing Positive psychology
Introducing Positive psychologyIntroducing Positive psychology
Introducing Positive psychology
 
Mindfulness for Mental Health Professionals
Mindfulness for Mental Health ProfessionalsMindfulness for Mental Health Professionals
Mindfulness for Mental Health Professionals
 
Affect and emotion cvh
Affect and emotion cvhAffect and emotion cvh
Affect and emotion cvh
 
Emotional intelligence
Emotional intelligenceEmotional intelligence
Emotional intelligence
 
Neuroscience perspective of compassion
Neuroscience perspective of compassionNeuroscience perspective of compassion
Neuroscience perspective of compassion
 
Positive Psychology
Positive PsychologyPositive Psychology
Positive Psychology
 
Prosocial behavior
Prosocial behaviorProsocial behavior
Prosocial behavior
 
Ch. 12: Emotions, Stress, & Health
Ch. 12: Emotions, Stress, & HealthCh. 12: Emotions, Stress, & Health
Ch. 12: Emotions, Stress, & Health
 
What is Positive Psychology ?
What is Positive Psychology ?What is Positive Psychology ?
What is Positive Psychology ?
 
Positive Psychology
Positive PsychologyPositive Psychology
Positive Psychology
 
Introduction to Psychology : Emotions
Introduction to Psychology : EmotionsIntroduction to Psychology : Emotions
Introduction to Psychology : Emotions
 
Anger Psychology
Anger PsychologyAnger Psychology
Anger Psychology
 
EMOTIONS
EMOTIONSEMOTIONS
EMOTIONS
 
Introduction to Positive Psychology
Introduction to Positive PsychologyIntroduction to Positive Psychology
Introduction to Positive Psychology
 

Similar to Emotion recognition

Processing Emotions - Happiness
Processing Emotions - HappinessProcessing Emotions - Happiness
Processing Emotions - HappinessNicolae Sfetcu
 
Damasio antonio subcortical and cortical brain activity during the feeling ...
Damasio antonio   subcortical and cortical brain activity during the feeling ...Damasio antonio   subcortical and cortical brain activity during the feeling ...
Damasio antonio subcortical and cortical brain activity during the feeling ...Jorge Alberto Khouri
 
Chapter 4 pwrpt
Chapter 4 pwrptChapter 4 pwrpt
Chapter 4 pwrptjamiesamel
 
[系列活動] Emotion-AI: 運用人工智慧實現情緒辨識
[系列活動] Emotion-AI: 運用人工智慧實現情緒辨識[系列活動] Emotion-AI: 運用人工智慧實現情緒辨識
[系列活動] Emotion-AI: 運用人工智慧實現情緒辨識台灣資料科學年會
 
EMOTIONS and INTELLIGENCE in Psychology
EMOTIONS and INTELLIGENCE in PsychologyEMOTIONS and INTELLIGENCE in Psychology
EMOTIONS and INTELLIGENCE in Psychologyitsennyl_
 
Emotions and Types of Emotional Responses.pptx
Emotions and Types of Emotional Responses.pptxEmotions and Types of Emotional Responses.pptx
Emotions and Types of Emotional Responses.pptxCol Mukteshwar Prasad
 
Components and Competency of Emotions
Components and Competency of EmotionsComponents and Competency of Emotions
Components and Competency of Emotionscognitomeprogram
 
Motivation and Emotions
Motivation and EmotionsMotivation and Emotions
Motivation and EmotionsShiva Kakkar
 
Cognition, biology and emotion pp
Cognition, biology and emotion ppCognition, biology and emotion pp
Cognition, biology and emotion ppabonica
 
Perceived emotion in the brain
Perceived emotion in the brainPerceived emotion in the brain
Perceived emotion in the brainAngelo Bruschi
 

Similar to Emotion recognition (20)

Emotions
EmotionsEmotions
Emotions
 
Processing Emotions - Happiness
Processing Emotions - HappinessProcessing Emotions - Happiness
Processing Emotions - Happiness
 
Social emotions
Social emotionsSocial emotions
Social emotions
 
Artificial Emotion
Artificial EmotionArtificial Emotion
Artificial Emotion
 
Damasio antonio subcortical and cortical brain activity during the feeling ...
Damasio antonio   subcortical and cortical brain activity during the feeling ...Damasio antonio   subcortical and cortical brain activity during the feeling ...
Damasio antonio subcortical and cortical brain activity during the feeling ...
 
Chapter 4 pwrpt
Chapter 4 pwrptChapter 4 pwrpt
Chapter 4 pwrpt
 
Emotions
EmotionsEmotions
Emotions
 
[系列活動] Emotion-AI: 運用人工智慧實現情緒辨識
[系列活動] Emotion-AI: 運用人工智慧實現情緒辨識[系列活動] Emotion-AI: 運用人工智慧實現情緒辨識
[系列活動] Emotion-AI: 運用人工智慧實現情緒辨識
 
EMOTIONS and INTELLIGENCE in Psychology
EMOTIONS and INTELLIGENCE in PsychologyEMOTIONS and INTELLIGENCE in Psychology
EMOTIONS and INTELLIGENCE in Psychology
 
Emotion
EmotionEmotion
Emotion
 
Emotion Introduction
Emotion IntroductionEmotion Introduction
Emotion Introduction
 
Emotions and Types of Emotional Responses.pptx
Emotions and Types of Emotional Responses.pptxEmotions and Types of Emotional Responses.pptx
Emotions and Types of Emotional Responses.pptx
 
Components and Competency of Emotions
Components and Competency of EmotionsComponents and Competency of Emotions
Components and Competency of Emotions
 
Emotion annesley 2010
Emotion annesley 2010Emotion annesley 2010
Emotion annesley 2010
 
Emotion
EmotionEmotion
Emotion
 
Authentic Joy
Authentic JoyAuthentic Joy
Authentic Joy
 
Motivation and Emotions
Motivation and EmotionsMotivation and Emotions
Motivation and Emotions
 
Cognition, biology and emotion pp
Cognition, biology and emotion ppCognition, biology and emotion pp
Cognition, biology and emotion pp
 
Emotion
EmotionEmotion
Emotion
 
Perceived emotion in the brain
Perceived emotion in the brainPerceived emotion in the brain
Perceived emotion in the brain
 

Recently uploaded

Digital Signal Processing Lecture notes n.pdf
Digital Signal Processing Lecture notes n.pdfDigital Signal Processing Lecture notes n.pdf
Digital Signal Processing Lecture notes n.pdfAbrahamGadissa
 
2024 DevOps Pro Europe - Growing at the edge
2024 DevOps Pro Europe - Growing at the edge2024 DevOps Pro Europe - Growing at the edge
2024 DevOps Pro Europe - Growing at the edgePaco Orozco
 
A case study of cinema management system project report..pdf
A case study of cinema management system project report..pdfA case study of cinema management system project report..pdf
A case study of cinema management system project report..pdfKamal Acharya
 
WATER CRISIS and its solutions-pptx 1234
WATER CRISIS and its solutions-pptx 1234WATER CRISIS and its solutions-pptx 1234
WATER CRISIS and its solutions-pptx 1234AafreenAbuthahir2
 
fundamentals of drawing and isometric and orthographic projection
fundamentals of drawing and isometric and orthographic projectionfundamentals of drawing and isometric and orthographic projection
fundamentals of drawing and isometric and orthographic projectionjeevanprasad8
 
A CASE STUDY ON ONLINE TICKET BOOKING SYSTEM PROJECT.pdf
A CASE STUDY ON ONLINE TICKET BOOKING SYSTEM PROJECT.pdfA CASE STUDY ON ONLINE TICKET BOOKING SYSTEM PROJECT.pdf
A CASE STUDY ON ONLINE TICKET BOOKING SYSTEM PROJECT.pdfKamal Acharya
 
Top 13 Famous Civil Engineering Scientist
Top 13 Famous Civil Engineering ScientistTop 13 Famous Civil Engineering Scientist
Top 13 Famous Civil Engineering Scientistgettygaming1
 
İTÜ CAD and Reverse Engineering Workshop
İTÜ CAD and Reverse Engineering WorkshopİTÜ CAD and Reverse Engineering Workshop
İTÜ CAD and Reverse Engineering WorkshopEmre Günaydın
 
shape functions of 1D and 2 D rectangular elements.pptx
shape functions of 1D and 2 D rectangular elements.pptxshape functions of 1D and 2 D rectangular elements.pptx
shape functions of 1D and 2 D rectangular elements.pptxVishalDeshpande27
 
Introduction to Casting Processes in Manufacturing
Introduction to Casting Processes in ManufacturingIntroduction to Casting Processes in Manufacturing
Introduction to Casting Processes in Manufacturingssuser0811ec
 
Fruit shop management system project report.pdf
Fruit shop management system project report.pdfFruit shop management system project report.pdf
Fruit shop management system project report.pdfKamal Acharya
 
Quality defects in TMT Bars, Possible causes and Potential Solutions.
Quality defects in TMT Bars, Possible causes and Potential Solutions.Quality defects in TMT Bars, Possible causes and Potential Solutions.
Quality defects in TMT Bars, Possible causes and Potential Solutions.PrashantGoswami42
 
Introduction to Machine Learning Unit-5 Notes for II-II Mechanical Engineering
Introduction to Machine Learning Unit-5 Notes for II-II Mechanical EngineeringIntroduction to Machine Learning Unit-5 Notes for II-II Mechanical Engineering
Introduction to Machine Learning Unit-5 Notes for II-II Mechanical EngineeringC Sai Kiran
 
Automobile Management System Project Report.pdf
Automobile Management System Project Report.pdfAutomobile Management System Project Report.pdf
Automobile Management System Project Report.pdfKamal Acharya
 
RS Khurmi Machine Design Clutch and Brake Exercise Numerical Solutions
RS Khurmi Machine Design Clutch and Brake Exercise Numerical SolutionsRS Khurmi Machine Design Clutch and Brake Exercise Numerical Solutions
RS Khurmi Machine Design Clutch and Brake Exercise Numerical SolutionsAtif Razi
 
Halogenation process of chemical process industries
Halogenation process of chemical process industriesHalogenation process of chemical process industries
Halogenation process of chemical process industriesMuhammadTufail242431
 
ASME IX(9) 2007 Full Version .pdf
ASME IX(9)  2007 Full Version       .pdfASME IX(9)  2007 Full Version       .pdf
ASME IX(9) 2007 Full Version .pdfAhmedHussein950959
 
Construction method of steel structure space frame .pptx
Construction method of steel structure space frame .pptxConstruction method of steel structure space frame .pptx
Construction method of steel structure space frame .pptxwendy cai
 

Recently uploaded (20)

Digital Signal Processing Lecture notes n.pdf
Digital Signal Processing Lecture notes n.pdfDigital Signal Processing Lecture notes n.pdf
Digital Signal Processing Lecture notes n.pdf
 
2024 DevOps Pro Europe - Growing at the edge
2024 DevOps Pro Europe - Growing at the edge2024 DevOps Pro Europe - Growing at the edge
2024 DevOps Pro Europe - Growing at the edge
 
A case study of cinema management system project report..pdf
A case study of cinema management system project report..pdfA case study of cinema management system project report..pdf
A case study of cinema management system project report..pdf
 
WATER CRISIS and its solutions-pptx 1234
WATER CRISIS and its solutions-pptx 1234WATER CRISIS and its solutions-pptx 1234
WATER CRISIS and its solutions-pptx 1234
 
fundamentals of drawing and isometric and orthographic projection
fundamentals of drawing and isometric and orthographic projectionfundamentals of drawing and isometric and orthographic projection
fundamentals of drawing and isometric and orthographic projection
 
A CASE STUDY ON ONLINE TICKET BOOKING SYSTEM PROJECT.pdf
A CASE STUDY ON ONLINE TICKET BOOKING SYSTEM PROJECT.pdfA CASE STUDY ON ONLINE TICKET BOOKING SYSTEM PROJECT.pdf
A CASE STUDY ON ONLINE TICKET BOOKING SYSTEM PROJECT.pdf
 
Top 13 Famous Civil Engineering Scientist
Top 13 Famous Civil Engineering ScientistTop 13 Famous Civil Engineering Scientist
Top 13 Famous Civil Engineering Scientist
 
İTÜ CAD and Reverse Engineering Workshop
İTÜ CAD and Reverse Engineering WorkshopİTÜ CAD and Reverse Engineering Workshop
İTÜ CAD and Reverse Engineering Workshop
 
shape functions of 1D and 2 D rectangular elements.pptx
shape functions of 1D and 2 D rectangular elements.pptxshape functions of 1D and 2 D rectangular elements.pptx
shape functions of 1D and 2 D rectangular elements.pptx
 
Introduction to Casting Processes in Manufacturing
Introduction to Casting Processes in ManufacturingIntroduction to Casting Processes in Manufacturing
Introduction to Casting Processes in Manufacturing
 
Fruit shop management system project report.pdf
Fruit shop management system project report.pdfFruit shop management system project report.pdf
Fruit shop management system project report.pdf
 
Quality defects in TMT Bars, Possible causes and Potential Solutions.
Quality defects in TMT Bars, Possible causes and Potential Solutions.Quality defects in TMT Bars, Possible causes and Potential Solutions.
Quality defects in TMT Bars, Possible causes and Potential Solutions.
 
Introduction to Machine Learning Unit-5 Notes for II-II Mechanical Engineering
Introduction to Machine Learning Unit-5 Notes for II-II Mechanical EngineeringIntroduction to Machine Learning Unit-5 Notes for II-II Mechanical Engineering
Introduction to Machine Learning Unit-5 Notes for II-II Mechanical Engineering
 
Standard Reomte Control Interface - Neometrix
Standard Reomte Control Interface - NeometrixStandard Reomte Control Interface - Neometrix
Standard Reomte Control Interface - Neometrix
 
Automobile Management System Project Report.pdf
Automobile Management System Project Report.pdfAutomobile Management System Project Report.pdf
Automobile Management System Project Report.pdf
 
RS Khurmi Machine Design Clutch and Brake Exercise Numerical Solutions
RS Khurmi Machine Design Clutch and Brake Exercise Numerical SolutionsRS Khurmi Machine Design Clutch and Brake Exercise Numerical Solutions
RS Khurmi Machine Design Clutch and Brake Exercise Numerical Solutions
 
Halogenation process of chemical process industries
Halogenation process of chemical process industriesHalogenation process of chemical process industries
Halogenation process of chemical process industries
 
ASME IX(9) 2007 Full Version .pdf
ASME IX(9)  2007 Full Version       .pdfASME IX(9)  2007 Full Version       .pdf
ASME IX(9) 2007 Full Version .pdf
 
Water Industry Process Automation and Control Monthly - May 2024.pdf
Water Industry Process Automation and Control Monthly - May 2024.pdfWater Industry Process Automation and Control Monthly - May 2024.pdf
Water Industry Process Automation and Control Monthly - May 2024.pdf
 
Construction method of steel structure space frame .pptx
Construction method of steel structure space frame .pptxConstruction method of steel structure space frame .pptx
Construction method of steel structure space frame .pptx
 

Emotion recognition

  • 2. ■ Emotion Definition (page 3) – Basic Emotion – Dimensional Emotion ■ Social Emotion And Emotion-evoked Theory (p age 9) – Social Emotion – James-lange Theory – Cannon-bard Theory – Schatter & Singer Two Factor Theory ■ Bioreaction According To Emotion (page 21) – Brain – Heart – Eye – Skin – Facial expression ■ Emotional Issues (page 29) – Subjectivity And Objectivity – Moment Emotion – Fake Emotions – Temporary And Daily Emotions – Emotional Consciousness And Unconsci ous – Emotional Contagion And Synchronizati on – Personal Emotion And Social Emotion Catalog ■ Emotion Intensity (page 37) – Definitions – Features – Expressions ■ Complex Emotion (page 41) 2
  • 3. Emotion Definition - Basic Emotion - Dimensional Emotion 3
  • 4. Contents ■ History Of Basic Emotion Research - Duchenne de Boulogne (1862) identifies 13 major emotions by one or two facial muscle representations; - Attention, Reflection, Meditation, Intentness of mind, Pain, Aggression or Menace, Weeping with hot tears, Moderate Weeping, Joy, Laughter, False Laughter, Irony, ironic laughter, Sadness or Despondency - Charles Darwin (1872) divides emotions into 8 groups and considers them culturally unaffected; - Silvan Tomkins(1962) divides emotions into 9 emotions based on the same biological response (the Nine effect); - Positive (Interest-excitement, Enjoyment-joy), Neutral (Surprise-startle), Negative (Distress-anguish, Anger-rage, Fear- terror, Shame-humiliation, Dissmell (root of contempt), Disgust). - Paul Ekman (1971), removed three emotions (Contemut, Sham and Inner), and defines six basic emotions based on Tomkins theory. - Based on facial expressions (It have no cultural differences) 4
  • 5. Contents ■ Ekman’s Six Basic Emotion - Ekman's face expression extraction processes - Six emotions base on FACS(Facial Action Coding System) - Ekman’s six basic emotions: happy, sad, anger, surprise, fear, disgust, there is no difference between social, culture and ages; Emotion AU(Action Unit) Example Happiness 6 : Cheek Raise 12 : Lip Corner Pull 25 : Lips Part Sadness 1 : Inner Brow Raise 4 : Brow Lower 17 : Chin Raise Anger 4 : Brow Lower 7 : Lid Tighten 17 : Chin Raise 24 : Lip Press Emotion AU(Action Unit) Example Fear 1 : Inner Brow Raise 2 : Outer Brow Raise 4 : Brow Lower 5 : Upper Lid Raise 20 : Lip Stretch Surprise 1 : Inner Brow Raise 2 : Outer Borw Raise 5 : Upper Lid Raise 26 : Jaw Drop Disgust 9 : Nose Wrinkle 10 : Upper Lid Raise 15 : Lid Corner Depress 25 : Lips Part 5 Figures from: Tian, Y. I., Kanade, T., & Cohn, J. F. (2001). Recognizing action units for facial expression analysis. IEEE Transactions on pattern analysis and machine intelligence, 23(2), 97-115. James A Russell. (1980). Circumplex Model of Affect. Journal of Personality and Social Psychology, 39(6), 1161-1178
  • 6. Contents ■ Facial Expressions – Au(Action Units) - The expression and emotion of a person are not based on culture or learning, but is a instinct. So that there's a universality in facial expressions. - There are 42 muscles on the human face, Micro-Expression appear and change between 0.5 and 4 seconds in our usual facial expressions. Moreover, an indescribable expression of true feelings expresses by unconsciousness that appears and disappears momentarily in a very short time of 0.2 seconds. - FACS (Facial Action Coding System) each facial expression is given an alphabet and number to sign its type and intensity. - Alphabetical rating (A-E): the intensity of emotions. It is more intensity from A to E. ■ History Of Dimensional Emotion Research - Nowlis define emotion in six to twelve independent emotional dimensions, like sadness, anxiety, aner, elation, tension, etc. based on self-reporting experiment. - Tomkins, Lzard, Ekman think that each emotional state can be seen as a different dimension, For example, sadness and great joy can be conjoined together in reverse. - Schlosberg thinks emotions are not independent of each other, but very systematically associated with each other. He defines a two-dimensional circle model in pleasantness – unpleasantness, attention – rejection, and then proposes three dimensional model by adding dimension of sleepiness – tension. - Russell defined in a circular form with two-dimensional bipolar properties: valence and arousal based on Laymen’s Conceptualization of Affect (judgement) and Multivariate Analysis of Self-reported Affective States (experiences) 6Figures from: Clark, E. A., J'Nai Kessinger, S. E. D., Bell, M. A., Lahne, J., Gallagher, D. L., & O'Keefe, S. F. (2020). The Facial Action Coding System for Characterization of Human Affective Response to Consumer Product- Based Stimuli: A Systematic Review. Frontiers in Psychology, 11.
  • 7. Contents ■ Russell’s dimensional circle model - Russell’ dimensional emotion use two independent dimensions to explain emotional states: valence and arousal; - Methods - Circular Scaling of Terms - Multidimensional Scaling of Terms - Unidimensional Scaling - Structure of Self-Reported Affect - the classification of emotions by a person's judgment is based on the person's cognitive structure - Dimensional emotion model is defined as valence and arousal - Neurophysiological interpretation - Excited, Tense, Angry: sympathetic nerve ↑, parasympathetic nerve ↓, pupil dilation - Calm, Bored, Tired: sympathetic nerve ↓, parasympathetic nerve ↑, pupil constriction - Β wave: Rise (cupillary lobe) - Awakening under stress conditions - Α wave: Low brain activity (hypodiacal lobe) - Stable - Beta/Alpha: The ratio of two frequencies can be used to determine the awakening - The frontal lobe plays a crucial role in the experience of sperm control and consciousness. - Inactivation of the left hemisphere forebrain is associated with negative emotion - In contrast, inactivation of the right hemisphere forebrain indicates positive 7Figures from: James A Russell. (1980). Circumplex Model of Affect. Journal of Personality and Social Psychology, 39(6), 1161-1178
  • 8. Reference - Ekman, P. (1989).The argument and evidence about universals in facial expressions. Handbook of social psychophysiology, 143-164. - Ekman, P. (1992).An argument for basic emotions. Cognition & emotion, 6(3-4), 169-200. - Ekman, P., & Friesen,W.V. (1971). Constants across cultures in the face and emotion. Journal of personality and social psychology, 17(2), 124. - James A Russell. (1980). Circumplex Model of Affect. Journal of Personality and Social Psychology, 39(6), 1161-1178. - Jonathan Posner. (2009).The Neurophysiological Bases of Emotion:An fMRI Study of theAffective Circumplex Using Emotion-Denoting Words. Hum Brain Mapp. 30(3). 883-895. - Ortony,A., &Turner,T. J. (1990).What's basic about basic emotions?. Psychological review, 97(3), 315. - Ortony,A., &Turner,T. J. (1990).What's basic about basic emotions?. Psychological review, 97(3), 315. - Rinn,W. E. (1984).The neuropsychology of facial expression: a review of the neurological and psychological mechanisms for producing facial expressions. Psychological bulletin, 95(1), 52. - Saarimäki, H., Gotsopoulos, A., Jääskeläinen, I. P., Lampinen, J.,Vuilleumier, P., Hari, R., ... & Nummenmaa, L. (2016). Discrete neural signatures of basic emotions. Cerebral cortex, 26(6), 2563-2573. - Wundt,Wilhelm Max. Lectures on human and animal psychology. George Allen, 1896. - Schlosberg, Harold. "The description of facial expressions in terms of two dimensions." Journal of experimental psychology 44.4 (1952): 229. - Levenson R W.The autonomic nervous system and emotion[J]. Emotion Review, 2014, 6(2): 100-112. - Handbook of emotions[M]. Guilford Press, 2010. - Agrafioti F, Hatzinakos D,Anderson A K. ECG pattern analysis for emotion detection[J]. IEEETransactions on affective computing, 2011, 3(1): 102-115. - Tomarken, Resting frontal brain asymmetry predicts affective responses to films, 1990 - Davidson, Neuropsychological perspectives on affective styles and their cognitive consequences, 1999 - Davidson, R. J., Ekman, P., Saron, C. D., Senulis, J. A., &Friesen,W.V. (1990). Approach-withdrawal and cerebral asymmetry: Emotional expression and brain physiology: I. Journal of Personality and Social Psychology, 58 (2), 330–341 - Paul Ekman (2012) , “should we call it expression or communication?”,The European Journal of social science research, Jan 24 8
  • 9. Social Emotion And Emotion-evoked Theor y - Social Emotion - Emotion-evoked Theory - Social Emotion - Emotion-evoked Theory 9
  • 10. Contents ■ Social Emotions - Social emotions are caused by interactions with others and have important social function, that means social emotions depend on the thoughts, feelings, and behaviors of others, and relate to interpersonal relationship, institutional system, and culture. - Definition - Social emotion are various opinions based on factors and categories; - Social emotions are complex emotions, in which cognitive factors play an important role; - Social emotions are influenced by communication, not internal phenomena; - Social emotions play an important role in moral decision-making, so it is also called moral emotion. - Opinion 1: Social emotions develop in the later stages of human evolution rather than general emotions - Buck(1999) - Emotions are separate from biological mechanism, especially social emotions are developed from basic attachments in society. - Oatley(1987) - All human emotions are social because they believe that the way of evolution takes into account the social perception in the previous structure to deal with the complexity of social life. - Even basic emotions such as happiness, sadness, anxiety, anger, and disgust are considered social emotions because they are mainly related to social objects - Opinion 2: Social emotions are caused by judgments of facts, imagination and expectations - Leary(2001) - Emphasis on relationships of all types of social emotion - Bennett& Campos(1987) - Social emotions are classified based on basic principles and goals. 10
  • 11. Contents ■ Comparison of Group Emotions and Social Emotions - Group Emotions - Form emotions in one direction and transfer emotions in a group - Through the interaction and transmission of emotions among group members, individual emotions are transformed into group emotions - Public emotion has the same or similar emotional structure - Features - Unity and collective - With the popularity of social media, the transfer of public sentiment has accelerated. - Emotion formation process is formed by the same life experience and cultural factors - The homogenization trend of the spread of individual emotional states among members of a specific group - Individual emotions or states are ignored by people with greater intensity of sensitivity - Emotional strength within the group is an important reason for public emotion - Synchronization between leader and slave - Social Emotions - Emotions caused by interaction with others - Emotions caused by social connection between people the same psychological experience. - Features - Based on emotional interaction between two people - Different people may have different sensitivities - React to the thoughts, feelings or behavior of others - The categories of social emotion are comprehensive and diverse: jealousy, guilt, shame, etc. - Compared with basic emotions, it has a more complex system and develops later 11
  • 12. Contents ■ Comparison Tabel Group Emotions Social Emotions Commons Emotions may be evoked from others It is formed by experiences based on social and cultural factors during the process of emotional development. Difference same emotional direction May have different emotional direction the strength of emotion in the group is important Emotional interaction between two people is important Basing on emotion infection Basing on social relationships Synchronization between leader and followers Synchronization between two people Personal emotion is disregarded by others' great intensity emotion Form social relations through emotional interaction 12
  • 13. Contents ■ Social emotions - Classifications (table 1) - Moral emotions - Basing on Social emotions play an important role in moral decision-making, so it is also called moral emotion. - Closely related to the interests or well-being of the entire society - Shame, guilt, regret, embarrassment, contempt, anger, disgust, gratitude, jealousy, jealousy, compassion, empathy - From self-aware emotions - Emotions that occur when an individual recognizes that an event or situation may have effect on self- assessment or happiness. - For example: Shame, guilt, pride, embarrassment Author Social Emotions Adolphs, Baron Cohen & Tranel, 2002 Admiration, arrogance, flirtatiousness, guilt, loyalty Barbalet, 1996 Confidence, trust Barrett & Campos, 1987 Envy, guilt, pride, shame Barrett and Nelson-Goens, 1997 Embarrassment, envy, guilt, pride, shame Buck, 1999 Arrogance, envy, guilt, jealousy, joy, pity, pride, scorn, shame Hareli & Weiner, 2002 Admiration, anger, contempt, dislike, distaste, envy, gratitude, guilt, like, pride, respect, schadenfreude, shame, sympathy Leary, 2000 Admiration, embarrassment, envy, hatred, hurt feelings, jealousy, loneliness, love, pride, shame, social anxiety, social sadness Oatley & Johnson-Laird, 1987 Bitterness, delight, depression, disappointment, embarrassment, horror, loathing, sexual love, vengefulness Parkinson, Fischer & Manstead, 2005 Envy, fago, grief, guilt, jealousy, love, shame different social emotions 13
  • 14. Contents ■ Emotional intelligence - A complex of emotional and social abilities/skills that helps people solve everyday problems and improve efficiency in their personal and social lives - Self-awareness: the understanding of strengths and limitations, and the desire for continuous improvement; - Self-management: successfully control own emotions and behaviors, and can achieve a succeed in new or challenging situations; - Social-awareness: the ability to interact with others in a social environment through collaboration and tolerance; - Relationship Skills: the ability to promote and maintain positive relationships with others - Goal-Directed Behavior: start and insist on completing tasks of various difficulty - Personal Responsibility: be cautious and reliable, and help collective efforts - Decision-Making: use your own values to guide actions and take responsibility for your decisions - Optimistic Thinking: confidence, hope, positive ways of thinking, attitudes towards yourself and past, present and future living conditions - Factors - Self-awareness - Self-management - Social awareness - Relationship management 14 Figure from pinterest: https://www.pinterest.co.uk/pin/298152437802302187/
  • 15. Contents ■ Social emotions and Emotional intelligence Social Emotion Social Intelligence An individual's feelings depending on the thoughts, feelings, and actions of others Heavily influenced by communication with others What’s your emotions under an special circumstances when you communicate with others? The ability to socialize and act appropriately to social situations Heavily influenced by a given social situation How do you live and act under a special circumstances? 15
  • 16. Contents ■ Social emotion and SNS - The roles of social emotions in SNS - People share emotions and information in social media as same as in real society; - Emotional sharing relationship: express your recent situation, mood, emotions, etc. through SNS, and express and share emotions with offline people. - Information sharing relationship: sharing information or music, or getting a new perspective from someone with professional knowledge-compared to emotional sharing, this connection is worse and forms negative social emotions - Method of analysis - Define the representative relationship between SNS users as emotional sharing relationship (variable) and information sharing relationship (variable); - Establish model to verify the social emotion model Social emotional vocabulary analysis and collection Verify the suitability of socially sensitive vocabulary Chi-square test Representative social sensitivity Correlation analysis and factor analysis between social sensitivities Structural analysis of social emotion model Building a social emotion model Verify social emotion model Subjective evaluation 16
  • 17. Contents ■ Social emotion and Parasympathetic nervous systems (PN) - When activated, it controls the endocrine glands to prepare the body for emergency action and causes the adrenal glands to produce epinephrine - increased blood flow to the muscles - increased heart rate - Help the body to move more quickly and feel less pain in situations perceived to be dangerous. - Parasympathetic nervous systems (PN) - When the body is relaxed or at rest, it helps the body store energy for future use. - Increased stomach activity and decreased blood flow to the muscles. limbic system autonomicnervous system reticular activating system serotonin noradrenaline dopamine Result pleasant or unpleasant mental states SNS PN together with the hypothalamus, regulates pulse, blood pressure, breathing arousal in response to emotional cues first arouse the cortex then maintain its wakefulness sensory information and emotion can be interpreted more effectively. emotion cerebral cortex hippocampus amygdala grey, folded, outermost layer of the cerebrum responsible for higher brain processes such as sensation, voluntary muscle movement, thought, reasoning, and memory. in the medial temporal lobe play a key role in emotion in both animals and humans, particularly in the formation of fear-based memories in the temporal lobe of the brain plays a role in memory and emotion 17
  • 18. Contents ■ James-Lange theory - Emotion is the result of a physiological reaction to an external event - Physiological changes at first, then emotions - E.x. Happy because of smile; sad because of crying; - Detect - In the majority of emotions, this test is inapplicable - Only corroborates in emotions that have a distinct bodily expression. - For many of the manifestations are in organs over which we have no volitional control ■ Cannon-Bard theory - emotional and physiological responses both happen—but these are two separate processes - based on thalamic processes which response for emotional responses to experienced stimuli - when the thalamic discharge occurs, the bodily changes occur almost simultaneously with the emotional experience. ■ Schatter & singer two factor theory - Emotion = arousal + cognition - emotions are the result of both physiological and cognitive processes. - In a famous 1962 study, Schachter and Singer investigated whether people would respond differently to a shot of adrenaline depending on the context they found themselves in. - While later research hasn’t always supported Schachter and Singer’s findings, their theory has been incredibly influential and has inspired many other researchers. 18
  • 19. Contents ■ Jame-lange Emphasize Emotions are caused by physical reactions to events ■ Cannon-Bard proposes that both of these reactions originate simultaneously in the thalamus ■ Schachter & Singer(Two-factor) theory of emotion Adds onto James-lange Theory of emotion by stating that two factors are needed: physiologic response and congnitive label, emp Cognition is the main factor determining emotional state 19Figures from internet
  • 20. Reference - Buck, R. (1980). Nonverbal behavior and the theory of emotion:The facial feedback hypothesis. Journal of Personality and Social Psychology, 38(5), 811–824. doi:10.1037/0022-3514.38.5.811 - Strack, Fritz; Martin, Leonard L.; Stepper, Sabine (May 1988). "Inhibiting and FacilitatingConditions of the Human Smile: A NonobtrusiveTest of the Facial Feedback Hypothesis". Journal of Personality and Social Psychology. 54 (5): 768–777. doi:10.1037/0022-3514.54.5.768. PMID 3379579. - Cannon,W.B. (1927). "The James-Lange theory of emotions: A critical examination and an alternative theory".TheAmerican Journal of Psychology. 39 (1/4): 106– 124. doi:10.2307/1415404. JSTOR 1415404. - Cannon,W.B. (1931). "Again the James-Lange and the thalamic theories of emotion". Psychological Review. 38 (4): 281–295. doi:10.1037/h0072957. - Ye-Sool Cha , Ji-Hye Kim , Jong-Hwa Kim , Song-Yi Kim ,Dong-Keun Kim, Min-CheolWhang (2012), “Validity analysis of the social emotion model based on relation types in SNS”, 감성과학,Vol.15, No.2, pp.283-296, June 2012 - JF Kihlstrom, N Cantor, “Social Intelligence” - Brian Parkinson (1996), “Emotions are social”, British journal of psychology, 1996 -WileyOnline Library - What is Elevation? - https://gostrengths.com/what-is-elevation/ - Social emotions - https://en.wikipedia.org/wiki/Social_emotions - Embarrass - https://www.psychologytoday.com/us/blog/intense-emotions-and-strong-feelings/201112/embarrassment - Marinetti,C., Moore, P., Lucas, P., & Parkinson, B. (2010). Emotions in Social Interactions:Unfolding Emotional Experience. Emotion-Oriented Systems, 31– 46. doi:10.1007/978-3-642-15184-2_3 20
  • 21. Bioreaction According To Emotion - Brain - Heart - Eye - Skin - Facial expression 21
  • 22. Contents ■ Brain - EEG - The electroencephalogram (EEG) is a recording of the electrical activity of the brain from the scalp. The recorded waveforms reflect the cortical electrical activity. - the main frequencies of the human EEG waves are: Delta(1-3Hz), Theta(3.5-7.5Hz), Alpha(7.5-13Hz), Beta(14-30Hz), γ(30~80Hz) - The electric potential generated by an individual neuron is far too small to be picked up by EEG or MEG.[46] EEG activity therefore always reflects the summation of the synchronous activity of thousands or millions of neurons that have similar spatial orientation. - Research results - In the comparison between the stable state and the emotion-induced state caused by visual stimuli, there are significant differences in almost all regions. - Positive and negative - Positive: Beta and gamma waves are activated in the temporal lobe. - Neutral: Inactivation of beta wave and gamma wave in temporal lobe, and activation in frontal lobe in delta wave, theta wave, and alpha wave. - Negative: Similar to Neutral, but different from Alpha and Delta, showing delta wave activation in parietal lobe. - Basic emotions - Alpha power AMUSEMENT <NEUTRAL <DISGUST <SAD - SAD: activated in the frontal, parietal, and parietal lobes - DISGUST: activated in the frontal and parietal lobes - NEUTRAL: activated in the frontal and parietal lobes - Amusement: activated slightly in the parietal lobe - Happy: have significant EEG, but similar to sleepy 22
  • 23. Contents ■ Brain - EEG Wave Patterns Frequency Range (Hz) Signal Features Significant δ (Delta wave) ~3.5 the highest in amplitude and the slowest waves - Infancy or immature intellectual development, extreme fatigue and let hargy or anesthesia θ (Theta wave) 3.5~7 High-amplitude - frustration or depression - associated with reports of relaxed, meditative, and creative states - Gloomy: θ(4-7Hz) lateral brain α (Alpha wave) 8~12 the "posterior basic rhythm“ wave - awake, quiet when closing eyes - Active: There are significant differences between the basic emotions in the left frontal lobe. - Calm: α (8-13Hz) in Posterior lobe β (Beta waveγγ) 13~30 both sides in symmetrical distribution; Low-amplitude - nervous and excited Γ (Gamma wave) 31~50 Lowest-amplitude - Exchange of information between cortical and subcortical areas - Appears in conscious awakening and dreams during REM sleep. - It may appear overlapped with beta waves. - Tense:Γ (30-50Hz) in the forebrain Information about EEG 23
  • 24. Contents■ Heart - ECG (Electrocardiography) - It is a graph of voltage versus time of the electrical activity of the heart[4] using electrodes placed on the skin. - Normal rhythm produces four entities – a P wave, a QRS complex, a T wave, and a U wave - each have a fairly unique pattern - P wave: atrial depolarization. - QRS: complex represents ventricular depolarization. - T wave: ventricular repolarization. - U wave: papillary muscle repolarization. - The heart's electrocardiogram declines when you feel sad or stable, but increases when it is excited - ECG and emotion - The signals of ECG decrease when nervous, sad and calm - The signals of ECG increase when excited and anxious - Research results about EEG - Anger: acceleration and amplitude are relatively large - Comfortable: acceleration and amplitude are relatively small - Sad: acceleration is relatively large, amplitude is relatively small - Happy: acceleration is relatively small, amplitude is relatively large - PPG - used to detect blood volume changes in the microvascular bed of tissue - most common sites: ear, nasal septum, and forehead, right and left ear lobes, index fingers and great toes - Heart rate variability measured by PPG divided from HRV to LF/HF and analyzed - When the LF component increases, the parasympathetic nervous system prevails and is judged to be negative. - When HF component increases, the sympathetic nervous system prevails and is judged as a positive emotion - When the LF/HF value was increased, the LF value was relatively increased, and the parasympathetic nerve was dominant. 24 Figures from internet
  • 25. Contents ■ Eye - Pupil - It is an empty space in the center of the eye. - Through the pupil, light enters the retina and enables visual processing. - It is black because the space behind the eyes is dark, and it is black regardless of the iris color. - The pupil diameter is about 2 to 8 mm. - The pupil's response to light - Exact response time may vary depending on age, stimulus intensity, etc. - 0~0.2 sec: pupils do not respond - 0.2~1.5 sec: Shrinks quickly and strongly until the pupil shrinks to the smallest size - 1.2~10 sec: The pupil is still deflated and slightly restored - 10~30 sec: Pupil gradually returns to its original size; expansion by light is slower to recover - Physiological characteristics (figure 14, table ) Different Social EmotionsPupil sphincter (括约肌) Mydriasis major Definition Circular muscles around the pupil Radial muscles around the pupil Autonomic nervous system Parasympathetic nervous system Sympathetic nervous system Function - Reduces pupil size when light is bright - Highly related to rest-storage reactions - Increases pupil size to receive more light - Closely related to the fight-run reaction 25Figures from: Mathôt, S. (2018). Pupillometry: Psychology, physiology, and function. Journal of Cognition, 1(1).
  • 26. Contents ■ Eye - Pupil - Amygdala - The amygdala suppresses the parasympathetic nerve. - Amygdala activation: pupil dilation - Amygdala inactivation: pupil contraction - Path-way : eye to brain ■ Skin - GSR (Galvanic Skin Resistance) - Measure sweat gland activity from finger skin which are reflective of the intensity of our emotional state, otherwise known as emotional arousal. - scary, threatening, joyful, or otherwise emotionally relevant - increases eccrine sweat gland activity - The GSR signal is therefore not representative of the type of emotion, but the intensity of it. - It is noteworthy that both positive (“happy” or “joyful”) and negative (“threatening” or “saddening”) stimuli can result in an increase in arousal – and in an increase in skin conductance. - SKT (Skin Temperature) Retina Optic Intersecting Optic nerves Right Field Of View Information Left Field Of View Information EWN : Edinger –Westphal nucleus EWN Laryngeal Lob e 26
  • 27. Contents ■ Facial expression - Facial expression is controlled by the movement and position of the muscles under the skin of the face. - The muscles involved are divided into 14 muscles. - EMG (Electrormyogram) - evaluating and recording the electrical activity produced by skeletal muscles - use as middleware in gesture recognition towards allowing the input of physical action to a computer as a form of Human- computer interaction - two kinds of EMG: surface EMG and intramuscular EMG - FEMG is a face electromyography test. 27 Figures from: Gibert, G., Pruzinec, M., Schultz, T., & Stevens, C. (2009, November). Enhancement of human computer interaction with facial electromyographic sensors. In Proceedings of the 21st Annual Conference of the Australian Computer-Human Interaction Special Interest Group: Design: Open 24/7 (pp. 421-424). https://imotions.com/blog/facial-expression-pictures/
  • 28. Reference 1. Babiker, A., Faye, I., & Malik, A. (2013). Pupillary behavior in positive and negative emotions. 2013 IEEE International Conference on Signal and Image Processing Applications. 2. Geangu, E., Hauf, P., Bhardwaj, R., & Bentz, W. (2011). Infant pupil diameter changes in response to others' positive and negative emotions. PloS one, 6(11), e27132. 3. Ho, C. H., & Lu, Y. N. (2014). Can pupil size be measured to assess design products?. International Journal of Industrial Ergonomics, 44(3), 436-441 4. Oliva, M., & Anikin, A. (2018). Pupil dilation reflects the time course of emotion recognition in human vocalizations. Scientific reports, 8(1), 4871. 5. Somchanok T, Michiko O. (2015). Emotion Recognition using ECG Signals with Local Pattern Description Methods. International Journal of Affective Engineering, 6. Valenzi, S., Islam, T., Jurica, P., & Cichocki, A. (2014). Individual classification of emotions using EEG. Journal of Biomedical Science and Engineering, 2014. 7. Van Steenbergen, H., Band, G. P., & Hommel, B. (2011). Threat but not arousal narrows attention: evidence from pupil dilation and saccade control. Frontiers in psychology, 2, 281. 8. Zheng, W. L., Zhu, J. Y., & Lu, B. L. (2017). Identifying stable patterns over time for emotion recognition from EEG. IEEE Transactions on Affective Computing. 28
  • 29. Emotional Issues – Subjectivity And Objectivity – Moment Emotion – Fake Emotions – Temporary And Daily Emotions – Emotional Consciousness And Unconscious – Emotional Contagion And Synchronization – Personal Emotion And Social Emotion 29
  • 30. Contents ■ Emotional Subjectivity and Objectivity - Objective Or Subjective - Emotions are subjective because they are influenced by personal, social, and cultural environments. - Physiological indicators reveal more obvious differences depending on the emotional experience as they become more physically excited. - Conversely, if the level of excitement is low, it is difficult to predict the emotional experience with only physiological indicators. - Subjective evaluation method - There is a delay of around 10 seconds in the brain immediately after presenting visual stimuli and the subject expresses the highest emotional value - Real-time subjective evaluation and non-real-time subjective evaluation - Measurements through questionnaires, such as the cut scale and the semantic scale. - Emotions are considered subjective because its process of generation varies depending on personal, social, and cultural differences - Emotion are objective because that it happens with physiological changes in the body and can be objectively measured - Measurements through biometric signals (EEG, ECG, GSR, EMG, etc.). - Evaluate false emotions resulting from the discrepancy between actual feelings and expressions through brain wave response analysis ■ Moment Emotion - Ekman's Micro-Expression captures the moment of emotion according to the expression that should pay attention to the persistence of emotion and the change of emotion with time - The persistence of emotions is mainly divided into negative emotions and positive emotions - Emotions often cause other emotions to motivate the expression of emotions. For example, the continuation of a negative emotional state stimulates the expression of positive emotions, leading to escape from negative emotions. 30
  • 31. Contents ■ Fake Emotions - It can be detected form objective methods - based on facial micro stress, body language, and interrogation language analysis. - facial EMG response - E.x. body behavior - Lying smile, paraphrase behavior, grooming behavior, hesitation, increased frequency of eye blinking, speechlessness, decreased hand, foot, and body movement. - E.x. facial expression - Dull smile-periocular area: shows a significant difference between a neutral expression and a dull smile-Ball muscle area: strong response when a dull smile, a non-dull smile does not differ from a neutral expression-affects altruism: see a dull smile or open mouth Subjects who saw a smile showed positive behavior to share money. - E.x. pupil change - Reduced pupil size in a stiff smile - Women increased pupil size in a dull smile; Male increased pupil size in a an-stiff smile - The eye blink rate of a person increases to eight times the normal rate after lying - E.x. EEG signal - The signals in F3, F4, C4, P3, P4, O1, O2 of brain have significant differences between actual and false emotions - E.x. ECG signal - looking at a back-to-back smile (true smile) has resulted in much stronger fascia and cheek muscle EMG activity compared to the activity gained by looking at a neutral face - others - the EMG reaction of the pericardial and ball muscle region to Non Dussen smile was no different from that of the neutral face - the intensity was more significant in a happy expression than in an angry expression. 31
  • 32. Contents ■ Temporary And Daily Emotions - Temporary emotion - Memory-based emotion - Memory is stimulated by instantaneous stimuli - The ability to remember varies by emotion - Daily emotion - Described as Mood - Development into everyday emotions as the continuation of temporary emotions - Deriving various everyday emotions depending on context or by differences in persistence by emotion ■ Emotional Consciousness And Unconscious - Conscious emotion - This is all the emotional experience we perceive in our daily lives. - If you consciously perform facial mimicry instead of distinguishing emotions, the ability is poor. - Unconscious emotion - It is an emotional experience that we do not recognize in our daily life. - Facial express micro-movement rises from the face when unfair things happen: the psoas muscles and the cheek muscles - empathy More empathy for someone imitating their behavior. - Self-esteem Self-esteem suppresses acts that imitate others (unknowingly) - Cheers to try to imitate someone unconsciously in order to buy someone else's cheers. - When imitating a variety of emotional facial stimuli, the facial muscles are involuntarily moved in a micro-movement like the suggested expression. - The act of imitating someone increases the likelihood of the person unconsciously. 32
  • 33. Contents ■ Emotional Contagion And Synchronization - Contagion - Positive emotions - the frequency of the frontal lobe (F7), anterior lobe (T3, T4, T5, T6) and larynx (O2) vary significantly. - Negative emotions - a significant difference between the amount of frequency changes in the frontal lobe (F3), anterior lobe (T4) and posterior lobe (I2) - Empathy: a significant difference in frequency was observed in the temporal lobe (T4). - non-empathy: a significant difference in the amount of frequency change in the parietal lobe (P3, P4) and the central sphere (c3) can be confirmed. - Synchronization - Empathy is a person's stand, feeling and thinking about his emotions, which is spread by others' emotions - Everything that explains and reflects the world is related to emotions, and they affect and spread each other. ■ Personal Emotion And Social Emotion - Personal sensibility - Stimulation triggers your own sensibility - Emotional reactions are not the same for everyone. - In order to properly analyze biosignals, which is a means to objectively classify individual emotions, a method of reducing individual differences is needed. - When a stable state is used, a reference to be used as a reference is measured together, and a biosignal that changes according to emotion is calculated and normalized as a rate of change to overcome individual differences. - Social sentiment - A society where individuals form a social relationship - Sensibility plays a decisive role as a medium to form social ties - Social sentiment should be measured not by individual, but by relationship with others. - Intimacy, empathy, etc. 33
  • 34. Reference 1. Strike, P. C., Wardle, J., & Steptoe, A. (2004). Mild acute inflammatory stimulation induces transient negative mood. Journal of psychosomatic research, 57(2), 189-194. 2. Bouhuys, A. L., Bloem, G. M., & Groothuis, T. G. (1995). Induction of depressed and elated mood by music influences the perception of facial emotional expressions in healthy subjects. Journal of affective disorders, 33(4), 215-226. 3. Strike, P. C., Wardle, J., & Steptoe, A. (2004). Mild acute inflammatory stimulation induces transient negative mood. Journal of psychosomatic research, 57(2), 189-194. 4. Strike, P. C., Wardle, J., & Steptoe, A. (2004). Mild acute inflammatory stimulation induces transient negative mood. Journal of psychosomatic research, 57(2), 189-194. 5. Hayakawa, Y., Takada, K., Miki, H., & Tanaka, K. (2000). Effects of music on mood during bench stepping exercise. Perceptual and motor skills, 90(1), 307-314.. 6. Balteș, F. R., & Miu, A. C. (2014). Emotions during live music performance: Links with individual differences in empathy, visual imagery, and mood. Psychomusicology: Music, Mind, and Brain, 24(1), 58.. 7. Mathews, A., & Bradle, B. (1983). Mood and the self-reference bias in recall. Behaviour research and therapy, 21(3), 233-239. 8. George, M. S., Ketter, T. A., Parekh, P. I., Horwitz, B., Herscovitch, P., & Post, R. M. (1995). Brain activity during transient sadness and happiness in healthy women. American Journal of Psychiatry, 152(3), 341-351 9. Hammersley, R., & Reid, M. (2009). Theorising transient mood after ingestion. Neuroscience & Biobehavioral Reviews, 33(3), 213-222. 10. Barabasz, M. (1991). Effects of aerobic exercise on transient mood state. Perceptual and motor skills, 73(2), 657-658. 11. Winkielman, P., & Berridge, K. C. (2004). Unconscious Emotion. Current Directions in Psychological Science, 13(3), 120–123. 12. 안호석, 최진영, 이동욱. (2012). 의식과 무의식을 구분하는 감성 로봇 시스템. 제어로봇시스템학회 국내학술대회 논문집, (), 186-187. 13. Um, Z.-S., Yang, J.-C., Park, J.-I., & Kim, G.-W. (2019). 유년기 정신적 외상을 경험한 외상후 스트레스장애 환자에서 무의식적 감정 자극이 의식적 작업기억 수행에 미치는 영향에 관한 기능적 자기공명영상 연구. Psychoanalysis, 30(4), 114-123. 14. 김민정, 이영애 (2011). 목표지향적 정보처리에서 무의식적 사고의 효과. 인지과학, 22(4), 405-427 15. 손민정, 남택진 (2010). 지속가능한 인터랙션 디자인에 적용하기 위한 인간의 무의식적인 행동에 관 한 연구. 한국HCI학회 학술대회, 456-459 34
  • 35. Reference 16. Dimberg, U., Thunberg, M., & Elmehed, K. (2000). Unconscious Facial Reactions to Emotional Facial Expressions. Psychological Science, 11(1), 86–89. doi:10.1111/1467-9280.00221 17. 조덕기, 이은주, 방성근, 권오재, 임인종, 김만영, 김진희 (2011). Wavelet cross correlation을 이용한 의식 적인 의도와 무의식적인 의도에 따른 뇌활성 신호의 특징 추출. 정보과학회논문지 : 컴퓨팅의 실제 및 레터, 17(12), 613-621 18. 정진복, 안창일 (2000). 식역하 ERP 를 통한 정서적 자극의 무의식 처리. 한국심리학회지: 건강, 5(2), 304-315 19. Ivonin, L., Chang, H.-M., Chen, W., & Rauterberg, M. (2012). Unconscious emotions: quantifying and logging something we are not aware of. Personal and Ubiquitous Computing, 17(4), 663–673. doi:10.1007/s00779-012-0514-5 20. Jessen, S., & Grossmann, T. (2015). Neural signatures of conscious and unconscious emotional face processing in human infants. Cortex, 64, 260–270. doi:10.1016/j.cortex.2014.11.007 21. Kramer,A. D.,Guillory, J. E., & Hancock, J.T. (2014). Experimental evidence of massive-scale emotional contagion through social networks. Proceedings of the NationalAcademy of Sciences, 111(24), 8788-8790. 22. Coviello, L., Sohn,Y., Kramer,A. D., Marlow,C., Franceschetti, M., Christakis, N.A., & Fowler, J. H. (2014). Detecting emotional contagion in massive social networks. PloS one, 9(3). 23. Manera,V., Grandi, E., & Colle, L. (2013). Susceptibility to emotional contagion for negative emotions improves detection of smile authenticity. Frontiers in Human Neuroscience, 7, 6. 24. Ferrara, E., &Yang, Z. (2015). Measuring emotional contagion in social media. PloS one, 10(11), e0142390. 25. Xiong, X., Li,Y., Qiao, S., Han, N.,Wu,Y., Peng, J., & Li, B. (2018). An emotional contagion model for heterogeneous social media with multiple behaviors. Physica A: Statistical Mechanics and its Applications, 490, 185-202. 26. Hashimoto, M.,Yamano, M., & Usui,T. (2009, September). Effects of emotional synchronization in human-robot KANSEI communications. In RO-MAN 2009- The 18th IEEE InternationalSymposium on Robot and Human InteractiveCommunication (pp. 52-57). IEEE. 35
  • 36. Reference 27. Grandjean, D., Sander, D., & Scherer, K. R. (2008). Conscious emotional experience emerges as a function of multilevel, appraisal-driven response synchronization. Consciousness and cognition, 17(2), 484-495. 28. Li,Y., & Hashimoto, M. (2011, December). Effect of emotional synchronization using facial expression recognition in human-robot communication. In 2011 IEEE InternationalConference on Robotics and Biomimetics (pp. 2872-2877). IEEE. 29. Osvath, M., & Sima, M. (2014). Sub-adult ravens synchronize their play: a case of emotional contagion. Anim Behav Cogn, 2, 197. 30.Wiss, M., &Tordjman,S. (2016). Creating a ‘social zeitgeber’to synchronize family emotional rhythms:A new therapeutic approach in child and adolescent psychiatry. Journal of Physiology-Paris, 110(4), 480-486. 31. 강유원(2010), “사회적감성, 정치적의식, 정치적행위”, 감성연구1권,0호,69-83. 32. 신승섭, 노수진, 차예술, 김종화, 황민철(2012), “사랑과 우정에 대한 사회감성 모델에 관한 연구”, 한국 감성과학회 춘계학술대회 2012권, 0호, 71-72. 33. 이구형(1998), “감성과 감정의 이해를 통한 감성의 체계적 측정 평가”, 감성과학1권,1호,113-122. 34. J. M. Barbalet, Social emotions: confidence, trust and loyalty, International Journal of Sociology and Social Policy, 16(9/10), 1996, 75–96. 35. Hareli, S., & Parkinson, B. (2008).What’s social about social emotions?, Journal for theTheory of Social Bevaviour, 38, 131–156. 36. Seyfert, R. (2012) ‘Beyond Person Feelings and Collective Emotions:Toward aTheory of SocialAffect’,Theory,Culture and Society 29(6): 27–46. 37. Parkinson,B., & Lea, M. E (1991). Investigating personalconstructs of emotion.British Journal of Psychology,82, 73-86. 38. Cavalera,C., & Pepe,A. (2014). Social emotions and cognition: Shame, guilt and working memory. Social and Behavioral Sciences, 112, 457-464. 39. Parkinson, B.(1996). "Emotions are social." British,Journal of Psychology, 87: 663-683. 40. L. J. Chang, andA. Smith, “Social emotions and psychological games,” Curr.Opin. Behav. Sci., vol. 5, pp. 133-140, Oct. 2015. 36
  • 37. Emotion Intensity – Definitions – Features – Expressions 37
  • 38. Contents ■ Definition - Difference in feeling or expression of emotion - Experienced by individuals in response to emotion-provoking stimuli – Larsen (1984) - It is stable experienced by individuals during centuries– Larsen and Diener (1987) - Personal characteristics that indicate the degree of emotion experienced by individuals for a particular object ■ Features - Even if they feel the same, different intensity may be different emotions - An emotion can be expressed in many forms based on intensity - Factors such as duration of emotion, individual psychological factors, bioreaction, cultural differences, and gender are related to the strength of emotion - Emotional intensity and classification of emotion - Y axis: high intensity-low intensity - X axis: negative emotions-positive emotions - Low intensity feeling is mostly gloomy or quiet, calm feeling - High-intensity emotions are anger and excitement 38Figures from: Seppälä, E. (2016). The happiness track: How to apply the science of happiness to accelerate your success. Hachette UK.
  • 39. Contents ■ Expression - FACS (Facial Action Coding System) - Models with angry or happy expressions get a higher intensity level than models with neutral expressions. - Compared with male models who portray the same expressions, the expressions on female models' faces are more strongly evaluated. - Facial expressions vary according to emotional intensity - Body response changes with changes in emotional intensity 39
  • 40. Reference 1. Chen, Y., Lee, S. Y. M., & Huang, C. R. (2011). Automatic Recognition of Emotion based on a Cognitively Motivated Emotion Annotation System. Journal of Cognitive Science, 12(3), 277-296. 2. Li, Y., Mavadati, S. M., Mahoor, M. H., Zhao, Y., & Ji, Q. (2015). Measuring the intensity of spontaneous facial action units with dynamic Bayesian network. Pattern Recognition, 48(11), 3417-3427. 3. Spignesi, A., & Shor, R. E. (1981). The judgment of emotion from facial expressions, contexts, and their combination. The Journal of General Psychology, 104(1), 41-58. 4. Para citar este artículo: Alves, N. T., Bezerra, I. A. O., Claudino, R. G., & Pereira, T. C. L. (2013). Recognition of static and dynamic facial expressions: Influences of sex, type and intensity of emotion. Avances en Psicología Latinoamericana, 31 (1), pp. 192-199. 5. David I Perrett, Reiner Sprengelmeyer.(2002). Facial expressions of emotion: Stiumli and tests(FEEST).Psychology manual,1 6. Camille D, Helene F, Caroline B, Andrea D & Daniel F(2017). The effect of acute social stress on the recognition of facial expression of emotions. Scientific Reports 7. Kam, C. C.-S., & Bond, M. H. (2008). Role of emotions and behavioural responses in mediating the impact of face loss on relationship deterioration: Are Chinese more face-sensitive than Americans? Asian Journal Of Social Psychology, 11(2), 175–184. doi:10.1111/j.1467-839x.2008.00254.x 8. Lien, J. J., Kanade, T., Cohn, J. F., & Ching-Chung Li. (n.d.). Automated facial expression recognition based on FACS action units. Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition. doi:10.1109/afgr.1998.670980 9. Biele, C., & Grabowska, A. (2006). Sex differences in perception of emotion intensity in dynamic and static facial expressions. Experimental Brain Research, 171(1), 1–6. 10. Juslin, P. N., & Laukka, P. (2001). Impact of intended emotion intensity on cue utilization and decoding accuracy in vocal expression of emotion. Emotion, 1(4), 381–412. 11. N’Diaye, K., Sander, D., & Vuilleumier, P. (2009). Self-relevance processing in the human amygdala: Gaze direction, facial expression, and emotion intensity. Emotion, 9(6), 798–806 40
  • 41. Complex Emotion – Definitions – Features – Expressions 41
  • 42. Contents ■ Definitions ((Carrera, P., & Oceja, L. (2007)) - any emotion that is an aggregate of two or more others.(contrast to simple emotions which are those that are irreducible by analysis to any other emotion.) - e.x. hate=anger + fear + disgust - love = tenderness + pleasure + devotion + passion - other like: awe, disgust, embarrassment, envy, gratitude, guilt, jealousy, pride, remorse, shame, and worry - Definition 1 - Affective experiences can fluctuate, be combined, and fused, resulting in various phenomena labeled as being emotionally complex - complex emotions insofar as the single components of the affect system (i.e., emotional adjectives) interact forming patterns or categories that are integrated into systems which do not resemble the constituent emotions permitting adaptive functions. - Different of Emotional Complexity: based on different emotions establish different interrelations between them - emotional differentiation - emotional granularity - implies discerning among many positive and negative emotions (Grossman et al., 2016) - emotional granularity, make finer distinctions and well-differentiated reports of emotional experience - language contributes to the perception of emotions (Lindquist et al., 2006; Gendron et al., 2012). - emodiversity - The degree to which people can experience a diverse and abundant set of emotional experiences is a form of emotional complexity. - Emodiversity is a measure of the richness of emotional complexity and the proportionality of experiences about a wide number of emotions (Quoidbach et al., 2014). - emodiversity and emotional granularity are at opposite sides of a hypothetical differentiation continuum, ranging from making thin distinctions between different emotions (emotional granularity) to experiencing an abundant and diverse range of emotions (emodiversity). 42 Figures from: https://redpenpalsblog.com/how- to-write-complex-emotions/
  • 43. Contents ■ Definitions - Emotional interdependence - Emotions mutually influence each other throughout an event, altering the intensity of subsequent affects, modifying the hedonic valence of ongoing experiences, coupling multiple emotional experiences as a consequence of similar appraisals, or changing the behaviors to be deployed at a given moment. - Co-occurrence of emotional experiences of positive and negative valence (subjective experience) - E.X. Happy-sad; fear-hope: graduate experience more positive (happiness) and negative (sadness) emotions at the same time, compared to the same students surveyed at distant time points from graduation (larsen et al., 2001; hershfield et al., 2008). - Affective dynamics (flow of the everyday emotional experience ) - Changes in emotion can result in diverse processes defined by the individuals’ fluctuations in emotion (davidson, 1998). Mixed emotions: the co-activation of opposite emotions at the same time - E.X. Feeling excited and, not very long after, feeling blue. Emotions change dramatically from one moment to another. - Meta-emotions (a causal relation between a pair of different emotions) - One emotion prompting a secondary emotion (gottman et al., 1996; norman and furnes, 2016). - Experiencing a meta-emotion requires that one emotion (e.G., Sadness) triggers a secondary emotion (e.G., Anger). Fundamental in the understanding of meta-emotions as a complex emotional experience is that emotions can be hierarchically organized, forming finite layers of emotions - Emotions are aggregated on top of each other. - Aesthetic emotions - A group of affective experiences felt during aesthetic appreciation, including stimuli from nature (e.G., Natural wonders) and human creation (e.G., Painting or music), as well as emotional reactions that follow religious experiences or epiphanies (keltner and haidt, 2003; gordon et al., 2016). - E.X. Awe involves a mixture of surprise, pleasure, elevation, and astonishment (keltner and haidt, 2003). - First being-moved - Includes the emotional experiences of sadness and joy (menninghaus et al. (2015)) - The most common scenarios: deaths and births, and significant relationship events (reunions) (kuehnast et al., 2014). - High levels of compatibility with social norms and self-ideals. - Second awe - A mixture of surprise, pleasure, elevation, and astonishment (keltner and haidt, 2003). 43
  • 44. Contents ■ Definitions - Definition 2 : Primary And Secondary Emotions (figure 22 ) - A tree-structured list of emotions was described in Shaver et al. (1987), and also featured in Parrott (2001). - Definition 3 Emotional equations​ (figure 23) - Chip Conley showed how emotions and feelings are organised using mathematical. 44Figures from: https://en.wikipedia.org/wiki/Emotion
  • 45. Contents ■ Definitions - Definition 3 : Plutchik’s Wheel of Emotions - In 1980, Robert Plutchik diagrammed a wheel of eight emotions: joy, trust, fear, surprise, sadness, disgust, anger and anticipation. - And then Plutchik also theorized twenty-four "Primary", "Secondary", and "Tertiary" dyads (feelings composed of two emotions). - First, the eight primary emotions in this model are the basis for all others and are grouped into polar opposites (figure 24): - joy and sadness - acceptance and disgust - fear and anger - surprise and anticipation - inner circles are more basic and outer circles more complex, which are also formed by blending the inner circle emotions. - Containing mild emotion, mild opposite emotion, basic emotion, basic opposite emotion, intense emotion and intense opposite emotion - mild emotion: Serenity, Acceptance, Apprehension, Distraction - mild opposite emotion: Pensiveness, Boredom, Annoy, Interest - Basic emotion: Joy, Trust, Fear, Surprise - basic opposite emotion: Sadness, Disgust, Anger, Anticipation - intense emotion: Ecstasy, Admiration, Terror, Amazement - intense opposite emotion: Grief, Loathing, Rage, Vigilance - Second, the improving model contains the following information (figure 25): - Primary dyad = one petal apart = Love = Joy + Trust - Secondary dyad = two petals apart = Envy = Sadness + Anger - Tertiary dyad = three petals apart = Shame = Fear + Disgust - Opposite emotions = four petals apart = Anticipation - Surprise - (Anger is classified as a "positive" emotion because it involves "moving toward" a goal,[58] while surprise is negative because it is a violation of someone's territory.[) - - 45Figures from: https://en.wikipedia.org/wiki/Emotion
  • 46. Reference 1. Carrera, P., & Oceja, L. (2007). Drawing mixed emotions: Sequential or simultaneous experiences?. Cognition and emotion, 21(2), 422-441. 2. Oceja, L., & Carrera, P. (2003, February). Mixed emotional experience. Poster presented at the Annual Meeting of the Society for Personality and Social Psychology, Los Angeles, USA 3. Larsen, J. T., & McGraw, A. P. (2011). Further evidence for mixed emotions. Journal of Personality and Social Psychology, 100(6), 1095–1110. doi:10.1037/a0021846 4. Patwardhan, A. S. (2017). Multimodal mixed emotion detection. 2017 2nd International Conference on Communication and Electronics Systems 5. Fernando, J. W., Kashima, Y., & Laham, S. M. (2014). Multiple emotions: A person-centered approach to the relationship between intergroup emotion and action orientation. Emotion, 14(4), 722–732. 46