1. Loud e-Motion
Arezu Aghaseyedjavadi, Linda Baebler, Pablo Paredes
School of Information
UC Berkeley
Towards Multisensoral Expression of Emotions
Project Motivation
Sounds can evoke distinct emotions, but
how about touch (via haptics)?
Hertsenstein and Keltner found that touch
can also communicate distinct
emotions.. Moreover, acoustic cues can
activate emotional reactions similar to
pictures.
Research Questions/Hypotheses to
Test:
• Sounds to have greater dominance
than haptics to evoke emotions
• Emotions intensify with combination
of sound and haptics
• Combination of unmatched sound
and haptic stimulation will trigger
confusion/different emotional
outcome
Design of Haptic+Sound Wearable
Considerations:
• Sound and haptics should originate
from the same place.
• Haptics should emulate interactions
by placing 2 motors to simulate
stroke/caress movement in order to
present emotions –(Poupyrev, CHI
2011)
Mapping Sounds and Haptics to Emotions
First Iteration of Haptic+Sound Wearable
Sadness Relaxed
Arousal
Valence
Arousal
Valence
Haptics from Affective Touch and Sounds from IADS mapped onto the Circumplex Model of Affect
Anger Happiness
Mapping of Sounds from IADS onto Circumplex Model
Design considerations for wearable device
development
Participant completing Test Questions after encountering
Haptic/Sound stimuli
“Haptics had a much greater effect
on my mood than I expected.”Experiment Design (N=7):
• Randomized and Counterbalanced Testing
• Test 1: Haptic-Sound -> Haptic-Sound -> Combination
• Test 2: Sound-Haptic -> Sound-Haptic -> Combination
• 4 Emotions Elicited: Anger, sadness, happiness, relaxed
• Additional 9 Emotions Tested: Fear, disgust, surprised,
envy, gratitude, pride, stress, love, sympathy
• Experiment Format: Pre-test -->Test --> Post-Test
Findings:
Popularity of Emotions for Sound Only:
Relaxed(34%), Surprise(22%), Stress (9%)
Popularity of Emotions for Haptics Only:
Anger (21%), Happiness( 19%), Relaxed (19%)