1) The document presents story structures that can elicit emotions in storytelling in order to maximize the user experience. It discusses using emotion recognition to adapt story elements like framing, editing, sound, lighting and music. 2) It defines four dramatic emotion clusters (anxiety, happiness, sadness, relax) and how story elements could be adapted for each cluster based on arousal and valence dimensions. 3) As a case study, it analyzes how the emotion detection system could have adapted elements in the movie Silence of the Lambs based on detected viewer emotions, like changing lighting or editing for different scenes.

1. Nelson Zagalo, Vasco Branco, Anthony Barker University of Aveiro, Portugal Story Reaction Structures to Emotion Detection ACM MULTIMEDIA WORKSHOP SRMC, 2004

3. Emotion in Storytelling Oral and Cinematic process Affective Storytelling Process 2/20

4. Style and Representation Story Style Representation Nuclei Catalysers ORAL Tone of Voice Facial Expression Posture Gesture Eye Direction CINEMATIC Framing Editing Music Sound Lighting ORAL / CINEMATIC 3/20

5. Cinematic and Oral Representation Style Cinematic Oral Static Dynamic Storyteller reinforces or subtracts according to the story-listeners expression of emotions , using new elements from Total Story Representation Style Static and Dynamic Viewer Emotions 4/20

8. Emotion Flow Director ’s Version over-stimulation under-stimulation (A) Overall Story Emotion (B) Intermediate Tension sequences Viewer ’s Will traditional dramatic arcs Director and Viewer Control In the Viewer ’s Will , the unbalancing of the tension sequences, results in an (A) overall equal or below to any (B) intermediate sequence. 7/20

22. Story Reaction Structures to Emotion Detection Nelson Zagalo 1 , Anthony Barker 3 , Vasco Branco 2 1,2 Dept. of Communication and Art, University of Aveiro 3810-193 Aveiro, Portugal ntz@ca.ua.pt, vab@ca.ua.pt 3 Dept. of Languages and Cultures, University of Aveiro 3810-193 Aveiro, Portugal [email_address] ACM WORKSHOP SRMC, 2004