ShEMP(AND FRIENDS)BRENNON BORTZDEPT OF COMPUTER SCIENCEINSTITUTE FOR CREATIVITY, ARTS, AND TECHNOLOGYVIRGINIA TECH
ShEMP AND FRIENDS2 • 22VIRGINIA TECHMUSE ABOUT USThe Music, Sensors and Emotionresearch group is a multidisciplinaryteam f...
3 • 22MUSE RESEARCH AREASShEMP AND FRIENDS‣Integral music control‣Measuring gesture andemotion during performance‣Physiolo...
4 • 22VIRGINIA TECHMUSE SIEMPREDeveloping novel theoretical and methodologicalresearch frameworks, computational models, a...
MUSE SHADOW MEDIA5 • 22‣ Inseparable‣ Evocative of presence‣ Expansion of self‣ Moves in tandem with bodyWays through whic...
6 • 22VIRGINIA TECHShEMP AND FRIENDSMUSE SHADOW MEDIA
7 • 22VIRGINIA TECHShEMP AND FRIENDSMUSE SHADOW MEDIA
MUSE PIEs8 • 22ShEMP AND FRIENDSVIRGINIA TECHAssessment of emotional state isaccomplished through a number ofphysiological...
9 • 22MUSE MOBILEMUSEShEMP AND FRIENDS‣Sensors‣Pulse oximetry‣EDA‣Temperature‣Triaxial accelerometer‣Audio signal outputVI...
MUSE ShEMP10 • 22‣ Modular iOS Library for experimentaldesign and execution‣ Tools for:‣ Sensor data acquisition‣ Various ...
12 • 22ShEMP AND FRIENDSVIRGINIA TECHMUSE PERFORMER / AUDIENCE
13 • 22ShEMP AND FRIENDSVIRGINIA TECHMUSE PERFORMERS
14 • 22ShEMP AND FRIENDSVIRGINIA TECHMUSE PERFORMERS
15 • 22MUSE EMOTION IN MOTIONShEMP AND FRIENDSVIRGINIA TECH
‣ Over 10,000 participants‣ Average of 40 visitors per day‣ Over 20,000 songs listened!‣ Pool of 67 songs‣ Happy/Sad, Tens...
MUSE EiM17 • 22ShEMP AND FRIENDSVIRGINIA TECH
KARBON PRESENTATION 8 • 24LEVEL 13, 82 SPENCER ST, MELBOURNEIMMERSEYOURSELFMUSE EiM ANALYSIS18 • 22ShEMP AND FRIENDSVIRGIN...
19 • 22ShEMP AND FRIENDSVIRGINIA TECH
20 • 22ShEMP AND FRIENDSVIRGINIA TECH
MUSE THANK YOUQuestions?ShEMP AND FRIENDS21 • 22VIRGINIA TECH
ShEMP AND FRIENDS22 • 22MUSE CONTACT US{brennon,ben,javier,niall,nick}@musicsensorsemotion.comVIRGINIA TECH
B. Bortz, I. Crandell, R. B. Knapp, Y. Miwa, and S. Itai, “Comparison of the Effect of Proximity on Emotional Change in Re...
ShEMP(AND FRIENDS)BRENNON BORTZDEPT OF COMPUTER SCIENCEINSTITUTE FOR CREATIVITY, ARTS, AND TECHNOLOGYVIRGINIA TECH
Brennon Bortz - A Mobile Physiological Sensing System for Measuring Emotional State in Music Performance and other Ecologi...
Upcoming SlideShare
Loading in...5
×

Brennon Bortz - A Mobile Physiological Sensing System for Measuring Emotional State in Music Performance and other Ecological Environments

327

Published on

Published in: Business, Technology
0 Comments
0 Likes
Statistics
Notes
  • Be the first to comment

  • Be the first to like this

No Downloads
Views
Total Views
327
On Slideshare
0
From Embeds
0
Number of Embeds
0
Actions
Shares
0
Downloads
0
Comments
0
Likes
0
Embeds 0
No embeds

No notes for slide

Brennon Bortz - A Mobile Physiological Sensing System for Measuring Emotional State in Music Performance and other Ecological Environments

  1. 1. ShEMP(AND FRIENDS)BRENNON BORTZDEPT OF COMPUTER SCIENCEINSTITUTE FOR CREATIVITY, ARTS, AND TECHNOLOGYVIRGINIA TECH
  2. 2. ShEMP AND FRIENDS2 • 22VIRGINIA TECHMUSE ABOUT USThe Music, Sensors and Emotionresearch group is a multidisciplinaryteam focused on both qualitatively andquantitatively measuring therelationship between music and emotionand using this information to informmusical composition and performance.
  3. 3. 3 • 22MUSE RESEARCH AREASShEMP AND FRIENDS‣Integral music control‣Measuring gesture andemotion during performance‣Physiological monitoring‣Contagion of emotionVIRGINIA TECH
  4. 4. 4 • 22VIRGINIA TECHMUSE SIEMPREDeveloping novel theoretical and methodologicalresearch frameworks, computational models, andalgorithms for the analysis of creative communicationwithin groups of people.Research is focused on ensemble musicalperformance and audience experience.ShEMP AND FRIENDS
  5. 5. MUSE SHADOW MEDIA5 • 22‣ Inseparable‣ Evocative of presence‣ Expansion of self‣ Moves in tandem with bodyWays through which space can be shared betweenremote actual fields are necessary to support thecreation of a sense of co-existence and mutual trust—a requirement for co-creation.ShEMP AND FRIENDSVIRGINIA TECH
  6. 6. 6 • 22VIRGINIA TECHShEMP AND FRIENDSMUSE SHADOW MEDIA
  7. 7. 7 • 22VIRGINIA TECHShEMP AND FRIENDSMUSE SHADOW MEDIA
  8. 8. MUSE PIEs8 • 22ShEMP AND FRIENDSVIRGINIA TECHAssessment of emotional state isaccomplished through a number ofphysiological indicators of emotion(PIEs).
  9. 9. 9 • 22MUSE MOBILEMUSEShEMP AND FRIENDS‣Sensors‣Pulse oximetry‣EDA‣Temperature‣Triaxial accelerometer‣Audio signal outputVIRGINIA TECH
  10. 10. MUSE ShEMP10 • 22‣ Modular iOS Library for experimentaldesign and execution‣ Tools for:‣ Sensor data acquisition‣ Various self-report mechanisms‣ Visualization‣ Shared media‣ Data persistence‣ Co-creationShEMP AND FRIENDSVIRGINIA TECH
  11. 11. 12 • 22ShEMP AND FRIENDSVIRGINIA TECHMUSE PERFORMER / AUDIENCE
  12. 12. 13 • 22ShEMP AND FRIENDSVIRGINIA TECHMUSE PERFORMERS
  13. 13. 14 • 22ShEMP AND FRIENDSVIRGINIA TECHMUSE PERFORMERS
  14. 14. 15 • 22MUSE EMOTION IN MOTIONShEMP AND FRIENDSVIRGINIA TECH
  15. 15. ‣ Over 10,000 participants‣ Average of 40 visitors per day‣ Over 20,000 songs listened!‣ Pool of 67 songs‣ Happy/Sad, Tense/Relaxed‣ From Handel to the Beach Boys to theBlack Eyed Peas and SlayerMUSE EiM STATS16 • 22VIRGINIA TECHShEMP AND FRIENDS
  16. 16. MUSE EiM17 • 22ShEMP AND FRIENDSVIRGINIA TECH
  17. 17. KARBON PRESENTATION 8 • 24LEVEL 13, 82 SPENCER ST, MELBOURNEIMMERSEYOURSELFMUSE EiM ANALYSIS18 • 22ShEMP AND FRIENDSVIRGINIA TECH
  18. 18. 19 • 22ShEMP AND FRIENDSVIRGINIA TECH
  19. 19. 20 • 22ShEMP AND FRIENDSVIRGINIA TECH
  20. 20. MUSE THANK YOUQuestions?ShEMP AND FRIENDS21 • 22VIRGINIA TECH
  21. 21. ShEMP AND FRIENDS22 • 22MUSE CONTACT US{brennon,ben,javier,niall,nick}@musicsensorsemotion.comVIRGINIA TECH
  22. 22. B. Bortz, I. Crandell, R. B. Knapp, Y. Miwa, and S. Itai, “Comparison of the Effect of Proximity on Emotional Change in Real and Virtual SharedSpaces,” presented at the International Conference on Affective Computing and Intelligent Interaction 2013, Geneva, ShEMP: A Mobile Frameworkfor Shared Emotion, Music, and Physiology, ACM-ICMI SBM workshop, Santa Monica, California, USA.Jaimovich, Javier, Niall Coghlan, and R. Benjamin Knapp (2012) Emotion in Motion: A Study of Music and Affective Response. In Proceedings of the9th International Symposium on Computer Music Modeling and Retrieval (CMMR) Music and Emotions, pp.29-44. Queen Mary University of London.Jaimovich, Javier, Miguel Ortiz, Niall Coghlan, and R. Benjamin Knapp (2012) The Emotion in Motion Experiment: Using an Interactive Installation asa Means for Understanding Emotional Response to Music. In Proceedings of the 2012 Conference on New Interfaces for Musical Expression (NIME),pp.457-8. University of Michigan, Ann Arbor: Division of Computer Science & Engineering, University of Michigan.Jaimovich, J., Ortiz, M., et al., 2012. The Emotion in Motion Experiment: Using an Interactive Installation as a Means for Understanding EmotionalResponse to Music. In Proceedings of the 2012 Conference on New Interfaces for Musical Expression (NIME 2012), Ann Arbor, Michigan. NewInterfaces for Musical Expression. Ann Arbor, Michigan, p. (In Press).Jaimovich, J., Coghlan, N. & Knapp, R.B., 2012. Emotion in Motion: A Study of Music and Affective Response. In Proceedings of the 9th InternationalSymposium on Computer Music Modeling and Retrieval (CMMR) Music and Emotions. Symposium on Computer Music Modeling and Retrieval.London, England, p. (In Press).Switzerland.R. B. Knapp and B. C. Bortz, “MobileMuse: Integral Music Control Goes Mobile,” presented at the 11th International Conference on New Interfacesfor Musical Expression, Oslo, Norway, 2011, pp. 203–206.B. Bortz, S. Salazar, J. Jaimovich, R. B. Knapp, G. Wang (2012)ShEMP AND FRIENDSVIRGINIA TECHMUSE REFERENCES
  23. 23. ShEMP(AND FRIENDS)BRENNON BORTZDEPT OF COMPUTER SCIENCEINSTITUTE FOR CREATIVITY, ARTS, AND TECHNOLOGYVIRGINIA TECH

×