This document discusses the development of a gestural instrument for computer music creation. It describes mapping gestures to musical properties like tempo, intensity and velocity. The goal is to allow computer musicians to easily improvise expression. Two gestural instruments are presented - one that maps magnitude, speed and periodicity of movement to musical intensity, velocity and tempo. The other maps hand position, baton position, movement speed and periodicity to effects like panning, vibrato, envelope and tempo. The instrument is meant to integrate with sequencers to allow computer musicians to improvise.

1. Music & Gesture
PRESENTATION 3
esis Development | Instructor Jennifer Bove | Russ Maschmeyer | SVA MFA Interaction Design ‘11

2. About Music

3. Music is made of patterns.

4. Interesting Music is made of changing patterns.

5. About Musicians

6. 1
Technique

7. 2
Expression

8. About Instruments

9. Expressivity
Violin/Viola/Cello
Piano
Guitar
Sweet Spot Saxophone
Flute
Drum Set
Bass Guitar
Digital Keyboard
Drum Machine / Sequencer
Recorder
Reactable
Sampler Traditional
iPhone/iPad Apps
Tenori-On
Digital
Step Sequencer
Technique

10. I’m making a gestural instrument
for the creation of computer music
to be used by computer musicians
so they can easily improvise expression

11. Hoop

12. GESTURE
Magnitude of Movement
Speed of Movement
Periodicity of Movement

13. GESTURE MUSIC
Magnitude Intensity
Speed Velocity
Periodicity Tempo

14. INPUT

15. INPUT COMPUTER
pixels periodicity
speed
magnitude
tempo
velocity
intensity
amplitudes
frequencies
note
sample
OUTPUT SEQUENCER

16. tempo

17. intensity

18. intensity

19. intensity

20. intensity

22. Aqwire

23. GESTURE
Speed of Movement
Hand Position(X/Y)
Baton Position (Tip)
Periodicity of Movement
Posture of hand (Open/Close)

24. GESTURE MUSIC
Speed Envelope
Hand Position Panning/Vol
Baton Position Vibrato/Bend
Periodicity Tempo
Posture Slide

25. INPUT COMPUTER
speed
hand position
pixels baton position
periodicity
posture
envelope
panning/vol
vibrato/bend
tempo
slide
amplitudes
frequencies
note(s)
OUTPUT SEQUENCER

30. Instrument Concepts
BUSINESS FRAMEWORKS

31. license

32. partner

33. integrate

34. Feedback / Questions
Confusion points?
ings you liked?
Anything missing?
General Questions?