Motion Sensors + Audio Visual Performance
Upcoming SlideShare
Loading in...5
×
 

Motion Sensors + Audio Visual Performance

on

  • 762 views

 

Statistics

Views

Total Views
762
Views on SlideShare
309
Embed Views
453

Actions

Likes
0
Downloads
5
Comments
0

1 Embed 453

http://badmindtime.wordpress.com 453

Accessibility

Upload Details

Uploaded via as Microsoft PowerPoint

Usage Rights

© All Rights Reserved

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Processing…
Post Comment
Edit your comment
  • ----- Meeting Notes (2/1/14 16:06) ----- <br /> A quick word of thanks to Dileana Alexander and everyone at Filmgate for hosting a really fantastic array of events in this conference, <br /> Also thanks to Lolo Resnick and eveyone at Sweat Records for hosting this event! <br />
  • ----- Meeting Notes (2/1/14 16:06) ----- <br /> In the domain of sound, I&apos;m trying to use a language that can be applied across a wide spectrum of genres—pop, jazz, world music, classical, electronic, experimental, avant-garde, etc. Kinect has already found its way into the world of dubstep and experimental eletronic performance. <br />

Motion Sensors + Audio Visual Performance Motion Sensors + Audio Visual Performance Presentation Transcript

  • Motion Sensors + Audio Visual Performance: Using Kinect to Control Live Visuals and Sound by Joey Bargsten, Ph.D. Florida Atlantic University • SCMS • MTEn
  • Thanks! http://film-gate.org http://sweatrecordsmiami.com
  • Format/Overview: • Presentation / Demo (noon – 12:40) • Questions? (12:40 – 12:50) • Break (10 min) • Workshop on PureData (1pm – 2pm)
  • Background on Kinect
  • Background on Kinect • Released November 2010
  • Background on Kinect • Released November 2010 • Sold 8M units in 60 days
  • Background on Kinect • Released November 2010 • Sold 8M units in 60 days • SDK Drama!
  • Kinect (Development) Community • Gaming and Virtuality
  • Kinect (Development) Community • Gaming and Virtuality • Medicine
  • Kinect (Development) Community • Gaming and Virtuality • Medicine • Surveillance, Security, Facial Recognition
  • Kinect (Development) Community • Gaming and Virtuality • Medicine • Surveillance, Security, Facial Recognition • Robotics
  • Kinect (Development) Community • Gaming and Virtuality • Medicine • Surveillance, Security, Facial Recognition • Robotics • 3D Scanning and Printing
  • Kinect (Development) Community • Gaming and Virtuality • Medicine • Surveillance, Security, Facial Recognition • Robotics • 3D Scanning and Printing • Avant-Garde Art, Music, and Performance
  • Suggestions, Approaches Systems & Configurations
  • My Configuration • Kinect Sensor (2011); Model 1414, EN/ES US HD (this is the most ‘open’ one!) • Synapse Middleware (converts skeleton to OSC) • PureData v. 0.43.4-Extended (incl. MrPeach library) • Quartz Composer v. 4.0 (+ old FW400 SD camcorder) • 2011 MBP, 2.4mHz, running OSX 7.5 “Lion”.
  • Approaches to Performance • One-Person Band (virtuoso!) – One person, one controller – Controls both audio and visual Video on YouTube http://www.youtube.com/watch?v=1ge7RcIBWsc
  • Approaches to Performance • Division of Labor (conventional ensembles)
  • Approaches to Performance • Division of Labor (conventional ensembles) “For every new technology that comes along, make an ensemble out of it!”—JB, EMV (2011)
  • Approaches to Performance • Division of Labor (conventional ensembles) “For every new technology that comes along, make an ensemble out of it!”—JB, EMV (2011) • Applied to Kinect: –Multiple controllers –Dedicate separate software to audio and visuals –Multiple performers for audio and visuals
  • What Do You Want to Control? SONIC COMPONENTS Background: ambient • sustained • slow rate of change • non-pitched (environments) or pitched (“harmonic”) Middleground: active • patterned /predictable rates of change • motor rhythm + overlays + articulation points (“rhythmic”) Foreground: solo • draws attention • contrasting ‘change vocabulary’ • contrasting timbre (“melodic”) VISUAL COMPONENTS Background: abstract • blurry, fuzzy, indistinct • textures • slow rate of change Middleground: referential, pictoral images • abstractions of geometry or biology • text / motion graphics • Foreground: interactive visuals (may also be referential, pictoral, live, connected to sound events)
  • How Do You Want To Control It? • Discontinuous, trigger events – model: keyboard • Continuous, gradual events – model: theremin • Hybrid Control: multiple parameters – model: sample player
  • Kinect Control Parameters
  • Kinect Kombo™: Quad Theremin + Sample Player • Built in PureData • Free, cc-by-d-nc
  • Kinect Kombo™: Skeleton View + Performer Interface
  • Kinect Kombo™
  • Kinect Kombo™
  • Controlling Visuals Kinect and Quartz Composer
  • The Augmented Dance: Live Body —Kinect— Virtual Body
  • Variations • Figure – Simple Camera Figure and Skeleton – Primitives, 3D Objects, Video Mapped to Skeleton • Paint Brush/Image Hose (Effects Mapped to Skeleton) • Background (Texture or Stylized Video Controlled by Skeleton)
  • “My Profundis (2012)” Video on YouTube http://www.youtube.com/watch?v=gT1lbhR1Qj8
  • Resources • OpenKinect.org • V002.info (vade & bangnoise) • OpenNI.org • Cycling74.com • PureData.info • IdeaChannel ‘Kinect’ Episode • Synapsekinect.tumblr.com • CreateDigitalMusic.com • CreateDigitalMotion.com • OffBook ‘Creative Coding’ Episode • www.fau.edu/scms (MFA - MTEn) • www.badmindtime.com • Melancholalaland™ (my multimedia opera)