More Related Content
Similar to Connect with your Kinect
Similar to Connect with your Kinect (20)
Recently uploaded
Recently uploaded (20)
Connect with your Kinect
- 10. Wow!
- 11. Motorized Tilt RGB Camera 3D Depth Sensors Microphone Array
- 14. That’s not USB You’ll need this Xbox Kinect
- 17. BGR32 Format width in pixels heightinpixels Stride = Bytes Per Row = bytes per pixel * width = 4 * width 4 Bytes Per pixel Byte Array:
- 18. Demo 1 Hello Colorful World
- 19. Depth data 500mm 500mm 500mm 500mm 2000mm 2030mm 2010mm 2000mm 500mm500mm500mm2500mm
- 20. Depth data Max resolution for raw depth data is 640 x 480 2 bytes per pixel of depth data (short) 11011110 pixel pixel pixel 00001 1110101000000 1110101000001 depthInMM = pixel >> DepthImageFrame.PlayerIndexBitmaskWidth 000 000 000
- 21. Demo 2 Depth
- 22. Depth + Player Data 500mm 500mm 500mm 500mm 2000mm 2030mm 2010mm 2000mm 500mm500mm500mm2500mm player 1 player 1 player 1player 1player 1 player 1 player 1 SkeletonStream.Enable(); var player = pixel & DepthImageFrame.PlayerIndexBitmask; 1101111000001010
- 23. Demo 3 Depth + Player Data
- 25. skeletonFrame.Skeletons where skeleton.TrackingState == SkeletonTrackingState.Tracked skeletonFrame.Skeletons from skeleton in skeletonFrame.Skeletons where skeleton.TrackingState == SkeletonTrackingState.PositionOnly
- 26. hand_left wrist_left elbow_left shoulder_left hand_right wrist_right elbow_right shoulder_right hip_left head hip_right knee_left knee_right ankle_rightankle_left foot_left foot_right hip center spine shoulder_center Skeleton.Joints[JointType] Joint.Position (X,Y,Z) Skeletons are mirrored X, Y, Z in meters Origin(0,0,0) = center of camera. +Z is out +X is to the right +Y is up
- 31. Kinect Audio
- 34. Echo Cancellation EchoCancellationMode: None, CancellationOnly, CancellationAndSuppression int EchoCancellationSpeakerIndex: Index of speaker to cancel
- 36. Noise Supression bool NoiseSuppression – true, false
- 38. Automatic Gain Control bool AutomaticGainControl – true, false
- 39. Beam Forming
- 40. Beam Forming -0.875 radians -50 degrees 0.875 radians 50 degrees .0175 radians 10 degrees
- 42. Audio @!%!#!! Gotchas Use Microsoft.Speech not System.Speech Must run in an MTA AEC SystemModes crash if no speaker output. Must plug Kinect into Wall DevicePairGuid / Qualitymetrics = crash Should run in ThreadMode Priority Highest?
- 44. Kinect SDK 1.5! Seated Skeletal Tracking Face Tracking Joint Rotation Kinect Studio
- 45. Creative Commons Acknowledgments • Flickr by Ian Lewis • Flickr by major nelson • Flickr by markodesign • Flickr by stephantom • Flickr by Abstract Machine • Flickr By Aixo.co.kr • Flickr By Andresmh • Flickr by Antony Bennison • Flickr by Ars Electronica • Flickr By bm.iphone • Flickr by campuspartymexico • Flickr by Chris Jagers • Flickr By ci_polla Paola Sucato • Flickr by creepyhalloweenimages • Flickr by cvander • Flickr by IMAL.org • Flickr by Institut Douglas • Flickr by Joshua and AmberFlickr by Logon Sakai • Flickr by openexhibits • Flickr by Paul_Clarke • Flickr by petyr.rahl • Flickr by pt • Flickr by Stilldavid • Flickr by y3rdua • Flickr by yesyesnono • Flickr by yum9me • Flickr by Jeff Howard • Flickr by jhscreenwm • Flickr by Kyle McDonald • Flickr by Morten Rand-Hendriksen • Flickr by Stuart Herbert • Flickr by Visiophone • Flickr by orkomedix • Michael Zöllner and Stephan Huber at the University of Konstanz • Openclip by J_Alves • Openclip by jetxee • Openclip by molumen • Openclip by shokunin • Openclip by Jhnri • Openclip by Machovka • Adafruit image of Hector Martin Thanks!!
Editor's Notes
- When I first saw Kinect…
- It’s really something. Whether your 6 or 66 if you remember how to pretend, you can have fun.
- The gaming peripheral may have been the end of the story.. But hackers being who they are… Johnny Chung Lee and the Adafruit bounty.
- Exploring what the Kinect can do.
- Art and puppets
- robotics
- HUDs and NUIs
- The really out there stuff
- Open kinect this march just got skeleton tracking committer
- Retails for $250. You can develop with the Xbox Kinect, but you’ll need this to go live. But for students, educators, museums and the like – can get for $150. Also includes “near mode”. to see objects as close as 50 centimeters in front of the device without losing accuracy or precision, with graceful degradation down to 40 centimeters
- If you got your Kinect in a bundle, you’ll need this add –on.
- Our vision is a top down and a bottom up process. We use things like shadows and colors and what we know about the world to infer