A brief introduction to Kinect for Windows development. The slide gives brief introduction to kinect, kinect features, possibilities and application areas The slide was prepared for tech talk in K-MUG event.

1. Abilash Ashok | User Experience Developer
Kinect for Windows
Embracing Natural User Interface (NUI) | May 23, 2015

2. 2© 2015 www.cametoofar.com | Embracing Natural User Interface@abhilashca
Contents
 Natural User Interface (NUI)
 Know the device
 Sensor capability
 Design guidelines
 Developer story

3. 3© 2015 www.cametoofar.com | Embracing Natural User Interface@abhilashca
Natural User Interface (NUI)
 Natural User Interface
 Voice
 Gestures
 Natural interactions (touch, push, pull, grab and fling)

4. 4© 2015 www.cametoofar.com | Embracing Natural User Interface@abhilashca
Devices

5. 5© 2015 www.cametoofar.com | Embracing Natural User Interface@abhilashca
Know the device
Kinect sensor
• Full HD - 1080p (1920x1080)
• Depth camera, IR emitter, RGB Camera
• 4 microphone array
Kinect adapter
Application Area
• Retail
• Education
• Entertainment
• Healthcare
• Games

6. 6© 2015 www.cametoofar.com | Embracing Natural User Interface@abhilashca
Sensor capability
Body Tracking
Angle of Vision
 Tracks 6 skeletons (with confidence level)
 Supports 2 modes
 Standing mode (25 joints, 2-4.5 meters)
 Seated mode (10 joints, 0.5-2.0 meters)
 Face tracking (smiling, eyes closed, wearing glass, mouth opened, etc.)
 Directional voice tracking
 Tracks joint rotation
 Hand states – open/closed/Lasso
 Pre-baked interactions
 Speech recognition
 Speech languages (en-US, de-DE, fr-FR, es-ES, etc.)

7. 7© 2015 www.cametoofar.com | Embracing Natural User Interface@abhilashca
Demo
 RGB Camera (1920x1080)
 Joints, Skeleton with (directional) Audio
 Depth Sensor (512×424)
 IR Sensor (512×424)
 Production App
 Windows Store

8. 8© 2015 www.cametoofar.com | Embracing Natural User Interface@abhilashca
Developer story
 Development platform
 Cross-platform APIs
 WPF, Windows Store, Xbox One, HTML5/JS, Unity
 Debugging
 Kinect Studio
 Gestures
 Visual Gesture Builder

9. 9© 2015 www.cametoofar.com | Embracing Natural User Interface@abhilashca
Design guidelines
 Physical Interaction Zone (no overlapping users/movements)
 Voice (quite environment)
 Adaptable UI (based on user’s position)
 Lighting (not suitable for outdoor/extreme lighting)
 Dressing (avoid reflective jewelry, etc.)
 Placing the sensor (at optimal height)

10. 10© 2015 www.cametoofar.com | Embracing Natural User Interface@abhilashca
Requirements
 Kinect Sensor (with Kinect Adapter)
 Windows 8/8.1, Embedded Standard (64-bit)
 4 GB Memory, dual-core 3.1 GHz, USB 3.0
 Visual Studio 2012/2013 (including Express Edition)
 DirectX 11 capable graphics adapter

11. 11© 2015 www.cametoofar.com | Embracing Natural User Interface@abhilashca
References
 http://www.microsoft.com/en-us/kinectforwindows/
 http://aka.ms/k4wv2jumpstart
 https://github.com/KinectEx/KinectEx
 https://msdn.microsoft.com/en-us/library/dn799271.aspx

12. 12© 2015 www.cametoofar.com | Embracing Natural User Interface@abhilashca
What’s next
Explore
Experiment
Freedom to
Fail
Creative

13. 13© 2015 www.cametoofar.com | Embracing Natural User Interface@abhilashca
Thank you
for your time.