This document provides an introduction to using Kinect with Flash game programming. It describes Kinect's sensors and capabilities for full-body 3D motion capture and tracking of up to 6 people. It also discusses the Kinect for Windows SDK and OpenNI drivers, and the AIR Kinect 2 library for ActionScript. Code examples are provided for initializing Kinect settings, accessing the RGB camera image, and getting the position of skeleton joints. Finally, it briefly describes two tasks for a sample game called Jet&Giant that involves controlling the Giant's position with the right hand and shooting by raising one's hand.

1. An Introducton to Game
Programming with Flash
4: Kinect

2. Kinect
● Presented in 2009 (project Natal)
● Released in 2010
● The fastest-selling electronic gizmo of all tme
● 8 million sold during first 60 days
● 24 million sold so far*
● Over 120 games*
* Febuary 2013

3. Sensors
● RGB Camera
● 640x480 px
● Depth sensors
● IR
● CMOS sensor
● Automatc calibraton based on gameplay, furnitures etc.
● Mult-array microphone
● Ambient noise suppression

4. Capabilites
● Full-body 3D moton capture
● Tracking up to 6 people
● 20 joints per player
● Facial recogniton
● Voice recogniton
● Currently enabled in 11 countries

5. Drivers
● Kinect for Windows SDK
● Windows
● http://kinectforwindows.org/
● Open NI Framework
● Windows
● Mac
● http://www.openni.org/
● https://code.google.com/p/simple-openni/

6. AIR Kinect 2.0
https://github.com/AS3NUI/airkinect-2-core
https://github.com/AS3NUI/airkinect-2-examples

7. Initalizaton & Settings
var kinect:Kinect = Kinect.getDevice();
var settings:KinectSettings = new KinectSettings();
settings.rgbEnabled = true;
settings.skeletonEnabled = true;
settings.skeletonSmoothing = 0.8;
kinect.start(settings);
1
2

8. RGB Camera
var cameraBitmap:Bitmap = new Bitmap();
addChild(cameraBitmap);
kinect.addEventListener(CameraImageEvent.RGB_IMAGE_UPDATE,
onCameraUpdate);
private function onCameraUpdate(event:CameraImageEvent): void
{
cameraBitmap.bitmapData = event.imageData;
}
1
2
3

9. Skeleton Joint
kinect.addEventListener(UserEvent.USERS_ADDED, onUserAdded);
private function onUserAdded(event:UserEvent):void
{
var user:User = event.users[0];
var joint:SkeletonJoint =
user.getJointByName(SkeletonJoint.HEAD);
var headPt:Point = joint.position.depthRelative;
}
1
2
3
4

10. Jet&Giant

11. git clone git://github.com/krzysztof-o/epi-
wdpg.git
Jet&Giant

12. Task 1
Controlling Giant:
● Giant's positon should be controlled using right hand

13. Task 2
Shootng Giant:
● Giant should shoot after rising one's hand