This document summarizes a presentation about hacking the Kinect motion sensing device. It discusses the drivers and libraries that allow accessing the Kinect's sensors from a computer, including the open-source libraries libfreenect and OpenNI. It also covers using the Kinect with openFrameworks and processing data from the Kinect in real-time using C++. Lastly, it discusses transmitting Kinect sensor data to a web browser over websockets using Node.js to enable controlling and visualizing the Kinect from a web page.

1. Kinect Hack
hagino3000
Feb. 23, 2011 Kinect Vol.1
1

2. @hagino3000 ?
2

3. Twitter
3

4. 4

5. About me
✴ Web Developer
✴ JavaScript
✴
✴ java-ja.js
✴ Kinect
5

6. (Jun. 2011)
6

7. Agenda
✴ Introduction
✴ Drivers for Kinect
✴ openFrameworks
✴ Live coding with Xcode and C++
✴ Kinect with Browser
7

8. 8

9. Hack Kinect
No
40
Yes
46
9

10. Hack
Yes
11
No
35
10

11. Introduction
11

12. 12

13. Buy it!!
13

14. Kinect Hack
✴ 11 Kinect
2,000
✴ Hector Martin libfreenect
✴ Kinect
14

15. http://www.youtube.com/watch?v=rKhW-cvpkks
15

16. libfreenect
✴ Windows/MacOS/Linux
✴ C++/Python
✴
16

17. Natural Interaction
www.openni.org
17

18. OpenNI
✴ Natural Interaction
✴ Kinect
PrimeSence
✴ Natural Interaction
18

19. Natural Interaction
✴ Speech and command recognition, where
devices receive instructions via vocal
commands.
✴ Hand gestures, where pre-defined hand
gestures are recognized and interpreted to
activate and control devices.
✴ Body Motion Tracking, where full body
motion is tracked, analyzed and interpreted
for gaming purposes.
19

20. <="" p=""/>
http://www.openni.org/documentation
20

21. NITE
Middle ware
21

22. MS
22

23. XBOX
23

24. Kinect for Windows SDK
http://blogs.technet.com/b/microsoft_blog/archive/2011/02/21/kinect-
for-windows-sdk-to-arrive-spring-2011.aspx
24

25. OpenNI +
PrimeSensor Module
(MacOS )
25

26. Many Hacks
✴ Media Art
✴ Computer Interface
✴ Sex Game Controller
26

27. ✴
✴
✴
27

28. http://www.kinect-
hacks.com/openni
28

29. openFrameworks
29

30. http://www.openframeworks.cc/
30

31. openFrameworks
✴
✴ C++
✴ Kinect addon
(ofxKinect / ofxOpenNI)
✴
31

32. Demo
32

33. Web
33

34. Socket node.js Tornade
WebSocket
34

35. var http = require('http'),
io = require('socket.io'),
zmq = require('zeromq');
var server = http.createServer();
server.listen(9876);
// Setup
var webSocket = io.listen(server);
webSocket.on('connection', function(client) {
// do something
});
// C++ Program ==> node.js ==> Browser
var zsocket = zmq.createSocket('sub');
zsocket.on('message', function(event, data) {
webSocket.broadcast(data);
});
zsocket.connect('tcp://127.0.0.1:14444');
zsocket.subscribe('event');
35

36. Question?
36

37. Thank you
37