By Joaquim Rocha.
With the release of the Kinect device, there was finally an affordable camera capable of giving depth information. This, together with the Kinect's open USB connection, led to a lot of innovative projects.
Still, the Kinect just gives raw signals and the only way to obtain more complex information, such as skeleton tracking was to use either the Microsoft SDK or the OpenNI framework. Both of these solutions are closed, proprietary and, in the case of Microsoft's, only for non-commercial work.
To solve the issue above, Igalia developed Skeltrack, a Free and Open Source library published under LGPL that performs human skeleton tracking and identifies a number of skeleton joints.
It is a more atomic solution than the other commercial counterparts because it does not connect directly to the Kinect nor to any other depth camera, instead it expects to be given the buffer corresponding to the depth buffer.
In this talk Joaquim will present how Skeltrack was developed and show a demo of it working.
32. What we wanted:
✩ A shared library, no fancy SDK
✩ Modular (do one thing)
✩ Device independent
✩ No pattern matching, no databases
✩ Easy to use (everybody wants that!)
51. Skeleton Joint:
ID: HEAD, LEFT_ELBOW, RIGHT_HAND, ...
x: X coordinate in real world (in mm)
y: Y coordinate in real world (in mm)
screen_x: X coordinate in the screen (in pixels)
screen_y: Y coordinate in the screen (in pixels)
59. Creative Commons pictures from flickr:
Kinect: Auxo.co.kr
Monkey: nothingtosay
Kid Playing: Rob Welsh
Skeleton: Dark Botxy
Other non CC images:
Doctor: http://research.microsoft.com/en-us/projects/touchless/
Minority Report:
http://www.ovelf.com/2010/04/14/oblong-tan-g-speak-arttirilmis-gerceklikte-hareketlerin-3-boyutta-yorumlanmasi/