REAL TIME CASE STUDIES
ADVANTAGES AND DISADVANTAGES
Kinect motion technology uses a sensor device called
kinect,a 3D scanner which interprets 3D scene information
from a continuously projected infrared structured light.
Is used for:
–Xbox 360 console
Kinect was developed by microsoft .
Enables users to control and interact with the
–Without the need to touch a game controller .
–Through a natural user interface .
–Using gestures and spoken commands .
What is NUI ?
Natural User Interface:
An Invisible Interface
Skeleton Tracking using Kinect Sensor &Displaying in 3D
-ChanjiraSinthanayothin, Nonlapas Wongwaen, Wisarut
Motion Detection Real Time 3D Walkthrough in Limkokwing
University of Creative Technology (Modet-Walk) using
-Behrang Parhizkari,Kanammal Sandrasekaran and Arash
3D Depth sensor
3-D depth sensors
Three-dimensional sensors tracks the body within the play
An RGB (640 × 480) pixels
helps identify and takes in-game pictures and videos.
An array of microphones along the bottom, front edge of the
Kinect sensor are used for speech recognition and chat.
A mechanical drive in the base of the Kinect sensor
Full-body 3D motion capture
Voice recognition capabilities
Light Coding With Kinect:
Structured light is a form of active
In structured light,a known pattern
is projected onto the scene, and the
depth is calculated on the basis of the
triangulation between a known reference
pattern and observed reflected pattern.
Depth perception using the infrared camera
Detected face and upper body regions in the RGB image
The poses of human skeleton is recognized with the help
of machine learning algorithm called decision tree .
Construction of skeleton
The TurtleBot is a customizable mobile robotic platform
that rides on an iRobot Create platform .
The TurtleBot uses the Kinect to see the world in 3D and
for detecting and tracking people.
Topic NUI GUI
Ease User can learn features
easily through natural
New users may have a
difficult time learning to
use the mouse and all
Speed Depends on the user User must operate using
mouse and keyboard
Strain No strain Shortcut keys are used
Example 3D immersive touch Gnome shell
Sensitive to external infrared source (sunlight).
Cannot detect crystalline or highly reflective objects.
Detection and tracking of one or two people moving in
the field of view of the sensor, using the tracking of parts
of the skeleton.
Capture audio with noise and echo cancellation.
This technique aims to provide an application that uses
gestures to interact with virtual objects in an Augmented
Providing a way for using the gesture-based
interactions to manage operations in a virtual walkthrough
environment is a promising approach.