Google soli sensor

1. Introduction
ATAP:
Advanced Technology and Projects group which is department in
google company .they work on developing new products for general
use.
Everyone knows the basic Input devices like mouse keyboard touch
screen like this gestures can be used as an input.
Gesture recognition is a topic in computer science and language
technology with the goal of interpreting human gestures using
various algorithms.
Soli sensor is developed for detect various human hands gestures , it
uses radar technology same as used in military application but in
small form factor, It detects max 10 hand gestures we will see later
about this , it is in development phase , recently they have
announced the developer kits to for sensor programmers
About Sensor
Ivan Poupyrev is researcher and leader of this project .This sensor
working of radar is pretty much same as used planes submarines
other military applications, this sensors radar works on high
frequency ,short range as compare to military applications which
works on very high range and covers large area and detects various
object because of this which consumer more power and detect
This sensor captures very tiniest changes in hand movements ,it
captures objects movement about 1000 frames per seconds as
compare to camera which captures 60 frames/s because of this
accuracy of sensing hand movement is high

2. Gesture recognition And Radar
 Gesture recognition in by computers in real time is very
complex process. Gestures can be generated by any body
movements like hands,face legs ects which are used in gaming
applications like action or dancing games movement Radar
used in this sensor is very sort rang about 30cm ,
 Frequency Modulated Continuous Wave (FMCW) modulation
architectures FMCW radar (Frequency-
Modulated Continuous Wave radar = FMCW radar) is a special
type of radar sensor which radiates continuous transmission
power like a simple continuous wave radar
The basic features of FMCW radar are:
 Ability to measure very small ranges to the target.
 Ability to measure simultaneously the target range and its
relative velocity;
 Very high accuracy of range measurement;
Gesture recognition methods or literature survey
In Gesture recognition mainly camera based applications are popular
because of this most gesture algorithms works on image based
detection of gesture . Single camera or two camera are used to
capture movements and these are processed frame by frame and
compared with predefined frames this is basic working of camera
based recognition
Wire globs : These can provide input to the computer about the
position and rotation of the hands using magnetic or inertial tracking
devices
Working of sensor:

3. Soli sensor technology works by emitting electromagnetic waves in a
broad beam. Objects within the beam scatter this energy, reflecting
some portion back towards the radar antenna. Properties of the
reflected signal, such as energy, time delay, and frequency shift
capture rich information about the object’s characteristics and
dynamics, including size, shape, orientation, material, distance, and
velocity
By processing these temporal signal variations, Soli can distinguish
complex finger movements and deforming hand shapes within its
field.
Range-Doppler images :Imaging radar is an application
of radar which is used to create two-dimensional images
After this various noise in images is removed and only hand signal is
captured then this image is compared and gesture is detected
This all stages should be done real time.
The developer used neural network to train the system and guess
various patterns. Convolutional neural networks (CNNs) consist of
multiple layers of receptive fields. These are small neuron collections
which process portions of the input image.
Applications:
In video game this sensor can be used as alternative to camera based
sensor or as extra feature this could add extra control for gamers
In home automations application like to control sound of speakers
,turn on off application
Like this in cars can be used to control various applications