Google’s PROJECT SOLI by Advanced Technology And Project group[ATAP]. A new gesture Recognition sensor. Presented By Anand Namastemath.

1. Submitted By
Anand Namastemath
Under The Guidance of
Prof. Swathi Shastry

2. ABSTRACT:
Google’s ATAP came up with a new, robust, and unimaginable concept called PROJECT
SOLI. This technology considers the human gesture as input to enable new types of touchless interactions.
Project Soli uses portable smart radar sensor to recognize the human gesture based on pattern recognition. The
Soli’s radar sensor can track sub-millimeter motion at high speed and accuracy. The sensor captures the
gestures movements of the human. Some special task on a device can be done using these gestures.

3. INTRODUCTION:
• This project is headed by Ivan Poupyrev.
• Soli was announced at Google I/O 2015.
• Soli is a new Gesture sensing technology for human-
computer interaction.
• Soli is a millimetre-wave radar that can detect micro
motion of human hand.
• To track human hand, Radars have been used for many
different things, to track cars, big objects, satellites, and
planes.

4. INTRODUCTION TO RADAR:
• Radar is a technology which transmits a radio wave
towards a target and then the receiver of the radar
intercepts the reflected energy from the target.
• . The reason to interpret so much from this one Radar
signal because of the full gesture recognition pipeline
that is built.
• Radar has some unique properties when compared to
Cameras, for example, it has very high positional
accuracy, which means that we can sense the tiniest
motions.

5. LITERATURE SURVEY:
• Erol, A., G. Bebis, M. Nicolescu, R. D. Boyle, and X. Twombly. Vision-based hand pose estimation: A review. Comput.
Vision Image Understanding 108, 1-2 (Oct. 2007), 52–73.
A number of camera based solutions exist, with early work focusing on 2D RGB cameras.
• Kim, D., O. Hilliges, S. Izadi, A. D. Butler, J. Chen, I. Oikonomidis, and P. Olivier. Digits: Freehand 3D interactions
anywhere using a wrist-worn gloveless sensor. In Proc. ACM UIST, 2012, 167.
In-air gestures in onthe-go scenarios have been shown using either wrist-worn cameras [20]
• Chen, K.-Y., K. Lyons, S. White, and S. Patel. uTrack: 3D input using two magnetic sensors. In Proc. ACM UIST, Oct.
2013, 237–244.
More recent methods have enabled fine-grained 3D hand-pose estimation in real-time from depth-images.

6. BLOCK LEVEL EXPLANATION:

7. APPLICATIONS:
•In medical field
•In Wearable's
•Gaming
•IOT
•Smart Phones
•Smart Tabs.

8. ADVANTAGES:
• It can easily be used in even the smallest wearable.
• It is capable of accurately detecting hand movements in
real-time.
• The soli chip is small in size of 5x5 mm.
• It has a sensor which can capture a very tiny movements
of hands in 3D space.
• It capture motions of hand at a rate of 10,000
frames/second.

9. DISADVANTAGES:
•It has a limited radar range.
•Multiple gestures could not be possible at a time.
•Gestures will be predefined.
•Highly expensive.
•Security threat.

10. CONCLUSION:
• One of the big problems with Soli’s sensor enabled
device right now is inputs - there's no simple way to
control these devices.
• Therefore gestures will be used by individuals to carry
out certain functions with wearables.

11. REFERENCES:
[1]. Project Soli information document.
[2]. Soli: Ubiquitous Gesture Sensing with Millimeter Wave Radar. Jaime Lien , Nicholas Gillian, M. Emre Karagozler,
Patrick Amihood, Carsten Schwesig, Erik Olson, Hakim Raja, Ivan Poupyrev Google ATAP.
[3]. Interacting with Soli: Exploring Fine-Grained Dynamic Gesture Recognition in the Radio-Frequency Spectrum.
Saiwen Wang , Jie Song , Jaime Lien , Ivan Poupyrev , Otmar Hilliges ETH Zurich, Google ATAP.
{jsong|otmar.hilliges}@inf.ethz.ch, sawang@student.ethz.ch, {jaimelien|ipoupyrev}@google.com.
[4]. Erol, A., G. Bebis, M. Nicolescu, R. D. Boyle, and X. Twombly. Vision-based hand pose estimation: A review. Comput.
Vision Image Understanding 108, 1-2 (Oct. 2007).
[5]. Chen, K.-Y., K. Lyons, S. White, and S. Patel. uTrack: 3D input using two magnetic sensors. In Proc. ACM UIST, Oct.
2013.