Both Augmented Reality (AR) & Virtual Reality (VR) can be implemented on smart phones, tablet PCs, near-eye devices (glasses, goggles, helmet or called head-mounted displays HMD), head-up displays (HUD), game console, or TV. Due to different devices, different Human-machine interaction (HMI) sensor technologies are used, these includes: touch sensor, voice command, gesture control, eye-tracking, motion sensor, short range wireless and other sensors. Dr. Colegrove will discuss all these HMI sensor technologies and provide market forecast until 2021. Augmented World Expo (AWE) is back for its seventh year in our largest conference and expo featuring technologies giving us superpowers: augmented reality (AR), virtual reality (VR) and wearable tech. Join over 4,000 attendees from all over the world including a mix of CEOs, CTOs, designers, developers, creative agencies, futurists, analysts, investors, and top press in a fantastic opportunity to learn, inspire, partner, and experience first hand the most exciting industry of our times. See more at http://AugmentedWorldExpo.com

1. June 1, 2016
Jennifer Colegrove, Ph.D.
jc@touchdisplayresearch.com
AUGMENTED REALITY & VIRTUAL REALITY
HUMAN-MACHINE INTERACTION SENSOR
TECHNOLOGIES AND MARKET FORECAST

2. All rights and property of Touch Display Research Inc. 2016
Outline
1. Hot trends in 2016
2. Augmented reality and virtual reality devices
3. Artificial intelligence devices
4. Market driver for sensors
5. Sensor technologies
– Gesture control
– Eye tracking
– Voice recognition
– Other touchless sensors
– Touch sensor and touch pad technologies
6. Sensors for AR, VR, and AI market forecast to 2022
7. Summary and business strategy recommendations

3. All rights and property of Touch Display Research Inc. 2016
Hot Trends in 2016
• Smart home: Google/NestLabs $3.2 B
• 4K, 5K, 8K, transparent
• Quantum dot
• Near-eye devices
• Flexible display, curved
• Touch panel: ITO replacement, in-cell, on-cell
• Touchless control: gesture, voice, proximity
• Google, Apple into automotive
• Active pen: Apple Pencil, Microsoft/N-trig
• Wearable: watches, fitness, baby care, pet tracker
• Authentication: finger print, voice, Iris
• AR & VR
Source:
NestLabs
TDR,
Facebook/Oculus
Source: Touch and Emerging Display monthly report

4. All rights and property of Touch Display Research Inc. 2016
Outline
1. Hot trends in 2016
2. Augmented reality and virtual reality devices
3. Artificial intelligence devices
4. Market driver for sensors
5. Sensor technologies
– Gesture control
– Eye tracking
– Voice recognition
– Other touchless sensors
– Touch sensor and touch pad technologies
6. Sensors for AR, VR, and AI market forecast to 2022
7. Summary and business strategy recommendations

5. All rights and property of Touch Display Research Inc. 2016
AR VR devices
• Augmented reality (AR) devices include:
• Virtual reality (VR) devices include:
Amazon Firephone Samsung Gear VR Nintendo DSi
Octagon
Facebook/Oculus
HTC Vive Toshiba
Source: Touch Display Research, Sensor for AR VR AI 2016 report

6. All rights and property of Touch Display Research Inc. 2016
Artificial Intelligence devices
Amazon
GEMECODViv
FENOTEK
Google
Source: Touch Display Research,
Sensor for AR VR AI 2016 report

7. All rights and property of Touch Display Research Inc. 2016
Outline
1. Hot trends in 2016
2. Augmented reality and virtual reality devices
3. Artificial intelligence devices
4. Market driver for sensors
5. Sensor technologies
– Gesture control
– Eye tracking
– Voice recognition
– Other touchless sensors
– Touch sensor and touch pad technologies
6. Sensors for AR, VR, and AI market forecast to 2022
7. Summary and business strategy recommendations

8. All rights and property of Touch Display Research Inc. 2016
Critical components for AR VR:
Sensors
• In the “Sensor for AR VR AI” 2016 report, Touch Display Research analyzed over
20 sensor technologies, arranged into 10 categories.
10 sensor technologies categories for
AR VR AI
1 Camera-based gesture
2 Camera-based eye tracking
3 Ultrasound or radar-based gesture
4 Voice recognition
5 Photodiode sensor
6 Proximity touch screen
7 Motion sensor fusion
8 Short-range wireless sensor
9 Other touchless tech
10 Touch sensors and touch pad
Source: Touch Display Research,
Sensor for AR VR AI 2016 report

9. All rights and property of Touch Display Research Inc. 2016
Outline
1. Hot trends in 2016
2. Augmented reality and virtual reality devices
3. Artificial intelligence devices
4. Market driver for sensors
5. Sensor technologies
– Gesture control
– Eye tracking
– Voice recognition
– Other touchless sensors
– Touch sensor and touch pad technologies
6. Sensors for AR, VR, and AI market forecast to 2022
7. Summary and business strategy recommendations

10. All rights and property of Touch Display Research Inc. 2016
Touchless sensor companies
• Over 250 touchless sensor suppliers, software companies, system
integrators/brand companies are profiled.
Source: Touch Display Research,
Sensor for AR VR AI 2016 report
Touchless HMI technologies
Companies
in 2015
Companies
in 2016
1 Camera-based gesture 61 67
2 Camera-based eye tracking 11 12
3 Ultrasound or radar based gesture 10 10
4 Voice recognition 31 32
5 Photodiode sensor 15 16
6 Proximity touch screen 8 8
7 Motion sensor fusion 51 52
8 Short-range wireless for wearable 26 26
9 Other touchless tech 26 27
Total >220 >250

11. All rights and property of Touch Display Research Inc. 2016
Camera-based gesture control
• In November 2010, Microsoft adopted PrimeSense’s technology in the Kinect
game console. The game console became very popular with 8 million sold in the
first 2 months in the market.
• In end of 2013, Apple acquired PrimeSense.
• >60 companies
Microsoft
Artheer

12. All rights and property of Touch Display Research Inc. 2016
Eye tracking
• Eye tracking is also called eye control or eye gaze.
• In November 2014, SMI offered eye-tracking HMD upgrade for Oculus Rift
developers version DK2.
• >10 companies
SMI
Fove,
photo by: Touch Display Research

13. All rights and property of Touch Display Research Inc. 2016
Outline
1. Hot trends in 2016
2. Augmented reality and virtual reality devices
3. Artificial intelligence devices
4. Market driver for sensors
5. Sensor technologies
– Gesture control
– Eye tracking
– Voice recognition
– Other touchless sensors
– Touch sensor and touch pad technologies
6. Sensors for AR, VR, and AI market forecast to 2022
7. Summary and business strategy recommendations

14. All rights and property of Touch Display Research Inc. 2016
Voice control
• Voice control is also called voice recognition, or voice command.
• The benefits of voice control include:
– 1. Safety.
– 2. Faster.
– 3. Voice control doesn’t take large spaces.
• Voice control has a big challenge--accuracy.
• >30 companies
Google TV voice search
Viv

15. All rights and property of Touch Display Research Inc. 2016
Other touchless sensors
• Motion sensor: Accelerometer, Gyroscope,
Magnetic Sensors, Pressure
sensors(Barometers).
• Photodiode sensor
• Proximity touch sensor
• Short-range Wireless: NFC, RFID, Bluetooth
• Muscle sensor: electromyographic (EMG)
sensor.
• Brain wave sensor
Source: Kionix
Source: Microchip
Source: Myo

16. All rights and property of Touch Display Research Inc. 2016
Touch sensor/pad
• Touch sensor market has been growing explosively since 2006.
• There are over a dozen touch technologies.
• Touch pad for Gear VR
Samsung Gear VR
Touch pad with grove

17. All rights and property of Touch Display Research Inc. 2016
Outline
1. Hot trends in 2016
2. Augmented reality and virtual reality devices
3. Artificial intelligence devices
4. Market driver for sensors
5. Sensor technologies
– Gesture control
– Eye tracking
– Voice recognition
– Other touchless sensors
– Touch sensor and touch pad technologies
6. Sensors for AR, VR, and AI market forecast to 2022
7. Summary and business strategy recommendations

18. All rights and property of Touch Display Research Inc. 2016
Sensor market forecast for AR VR and
AI
• Touch Display Research forecasts that the sensor for AR VR and AI market will
continue to have rapid growth. Over 10 billion sensors will be adopted for AR,
VR, AI market in 2017, which is $96.9 billion in value. The sensor for these
markets will reach $160 billion in 2022.
©Touch Display Research
©TouchDisplayResearch
Source: Touch Display Research,
Sensor for AR VR and AI 2016 report

19. All rights and property of Touch Display Research Inc. 2016
Summary and Business Strategies
Recommendation
• Hot trends in 2016: Smart home, quantum dot, flexible/curved, 4K, ITO
replacement, near eye, wearable.
• Augmented reality (AR), virtual reality (VR), and artificial intelligence (AI)
devices include advanced smart phones, tablet PCs, digital signage, some head
mounted displays (HMD), and head up displays for automobiles.
• Sensors are critical components for AR, VR and AI devices.
• Touch Display Research forecasts that the sensor for AR VR and AI market will
continue to have rapid growth. Over 10 billion sensors will be adopted for AR,
VR, AI market in 2017, which is $96.9 billion in value. The sensor for these
markets will reach $160 billion in 2022.
• We recommend industries to adopt more sensor tech for the benefit of easy
control, intuitive, convenience, faster result, power saving, safety, intelligence,
fun, coolness.
• We recommend sensor manufactures to work on sensor integrations for low
cost, small foot print, and fast to market.

20. THANK YOU!
jc@TouchDisplayResearch.com
Market Research
Reports:
Touch Display Research
provides out-of-shelf
reports on touch,
displays, sensors, and
emerging technologies.
Speaking:
Touch Display
Research provides
tutorial or speaking at
company’s sites or
conferences.
Consulting:
Touch Display
Research provides
customized
consulting reports,
due diligence,
analyst phone call,
and industry match-
making services.