MEMS and Sensors in Automotive Applications on the Road to Autonomous Vehicles: HUD and ADAS

Don’t just think outside the box.
See outside the box.
MEMS and Sensors in Automotive Applications on the
Road to Autonomous Vehicles: HUD and ADAS
Jari Honkanen
Rev. 0.3; Nov 10, 2016

2 MICROVISION, INC. COPYRIGHT 2016. ALL RIGHTS RESERVED.11/28/2016
What are Autonomous Vehicles?
 Self-driving cars with sensors [and MEMS] able to observe and understand
surroundings

11/28/20163 MICROVISION, INC. COPYRIGHT 2016. ALL RIGHTS RESERVED.
Agenda
Autonomous Vehicles
• Evolution of Automation
• Market Opportunity
• Enabling Sensor Technologies
• Case Study:
• MicroVision MEMS for HUD Applications
• MicroVision MEMS for LIDAR Applications
• Conclusions & Call to Action

Evolution of Automation
 SAE (Society of Automotive Engineers) has defined six different levels for self-driving cars,
ranging from complete driver control to complete autonomy.
Levels 0-2: Human Driver monitors the
driving environment
Source: MarketWatch research, SAE International

Automated Functions Today
 Manual Driving
 Automatic Transmission
 Cruise Control
 ABS & Stability System
 Electric Power Steering
 Assisted Driving – Human Driver in Control
 Adaptive Cruise Control
 Collision Warning System
 Lane Departure Warning
 Lane Keep Assist
 Head-Up Display (HUD)
 Blind Spot Monitor
 Parking Assist
 Traffic Sign Recognition
 Adaptive High Beams

Evolution of Automation
 SAE (Society of Automotive Engineers) has defined six different levels for self-driving cars,
ranging from complete driver control to complete autonomy.
Levels 0-2: Human Driver monitors the
driving environment
Levels 3-5: Automated Driving System
monitors the driving environment

Automated Functions in the Future
 Automated Driving System in Control
 Level 3: Within known, limited environments (such as
freeways), the driver can safely turn their attention
away from driving tasks.
Source: https://en.wikipedia.org/wiki/Autonomous_car
 Level 4: The automated system can control the vehicle
in all but a few environments such as severe weather.
The driver must enable the automated system only
when it is safe to do so. When enabled, driver attention
is not required.
 Level 5: Other than setting the destination and
starting the system, no human intervention is required.
The automatic system can drive to any location where
it is legal to drive.

Market Opportunity: Evolution of Automotive Electronics
 Value in cars is shifting from chassis and drivetrain into electronics and sensors.
1%
3% 4%
10%
15%
20%
30%
35%
50%
0%
10%
20%
30%
40%
50%
60%
1950 1960 1970 1980 1990 2000 2010 2020 2030
Automotive electronics cost as a percentage of total
car cost (1950 - 2030)
Source: Statista

Market Opportunity: Growing Automotive Sales
 2015 record auto sales in the U.S. at 17.5M
39.2
52.57
68.65 71.17 72.37 74.39
100
0
20
40
60
80
100
120
1990 - 1999 2000 - 2012 2013 2014 2015 2016 2020
Number of cars sold worldwide annually
from 1990 to 2020 (in million units)
Source: Statista
 Global car sales are expected to exceed 100 million units by 2020

Possible Sensor technologies for Autonomous Vehicles
Lidar
Camera
Radar
GPS
Ultrasonic
Odometry
Central
Computer Inertial
Sensors

Sensors enabling Autonomous Vehicles to “see”
Source: Delphi
Camera
• Camera records video interpreted by computer
vision algorithms.
• Pros: Can distinguish and classify objects, such
as signs, lane markings, traffic lights. May also be
able to classify more complex objects such
as animals and pedestrians.
• Cons: Can only see what camera can
see, challenges in low light or bright
sun light`

Source: Delphi
Radar
• Car transmits radio waves and interprets the
back reflection from objects
• Pros: Can detect large objects and can easily
calculate speed and distance. Works in all
weather and lighting conditions, day or night.
•
Cons: Cannot distinguish color or differentiate
between objects. All same size objects look the
same.

Source: Delphi
LIDAR
• Car transmits light pulses and interprets the
back reflection from objects
• Pros: Can detect specific objects and calculate
distance. Can detect lines and edges of the road.
Works during day and in the dark at night,
•
Cons: In inclement weather, the light can reflect
from rain, snow, or fog, reducing the
effectiveness and detection range.

Sensor Technologies: One size does not fit all
 Autonomous Vehicles will utilize variety of sensor technologies
 Different Sensors have different strengths and weaknesses
 Multiple sensors for redundancy and safety
 Sensor Fusion
Source: Design News, April 2016

Case Study: MEMS for Automotive
Head-Up Display (HUD)

Safety improvement for Assisted Driving - HUD
• A Head-Up Display (HUD) overlays essential
information on top of the driving scene ahead
so that the driver can consume the information
without taking eyes of the road.
• Essential information may include
• For Manual Driving:
• Speed
• Gear & RPM
• Navigation info
• For Assisted Driving:
• Adaptive Cruise Control state
• Lane Departure Warning
• Blind Spot Warning
• Obstacle Ahead Alert
• Traffic Signs
Source: Continental

Application Industry Drivers
Industry
Growth
AR / VR
Display
194%Personal Mobility
Heads-Up
Display
27%Driver Safety & Infotainment
Sources: AR / VR Display: CAGR 2014 – 2019, Source: TechNavio; Heads-Up Display: CAGR 2014 – 2024, ABI Research; 3D Imaging & Sensing: CAGR 2014 – 2020, Source: Markets&Markets; Personal Projection: CAGR 2014 –
2019, Source: TechNavio;
Case Study: MEMS for Automotive Laser HUD
Platform
Technology
3D Imaging
& Sensing
23.4%Information Capture
MicroVision’s Laser Beam Scanning Technology is a platform approach, applying one solution across
multiple markets – at the heart of which is MicroVision’s MEMS scanner
Mobile
Projection
Anytime, Anywhere Content Sharing 32.4%

PicoP® Scanning Technology - Projection Display
Red laser
Green laserBlue laser
2D MEMS
Micro mirror
Case Study: How PicoP® Scanning Technology Works
A single MEMS
scanning mirror
in an extremely tiny,
low power package

Case Study: PicoP® Scanning Technology for HUD
Optical Layout of MEMS Scanned Laser Virtual Image HUD
Realization of MEMS Scanned Laser Virtual Image HUD

Laser Scanning
HUD installed in car
dash
Virtual image
1.5 - 2.5m away
Virtual image seen
within eyebox
Image reflected off coated
windshield or combiner
Case Study: MEMS Virtual Image HUD Overview

Case Study: Benefits of using MEMS Laser Scanning for
HUD
Embedded
Aftermarket
Image Quality
• Highest Contrast Ratio
• Widest Color Gamut
• No Background Glow
• Sunlight Readable
Display Performance
• High System Brightness
• Large Field of View
• Large Dimming Ratio
• Small Display Engine Size
• High Brightness / Power Ratio

Case Study: MEMS for Automotive
Mid-Range LIDAR

Today: LIDAR in Autonomous Vehicle Prototypes
• Single long-range LIDAR
• Typically mounted on the roof of the car
• Environmental mapping and modeling
Today’s Representative LIDAR Specs
• Range: 100 – 150m
• FOV: 360° x 30°
• Data rate: 300k – 2.2M points/sec
• Frame rate: 5 – 20Hz
• Horizontal Resolution: 900 – 3,600
• Vertical Resolution: 16 – 64
• Price: $8K - $80K

Applications for mid-range high resolution computer vision
Rear collision warning
Parking Assist
Parking Assist
Cross traffic alert
Stop and Go
Blind Spot Detection
Curb Detection
Lane Assist and Departure warning

Application Industry Drivers
Industry
Growth
AR / VR
Display
194%Personal Mobility
Heads-Up
Display
27%Driver Safety & Infotainment
Sources: AR / VR Display: CAGR 2014 – 2019, Source: TechNavio; Heads-Up Display: CAGR 2014 – 2024, ABI Research; 3D Imaging & Sensing: CAGR 2014 – 2020, Source: Markets&Markets; Personal Projection: CAGR 2014 –
2019, Source: TechNavio;
Case Study: MEMS for Automotive LIDAR
Platform
Technology
3D Imaging
& Sensing
23.4%Information Capture
MicroVision’s Laser Beam Scanning Technology is a platform approach, applying one solution across
multiple markets – at the heart of which is MicroVision’s MEMS scanner
Mobile
Projection
Anytime, Anywhere Content Sharing 32.4%

2D MEMS
Micro mirror
IR laser
IR Photodiode
Case Study: How MEMS Technology for mid-range LIDAR works
IR laser
IR laser
👈
👈

Case Study: Mid-Range Automotive LIDAR
• Multiple cost effective mid-range LIDARs for performing
different functions
• High resolution vision
• Multiple sensors for redundancy and safety
Mid-Range LIDAR Target Specs
• Range: 10-15m
• FOV: 90° x 30°
• Data rate: 5.5M points/sec
• Frame rate: 30Hz
• Horizontal Resolution: 512
• Vertical Resolution: 360

Case Study: Benefits of using MEMS Laser Scanning for
Mid-Range LIDAR
Low
Persistence
(~15ns)
Enables blur free
capture of moving
objects
Cost Effective
(Re-uses existing MEMS
technology)
Enables new class of
applications
Highest
Resolution
(~5.5M points/sec)
Enables advanced
applications
Smallest Size
(Thinnest at 6mm)
Enables new class of
form factors
Dynamic
(Programmable
Resolution and Frame
Rate)
Enables both slower
high resolution and
faster lower resolution
captures depending on
the application or
driving situation

Challenges ahead for Autonomous Vehicles
(Trouble in Paradise)
• Vehicle innovations tend to be realized more slowly than other technological advances due to their
high costs, slow fleet turnover and strict safety requirements. Technical obstacles that need to be
addressed:
• Software reliability
• Car’s sensing and navigation systems susceptibility to different types of weather conditions
or deliberate interference (jamming and spoofing)
• Securing car’s central computer from hacking
• Availability to high-quality, accurate, and up to date maps
• Availability of radio spectrum for V2V (vehicle-to-vehicle) and V2I (vehicle-to-infrastructure)
communications
• Legislation and regulations need to catch up:
• Implementation of legal framework and establishment of government regulations for
autonomous vehicles.
• Insurance, who is liable for accidents of autonomous vehicles?
• Individual perceptions and attitudes need to evolve:
• Resistance by individuals to forfeit control of their cars
• Customer concern about the safety of driverless cars
• Loss of driving-related jobs. Resistance from professional drivers and unions.

Conclusion & Call to Action
• The value of cars are shifting from chassis and drivetrain to electronics,
sensors, and software.
-> Large opportunity for MEMS & Sensors industry
• And finally, automation in cars can bring significant benefits to the society in
large: reduced accidents and traffic fatalities, less pollution, increased
productivity.
-> Opportunity to MEMS & Sensor industry to do good and do well at
the same time
• However, designing MEMS to meet automotive quality standards can
be challenging
-> Consider automotive requirements from the beginning
• Automotive supply chain can be complex and difficult to penetrate
-> Look to partner with established OEM, Tier 1, or Tier 2
companies (depending on the application)

DON’T JUST THINK OUTSIDE THE BOX.
SEE OUTSIDE THE BOX.
© 2016 MICROVISION, INC. ALL RIGHTS RESERVED.
PICOP IS A REGISTERED TRADEMARK OF MICROVISION, INC. ALL OTHER TRADEMARKS ARE
THE PROPERTY OF THEIR RESPECTIVE OWNERS.

MEMS and Sensors in Automotive Applications on the Road to Autonomous Vehicles: HUD and ADAS

Recommended

Recommended

More Related Content

What's hot

What's hot (20)

Similar to MEMS and Sensors in Automotive Applications on the Road to Autonomous Vehicles: HUD and ADAS

Similar to MEMS and Sensors in Automotive Applications on the Road to Autonomous Vehicles: HUD and ADAS (20)

Recently uploaded

Recently uploaded (20)

MEMS and Sensors in Automotive Applications on the Road to Autonomous Vehicles: HUD and ADAS