MicroVision's MEMS Laser Beam Scanning Technology applied to HUD and ADAS applications presentation by Jari Honkanen at the MEMS & Sensors Executive Congress 2016, Scottsdale, AZ, November 10-11, 2016
#StandardsGoals for 2024: What’s new for BISAC - Tech Forum 2024
MEMS and Sensors in Automotive Applications on the Road to Autonomous Vehicles: HUD and ADAS
1. Don’t just think outside the box.
See outside the box.
MEMS and Sensors in Automotive Applications on the
Road to Autonomous Vehicles: HUD and ADAS
Jari Honkanen
Rev. 0.3; Nov 10, 2016
2. 2 MICROVISION, INC. COPYRIGHT 2016. ALL RIGHTS RESERVED.4/30/2017
What are Autonomous Vehicles?
Self-driving cars with sensors [and MEMS] able to observe and understand
surroundings
3. 4/30/20173 MICROVISION, INC. COPYRIGHT 2016. ALL RIGHTS RESERVED.
Agenda
Autonomous Vehicles
• Evolution of Automation
• Market Opportunity
• Enabling Sensor Technologies
• Case Study:
• MicroVision MEMS for HUD Applications
• MicroVision MEMS for LIDAR Applications
• Conclusions & Call to Action
4. 4 MICROVISION, INC. COPYRIGHT 2016. ALL RIGHTS RESERVED.4/30/2017
Evolution of Automation
SAE (Society of Automotive Engineers) has defined six different levels for self-driving cars,
ranging from complete driver control to complete autonomy.
Levels 0-2: Human Driver monitors the
driving environment
Source: MarketWatch research, SAE International
5. 5 MICROVISION, INC. COPYRIGHT 2016. ALL RIGHTS RESERVED.4/30/2017
Automated Functions Today
Manual Driving
Automatic Transmission
Cruise Control
ABS & Stability System
Electric Power Steering
Assisted Driving – Human Driver in Control
Adaptive Cruise Control
Collision Warning System
Lane Departure Warning
Lane Keep Assist
Head-Up Display (HUD)
Blind Spot Monitor
Parking Assist
Traffic Sign Recognition
Adaptive High Beams
6. 6 MICROVISION, INC. COPYRIGHT 2016. ALL RIGHTS RESERVED.4/30/2017
Evolution of Automation
SAE (Society of Automotive Engineers) has defined six different levels for self-driving cars,
ranging from complete driver control to complete autonomy.
Levels 0-2: Human Driver monitors the
driving environment
Levels 3-5: Automated Driving System
monitors the driving environment
7. 7 MICROVISION, INC. COPYRIGHT 2016. ALL RIGHTS RESERVED.4/30/2017
Automated Functions in the Future
Automated Driving System in Control
Level 3: Within known, limited environments (such as
freeways), the driver can safely turn their attention
away from driving tasks.
Source: https://en.wikipedia.org/wiki/Autonomous_car
Level 4: The automated system can control the vehicle
in all but a few environments such as severe weather.
The driver must enable the automated system only
when it is safe to do so. When enabled, driver attention
is not required.
Level 5: Other than setting the destination and
starting the system, no human intervention is required.
The automatic system can drive to any location where
it is legal to drive.
8. 8 MICROVISION, INC. COPYRIGHT 2016. ALL RIGHTS RESERVED.4/30/2017
Market Opportunity: Evolution of Automotive Electronics
Value in cars is shifting from chassis and drivetrain into electronics and sensors.
1%
3% 4%
10%
15%
20%
30%
35%
50%
0%
10%
20%
30%
40%
50%
60%
1950 1960 1970 1980 1990 2000 2010 2020 2030
Automotive electronics cost as a percentage of total
car cost (1950 - 2030)
Source: Statista
9. 9 MICROVISION, INC. COPYRIGHT 2016. ALL RIGHTS RESERVED.4/30/2017
Market Opportunity: Growing Automotive Sales
2015 record auto sales in the U.S. at 17.5M
39.2
52.57
68.65 71.17 72.37 74.39
100
0
20
40
60
80
100
120
1990 - 1999 2000 - 2012 2013 2014 2015 2016 2020
Number of cars sold worldwide annually
from 1990 to 2020 (in million units)
Source: Statista
Global car sales are expected to exceed 100 million units by 2020
10. 10 MICROVISION, INC. COPYRIGHT 2016. ALL RIGHTS RESERVED.4/30/2017
Possible Sensor technologies for Autonomous Vehicles
Lidar
Camera
Radar
GPS
Ultrasonic
Odometry
Central
Computer Inertial
Sensors
11. 11 MICROVISION, INC. COPYRIGHT 2016. ALL RIGHTS RESERVED.4/30/2017
Sensors enabling Autonomous Vehicles to “see”
Source: Delphi
Camera
• Camera records video interpreted by computer
vision algorithms.
• Pros: Can distinguish and classify objects, such
as signs, lane markings, traffic lights. May also be
able to classify more complex objects such
as animals and pedestrians.
• Cons: Can only see what camera can
see, challenges in low light or bright
sun light`
12. 12 MICROVISION, INC. COPYRIGHT 2016. ALL RIGHTS RESERVED.4/30/2017
Sensors enabling Autonomous Vehicles to “see”
Source: Delphi
Radar
• Car transmits radio waves and interprets the
back reflection from objects
• Pros: Can detect large objects and can easily
calculate speed and distance. Works in all
weather and lighting conditions, day or night.
•
Cons: Cannot distinguish color or differentiate
between objects. All same size objects look the
same.
13. 13 MICROVISION, INC. COPYRIGHT 2016. ALL RIGHTS RESERVED.4/30/2017
Sensors enabling Autonomous Vehicles to “see”
Source: Delphi
LIDAR
• Car transmits light pulses and interprets the
back reflection from objects
• Pros: Can detect specific objects and calculate
distance. Can detect lines and edges of the road.
Works during day and in the dark at night,
•
Cons: In inclement weather, the light can reflect
from rain, snow, or fog, reducing the
effectiveness and detection range.
14. 14 MICROVISION, INC. COPYRIGHT 2016. ALL RIGHTS RESERVED.4/30/2017
Sensor Technologies: One size does not fit all
Autonomous Vehicles will utilize variety of sensor technologies
Different Sensors have different strengths and weaknesses
Multiple sensors for redundancy and safety
Sensor Fusion
Source: Design News, April 2016
16. 16 MICROVISION, INC. COPYRIGHT 2016. ALL RIGHTS RESERVED.4/30/2017
Safety improvement for Assisted Driving - HUD
• A Head-Up Display (HUD) overlays essential
information on top of the driving scene ahead
so that the driver can consume the information
without taking eyes of the road.
• Essential information may include
• For Manual Driving:
• Speed
• Gear & RPM
• Navigation info
• For Assisted Driving:
• Adaptive Cruise Control state
• Lane Departure Warning
• Blind Spot Warning
• Obstacle Ahead Alert
• Traffic Signs
Source: Continental
17. 17 MICROVISION, INC. COPYRIGHT 2016. ALL RIGHTS RESERVED.4/30/2017
Application Industry Drivers
Industry
Growth
AR / VR
Display
194%Personal Mobility
Heads-Up
Display
27%Driver Safety & Infotainment
Sources: AR / VR Display: CAGR 2014 – 2019, Source: TechNavio; Heads-Up Display: CAGR 2014 – 2024, ABI Research; 3D Imaging & Sensing: CAGR 2014 – 2020, Source: Markets&Markets; Personal Projection: CAGR 2014 –
2019, Source: TechNavio;
Case Study: MEMS for Automotive Laser HUD
Platform
Technology
3D Imaging
& Sensing
23.4%Information Capture
MicroVision’s Laser Beam Scanning Technology is a platform approach, applying one solution across
multiple markets – at the heart of which is MicroVision’s MEMS scanner
Mobile
Projection
Anytime, Anywhere Content Sharing 32.4%
18. 18 MICROVISION, INC. COPYRIGHT 2016. ALL RIGHTS RESERVED.4/30/2017
PicoP® Scanning Technology - Projection Display
Red laser
Green laserBlue laser
2D MEMS
Micro mirror
Case Study: How PicoP® Scanning Technology Works
A single MEMS
scanning mirror
in an extremely tiny,
low power package
19. 19 MICROVISION, INC. COPYRIGHT 2016. ALL RIGHTS RESERVED.4/30/2017
Case Study: PicoP® Scanning Technology for HUD
Optical Layout of MEMS Scanned Laser Virtual Image HUD
Realization of MEMS Scanned Laser Virtual Image HUD
20. 20
MICROVISION, INC. PROPRIETARY AND CONFIDENTIAL
COPYRIGHT 2016. ALL RIGHTS RESERVED.
4/30/2017
Laser Scanning
HUD installed in car
dash
Virtual image
1.5 - 2.5m away
Virtual image seen
within eyebox
Image reflected off coated
windshield or combiner
Case Study: MEMS Virtual Image HUD Overview
21. 21
MICROVISION, INC. PROPRIETARY AND CONFIDENTIAL
COPYRIGHT 2016. ALL RIGHTS RESERVED.
4/30/2017
Case Study: Benefits of using MEMS Laser Scanning for
HUD
Embedded
Aftermarket
Image Quality
• Highest Contrast Ratio
• Widest Color Gamut
• No Background Glow
• Sunlight Readable
Display Performance
• High System Brightness
• Large Field of View
• Large Dimming Ratio
• Small Display Engine Size
• High Brightness / Power Ratio
23. 23
MICROVISION, INC. PROPRIETARY AND CONFIDENTIAL
COPYRIGHT 2016. ALL RIGHTS RESERVED.
4/30/2017
Today: LIDAR in Autonomous Vehicle Prototypes
• Single long-range LIDAR
• Typically mounted on the roof of the car
• Environmental mapping and modeling
Today’s Representative LIDAR Specs
• Range: 100 – 150m
• FOV: 360° x 30°
• Data rate: 300k – 2.2M points/sec
• Frame rate: 5 – 20Hz
• Horizontal Resolution: 900 – 3,600
• Vertical Resolution: 16 – 64
• Price: $8K - $80K
24. 24
MICROVISION, INC. PROPRIETARY AND CONFIDENTIAL
COPYRIGHT 2016. ALL RIGHTS RESERVED.
4/30/2017
Applications for mid-range high resolution computer vision
Rear collision warning
Parking Assist
Parking Assist
Cross traffic alert
Stop and Go
Blind Spot Detection
Curb Detection
Lane Assist and Departure warning
25. 25 MICROVISION, INC. COPYRIGHT 2016. ALL RIGHTS RESERVED.4/30/2017
Application Industry Drivers
Industry
Growth
AR / VR
Display
194%Personal Mobility
Heads-Up
Display
27%Driver Safety & Infotainment
Sources: AR / VR Display: CAGR 2014 – 2019, Source: TechNavio; Heads-Up Display: CAGR 2014 – 2024, ABI Research; 3D Imaging & Sensing: CAGR 2014 – 2020, Source: Markets&Markets; Personal Projection: CAGR 2014 –
2019, Source: TechNavio;
Case Study: MEMS for Automotive LIDAR
Platform
Technology
3D Imaging
& Sensing
23.4%Information Capture
MicroVision’s Laser Beam Scanning Technology is a platform approach, applying one solution across
multiple markets – at the heart of which is MicroVision’s MEMS scanner
Mobile
Projection
Anytime, Anywhere Content Sharing 32.4%
26. 26
MICROVISION, INC. PROPRIETARY AND CONFIDENTIAL
COPYRIGHT 2016. ALL RIGHTS RESERVED.
4/30/2017
2D MEMS
Micro mirror
IR laser
IR Photodiode
Case Study: How MEMS Technology for mid-range LIDAR works
IR laser
IR laser
👈
👈
27. 27 MICROVISION, INC. COPYRIGHT 2016. ALL RIGHTS RESERVED.4/30/2017
Case Study: Mid-Range Automotive LIDAR
• Multiple cost effective mid-range LIDARs for performing
different functions
• High resolution vision
• Multiple sensors for redundancy and safety
Mid-Range LIDAR Target Specs
• Range: 10-15m
• FOV: 90° x 30°
• Data rate: 5.5M points/sec
• Frame rate: 30Hz
• Horizontal Resolution: 512
• Vertical Resolution: 360
28. 28
MICROVISION, INC. PROPRIETARY AND CONFIDENTIAL
COPYRIGHT 2016. ALL RIGHTS RESERVED.
4/30/2017
Case Study: Benefits of using MEMS Laser Scanning for
Mid-Range LIDAR
Low
Persistence
(~15ns)
Enables blur free
capture of moving
objects
Cost Effective
(Re-uses existing MEMS
technology)
Enables new class of
applications
Highest
Resolution
(~5.5M points/sec)
Enables advanced
applications
Smallest Size
(Thinnest at 6mm)
Enables new class of
form factors
Dynamic
(Programmable
Resolution and Frame
Rate)
Enables both slower
high resolution and
faster lower resolution
captures depending on
the application or
driving situation
30. 30
MICROVISION, INC. PROPRIETARY AND CONFIDENTIAL
COPYRIGHT 2016. ALL RIGHTS RESERVED.
4/30/2017
Challenges ahead for Autonomous Vehicles
(Trouble in Paradise)
• Vehicle innovations tend to be realized more slowly than other technological advances due to their
high costs, slow fleet turnover and strict safety requirements. Technical obstacles that need to be
addressed:
• Software reliability
• Car’s sensing and navigation systems susceptibility to different types of weather conditions
or deliberate interference (jamming and spoofing)
• Securing car’s central computer from hacking
• Availability to high-quality, accurate, and up to date maps
• Availability of radio spectrum for V2V (vehicle-to-vehicle) and V2I (vehicle-to-infrastructure)
communications
• Legislation and regulations need to catch up:
• Implementation of legal framework and establishment of government regulations for
autonomous vehicles.
• Insurance, who is liable for accidents of autonomous vehicles?
• Individual perceptions and attitudes need to evolve:
• Resistance by individuals to forfeit control of their cars
• Customer concern about the safety of driverless cars
• Loss of driving-related jobs. Resistance from professional drivers and unions.
31. 31
MICROVISION, INC. PROPRIETARY AND CONFIDENTIAL
COPYRIGHT 2016. ALL RIGHTS RESERVED.
4/30/2017
Conclusion & Call to Action
• The value of cars are shifting from chassis and drivetrain to electronics,
sensors, and software.
-> Large opportunity for MEMS & Sensors industry
• And finally, automation in cars can bring significant benefits to the society in
large: reduced accidents and traffic fatalities, less pollution, increased
productivity.
-> Opportunity to MEMS & Sensor industry to do good and do well at
the same time
• However, designing MEMS to meet automotive quality standards can
be challenging
-> Consider automotive requirements from the beginning
• Automotive supply chain can be complex and difficult to penetrate
-> Look to partner with established OEM, Tier 1, or Tier 2
companies (depending on the application)