Webinar - Enabling Safe, Secure and Enriched Driving Experiences

HARMAN International. Confidential. Copyright 2019. 1
HARMAN WEBINAR:
ENABLING SAFE, SECURE AND
ENRICHED DRIVING EXPERIENCES

HARMAN International. Confidential. Copyright 2019.
1
Presentations Q & A
2 3
AGENDA
Introduction

©2017 HARMAN INTERNATIONAL INDUSTRIES, INCORPORATED
Aaron
Thompson
Director, ADAS Planning &
Marketing
HARMAN International
Aaron.Thompson@harman.com
Greg Bohl
Vice President, AI with ADAS Focus
HARMAN International
Greg.Bohl@harman.com
TODAY’S SPEAKERS

QUESTIONS?
When
Type your message in the
question pane and click
“send”
How
Anytime during the webinar

TWITTER
@HARMAN
@HARMANSERVICES
#DRIVERMONITORING
#AUTOMOTIVE
#CONNECTEDCAR

1
Q & A
3
AGENDA
Introduction Presentations
2

DRIVER MONITORING
SYSTEMS

DRIVER MONITORING FOR SAFETY
8
Drowsiness and Attention
• Drowsiness and Attention being considered for
EU regulation
– Drowsiness to contribute between 10 and 20%
of accidents in EU
• NCAP safety ratings incentivizing driver
monitoring systems into vehicles

DRIVER MONITORING FOR AUTOMATION
9
Conditional Automation
• Driver attention is still
necessary in this situation
due to being a fallback

DRIVER MONITORING TECHNOLOGY
Inference Inputs
• Steering Wheel and Forward Facing Camera
Infrared Camera Systems
• Using a Camera system to detect the driver’s features
• Detecting driver attributes such as:
̶ Head position/orientation, gaze, body position, pupil
position and size, eyelid position, facial cues, hand
position
• To be use in features such as
̶ Attention, Drowsiness, Behavior, Emotion, Cognition
RF Sensors
• Detecting Breathing and Heartrate

DRIVER MONITORING BASIC
FUNCTION SUMMARY
Face Analytics Activity Analytics Body Analytics
Face detection Eating / Drinking Body keypoints
Face recognition Texting Upper body height
Eye movement Using Phone Upper body width
Eyelid movement Using Infotainment Upper body size
Micro-sleep Using Glove box Motion detection
Head pose Sleeping Presence & Location
Head nod / shake Dancing Seat fidget & movement
Gaze tracking Gesturing Posture
Emotions detection Fighting Orientation
Mood metrics
11

Attention and Drowsiness
Driver Detection
Driver Distraction
Drowsiness and Sleep
Detection
Hands on Wheel
Cognitive and Emotional
Load
Driver Engagement
Driver Mood
Cognitive State
Driver State Monitoring
Breathing and Heartrate
Body Position
DRIVER MONITORING

DMS FUNCTIONS AND APPLICATIONS
13
Functions and Applications
• Sleep Detection
• Drowsiness Detection
• Eyelid Movement
• Eye Movement
• Micro-sleep
• Driver Distraction Detection
• Head Pose
• Eating / Drinking
• Phone Usage
• Gaze Tracking
• Texting
• Infotainment Usage
• Cognitive Load
• Emotional Load
• Autonomous Vehicle
Handover
• Driver Engagement
• Hands on Steering
Wheel
• Body Position
• Biometrics
• Theft Prevention
• Driver Preferences
• Driver Detection
• Face Detection
• Face Recognition
PLATFORMFUNCTIONS
SAFETY CRITICAL
NOT SAFETY CRITICAL-
CONVINIENCE
APPLICATIONS

HUMAN FACTORS
Detection
• How do we accurately gauge the driver’s state?
Reaction
• What do we safely change to support the driver?

DRIVER MONITORING SYSTEM TIMELINE
SOURCE: STRATEGY ANALYTICS

OCCUPANT
MONITORING SYSTEMS

ADDITIONAL SAFETY TOOL:
OCCUPANT MONITORING
Occupant Monitoring
Systems, or OMS can
provide additional tools
and technologies to a
DMS system to both
prevent driver distraction
as well as enhance
overall vehicle safety

RGB Camera IR Camera
DEVELOPMENT
PRODUCTION
IN-VEHICLE CAMERA OPTIONS
Like DMS, Both IR and RGB technologies can be used.

OCCUPANT MONITORING SYSTEM
CAMERA POSITION IN VEHICLE

VIEW FROM THE
CAMERA – DETECTING MOOD
View from the camera:
detecting mood from
facial expressions and
body positioning

INTERIOR CAMERA-BASED DMS
VOLUME OF DEMAND BY REGION

INTERIOR CAMERA-BASED DMS
PENETRATION BY REGION

OCCUPANT MONITORING SYSTEMS
24
We will discuss several
OMS use-cases:
Driver actions in the near
environment
Front row environment
Second Row environment
Back row or storage areas

DRIVER DISTRACTION
25

CELL PHONE PLACEMENT
Cell phone placement can be a
major cause of driver distraction:
• Ideally, a driver has paired their
cell phone to the car and placed
it in a secure location
• OMS can alert the driver when:
• The phone is in an
inappropriate location
• If cell phone was left behind
but is visible to one of the
cameras

DRIVER ALERTS – LEFT BEHIND ITEMS
If driver leaves phone when
exiting the vehicle:
• Alerts the driver with the
horn or lights that there’s an
issue with the car
• Message can be displayed on
one of the information
clusters, entertainment
system, or passenger display

OCCUPANT MONITORING – FRONT ROW
28

CAR HIJACKING USE CASE
29

OBJECTS LEFT BEHIND ON SEAT
30
Auto break-in rates are high in many larger cities.
One of the leading causes is a purse, back pack, or
laptop being left in the car.

CHILD SAFETY
31
Many times, a single driver and small
children are the only passengers in a
car.
With OMS – a parent can have eyes in
back of their head!

PET SAFETY
32
… the same is true for pets.

AVOIDING OCCUPANT HARM
Both DMS and OMS can be used to alert
the driver if a baby or animal has been left
in the car when the driver steps area.

SUMMING IT UP – VARIETY OF USE CASES

Thank You
Visit: Car.harman.com

Webinar - Enabling Safe, Secure and Enriched Driving Experiences

Recommended

Recommended

More Related Content

What's hot

What's hot (20)

Similar to Webinar - Enabling Safe, Secure and Enriched Driving Experiences

Similar to Webinar - Enabling Safe, Secure and Enriched Driving Experiences (20)

Recently uploaded

Recently uploaded (20)

Webinar - Enabling Safe, Secure and Enriched Driving Experiences