The Harman International webinar focuses on enabling safe and secure driving experiences through driver monitoring systems (DMS) and occupant monitoring systems (OMS). The session highlights the importance of monitoring driver attentiveness and drowsiness, along with the various functionalities such as detecting distractions, emotions, and biometric data that can enhance overall vehicle safety. Additionally, it discusses practical applications of these technologies in improving safety and preventing theft, as well as addressing concerns like child and pet safety in vehicles.

1. HARMAN International. Confidential. Copyright 2019. 1
HARMAN WEBINAR:
ENABLING SAFE, SECURE AND
ENRICHED DRIVING EXPERIENCES

2. HARMAN International. Confidential. Copyright 2019.
1
Presentations Q & A
2 3
AGENDA
Introduction

3. ©2017 HARMAN INTERNATIONAL INDUSTRIES, INCORPORATED
Aaron
Thompson
Director, ADAS Planning &
Marketing
HARMAN International
Aaron.Thompson@harman.com
Greg Bohl
Vice President, AI with ADAS Focus
HARMAN International
Greg.Bohl@harman.com
TODAY’S SPEAKERS

4. ©2017 HARMAN INTERNATIONAL INDUSTRIES, INCORPORATED
QUESTIONS?
When
Type your message in the
question pane and click
“send”
How
Anytime during the webinar

5. ©2017 HARMAN INTERNATIONAL INDUSTRIES, INCORPORATED
TWITTER
@HARMAN
@HARMANSERVICES
#DRIVERMONITORING
#AUTOMOTIVE
#CONNECTEDCAR

6. ©2017 HARMAN INTERNATIONAL INDUSTRIES, INCORPORATED
1
Q & A
3
AGENDA
Introduction Presentations
2

7. ©2017 HARMAN INTERNATIONAL INDUSTRIES, INCORPORATED
DRIVER MONITORING
SYSTEMS

8. HARMAN International. Confidential. Copyright 2019.
DRIVER MONITORING FOR SAFETY
8
Drowsiness and Attention
• Drowsiness and Attention being considered for
EU regulation
– Drowsiness to contribute between 10 and 20%
of accidents in EU
• NCAP safety ratings incentivizing driver
monitoring systems into vehicles

9. HARMAN International. Confidential. Copyright 2019.
DRIVER MONITORING FOR AUTOMATION
9
Conditional Automation
• Driver attention is still
necessary in this situation
due to being a fallback

10. HARMAN International. Confidential. Copyright 2018.
DRIVER MONITORING TECHNOLOGY
Inference Inputs
• Steering Wheel and Forward Facing Camera
Infrared Camera Systems
• Using a Camera system to detect the driver’s features
• Detecting driver attributes such as:
̶ Head position/orientation, gaze, body position, pupil
position and size, eyelid position, facial cues, hand
position
• To be use in features such as
̶ Attention, Drowsiness, Behavior, Emotion, Cognition
RF Sensors
• Detecting Breathing and Heartrate

11. HARMAN International. Confidential. Copyright 2019.
DRIVER MONITORING BASIC
FUNCTION SUMMARY
Face Analytics Activity Analytics Body Analytics
Face detection Eating / Drinking Body keypoints
Face recognition Texting Upper body height
Eye movement Using Phone Upper body width
Eyelid movement Using Infotainment Upper body size
Micro-sleep Using Glove box Motion detection
Head pose Sleeping Presence & Location
Head nod / shake Dancing Seat fidget & movement
Gaze tracking Gesturing Posture
Emotions detection Fighting Orientation
Mood metrics
11

12. HARMAN International. Confidential. Copyright 2018.
Attention and Drowsiness
Driver Detection
Driver Distraction
Drowsiness and Sleep
Detection
Hands on Wheel
Cognitive and Emotional
Load
Driver Engagement
Driver Mood
Cognitive State
Driver State Monitoring
Breathing and Heartrate
Body Position
DRIVER MONITORING

13. HARMAN International. Confidential. Copyright 2019.
DMS FUNCTIONS AND APPLICATIONS
13
Functions and Applications
• Sleep Detection
• Drowsiness Detection
• Eyelid Movement
• Eye Movement
• Micro-sleep
• Driver Distraction Detection
• Head Pose
• Eating / Drinking
• Phone Usage
• Gaze Tracking
• Texting
• Infotainment Usage
• Cognitive Load
• Emotional Load
• Autonomous Vehicle
Handover
• Driver Engagement
• Hands on Steering
Wheel
• Body Position
• Biometrics
• Theft Prevention
• Driver Preferences
• Driver Detection
• Face Detection
• Face Recognition
PLATFORMFUNCTIONS
SAFETY CRITICAL
NOT SAFETY CRITICAL-
CONVINIENCE
APPLICATIONS

14. HARMAN International. Confidential. Copyright 2018.
HUMAN FACTORS
Detection
• How do we accurately gauge the driver’s state?
Reaction
• What do we safely change to support the driver?

15. HARMAN International. Confidential. Copyright 2019. 15
DRIVER MONITORING SYSTEM TIMELINE
SOURCE: STRATEGY ANALYTICS

16. HARMAN International. Confidential. Copyright 2019. 16
DRIVER MONITORING SYSTEM TIMELINE
SOURCE: STRATEGY ANALYTICS

17. ©2017 HARMAN INTERNATIONAL INDUSTRIES, INCORPORATED
OCCUPANT
MONITORING SYSTEMS

18. HARMAN International. Confidential. Copyright 2017.
ADDITIONAL SAFETY TOOL:
OCCUPANT MONITORING
Occupant Monitoring
Systems, or OMS can
provide additional tools
and technologies to a
DMS system to both
prevent driver distraction
as well as enhance
overall vehicle safety

19. HARMAN International. Confidential. Copyright 2017. 19
RGB Camera IR Camera
DEVELOPMENT
PRODUCTION
IN-VEHICLE CAMERA OPTIONS
Like DMS, Both IR and RGB technologies can be used.

20. HARMAN International. Confidential. Copyright 2017. 20
OCCUPANT MONITORING SYSTEM
CAMERA POSITION IN VEHICLE

21. HARMAN International. Confidential. Copyright 2017. 21
VIEW FROM THE
CAMERA – DETECTING MOOD
View from the camera:
detecting mood from
facial expressions and
body positioning

22. HARMAN International. Confidential. Copyright 2017. 22
INTERIOR CAMERA-BASED DMS
VOLUME OF DEMAND BY REGION

23. HARMAN International. Confidential. Copyright 2017. 23
INTERIOR CAMERA-BASED DMS
PENETRATION BY REGION

24. HARMAN International. Confidential. Copyright 2017. 24
OCCUPANT MONITORING SYSTEMS
24
We will discuss several
OMS use-cases:
Driver actions in the near
environment
Front row environment
Second Row environment
Back row or storage areas

25. HARMAN International. Confidential. Copyright 2017. 25
DRIVER DISTRACTION
25

26. HARMAN International. Confidential. Copyright 2018.
CELL PHONE PLACEMENT
Cell phone placement can be a
major cause of driver distraction:
• Ideally, a driver has paired their
cell phone to the car and placed
it in a secure location
• OMS can alert the driver when:
• The phone is in an
inappropriate location
• If cell phone was left behind
but is visible to one of the
cameras

27. HARMAN International. Confidential. Copyright 2018.
DRIVER ALERTS – LEFT BEHIND ITEMS
If driver leaves phone when
exiting the vehicle:
• Alerts the driver with the
horn or lights that there’s an
issue with the car
• Message can be displayed on
one of the information
clusters, entertainment
system, or passenger display

28. HARMAN International. Confidential. Copyright 2018.
OCCUPANT MONITORING – FRONT ROW
28

29. HARMAN International. Confidential. Copyright 2018.
CAR HIJACKING USE CASE
29

30. HARMAN International. Confidential. Copyright 2018.
OBJECTS LEFT BEHIND ON SEAT
30
Auto break-in rates are high in many larger cities.
One of the leading causes is a purse, back pack, or
laptop being left in the car.

31. HARMAN International. Confidential. Copyright 2018.
CHILD SAFETY
31
Many times, a single driver and small
children are the only passengers in a
car.
With OMS – a parent can have eyes in
back of their head!

32. HARMAN International. Confidential. Copyright 2018.
PET SAFETY
32
… the same is true for pets.

33. HARMAN International. Confidential. Copyright 2017. 33
AVOIDING OCCUPANT HARM
Both DMS and OMS can be used to alert
the driver if a baby or animal has been left
in the car when the driver steps area.

34. HARMAN International. Confidential. Copyright 2017. 34
SUMMING IT UP – VARIETY OF USE CASES

35. ©2017 HARMAN INTERNATIONAL INDUSTRIES, INCORPORATED
Thank You
Visit: Car.harman.com