This document discusses how artificial intelligence can be used for road safety and sustainable urban mobility. It describes how AI-powered driver monitoring systems and advanced driver assistance systems can help reduce road accidents by detecting distracted or drowsy driving. It also discusses how AI and computer vision can help protect vulnerable road users like pedestrians and cyclists. Finally, the document outlines how smart infrastructure like connected traffic lights and roadside sensors using AI can help manage traffic flow and prioritize emergency vehicles. The overall aim is to accelerate the UN's goal of reducing road deaths and injuries by 50% by 2030 through innovative applications of AI technology.

1. February 2022
A.I for Road Safety:
Keystone for a Sustainable Urban Mobility
Thierry LESTABLE, Ph.D
Director, Head of Automotive & e-Mobility Solutions Business Dept
SAGEMCOM
Source: Nvidia

2. BeMyGuest – February 2022

3. BeMyGuest – February 2022
Global Status Report on Road Safety - 2018
VRU:
Vulnerable Road Users
50 Millions injured

4. BeMyGuest – February 2022
A.I for Road Safety → 2030
« Accelerating the United Nations
Sustainable Development Goals (SDG)»
Road traffic
deaths and
injuries to be
reduced by at
least 50 % from
2021 to 2030

5. Safer Vehicles & Road Users
Driver Monitoring Systems
(DMS) & ADAS
ADAS: Advanced Driver Assistance System

6. BeMyGuest – February 2022
A.C.E.S : 4 Mega-Trends Taking over the Auto industry

7. BeMyGuest – February 2022
Software Defined Vehicles – OEM Market trends
Big Tech’s Trojan’s Horse
$4.5 Billion
(ADAS lead)
Brand new SW Business Unit (2021)
How to change the Mindset?

8. BeMyGuest – February 2022
Automotive Grade HW platforms: Centralized & Powerful
SA8155AP
SA8195AP
STB « on-wheels » iMX9
GPU/NPU
IVI (In-Vehicle Infotainment)

9. BeMyGuest – February 2022
Autonomous Vehicle (AV): The Ultimate Sensor Fusion
Source: Waymo
« Space Odissey » with
some Direct Short Terms
& Affordable
Enhancements for our
Daily Life!

10. BeMyGuest – February 2022
LiDAR + Video Camera Fusion + A.I

11. BeMyGuest – February 2022
Two (2) Distinctive Paths towards Autonomous Vehicle
Source: Yole 2019
Automotive camera module industry has
reached $3Billion in 2018. Sales are expected
to reach $5.7B in revenue by 2024.
The average number of « Cameras per end-
product » will exceed 3 in 2024, for
Automotive Market & Mobile phones.
Last mile delivery
Robot Taxi
Shuttle

12. BeMyGuest – February 2022
A.I based Vision: from Innovation Labs to R&D Implementation
From Simulation To implementation
Mobile phone
Snapdragon
Benchmarking with competition
Driver Monitoring (Drowsiness, Distraction…)
Mobile platform
Snapdragon based
Passive ADAS
In-depth
understanding
of Key
technologies is
critical:
Credibility for
an efficient
Design (Choice
of HW & SW
platforms +
integration).

13. BeMyGuest – February 2022
DMS/ADAS Stakeholders : ‘Tip of the Iceberg’
DMS/OMS ADAS
May 2021
Acquisition of AFFECTIVA: $73 Million
Feb. 2021
Sale completed: €100 Million
July 28th 2021
IPO Tel Aviv Stock Exchange (TASE)

14. BeMyGuest – February 2022
A/M : in-House design Capabilities illustrations
Minimum Viable Product (MVP):
- Agile
- Gain from Experience through
iterations/runs
FPD Link
LTE Cat 6
SC66
SDM660
AI
Snapdragon™ Neural Processing Engine (SNPE)

15. BeMyGuest – February 2022
Hunting down Distraction
• Distraction detection is one of the key success factor
• 80% of all car accidents involve Distraction (rationale for SAFE act in the USA).
• 25% of fatal accidents involve distraction
Source: SAFE act (« Stay Aware For Everyone)

16. BeMyGuest – February 2022
Virtuous Circle of Connected Fleets
Crashes
-91%
Cost reduction
Police fines
-50%
Fines reduction
Insurance
-20%
Insurance
premium Energy
-10%
Consumption

17. BeMyGuest – February 2022
Complete In-car SDK sensing solutions
Driver Sense (DMS) Cabin Sense (OMS)
- Drowsiness
- Distraction
- Smoking
- Phone
- Drinking
- Seat belt
- Demographics
- Driver intention
- Profile Cabin Personalization
/ recognition of driver
- Occupancy
- Personalization
- Demographics
- Posture
- Objects
OMS: Occupant Monitoring System

18. BeMyGuest – February 2022
Driver Attention Alert (DAA) :: building blocks
Drowsiness Distraction

19. BeMyGuest – February 2022
Driver Gaze Zone tracking
Being able to track accurately the eye gaze can:
(1) improve efficiency for detection of lack of attention,
(2) gather insights about driver behaviour in context,
(3) trigger new services
Green point = Target to be followed by Driver
== ‘Cat Laser Chaser’ !

20. BeMyGuest – February 2022
Mobile Phone: Texting/Calling & Drinking
Mobile Phone: Texting, Calling Drinking
The main target cluster : young adults, since road crashes are #1 cause of death for this
category, and it’s proven that distraction due to Mobile phone usage amongst them is
dramatic.

21. BeMyGuest – February 2022
DMS/OMS :: Seat Belt detection
OMS: Occupant Monitoring System

22. BeMyGuest – February 2022
DMS/OMS: building blocks extra features
Person Identification / Occupant counting / Age Object Detection & Classification

23. BeMyGuest – February 2022
Child presence Detection :: using OMS building blocks
Child Seat Detection
Child Detection (via Age estimation)

24. BeMyGuest – February 2022
On the road to Identifying Impaired Drivers (1/2)
Health Monitoring: Heart Rate (H.R) & Breath Rate (B.R)
This might require
additional sensors to
complement the camera.

25. BeMyGuest – February 2022
On the road to Identifying Impaired Drivers (2/2)
Body Tracking
Investigation to reuse this
building block whilst detecting
sudden sickness (e.g. Heart
attack, Stroke)

26. BeMyGuest – February 2022
DMS for Face Detection
Liveness (Anti-spoofing)
Mainly used for Commercial Transport of hazardous
Goods.
Then this could be used also for Car/Environment
personalized configuration.

27. BeMyGuest – February 2022
Vision based ADAS
Road Safety Improvement:
• FCW (Forward Collision Warning)
• LDW (Lane Departure Warning)
• PCW (Pedestrian Collision Warning )
• HMW (Headway Monitoring Warning)
• FVSA (Front Vehicle Start Alarm)
PCW
FCW
LDW
In-cabin integration
& HMI is critical.
Avoid Distraction &
False Alarms.

28. BeMyGuest – February 2022
Vulnerable Road Users (VRU): 54% of Road Deaths !
It’s time to focus (more) on Human!
Pedestrian
Cyclist
Pedestrian
Source: courtesy of Humanising Autonomy

29. BeMyGuest – February 2022
VRU* :: Prediction of pedestrian Crossing intention
Alphapose
YOLOv3
DeepSORT
High interest to assess feasibility & TRL
(Technology Readiness Level) for further
integration into real world product ==
Differentiating Factor w.r.t Vulnerable Road
Users (VRU)
SUP’COM Students crossing the street, again & again…
*VRU : Vulnerable Road User

30. BeMyGuest – February 2022
VRU :: Monocular camera based (not LiDar!)
Source: courtesy of Humanising Autonomy
Paving the Way to Autonomous Vehicles

31. BeMyGuest – February 2022
TSR* with A/M Products (overview)
For an After Market (A/M) Product, within the scope of TSR, mostly 2 types are
of real interest:
1) STOP/YIELD & NO ENTRY: to generate ALARM
2) SPEED LIMITS: Intelligent Speed Assistance (ISA)
TSR: Traffic Sign Recognition

32. BeMyGuest – February 2022
Video-Telematics cloud platform: DMS & ADAS
Cloud Telematics platform integrating Video (DMS & ADAS) is available.
Besides Telematics (position, acceleration, speed, mileage, diagnostic, …),
short videos triggered by warnings and alarms from DMS/ADAS are
stored in the platform.
Key for Driver Coaching,
insurance claims...
+ ’Pay as you Drive’ Models
Field
Qualification
are
still
necessary

33. BeMyGuest – February 2022
List of features: A/M Product :: Pushing the Boundaries
ADAS Front algorithm model
HMW，Headway Monitoring Warning
FCW，Forward Collision Warning
LDW，Lane Departure Warning
PCW, Pedestrian Collision Warning
DMS algorithm model
DFW, Driver Fatigue Warning
DYA, Driver Yawning Alarm
DDW, Driver Distraction Warning
DCA, Driver Calling Alarm
DSA, Driver Smoking Alarm
DAA, Driver Abnormal Alarm
DDRA, Driver Drinking Alarm
FaceID Recognition
Additional features are necessary for being disruptive w.r.t Market
ADAS Front algorithm model
TSR, Traffic Sign Recognition
TLR, Traffic Light Recognition
Minimum feature list
OMS algorithm model
Child/Baby seat Detection
Dog/Cat Detection
Leaving Object Detection
Seat Belt Detection
Occupant Detection
Face attributes Detection
Rear Camera algorithm model
PCW, Pedestrian Collision Warning
Range to Target

34. Towards Road Safety Improvement
Regulation trends overview

35. BeMyGuest – February 2022
EU, USA
Driver
Drowsiness &
ISA
Driver
(advanced)
Distraction
2023 2025
Sudden
Sickness
GSR v2
Driver under
influence*
(impaired)
Child presence
Detection
face recognition, Genre classification, occupant
counting, object detection & classification, Driver
Gaze Zone tracking (for 3D control), Health
Monitoring, Body tracking
2026
Market demands for Next Gen Digital Cockpit (2026)
USA (2021): bipartisan $1.2 Trillion Infrastructure Bill
GSR: Global Safety Regulation, NCAP: New Car Assessment Programme
ISA: Intelligent Speed Assistance
features
Minimum
set
Extended
set
Lack of Ambition, still slow

36. BeMyGuest – February 2022

37. BeMyGuest – February 2022
UK regulations : Direct Vision Standard (DVS) & FORS
Camera sensors & Radar means
more opportunity for A.I based
warning system to support the
Driver to take care of its
surroundings, especially with
VRUs.
DVS: Direct Vision Standard
FORS: Fleet Operator Recognition Scheme
Safety Permit for
Heavy Good Vehicle
(HGV) to access
Greater London

38. BeMyGuest – February 2022

39. Smart City
Road Infrastructure & Traffic Management

40. BeMyGuest – February 2022
Urban Traffic Management :: A.I + 5G & C-V2X
Cross-Working Group Work Item VRU: 2020
A.I combined with 5G & C-V2X is paving the way to disrupting road
traffic Management services, thus saving and changing lives of
citizens.

41. BeMyGuest – February 2022
C-V2X services (very brief) Overview: Keystone of nextGen Mobility
Emergency First Responder priority
Smart Traffic Light
Blind curve: Hazard warning

42. BeMyGuest – February 2022
Road Side Unit (RSU) – CV2X + LiDAR + Video & A.I
Road Side Units (RSU) deployment jointly with
LiDAR & Cameras to capture activities & intention
of Vehicles + Pedestrian to improve safety, then
prioritized emergency vehicles, and finally
smooth/efficient traffic.
Smart City :: Security & Safety
Edge Computing (MEC) will also play a Key role within the IT infrastructure,
to secure Low Latency (RTT), gathering/fusion of sensors data & processing power.

43. BeMyGuest – February 2022
Road Side Unit (RSU) – CV2X + LiDAR + Video & A.I
China leading the way in terms of C-V2X RSU roll-out

44. BeMyGuest – February 2022
Smart Traffic Analysis & Management
Stereo-vision OTUS3D

45. BeMyGuest – February 2022
Traffic Management :: Classifying & counting – Flow control
Fixed Camera Flying Camera onboard Drone

46. BeMyGuest – February 2022
Smart Parking : Available lot detection

47. BeMyGuest – February 2022
Traffic Management :: Carpooling & Tunnel Watch
Carpooling :: High Occupancy Vehicle (HOV)
- Lateral & frontal detection for occupants counting
- Vehicle class recognition
- License plate matching
- GDPR compliant (Privacy: blurring of personnal data)
Tunnel Watch :: Automatic Incident Detection (AID)
- High Accuracy of Incident Detection
- Time saving for first responders
- vehicle categories & counting per Lane, for real-time
traffic informations
- ➔ Safety improved within such complex environment
Video Semantic Segmentation

48. BeMyGuest – February 2022
Prioritizing Emergency Vehicles flow :: A.I+C-V2X+(NG)eCall
A.I Jointly with C-V2X and (NG)e-Call system, will save lives, by
minimizing time for intervention (first responders),
whilst also increasing global security of cities.

49. BeMyGuest – February 2022
Urban investments in road safety :: How to Prioritize?
NYC – TOTAL Collisions NYC – VRU (Cyclists)
Collisions
Acquisition of relevant and quality Data from Road Traffic Crashes
(RTC) must be a Keystone for Sustainable Urban Planning, and still
unmet challenge, in spite of some progress thanks to open Data
policies in some Major cities worldwide.
Machine Learning + Geolocation
applied to Social Media
Crowdsourced Crash Report
(City of Nairoby)
Milusheva S. et al.

50. BeMyGuest – February 2022
Improving Road Safety via Infrastructure Hazards detection (e.g. Pothole)
Sensor Fusion : Video + Accelerometer (IMU) + GNSS
Potholes are amongst the primary
Road Infrastructure Hazards
jeopardizing safety of drivers
(especially Motorbikes, Cycles).
Thanks to latest Leading Edge
technologies such as Computer
Vision, fusioned with Inertial
sensors, it is now possible to detect
and monitor such hazards, and set-
up efficient repair campaigns via
predictive Maintenance.

51. BeMyGuest – February 2022
Potholes Detection & Mapping: Smart City Cloud Platform Extension
Prioritization & Optimization of Urban investment / Road Maintenance,
whilst cross-referencing with Road Traffic Crashes (RTC) Risk Management.

52. BeMyGuest – February 2022
Motorway Maintenance: Cost efficiency
“The costs of road maintenance in the Netherlands add up to 1.6 Billion euros on
an annual basis”
A.I
Driving footage
“a team of specialized technicians to go frame by
frame through the footage in order to recognize
anomalies. These defects are then manually
categorized before they are reported for maintenance”
The past: Costly & Lengthy
Now Semantic segmentation
Cost efficient Maintenance

53. BeMyGuest – February 2022
Tramway/Railway
Railway :: LiDAR + Video Semantic Segmentation
Tramway:: sensor fusion {LiDAR +
GNSS/IMU + Video}

54. Micro-Mobility
Smarter & Safer e-Scooters, e-Bikes

55. BeMyGuest – February 2022
Micro-Mobility is Key to Sustainable Smart Cities
Faster growth than ride-hailing !
Rebound after Covid-19 crisis.
Reduce
Carbon
Gaz
emission

56. BeMyGuest – February 2022
A.I Taking Fleet e-Scooter safety ( and Business) to the next level (1/2)
• Lane recognition – Is the
scooter riding on the Road,
the Sidewalk or the Bike
lane?
• Pedestrian detection
• Helmet detection
• Camera assisted parking
(using QR code recognition
in designated spaces that
don’t have any GPS signal –
e.g. underground car parks
or ‘urban canyons’)
• Smart City Insights (Surface
conditions, obstructions,
near misses etc)
Source: Luna & Voi
Sidewalk detection/Protection Parking assistance
Main challenge for business growth:
Sidewalk Protection

57. BeMyGuest – February 2022
A.I Taking Fleet e-Scooter safety ( and Business) to the next level (2/2)

58. BeMyGuest – February 2022
What about Consumer e-Scooters?
Model XI Crash Assist A.I
ADAS Camera sensor, making difference between: stop-light, stop-sign, person, car, or inanimate oject
➔ Audible & visual warnings!!.

59. BeMyGuest – February 2022
Qualcomm & Spoke: Bringing C-V2X to e-Bikes

60. BeMyGuest – February 2022
Boréal Bikes - Holoscene X (Developer Edition)

61. BeMyGuest – February 2022
Intelligent Helmets : A.I + A.R
A.R: Augmented Reality
Far beyond « Standard Helmets », however fueling
Innovation towards more Safety.
Potential Concerns with Distraction….likely to require
quite some Feedback Experience from the Field / Real
World…before any commercial launch.

62. Let’s Make a Difference for a
Better World!…