SAS - Removing the roadblocks to broader adoption

1. Our Vision Your Safety TM
Advanced Speed Assistance Systems
Seminar
May 9, 2017
Yoel Krupnik & Yoni Epstein

2. Our Vision Your Safety TM
Overview
1. Challenges for Global Coverage of SAS
2. Mobileye Roadmap (for Extended and Improved SAS)
3. Proposed Incentives for SAS Adoption

3. Our Vision Your Safety TM
Challenges for Global Coverage of SAS
• High Appearance Variability (Opportunity for Refinement of Standardization)
• City Entrance
• Residential Area
• Textual Supplementary
• Electronic Signs
• Relevance Challenges
• Localization Challenge

4. Our Vision Your Safety TM
City Entrance Sign: High Appearance Variability
Latvia
Lithuania
Luxembourg
Malta
Netherlands
Norway
Poland
Portugal
Romania
Slovakia
Slovenia
Spain
Sweden
Switzerland
UK
N/A
Austria
Belgium
Bulgaria
Croatia
Cyprus
Czech
Denmark
Estonia
Finland
France
Germany
Greece
Hungary
Ireland
Italy
• Too many variations of the sign are in use
• Text-only signs are not visually unique, which can lead to a high false rate

5. Our Vision Your Safety TM
City Entrance Sign: High Appearance Variability
Recommendations:
• Utilize variants 7b or 7c
• ensure identical pictogram across EU
From: Vienna Convention
https://www.unece.org/fileadmin/DAM/trans/conventn/Conv_road_signs_2006v_EN.pdf

6. Our Vision Your Safety TM
Residential Area: High Appearance Variability
Latviaa
Lithuania
Luxembourg
Malta
Netherlands
Norway
Poland
Portugal
Romania
Slovakia
Slovenia
Spain
Sweden
Switzerland
UK
Austria
Belgium
Bulgaria
Croatia
Cyprus
Czech
Denmark
Estonia
Finland
France
Germany
Greece
Hungary
Ireland
Italy
• Too many variations of the sign are in use
• Requires intensive development & data collection for full coverage
• Select common pictogram to adhere to
• Mandatory speed limits should be embedded or placed above

7. Our Vision Your Safety TM
Textual Supplementary Signs
• Mainstream ADAS cameras will likely not support OCR in the near future
• The challenge for camera detection of textual supplementary signs is difficult to
overcome due to the high variability of text, font and color (examples below).
• This may be overcome, at some level, with advanced DNN algorithms and large-scale
data efforts over the next several years.
• Recommendations:
• Standardize font, size, and color
• Use fixed units/intervals, such as 50m or 100m (i.e. 100m, 200m.. 900m, 1100m)

8. Our Vision Your Safety TM
Electronic Speed Signs
Electronic signs poses a challenge due to varying behaviors:
• The whole sign flickers (completely visible/invisible)
• Flickering is not synchronized across the entire sign, and at any given point in time,
only part of the sign is visible
• Signs interchange between a speed limit and lane merge (mostly in construction
areas)
• Appears in some countries without red bounding circle, with different meanings
across countries (mandatory / advisory)
Recommendations:
• Standardize visual and electronic specifications to eliminate partial visibility and
minimize flickering
• Standardize legal significance for non-Vienna variant

9. Our Vision Your Safety TM
Relevance Challenges
A big challenge for implementing SAS globally with a camera is the relevance problem
- deciding whether a specific sign is relevant or not.
Typical examples:
Which sign is relevant to my lane? Turning left while the 40 is for straight-on Sign is only relevant for the exit lane

10. Our Vision Your Safety TM
Relevance Challenges
The large variability of embedded signs renders detection of each variation almost
impossible.
We recommend to consider embedded signs as advisory, which are always followed
by standard mandatory speed limit signs or overhead signs (will also be useful for
drivers).
Relevance decisions will be improved as new technologies are rolled out,
• Lane Assignment: How many lanes exist, and which lane am I in?
• Lane Classification: What type of traffic is allowed in each lane?
(oncoming, preceding, bus, carpool, bicycle)
• Arrows on road, stop lines
• Expanding detected signs
• Improved 3D measurements

11. Our Vision Your Safety TM
Localization Challenge
• Localization required to understand:
• Kph / mph
• Implicit speed signs (Motorway / expressway / city entrance / end-of all
restrictions)
• Specific rules per countries
• Implicit speed limit when raining
• Solutions:
• Standardization
• Country-specific signs

12. Our Vision Your Safety TM
Mobileye SAS Roadmap: Features in global production by 2018
• Traffic Lights & Stop Signs – red traffic light and stop sign violation
• Stop Line – serving as reference point for braking and warning applications
• Arrows on Road and Traffic Light Supplementary Arrows – serve relevance decision
• No Entrance – violation warning
• Yield Sign – notification
• Lane Assignment and Lane Classification – serve relevance decision
• Painted speed limits on road
• Expanded coverage of signs on a global scale

13. Our Vision Your Safety TM
Stop Signs
Stop Sign Warning Suppressed by the Vision-Only
Relevance Module
Stop Sign Violation

14. Our Vision Your Safety TM
Traffic Lights & Stop Line

15. Our Vision Your Safety TM
Arrows on road

16. Our Vision Your Safety TM
Lane Assignment

17. Our Vision Your Safety TM
Scene Understanding

18. Our Vision Your Safety TM
Proposed Incentives for SAS adoption
Euro NCAP
• Expand SAS scenarios
• Junction Violation Warning: Red Traffic Light/Stop Sign
• Notification of crosswalk, yield sign
• Increase SAS score in accordance
• Require minimum SAS score for 5-star rating
Globally
• Encourage NCAPs to include SAS in Rating Scheme (US, Japan, Korea,
China, ASEA)
• Facilitate widespread adoption of SAS by harmonizing with Euro
NCAP
• Facilitate standardization (next meeting in Australia?)

19. Our Vision Your Safety TM
Thank you
Yoni.Epstein@Mobileye.com
Yoel.Krupnik@Mobileye.com