Ali Nouri Volvo Cars Gothenburg, Sweden Christian Berger University of Gothenburg, Sweden Department of Computer Science and Engineering Fredrik Törner Volvo Cars Gothenburg, Sweden

1. An Industrial Experience Report about Challenges
from Continuous Monitoring, Improvement, and
Deployment for Autonomous Driving Features
V o l v o
Ali Nouri
Volvo Cars
Gothenburg, Sweden
ali.nouri@volvocars.com
Christian Berger
University of Gothenburg, Sweden
Department of Computer Science and Engineering
christian.berger@gu.se
Fredrik Törner
Volvo Cars
Gothenburg, Sweden
Fredrik.Torner@volvocars.com
8/30/2022
Challenges from Continuous Monitoring, Improvement, and Deployment for Autonomous Driving Features,
Ali Nouri, Volvo Cars & Chalmers University of Technology

2. Industrial PhD Candidate: Assuring Safety
for Rapid and Continuous Deployment for
Autonomous Driving
Diarienummer: 2021-02585
Senior system safety engineer in Autonomous Drive
• Function and System design activities
• Safety Argumentation of AD
• Member of:
•ISO/PAS 8800 (Safety and Artificial Intelligence)
•ISO/TS 5083 (safety for automated driving systems)
Bio

3. Which level?
Not Applicable
Ref: “ISO/FDIS 21448, Road vehicles — Safety of the intended functionality,” standard, International Organization
Supervised
Unsupervised
8/30/2022
Challenges from Continuous Monitoring, Improvement, and Deployment for Autonomous Driving Features,
Ali Nouri, Volvo Cars & Chalmers University of Technology

4. The animations are for illustrative purpose only
Today
Supervised
8/30/2022
Challenges from Continuous Monitoring, Improvement, and Deployment for Autonomous Driving Features,
Ali Nouri, Volvo Cars & Chalmers University of Technology

5. Today
The animations are for illustrative purpose only
Supervised
8/30/2022
Challenges from Continuous Monitoring, Improvement, and Deployment for Autonomous Driving Features,
Ali Nouri, Volvo Cars & Chalmers University of Technology

6. Today
Tomorrow
Supervised
Unsupervised
8/30/2022
Challenges from Continuous Monitoring, Improvement, and Deployment for Autonomous Driving Features,
Ali Nouri, Volvo Cars & Chalmers University of Technology

7. Ref: https://unece.org/transport/documents/2021/03/standards/un-regulation-no-157-automated-lane-keeping-systems-alks
Regulation
8/30/2022
Challenges from Continuous Monitoring, Improvement, and Deployment for Autonomous Driving Features,
Ali Nouri, Volvo Cars & Chalmers University of Technology

8. Product Cybersecurity
(e.g., ISO 21434)
Safety of the Intended Functionality
(ISO 21448)
• Performance limitations
• Insufficiencies of specification
• etc.
Functional Safety (ISO 26262)
• Systematic SW failure
• Systematic HW failure
• Random HW failure
Product Safety
8/30/2022
Challenges from Continuous Monitoring, Improvement, and Deployment for Autonomous Driving Features,
Ali Nouri, Volvo Cars & Chalmers University of Technology

9. 1
4
2
3
Not
Hazardous
Hazardous
Known
Unknown
1
4
2
3
Copyright: ISO_PAS_21448_2019
SOTIF (ISO 21448)
8/30/2022
Challenges from Continuous Monitoring, Improvement, and Deployment for Autonomous Driving Features,
Ali Nouri, Volvo Cars & Chalmers University of Technology

10. Time of day
Environmental
Geographical
Included
Excluded
(for now)
Speed
Ref: “ISO/FDIS 21448, Road vehicles — Safety of the intended functionality,” standard, International Organization
SOTIF (ISO 21448)
8/30/2022
Challenges from Continuous Monitoring, Improvement, and Deployment for Autonomous Driving Features,
Ali Nouri, Volvo Cars & Chalmers University of Technology

11. 8/30/2022
Challenges from Continuous Monitoring, Improvement, and Deployment for Autonomous Driving Features,
Ali Nouri, Volvo Cars & Chalmers University of Technology
Ref: “ISO 21448, Road vehicles — Safety of the intended functionality,” standard, International Organization

12. 8/30/2022
Challenges from Continuous Monitoring, Improvement, and Deployment for Autonomous Driving Features,
Ali Nouri, Volvo Cars & Chalmers University of Technology
Ref: “ISO 21448, Road vehicles — Safety of the intended functionality,” standard, International Organization

13. 8/30/2022
Challenges from Continuous Monitoring, Improvement, and Deployment for Autonomous Driving Features,
Ali Nouri, Volvo Cars & Chalmers University of Technology

14. 8/30/2022
Challenges from Continuous Monitoring, Improvement, and Deployment for Autonomous Driving Features,
Ali Nouri, Volvo Cars & Chalmers University of Technology

15. O O O
O O O
Requirements
O O O Conventional
SW
ML-based
SW
HW
Specification &
Design
8/30/2022
Challenges from Continuous Monitoring, Improvement, and Deployment for Autonomous Driving Features,
Ali Nouri, Volvo Cars & Chalmers University of Technology

16. Specification &
Design HW Dev. Test
8/30/2022
Challenges from Continuous Monitoring, Improvement, and Deployment for Autonomous Driving Features,
Ali Nouri, Volvo Cars & Chalmers University of Technology

17. The animations are for illustrative purpose only
8/30/2022
Challenges from Continuous Monitoring, Improvement, and Deployment for Autonomous Driving Features,
Ali Nouri, Volvo Cars & Chalmers University of Technology

18. HW Dev.
Specification
& Design
Define &
Specify
Test
Test
Test
Develop
Component
Verification
Deploy &
Monitor
Safety Artifacts
Integrate
Test
Verification&
Validation
Field Monitoring
Confirmation
Measures
Conventional
SW Dev.
ML-based
SW Dev.
All
steps Done
Correctly? Yes
No
8/30/2022
Challenges from Continuous Monitoring, Improvement, and Deployment for Autonomous Driving Features,
Ali Nouri, Volvo Cars & Chalmers University of Technology

19. The animations are for illustrative purpose only
8/30/2022
Challenges from Continuous Monitoring, Improvement, and Deployment for Autonomous Driving Features,
Ali Nouri, Volvo Cars & Chalmers University of Technology

20. HW Dev.
Specification
& Design
Define &
Specify
Test
Test
Test
Develop
Component
Verification
Deploy &
Monitor
Safety Artifacts
Safety
Argumentation
Integrate
Test
Verification&
Validation
Field Monitoring
ODD
Expansion
Confirmation
Measures
Conventional
SW Dev.
ML-based
SW Dev.
All
steps Done
Correctly? Yes
No
8/30/2022
Challenges from Continuous Monitoring, Improvement, and Deployment for Autonomous Driving Features,
Ali Nouri, Volvo Cars & Chalmers University of Technology

21. ODD
ODD
8/30/2022
Challenges from Continuous Monitoring, Improvement, and Deployment for Autonomous Driving Features,
Ali Nouri, Volvo Cars & Chalmers University of Technology

22. Req.
ODD
Req.
Req.
Req.
ODD
8/30/2022
Challenges from Continuous Monitoring, Improvement, and Deployment for Autonomous Driving Features,
Ali Nouri, Volvo Cars & Chalmers University of Technology

23. Req.
ODD
Req.
Req.
Req.
ODD
8/30/2022
Challenges from Continuous Monitoring, Improvement, and Deployment for Autonomous Driving Features,
Ali Nouri, Volvo Cars & Chalmers University of Technology

24. Req.
ODD
SW.
Int.
Req.
Req.
Req.
ODD
SW.
Int.
8/30/2022
Challenges from Continuous Monitoring, Improvement, and Deployment for Autonomous Driving Features,
Ali Nouri, Volvo Cars & Chalmers University of Technology

25. Req.
ODD
SW.
Int.
Req.
Req.
Req.
ODD
SW.
Int.
Test.
Test.
Test.
Test.
8/30/2022
Challenges from Continuous Monitoring, Improvement, and Deployment for Autonomous Driving Features,
Ali Nouri, Volvo Cars & Chalmers University of Technology

26. Req.
ODD
SW.
Int.
Req.
Req.
Req.
ODD
SW.
Int.
Test.
Test.
Test.
Test.
8/30/2022
Challenges from Continuous Monitoring, Improvement, and Deployment for Autonomous Driving Features,
Ali Nouri, Volvo Cars & Chalmers University of Technology

27. Req.
ODD
SW.
Int.
Req.
Req.
Req.
ODD
SW.
Int.
Test.
Test.
Test.
Test.
CR
CR
8/30/2022
Challenges from Continuous Monitoring, Improvement, and Deployment for Autonomous Driving Features,
Ali Nouri, Volvo Cars & Chalmers University of Technology

28. SOTIF
Activity
FUSA
Activity
Cyber
Security
Activity
8/30/2022
Challenges from Continuous Monitoring, Improvement, and Deployment for Autonomous Driving Features,
Ali Nouri, Volvo Cars & Chalmers University of Technology

29. 8/30/2022
Challenges from Continuous Monitoring, Improvement, and Deployment for Autonomous Driving Features,
Ali Nouri, Volvo Cars & Chalmers University of Technology

30. In this study we reported the challenges in CDDM process when it applied to
AD which is a complex and safety critical function and system in the context of
functional safety and safety of intended function
But CDDM shall not be seen as a challenge, since it is contributing to a better
engineering of safety-critical functions:
• Continuously improve the function and reduce the limitations
• Rapidity of response time to safety issues
Future works needs to be done to adapting the existing safety engineering
process and its methods to CDDM
Conclusion and Future work
8/30/2022
Challenges from Continuous Monitoring, Improvement, and Deployment for Autonomous Driving Features,
Ali Nouri, Volvo Cars & Chalmers University of Technology

31. ASSERTED - Assuring Safety for Rapid and Continuous Deployment for
Autonomous Driving
Diarienummer: 2021-02585
The animations are for illustrative purpose only
8/30/2022

32. Thank You
ali.nouri@volvocars.com