Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

LEGO Approach for Autonomous Driving


Published on

Visteon presented at the IV Conference in Changshu City, China June 2018.

Published in: Automotive
  • Be the first to comment

LEGO Approach for Autonomous Driving

  1. 1. LEGO Approach for Autonomous Driving Visteon ADAS Chief Architect: Kai Wang
  2. 2. Visteon Confidential Market Overview and Trend
  3. 3. Dawn of Autonomous Driving • Market demand from ‘feature car‘ to ‘smart car‘ • Value chain from ‘tree structure‘ to ‘round table structure‘ Copyright © Visteon Corporation, 2018 3 L1-L2 ADAS 2005 2010 2015 2020 2025 ADAS/Autonomous L5 Robo-Taxis & Trucks L3-L4 Autonomous
  4. 4. REVENUE 2017 2018 2019 2020 2021 2022 2023 2024 VOLUME 2017 2018 2019 2020 2021 2022 2023 2024 Market Trend ADAS Domain Controller main revenue source in ADAS field • ADAS industry is estimated to be increased dramatically • Central domain controllers expected to be the biggest revenue source • SoC vendors aggressively enter domain controller market • Split between hard- and software Market Growth Rate ADAS Domain Controllers Copyright © Visteon Corporation, 2018 Source: Boston Consulting Group
  5. 5. Market Trends ADAS market continues to grow, but rules of the game are changing. SoC vendors trying to lead in ADAS ECU market First L3 Traffic Jam Pilot system available (Audi) First L3 Highway Pilot system available (MB) First OEMs will “introduce” L4 driving functions 20192018 2020 2021 2022 Uber and Tesla accidents might slow down development First solid state lidars market ready First imaging radars market ready Copyright © Visteon Corporation, 2018
  6. 6. Challenges of Autonomous Driving • Complexity of system design • Diversity of solutions • Cost of implementation Copyright © Visteon Corporation, 2018 Source: Internet
  7. 7. Rapid Changes in Sensor and Processing Landscape Camera/radar/LiDAR sensors evolving rapidly CPU/GPU/DSP capabilities increasing rapidly More data volume forces higher processing power New AI-specific processors expected in near future LiDAR Mechanical to solid state Higher resolution at low cost Processors CPU / GPU / DSP Emerging AI processors Radar 24GHz to 600 GHz 2-D to 3-D Camera Increased resolution up to 12 MP, frame rate up to 60 fps Copyright © Visteon Corporation, 2018
  8. 8. Technology trend in ADAS/Autonomous Driving • Trend in camera • Increased sensitivity, resolution and frame rate will lead to much higher availability and drastically increasing amount of data • Trend in Lidar • Data output in the same range as for state of the art CMOS cameras • Trend in Radar • Much more information on top of higher resolution will be provided that allows to treat radar data in a similar way as camera and Lidar • Trend in ICs • Computing power follows amount of data produced by future sensors • Increasing number of ASIL D capable ICs due to requirements of L3 and above driving • Trend in localization, mapping, connectivity and cloud • Rapid growth due to demand from L3 and above driving Copyright © Visteon Corporation, 2018
  9. 9. Level 3 is Main Market Driver for Autonomous Driving Highway Pilot and Self Parking are key autonomous features for Level 3 Night Vision Driver Monitoring Parking Assist/Self Parking Blind Spot Detection Adaptive Cruise Control/ Traffic Jam Pilot/ Highway Pilot Key Features 2017 2019 2021 2023 2025 • Represents largest segment of market by 2025 • Forward driving features merge into “Highway Pilot” for Level 3“. Parking Assist” is other key autonomous capability • Combines ACC, Lane Keep Assist, Lane Change Assist, & Swarm mode using V2X • Level 5 for mobility service and trucks only a niche market until 2025 Level 3+ Highway Pilot Lane Departure Warning Level 3 Highway Pilot is largest segment for autonomous driving until 2025 Copyright © Visteon Corporation, 2018
  10. 10. Visteon Confidential LEGO Concept for Autonomous Driving
  11. 11. Solution Brain Storming • Open or closed • Flexible or customized • Comercial consideration Copyright © Visteon Corporation, 2018 Failsafe Secure Centralized Computation OPEN for algorithm developers Artificial Intelligence in Autonomous Driving RuntimeStudioCompute Algorithm
  12. 12. DriveCore™ Technology Platform Scalable and modular computing hardware Software middleware abstracts hardware for AI algorithms PC-based dev toolchain for third-party algorithm and app development From Level 2 to Level 5 Patented advanced thermal management Perception ActuationPath Planning CNN Algorithms RL Algorithms Runtime Compute Camera, Radar, Lidar, Ultrasonic Vehicle Integration • Simulated environment for algorithm development • Simulation of real sensors • Enable open collaboration with third-party providers In-Vehicle System Development Tool Chain Copyright © Visteon Corporation, 2018
  13. 13. DriveCore™ - Visteon Autonomous Product Driving Offering Offering • DriveCore™ Algorithm ASIL compliant algorithms for data-fusion, environment classification and object detection, functions for automated driving • DriveCore™ Studio PC-based tool for algorithm development. Rich tool suite for sensor data record/playback, visualization, configuration, fusion, testing, comparison, configuration, validation and versioning. • DriveCore™ Runtime Middleware including APIs, high-frequency/low-latency communications layer for sensor data and framework for algorithms. Integrates Neural network based algorithms for object detection and classification • DriveCore™ Compute Scalable computing hardware platform with ASIL compliance Visteon Development Environment DriveCoreTM Studio Visteon Hardware Platform DriveCoreTM Runtime Components Visteon Hardware Platform DriveCoreTM Compute Visteon Algorithm Environment DriveCoreTM Algorithm Copyright © Visteon Corporation, 2018
  14. 14. Algorithm Developer Download DriveCore Algorithm and Runtime on DriveCore Compute DriveCore™: How it works / Development Process 14 OEM or External Validation (optional) Create Runtime Environment Create, simulate and test algorithm on Open APIs Algorithm Store: Manage, versioning and comparison of algorithm DriveCore™ Studio DriveCore™ Runtime DriveCore™ Compute Real-time data: Timestamped camera, radar, Lidar, positions Drive, test and record within autonomous vehicle Record and Upload EmbeddedWorldPCWorld Copyright © Visteon Corporation, 2018
  15. 15. DriveCore™ Compute – Scalable Concept Option: high level • Can be used for ADAS or any high-end multi domain system • The Hardware contains 2 types of board: • Base Board: • Covers main power supply, central PCIe and ETH switches to provide necessary data bandwidth for intercore communications • Daughter Board: • Computing Carrier board provides GP and VP for ADAS, GP and GPU for Fusion and can be adapted to SoCs of different vendors • Safety Carrier board provides vehicle interface and higher safety processing power • Extension Carrier board provides more sensor inputs for ADAS, audio/media/gateway for Fusion. • DriveCore Gen1 can support 2-layer high speed pile-ups in both top and bottom directions. • Up to 8 daughter boards can be plugged in for system level scalability. Base Board (Premium) Computation Carrier 1 GPU/ VPU Gateway SoC Gateway SoC Computation Carrier 2 GPU/ VPU ETH Extension Computation Carrier 6 Computation Carrier 3 GPU/ VPU Computation Carrier 4 GPU/ VPU Safety Carrier ASIL D Controller Computation Carrier 5 GPU/ VPU GPU/ VPU Copyright © Visteon Corporation, 2018
  16. 16. DriveCore™ Compute – Scalable Concept Key Architectual Differentiators • Modular design with full HW scalability on system level • Scalable on daughter board level by using different SoC/VIP from same family • Scalable in every direction: performance, safety, ability... • Flexible standardized mechanical designs for different car thermal environment • Highly dynamical workload and data sharing concept • Ultra low latency (us level) for intercore communication among SoCs and VIP(s) • Easy productized adaptation for cost-down in serial production • Common HW platform for ADAS, infotainment, cluster, gateway and any hybrid • A-Sample in Q1 2018 Scalable Computing Unit Level 2-3 Level 3-4 Level 4-5 Copyright © Visteon Corporation, 2018
  17. 17. DriveCore™ Compute – Scalable Concept Copyright © Visteon Corporation, 2018
  18. 18. DriveCore™ Compute – Scalable Concept DriveCoreTM Small DriveCoreTM Small (active cooling) DriveCoreTM Large DriveCoreTM Medium Copyright © Visteon Corporation, 2018
  19. 19. DriveCore™ Compute – Scalable Example Level 4-5Level 2-3 Level 3-4 Base Board (Premium) Computation Carrier 1 GPU/ NPU Gateway SoC Gateway SoC Computation Carrier 2 GPU/ NPU ETH Extension Computation Carrier 6 Computation Carrier 3 GPU/ NPU Computation Carrier 4 GPU/ NPU Base Board (Premium) Computation Carrier 1 GPU/ NPU Gateway SoC Gateway SoC Computation Carrier 2 GPU/ NPU Safety Carrier ASIL D Controller ETH Extension ETH Controller Base Board (Entry) Safety Carrier ASIL B/D Controller Computing Carrier GPU/ NPU Safety Carrier ASIL D Controller Computation Carrier 5 GPU/ NPU ECU ASIC Setup GPU/ NPU Copyright © Visteon Corporation, 2018
  20. 20. DriveCore™ Compute for Fast Productization Major KPI Major KPI Major KPI Entry Connectivity Rich Connectivity Premium Connectivity Entry Processing Power Rich Processing Power Premium Processing Power FastProductization FastProductization FastProductization Level 4-5Level 2-3 Level 3-4 Copyright © Visteon Corporation, 2018
  21. 21. OS Applications Comm Framework Alg. Alg. Alg. Alg. API’s NN Secure HW Communication Layer • Cyber secured • Inter process communication (IPC) • Messaging • real time processing • Shared memory OPEN APIs: • Interfaces to sensor data, localization, vehicle data • Common API • Open up in W3C Framework: • Sandboxing Algorithms • Environment Model • Sensor Agnostic Interface Declaration DriveCore™ Runtime Middleware DriveCore™Runtime DriveCore™ Runtime: • Optimized for Centralized Computing Unit • IPC based transport • Zero copy interfaces • Enhanced for multi-core multi- processor architectures • Maximize performance by leveraging native accelerators • Facilitate APIs for third party application developers • Secure communication • Secure sensor network • Time synchronized execution pipeline Copyright © Visteon Corporation, 2018
  22. 22. DriveCore™ Studio – Manage DriveCore Environment & Algorithms Integrates existing ROS / MatLab Tooling enriched by Visteon’s own development DriveCore™ Perspective(s) Sensor Data management Download/Upload Wrap ROS 2.0 DDS + SOME IP connection DriveCore™ Runtime config. Simulated sensor data Gazebo/Unity Configure visualizations Plots, Logs, Rviz. Log perf. data Record & play Real-time alg. profiling CPU, MEM, Latency, Accuracy… Online Help Real-time sensor data Algorithm Design Real-time data profiling Analyze logged perf. data Compare alg. perf. & accuracy Copyright © Visteon Corporation, 2018
  23. 23. DriveCore™ Autonomous Features & Challenges Visteon to be a leader in level 3 autonomous driving Forward Driving Side/Rear Parking Adaptive Cruise Control Lane Keeping Assist Lane Change Assist Cross Traffic Alert Surround View Advanced Emergency Braking Traffic Jam Assist Parallel Park Highway Pilot Parking Assist City Pilot Automated Parking Auto Pilot / Driverless Driving Robo-Taxi & Trucks L1 L2 L3 L4 L5 Function Scalable centralized computing Radar, Camera & LIDAR: Late fusion of sensor data Machine learning algorithms System performs permanent environmental monitoring CHALLENGES L3+ System Requirements Environment monitoring by human Environment monitoring increasingly by system ADAS Autonomous Driving Complexity and functional safety Adaptive Cruise Control with LKA Highway Pilot FOCUS 2018 - 2019 FOCUS > 2019 Emergency Braking Copyright © Visteon Corporation, 2018
  24. 24. DriveCore™ – A Bridge to Success in Autonomous Driving Visteon’s DriveCore™ fills system integration gap for autonomous driving ecosystem Silicon Sensors HD Map Scalable Computing Hardware and Middleware Car Manufacturers AI Algorithms & Frameworks System Hardware & Software Silicon, Sensors and HD Maps Copyright © Visteon Corporation, 2018