SlideShare a Scribd company logo
1 of 31
Download to read offline
0
Developing Autonomous Driving EVs for the
China Market XPENG Motors’ Approach
Junli Gu
VP of Autonomous Driving, XPENG
motors
March 18, 2019
1
Agenda
1. XPENG Motors Introduction and Background
2. Roadmap for XPENG Motors’ Autonomous Driving Solution
3. System Architecture Design Powered by Xavier
2
Who is XPENG?
We develop FUN, CONNECTED and INTELLIGENT EVs tailored for
the young and tech-savvy Chinese Millennials
2
• Aimed at young Internet users in China, with autonomous driving and
intelligent connection as the core differences
• 2014: Founded in Guangzhou, China
• Dec 2018: Mass production and official launch of G3 (electrical SUV)
• Q1 2019: Mass production of E28 (electrical sedan)
3
Strong R&D capabilities and investments
Shanghai
Intelligent Connected
Vehicle
Navigation R&D
Silicon Valley &
San Diego
Machine Learning
Autonomous Driving
R&D
Guangzhou
Vehicle and VCU
R&D
V2X Testing
Trial and Production
Lead-in
Beijing
Artificial Intelligence
R&D
R&D footprint
Our R&D headcount accounts for over 70% of our total number of employees.
4
Your Smart Driving Assistant
Connectivity
Xmart OS
X-pilot
Artificial
Intelligence
5
X-center
XPENG Headquarter
5
6
Agenda
1. XPENG Motors Introduction and Background
2. Roadmap for XPENG Motors’ Autonomous Driving Solution
3. System Architecture Design Powered by Xavier
7
L3 Products: Highly-Autonomous Highway Features
L4 Products: Fully-Autonomous
Urban & Highway Features
- Driverless Robo Taxi
- Driverless Robo Bus
- Human Driver vehicles
L2+ Products: Semi-Autonomous Highway/Urban Features
- Human Driver vehicles
Self-Driving Two Separate Branches…
Comfort Driving with safety guarantees
Where are we heading…
• Key differentiation through XPENG’s intelligent EV strategy
• Focus on in-house software solutions running on leading
computer hardware platforms
• Focus on enhancing driver assistance features towards L3
capabilities in 2020
• Focus on feature optimization for Chinese market and
Chinese consumers
8
9
Roadmap for XPENG Motors’ Autonomous Driving Solution XPilot
2018-2019 2020 2021-2022 2024-2025
CarModel
Autonomous
Driving
Achievement
&Goal
• Xpilot 2.0:
Full scenario auto
parking + LCC + ACC
• Xpilot 3.0:
Super Memory Parking
+ Highway Autopilot
• Xpilot 4.0:
AVP + Highway/Urban
Autopilot
• Xpilot x.0:
Full Automation in
limited scenarios
(highway, parking, etc.)
• First generation
solution for
commercialization
with partial self
developed IPs
• Fully self developed
end-to-end SW IP
• Next gen HW
platform with
optimized sensor cost
• First level-4 solution
in consumer vehicle
A Class SUV (G3) B Class Sedan (E28) B Class SUV
10
XPENG G3
By AI,
irregular lots
By memory
Roadmap for XPENG Motors’ Autonomous Driving Solution-XPilot
parking functions
XPENG E28
Alleviate people’s parking anxiety in parallel, vertical, perpendicular, irregular lots…
parking functions
By voice
By Vision
By Ultrasonic
11
Use Case Example: Super Memory Parking
12
Use Case Example: Highway Auto-Pilot
13
2km ahead
Xpilot’s Surrounding Reality
Ego
Traffic
Point of interest
Road side object
Lane condition
14
Agenda
1. XPENG Motors introduction and background
2. Roadmap for XPENG Motors’ Autonomous Driving Solution
3. System architecture design powered by Xavier
15
Driving
Big Data
AI and
Perception
High-perf
chips
Customized
Sensor
Structure
- -
Chinese Traffic Patterns
Local adaption is a must
- -
• Chinese style lane change and close cutting in
• Very large variety of obstacles
• Dense traffic
• Irregular Pattern
16
Challenge: Perception & Creating a Representative 3D Environmental Model
Compute (MP/s)
Quality raw sensor input with cost
constraints
2
1
Preponderance of training data
(especially corner cases)
3
17
Challenge: Perception & Creating a Representative 3D Environmental Model
Real stream taken from E28 camera sets; ISP developed in house;
18
Challenge: Extending to Day/Night, All Weather, All locations
1) Time (Location of Sun: Day/Night/NotDawn/NotDusk)
2) Select Weather Conditions
3) Availability of GNSS & RTK
4) Place (GeoFenced)
5) Select Speed Range
6) Road/Traffic Conditions
Sensing/Perception challenges (due
to insufficient quality of raw data
and/or compute power)
Mapping challenges
Driving policy
challenges
Ultrasonic Sensors
(6 in Front)
Tri-focal Cameras
(2M pixels, FOV 28,
52, 100, 60/15fps)
Surround-view
Camera (1 at Back)
Rear-view Camera
(2M pixels,FOV 52,
30fps)
In-Car Intelligent
Camera
Radars
(5 in Total)
Surround-view Camera
(1 in Front)
Ultrasonic Sensors
(6 at Back)
Surround-view
Camera (2 on Sides)
Cut-In Prevention
Camera
1M pixels, 60fps)Rear-view Camera
(1M pixels, 30fps)
Sensor System for E28 (Mass production in 2020)
19
Note: We use first vehicle G3’s picture as E28’s design is not revealed yet.
20
XPilot Camera Coverage and Functions for E28
360 coverage; Designed to cover traffic scenarios in China
HFOV 100
HFOV 52
21
System Differentiators
22
1828x948@15fps
(for Highway Driving)
457x237@60fps
(for Urban Driving)
Long Range CNN
(Perception at > 200m)
Close Proximity CNN
(Responds x4 faster)
Cameras
Variable fps Network for China Specific Drive Conditions
(Close Vehicle Proximity and Abrupt Cut-ins)
1
23
HighwayUrban Canyon
START POINT /
END POINT
55 Km route (Approx. 2.5hr)
2.5hrs x 3600 x 1Hz = 9,000 samples
GuangzhouRoute8
Absolute
Localization
Reference
Antenna +
GNSS/INS
2 GNSS / INS
20cm absolute-localization-accuracy at 95% (2 σ)
20cm absolute-localization-accuracy for at 95% (2 σ) of Highway route in white
24
Front Radars
Right Front
Corner Radar
Left Front
Corner Radar
Left Rear
Corner Radar
Right Rear
Corner Radar
3 RADAR
Five Radars of High Angular Resolution: 2x improvement
5th Generation of Radar Technology
25
Industry Leading Computing Platform
XPilot Unit (XPU) powered by NVIDIA Xavier
NVIDIA Xavier
Safety MCU
Camera Des
Camera Des
Camera Des
Memory
EMMC
Storage
CAN
Transceiver
Ethernet
Switch
Power
Management
CAN Ethernet
4
26
Why NVIDIA Xavier?
0
5
10
15
20
25
30
35
Computing Power (TOPS)
Deep Learning Computing Throughput
NVIDIA Xavier FPGA NVIDIA Parker TI TDA2xx
TOPS
27
XPU Software Stack
NVIDIA Xavier SoC Aurix MCU
Hypervisor
NVIDIA
Foundations
QNX OS and BSP/Drivers
NVIDIA System Software NvMeida/CUDA/CuDNN/TensorRT …
NVIDIA Drive Works
XPilot Frameworks
(Project Eagle)
NVIDIA
Tier-1
AUTOSAR
OTA Data
Camera
Service
CAN
Service
(Radar,
IMU/GNSS,
Vehicle IO)
XPilot
Autonomous
Driving
Applications
Perception,
Localization
Prediction, Path
Planning
Control, …
XPU HW NVIDIA/Tier- SW XPU Platform SW XPilot SW
Visualization Launcher
Monitor
Diagnostic
Service
Xpilot
Safety
App
28
Driving hierarchy w/ safety intervention
AEB
Driver: Human Driver: XPilot
Collision
Warnings
5 SAFETY
Independent AEB System
29
Summary
• XPENG Motors develop FUN, CONNECTED and INTELLIGENT EVs tailored for the
young and tech-savvy Chinese millennials
• Roadmap for XPENG Motors’ Autonomous Driving Solution
• System architecture design powered by Xavier
30
E28 is coming…
To be revealed at Auto Shanghai April 16

More Related Content

What's hot

Opinion: The Politics of SA vs NSA 5G & 4G Speeds
Opinion: The Politics of SA vs NSA 5G & 4G SpeedsOpinion: The Politics of SA vs NSA 5G & 4G Speeds
Opinion: The Politics of SA vs NSA 5G & 4G Speeds3G4G
 
XPDDS18: Design and Implementation of Automotive: Virtualization Based on Xen...
XPDDS18: Design and Implementation of Automotive: Virtualization Based on Xen...XPDDS18: Design and Implementation of Automotive: Virtualization Based on Xen...
XPDDS18: Design and Implementation of Automotive: Virtualization Based on Xen...The Linux Foundation
 
Building blocks of deep learning
Building blocks of deep learningBuilding blocks of deep learning
Building blocks of deep learningKeshan Sodimana
 
2018 Genivi Xen Overview Nov Update
2018 Genivi Xen Overview Nov Update2018 Genivi Xen Overview Nov Update
2018 Genivi Xen Overview Nov UpdateThe Linux Foundation
 
Announcing Amazon EC2 F1 Instances with Custom FPGAs
Announcing Amazon EC2 F1 Instances with Custom FPGAsAnnouncing Amazon EC2 F1 Instances with Custom FPGAs
Announcing Amazon EC2 F1 Instances with Custom FPGAsAmazon Web Services
 
Tilera tile64 by Ibrahem Batta
Tilera tile64  by Ibrahem BattaTilera tile64  by Ibrahem Batta
Tilera tile64 by Ibrahem BattaIbrahem Batta
 
Introduction to MAML (Model Agnostic Meta Learning) with Discussions
Introduction to MAML (Model Agnostic Meta Learning) with DiscussionsIntroduction to MAML (Model Agnostic Meta Learning) with Discussions
Introduction to MAML (Model Agnostic Meta Learning) with DiscussionsJoonyoung Yi
 
Learn how to addressing medical and industrial challenges with BlackBerry QNX...
Learn how to addressing medical and industrial challenges with BlackBerry QNX...Learn how to addressing medical and industrial challenges with BlackBerry QNX...
Learn how to addressing medical and industrial challenges with BlackBerry QNX...Qt
 
Ike A 5G Private Networks PNI-NPN/SNPN LF Edge Akraino Technical Meeting Spri...
Ike A 5G Private Networks PNI-NPN/SNPN LF Edge Akraino Technical Meeting Spri...Ike A 5G Private Networks PNI-NPN/SNPN LF Edge Akraino Technical Meeting Spri...
Ike A 5G Private Networks PNI-NPN/SNPN LF Edge Akraino Technical Meeting Spri...Ike Alisson
 
On First-Order Meta-Learning Algorithms
On First-Order Meta-Learning AlgorithmsOn First-Order Meta-Learning Algorithms
On First-Order Meta-Learning AlgorithmsYoonho Lee
 
SFO15-302: Energy Aware Scheduling: Progress Update
SFO15-302: Energy Aware Scheduling: Progress UpdateSFO15-302: Energy Aware Scheduling: Progress Update
SFO15-302: Energy Aware Scheduling: Progress UpdateLinaro
 
Automotive embedded systems part6 v1
Automotive embedded systems part6 v1Automotive embedded systems part6 v1
Automotive embedded systems part6 v1Keroles karam khalil
 
Mixed-critical adaptive AUTOSAR stack based on VxWorks, Linux, and virtualiza...
Mixed-critical adaptive AUTOSAR stack based on VxWorks, Linux, and virtualiza...Mixed-critical adaptive AUTOSAR stack based on VxWorks, Linux, and virtualiza...
Mixed-critical adaptive AUTOSAR stack based on VxWorks, Linux, and virtualiza...Andrei Kholodnyi
 
Graph Neural Network - Introduction
Graph Neural Network - IntroductionGraph Neural Network - Introduction
Graph Neural Network - IntroductionJungwon Kim
 
XPDS13: Xen in OSS based In–Vehicle Infotainment Systems - Artem Mygaiev, Glo...
XPDS13: Xen in OSS based In–Vehicle Infotainment Systems - Artem Mygaiev, Glo...XPDS13: Xen in OSS based In–Vehicle Infotainment Systems - Artem Mygaiev, Glo...
XPDS13: Xen in OSS based In–Vehicle Infotainment Systems - Artem Mygaiev, Glo...The Linux Foundation
 
The Low-Risk Path to Building Autonomous Car Architectures
The Low-Risk Path to Building Autonomous Car ArchitecturesThe Low-Risk Path to Building Autonomous Car Architectures
The Low-Risk Path to Building Autonomous Car ArchitecturesReal-Time Innovations (RTI)
 
Introduction of Deep Reinforcement Learning
Introduction of Deep Reinforcement LearningIntroduction of Deep Reinforcement Learning
Introduction of Deep Reinforcement LearningNAVER Engineering
 
Intro to Neural Networks
Intro to Neural NetworksIntro to Neural Networks
Intro to Neural NetworksDean Wyatte
 
ACRN vMeet-Up EU 2021 - shared memory based inter-vm communication introduction
ACRN vMeet-Up EU 2021 - shared memory based inter-vm communication introductionACRN vMeet-Up EU 2021 - shared memory based inter-vm communication introduction
ACRN vMeet-Up EU 2021 - shared memory based inter-vm communication introductionProject ACRN
 

What's hot (20)

Opinion: The Politics of SA vs NSA 5G & 4G Speeds
Opinion: The Politics of SA vs NSA 5G & 4G SpeedsOpinion: The Politics of SA vs NSA 5G & 4G Speeds
Opinion: The Politics of SA vs NSA 5G & 4G Speeds
 
LFCollab14: Xen vs Xen Automotive
LFCollab14: Xen vs Xen AutomotiveLFCollab14: Xen vs Xen Automotive
LFCollab14: Xen vs Xen Automotive
 
XPDDS18: Design and Implementation of Automotive: Virtualization Based on Xen...
XPDDS18: Design and Implementation of Automotive: Virtualization Based on Xen...XPDDS18: Design and Implementation of Automotive: Virtualization Based on Xen...
XPDDS18: Design and Implementation of Automotive: Virtualization Based on Xen...
 
Building blocks of deep learning
Building blocks of deep learningBuilding blocks of deep learning
Building blocks of deep learning
 
2018 Genivi Xen Overview Nov Update
2018 Genivi Xen Overview Nov Update2018 Genivi Xen Overview Nov Update
2018 Genivi Xen Overview Nov Update
 
Announcing Amazon EC2 F1 Instances with Custom FPGAs
Announcing Amazon EC2 F1 Instances with Custom FPGAsAnnouncing Amazon EC2 F1 Instances with Custom FPGAs
Announcing Amazon EC2 F1 Instances with Custom FPGAs
 
Tilera tile64 by Ibrahem Batta
Tilera tile64  by Ibrahem BattaTilera tile64  by Ibrahem Batta
Tilera tile64 by Ibrahem Batta
 
Introduction to MAML (Model Agnostic Meta Learning) with Discussions
Introduction to MAML (Model Agnostic Meta Learning) with DiscussionsIntroduction to MAML (Model Agnostic Meta Learning) with Discussions
Introduction to MAML (Model Agnostic Meta Learning) with Discussions
 
Learn how to addressing medical and industrial challenges with BlackBerry QNX...
Learn how to addressing medical and industrial challenges with BlackBerry QNX...Learn how to addressing medical and industrial challenges with BlackBerry QNX...
Learn how to addressing medical and industrial challenges with BlackBerry QNX...
 
Ike A 5G Private Networks PNI-NPN/SNPN LF Edge Akraino Technical Meeting Spri...
Ike A 5G Private Networks PNI-NPN/SNPN LF Edge Akraino Technical Meeting Spri...Ike A 5G Private Networks PNI-NPN/SNPN LF Edge Akraino Technical Meeting Spri...
Ike A 5G Private Networks PNI-NPN/SNPN LF Edge Akraino Technical Meeting Spri...
 
On First-Order Meta-Learning Algorithms
On First-Order Meta-Learning AlgorithmsOn First-Order Meta-Learning Algorithms
On First-Order Meta-Learning Algorithms
 
SFO15-302: Energy Aware Scheduling: Progress Update
SFO15-302: Energy Aware Scheduling: Progress UpdateSFO15-302: Energy Aware Scheduling: Progress Update
SFO15-302: Energy Aware Scheduling: Progress Update
 
Automotive embedded systems part6 v1
Automotive embedded systems part6 v1Automotive embedded systems part6 v1
Automotive embedded systems part6 v1
 
Mixed-critical adaptive AUTOSAR stack based on VxWorks, Linux, and virtualiza...
Mixed-critical adaptive AUTOSAR stack based on VxWorks, Linux, and virtualiza...Mixed-critical adaptive AUTOSAR stack based on VxWorks, Linux, and virtualiza...
Mixed-critical adaptive AUTOSAR stack based on VxWorks, Linux, and virtualiza...
 
Graph Neural Network - Introduction
Graph Neural Network - IntroductionGraph Neural Network - Introduction
Graph Neural Network - Introduction
 
XPDS13: Xen in OSS based In–Vehicle Infotainment Systems - Artem Mygaiev, Glo...
XPDS13: Xen in OSS based In–Vehicle Infotainment Systems - Artem Mygaiev, Glo...XPDS13: Xen in OSS based In–Vehicle Infotainment Systems - Artem Mygaiev, Glo...
XPDS13: Xen in OSS based In–Vehicle Infotainment Systems - Artem Mygaiev, Glo...
 
The Low-Risk Path to Building Autonomous Car Architectures
The Low-Risk Path to Building Autonomous Car ArchitecturesThe Low-Risk Path to Building Autonomous Car Architectures
The Low-Risk Path to Building Autonomous Car Architectures
 
Introduction of Deep Reinforcement Learning
Introduction of Deep Reinforcement LearningIntroduction of Deep Reinforcement Learning
Introduction of Deep Reinforcement Learning
 
Intro to Neural Networks
Intro to Neural NetworksIntro to Neural Networks
Intro to Neural Networks
 
ACRN vMeet-Up EU 2021 - shared memory based inter-vm communication introduction
ACRN vMeet-Up EU 2021 - shared memory based inter-vm communication introductionACRN vMeet-Up EU 2021 - shared memory based inter-vm communication introduction
ACRN vMeet-Up EU 2021 - shared memory based inter-vm communication introduction
 

Similar to Xpeng Motors' P7's self-driving roadmap and system design

“Market Analysis on SoCs for Imaging, Vision and Deep Learning in Automotive ...
“Market Analysis on SoCs for Imaging, Vision and Deep Learning in Automotive ...“Market Analysis on SoCs for Imaging, Vision and Deep Learning in Automotive ...
“Market Analysis on SoCs for Imaging, Vision and Deep Learning in Automotive ...Edge AI and Vision Alliance
 
Smart infrastructure for autonomous vehicles
Smart infrastructure for autonomous vehicles Smart infrastructure for autonomous vehicles
Smart infrastructure for autonomous vehicles Jeffrey Funk
 
Self-driving: AI evolution and Massive deployment in production cars
Self-driving: AI evolution and Massive deployment in production carsSelf-driving: AI evolution and Massive deployment in production cars
Self-driving: AI evolution and Massive deployment in production carsJunli Gu
 
Semi-Autonomous Vehicle
Semi-Autonomous VehicleSemi-Autonomous Vehicle
Semi-Autonomous VehicleIRJET Journal
 
smartcar-parkingsystem-180508104143 (1).pdf
smartcar-parkingsystem-180508104143 (1).pdfsmartcar-parkingsystem-180508104143 (1).pdf
smartcar-parkingsystem-180508104143 (1).pdfkannaradhas
 
SMART CAR-PARKING SYSTEM USING IOT
SMART CAR-PARKING SYSTEM USING IOTSMART CAR-PARKING SYSTEM USING IOT
SMART CAR-PARKING SYSTEM USING IOTSaipandu143
 
Smart Parking Solution using Camera Networks and Real-time Computer Vision
Smart Parking Solution using Camera Networks and Real-time Computer VisionSmart Parking Solution using Camera Networks and Real-time Computer Vision
Smart Parking Solution using Camera Networks and Real-time Computer VisionIRJET Journal
 
Design of Image Segmentation Algorithm for Autonomous Vehicle Navigationusing...
Design of Image Segmentation Algorithm for Autonomous Vehicle Navigationusing...Design of Image Segmentation Algorithm for Autonomous Vehicle Navigationusing...
Design of Image Segmentation Algorithm for Autonomous Vehicle Navigationusing...IJEEE
 
Key trends of smart transportation
Key trends of smart transportationKey trends of smart transportation
Key trends of smart transportationYoshifumi Sakamoto
 
DE - Smart Parking System.pptx
DE - Smart Parking System.pptxDE - Smart Parking System.pptx
DE - Smart Parking System.pptxBhavikSanghar
 
SMART MONITORING OF AUTOMOBILE USING IOT
SMART MONITORING OF AUTOMOBILE USING IOTSMART MONITORING OF AUTOMOBILE USING IOT
SMART MONITORING OF AUTOMOBILE USING IOTJournal For Research
 
Google's Driverless Car
Google's Driverless CarGoogle's Driverless Car
Google's Driverless Caraishu nischala
 
IRJET- Self Driving Car using Raspberry-Pi and Machine Learning
IRJET- Self Driving Car using Raspberry-Pi and Machine LearningIRJET- Self Driving Car using Raspberry-Pi and Machine Learning
IRJET- Self Driving Car using Raspberry-Pi and Machine LearningIRJET Journal
 
Automatic gate control
Automatic gate controlAutomatic gate control
Automatic gate controlDipankar Haloi
 
IRJET-Smart Parking System
IRJET-Smart Parking SystemIRJET-Smart Parking System
IRJET-Smart Parking SystemIRJET Journal
 
Practices of AI guided traffic analysis
Practices of AI guided traffic analysisPractices of AI guided traffic analysis
Practices of AI guided traffic analysisJumpingJaq
 
"2D and 3D Sensing: Markets, Applications, and Technologies," a Presentation ...
"2D and 3D Sensing: Markets, Applications, and Technologies," a Presentation ..."2D and 3D Sensing: Markets, Applications, and Technologies," a Presentation ...
"2D and 3D Sensing: Markets, Applications, and Technologies," a Presentation ...Edge AI and Vision Alliance
 
5G Automotive, V2X Opportunity and Challenges
5G Automotive, V2X Opportunity and Challenges5G Automotive, V2X Opportunity and Challenges
5G Automotive, V2X Opportunity and ChallengesMarie-Paule Odini
 

Similar to Xpeng Motors' P7's self-driving roadmap and system design (20)

“Market Analysis on SoCs for Imaging, Vision and Deep Learning in Automotive ...
“Market Analysis on SoCs for Imaging, Vision and Deep Learning in Automotive ...“Market Analysis on SoCs for Imaging, Vision and Deep Learning in Automotive ...
“Market Analysis on SoCs for Imaging, Vision and Deep Learning in Automotive ...
 
Smart infrastructure for autonomous vehicles
Smart infrastructure for autonomous vehicles Smart infrastructure for autonomous vehicles
Smart infrastructure for autonomous vehicles
 
Self-driving: AI evolution and Massive deployment in production cars
Self-driving: AI evolution and Massive deployment in production carsSelf-driving: AI evolution and Massive deployment in production cars
Self-driving: AI evolution and Massive deployment in production cars
 
Semi-Autonomous Vehicle
Semi-Autonomous VehicleSemi-Autonomous Vehicle
Semi-Autonomous Vehicle
 
smartcar-parkingsystem-180508104143 (1).pdf
smartcar-parkingsystem-180508104143 (1).pdfsmartcar-parkingsystem-180508104143 (1).pdf
smartcar-parkingsystem-180508104143 (1).pdf
 
SMART CAR-PARKING SYSTEM USING IOT
SMART CAR-PARKING SYSTEM USING IOTSMART CAR-PARKING SYSTEM USING IOT
SMART CAR-PARKING SYSTEM USING IOT
 
Fullstop.ai (1)
Fullstop.ai (1)Fullstop.ai (1)
Fullstop.ai (1)
 
Smart Parking Solution using Camera Networks and Real-time Computer Vision
Smart Parking Solution using Camera Networks and Real-time Computer VisionSmart Parking Solution using Camera Networks and Real-time Computer Vision
Smart Parking Solution using Camera Networks and Real-time Computer Vision
 
Design of Image Segmentation Algorithm for Autonomous Vehicle Navigationusing...
Design of Image Segmentation Algorithm for Autonomous Vehicle Navigationusing...Design of Image Segmentation Algorithm for Autonomous Vehicle Navigationusing...
Design of Image Segmentation Algorithm for Autonomous Vehicle Navigationusing...
 
IRJET-V8I686.pdf
IRJET-V8I686.pdfIRJET-V8I686.pdf
IRJET-V8I686.pdf
 
Key trends of smart transportation
Key trends of smart transportationKey trends of smart transportation
Key trends of smart transportation
 
DE - Smart Parking System.pptx
DE - Smart Parking System.pptxDE - Smart Parking System.pptx
DE - Smart Parking System.pptx
 
SMART MONITORING OF AUTOMOBILE USING IOT
SMART MONITORING OF AUTOMOBILE USING IOTSMART MONITORING OF AUTOMOBILE USING IOT
SMART MONITORING OF AUTOMOBILE USING IOT
 
Google's Driverless Car
Google's Driverless CarGoogle's Driverless Car
Google's Driverless Car
 
IRJET- Self Driving Car using Raspberry-Pi and Machine Learning
IRJET- Self Driving Car using Raspberry-Pi and Machine LearningIRJET- Self Driving Car using Raspberry-Pi and Machine Learning
IRJET- Self Driving Car using Raspberry-Pi and Machine Learning
 
Automatic gate control
Automatic gate controlAutomatic gate control
Automatic gate control
 
IRJET-Smart Parking System
IRJET-Smart Parking SystemIRJET-Smart Parking System
IRJET-Smart Parking System
 
Practices of AI guided traffic analysis
Practices of AI guided traffic analysisPractices of AI guided traffic analysis
Practices of AI guided traffic analysis
 
"2D and 3D Sensing: Markets, Applications, and Technologies," a Presentation ...
"2D and 3D Sensing: Markets, Applications, and Technologies," a Presentation ..."2D and 3D Sensing: Markets, Applications, and Technologies," a Presentation ...
"2D and 3D Sensing: Markets, Applications, and Technologies," a Presentation ...
 
5G Automotive, V2X Opportunity and Challenges
5G Automotive, V2X Opportunity and Challenges5G Automotive, V2X Opportunity and Challenges
5G Automotive, V2X Opportunity and Challenges
 

Recently uploaded

Human Resource Practices TATA MOTORS.pdf
Human Resource Practices TATA MOTORS.pdfHuman Resource Practices TATA MOTORS.pdf
Human Resource Practices TATA MOTORS.pdfAditiMishra247289
 
ABOUT REGENERATIVE BRAKING SYSTEM ON AUTOMOBILES
ABOUT REGENERATIVE BRAKING SYSTEM ON AUTOMOBILESABOUT REGENERATIVE BRAKING SYSTEM ON AUTOMOBILES
ABOUT REGENERATIVE BRAKING SYSTEM ON AUTOMOBILESsriharshaganjam1
 
Building a Future Where Everyone Can Ride and Drive Electric by Bridget Gilmore
Building a Future Where Everyone Can Ride and Drive Electric by Bridget GilmoreBuilding a Future Where Everyone Can Ride and Drive Electric by Bridget Gilmore
Building a Future Where Everyone Can Ride and Drive Electric by Bridget GilmoreForth
 
-The-Present-Simple-Tense.pdf english hh
-The-Present-Simple-Tense.pdf english hh-The-Present-Simple-Tense.pdf english hh
-The-Present-Simple-Tense.pdf english hhmhamadhawlery16
 
Lighting the Way Understanding Jaguar Car Check Engine Light Service
Lighting the Way Understanding Jaguar Car Check Engine Light ServiceLighting the Way Understanding Jaguar Car Check Engine Light Service
Lighting the Way Understanding Jaguar Car Check Engine Light ServiceImport Car Center
 
A Comprehensive Exploration of the Components and Parts Found in Diesel Engines
A Comprehensive Exploration of the Components and Parts Found in Diesel EnginesA Comprehensive Exploration of the Components and Parts Found in Diesel Engines
A Comprehensive Exploration of the Components and Parts Found in Diesel EnginesROJANE BERNAS, PhD.
 
Can't Roll Up Your Audi A4 Power Window Let's Uncover the Issue!
Can't Roll Up Your Audi A4 Power Window Let's Uncover the Issue!Can't Roll Up Your Audi A4 Power Window Let's Uncover the Issue!
Can't Roll Up Your Audi A4 Power Window Let's Uncover the Issue!Mint Automotive
 
Welcome to Auto Know University Orientation
Welcome to Auto Know University OrientationWelcome to Auto Know University Orientation
Welcome to Auto Know University Orientationxlr8sales
 
248649330-Animatronics-Technical-Seminar-Report-by-Aswin-Sarang.pdf
248649330-Animatronics-Technical-Seminar-Report-by-Aswin-Sarang.pdf248649330-Animatronics-Technical-Seminar-Report-by-Aswin-Sarang.pdf
248649330-Animatronics-Technical-Seminar-Report-by-Aswin-Sarang.pdfkushkruthik555
 
Pros and cons of buying used fleet vehicles.pptx
Pros and cons of buying used fleet vehicles.pptxPros and cons of buying used fleet vehicles.pptx
Pros and cons of buying used fleet vehicles.pptxjennifermiller8137
 
Mastering Mercedes Engine Care Top Tips for Rowlett, TX Residents
Mastering Mercedes Engine Care Top Tips for Rowlett, TX ResidentsMastering Mercedes Engine Care Top Tips for Rowlett, TX Residents
Mastering Mercedes Engine Care Top Tips for Rowlett, TX ResidentsRowlett Motorwerks
 
Control-Plan-Training.pptx for the Automotive standard AIAG
Control-Plan-Training.pptx for the Automotive standard AIAGControl-Plan-Training.pptx for the Automotive standard AIAG
Control-Plan-Training.pptx for the Automotive standard AIAGVikrantPawar37
 

Recently uploaded (12)

Human Resource Practices TATA MOTORS.pdf
Human Resource Practices TATA MOTORS.pdfHuman Resource Practices TATA MOTORS.pdf
Human Resource Practices TATA MOTORS.pdf
 
ABOUT REGENERATIVE BRAKING SYSTEM ON AUTOMOBILES
ABOUT REGENERATIVE BRAKING SYSTEM ON AUTOMOBILESABOUT REGENERATIVE BRAKING SYSTEM ON AUTOMOBILES
ABOUT REGENERATIVE BRAKING SYSTEM ON AUTOMOBILES
 
Building a Future Where Everyone Can Ride and Drive Electric by Bridget Gilmore
Building a Future Where Everyone Can Ride and Drive Electric by Bridget GilmoreBuilding a Future Where Everyone Can Ride and Drive Electric by Bridget Gilmore
Building a Future Where Everyone Can Ride and Drive Electric by Bridget Gilmore
 
-The-Present-Simple-Tense.pdf english hh
-The-Present-Simple-Tense.pdf english hh-The-Present-Simple-Tense.pdf english hh
-The-Present-Simple-Tense.pdf english hh
 
Lighting the Way Understanding Jaguar Car Check Engine Light Service
Lighting the Way Understanding Jaguar Car Check Engine Light ServiceLighting the Way Understanding Jaguar Car Check Engine Light Service
Lighting the Way Understanding Jaguar Car Check Engine Light Service
 
A Comprehensive Exploration of the Components and Parts Found in Diesel Engines
A Comprehensive Exploration of the Components and Parts Found in Diesel EnginesA Comprehensive Exploration of the Components and Parts Found in Diesel Engines
A Comprehensive Exploration of the Components and Parts Found in Diesel Engines
 
Can't Roll Up Your Audi A4 Power Window Let's Uncover the Issue!
Can't Roll Up Your Audi A4 Power Window Let's Uncover the Issue!Can't Roll Up Your Audi A4 Power Window Let's Uncover the Issue!
Can't Roll Up Your Audi A4 Power Window Let's Uncover the Issue!
 
Welcome to Auto Know University Orientation
Welcome to Auto Know University OrientationWelcome to Auto Know University Orientation
Welcome to Auto Know University Orientation
 
248649330-Animatronics-Technical-Seminar-Report-by-Aswin-Sarang.pdf
248649330-Animatronics-Technical-Seminar-Report-by-Aswin-Sarang.pdf248649330-Animatronics-Technical-Seminar-Report-by-Aswin-Sarang.pdf
248649330-Animatronics-Technical-Seminar-Report-by-Aswin-Sarang.pdf
 
Pros and cons of buying used fleet vehicles.pptx
Pros and cons of buying used fleet vehicles.pptxPros and cons of buying used fleet vehicles.pptx
Pros and cons of buying used fleet vehicles.pptx
 
Mastering Mercedes Engine Care Top Tips for Rowlett, TX Residents
Mastering Mercedes Engine Care Top Tips for Rowlett, TX ResidentsMastering Mercedes Engine Care Top Tips for Rowlett, TX Residents
Mastering Mercedes Engine Care Top Tips for Rowlett, TX Residents
 
Control-Plan-Training.pptx for the Automotive standard AIAG
Control-Plan-Training.pptx for the Automotive standard AIAGControl-Plan-Training.pptx for the Automotive standard AIAG
Control-Plan-Training.pptx for the Automotive standard AIAG
 

Xpeng Motors' P7's self-driving roadmap and system design

  • 1. 0 Developing Autonomous Driving EVs for the China Market XPENG Motors’ Approach Junli Gu VP of Autonomous Driving, XPENG motors March 18, 2019
  • 2. 1 Agenda 1. XPENG Motors Introduction and Background 2. Roadmap for XPENG Motors’ Autonomous Driving Solution 3. System Architecture Design Powered by Xavier
  • 3. 2 Who is XPENG? We develop FUN, CONNECTED and INTELLIGENT EVs tailored for the young and tech-savvy Chinese Millennials 2 • Aimed at young Internet users in China, with autonomous driving and intelligent connection as the core differences • 2014: Founded in Guangzhou, China • Dec 2018: Mass production and official launch of G3 (electrical SUV) • Q1 2019: Mass production of E28 (electrical sedan)
  • 4. 3 Strong R&D capabilities and investments Shanghai Intelligent Connected Vehicle Navigation R&D Silicon Valley & San Diego Machine Learning Autonomous Driving R&D Guangzhou Vehicle and VCU R&D V2X Testing Trial and Production Lead-in Beijing Artificial Intelligence R&D R&D footprint Our R&D headcount accounts for over 70% of our total number of employees.
  • 5. 4 Your Smart Driving Assistant Connectivity Xmart OS X-pilot Artificial Intelligence
  • 7. 6 Agenda 1. XPENG Motors Introduction and Background 2. Roadmap for XPENG Motors’ Autonomous Driving Solution 3. System Architecture Design Powered by Xavier
  • 8. 7 L3 Products: Highly-Autonomous Highway Features L4 Products: Fully-Autonomous Urban & Highway Features - Driverless Robo Taxi - Driverless Robo Bus - Human Driver vehicles L2+ Products: Semi-Autonomous Highway/Urban Features - Human Driver vehicles Self-Driving Two Separate Branches…
  • 9. Comfort Driving with safety guarantees Where are we heading… • Key differentiation through XPENG’s intelligent EV strategy • Focus on in-house software solutions running on leading computer hardware platforms • Focus on enhancing driver assistance features towards L3 capabilities in 2020 • Focus on feature optimization for Chinese market and Chinese consumers 8
  • 10. 9 Roadmap for XPENG Motors’ Autonomous Driving Solution XPilot 2018-2019 2020 2021-2022 2024-2025 CarModel Autonomous Driving Achievement &Goal • Xpilot 2.0: Full scenario auto parking + LCC + ACC • Xpilot 3.0: Super Memory Parking + Highway Autopilot • Xpilot 4.0: AVP + Highway/Urban Autopilot • Xpilot x.0: Full Automation in limited scenarios (highway, parking, etc.) • First generation solution for commercialization with partial self developed IPs • Fully self developed end-to-end SW IP • Next gen HW platform with optimized sensor cost • First level-4 solution in consumer vehicle A Class SUV (G3) B Class Sedan (E28) B Class SUV
  • 11. 10 XPENG G3 By AI, irregular lots By memory Roadmap for XPENG Motors’ Autonomous Driving Solution-XPilot parking functions XPENG E28 Alleviate people’s parking anxiety in parallel, vertical, perpendicular, irregular lots… parking functions By voice By Vision By Ultrasonic
  • 12. 11 Use Case Example: Super Memory Parking
  • 13. 12 Use Case Example: Highway Auto-Pilot
  • 14. 13 2km ahead Xpilot’s Surrounding Reality Ego Traffic Point of interest Road side object Lane condition
  • 15. 14 Agenda 1. XPENG Motors introduction and background 2. Roadmap for XPENG Motors’ Autonomous Driving Solution 3. System architecture design powered by Xavier
  • 16. 15 Driving Big Data AI and Perception High-perf chips Customized Sensor Structure - - Chinese Traffic Patterns Local adaption is a must - - • Chinese style lane change and close cutting in • Very large variety of obstacles • Dense traffic • Irregular Pattern
  • 17. 16 Challenge: Perception & Creating a Representative 3D Environmental Model Compute (MP/s) Quality raw sensor input with cost constraints 2 1 Preponderance of training data (especially corner cases) 3
  • 18. 17 Challenge: Perception & Creating a Representative 3D Environmental Model Real stream taken from E28 camera sets; ISP developed in house;
  • 19. 18 Challenge: Extending to Day/Night, All Weather, All locations 1) Time (Location of Sun: Day/Night/NotDawn/NotDusk) 2) Select Weather Conditions 3) Availability of GNSS & RTK 4) Place (GeoFenced) 5) Select Speed Range 6) Road/Traffic Conditions Sensing/Perception challenges (due to insufficient quality of raw data and/or compute power) Mapping challenges Driving policy challenges
  • 20. Ultrasonic Sensors (6 in Front) Tri-focal Cameras (2M pixels, FOV 28, 52, 100, 60/15fps) Surround-view Camera (1 at Back) Rear-view Camera (2M pixels,FOV 52, 30fps) In-Car Intelligent Camera Radars (5 in Total) Surround-view Camera (1 in Front) Ultrasonic Sensors (6 at Back) Surround-view Camera (2 on Sides) Cut-In Prevention Camera 1M pixels, 60fps)Rear-view Camera (1M pixels, 30fps) Sensor System for E28 (Mass production in 2020) 19 Note: We use first vehicle G3’s picture as E28’s design is not revealed yet.
  • 21. 20 XPilot Camera Coverage and Functions for E28 360 coverage; Designed to cover traffic scenarios in China HFOV 100 HFOV 52
  • 23. 22 1828x948@15fps (for Highway Driving) 457x237@60fps (for Urban Driving) Long Range CNN (Perception at > 200m) Close Proximity CNN (Responds x4 faster) Cameras Variable fps Network for China Specific Drive Conditions (Close Vehicle Proximity and Abrupt Cut-ins) 1
  • 24. 23 HighwayUrban Canyon START POINT / END POINT 55 Km route (Approx. 2.5hr) 2.5hrs x 3600 x 1Hz = 9,000 samples GuangzhouRoute8 Absolute Localization Reference Antenna + GNSS/INS 2 GNSS / INS 20cm absolute-localization-accuracy at 95% (2 σ) 20cm absolute-localization-accuracy for at 95% (2 σ) of Highway route in white
  • 25. 24 Front Radars Right Front Corner Radar Left Front Corner Radar Left Rear Corner Radar Right Rear Corner Radar 3 RADAR Five Radars of High Angular Resolution: 2x improvement 5th Generation of Radar Technology
  • 26. 25 Industry Leading Computing Platform XPilot Unit (XPU) powered by NVIDIA Xavier NVIDIA Xavier Safety MCU Camera Des Camera Des Camera Des Memory EMMC Storage CAN Transceiver Ethernet Switch Power Management CAN Ethernet 4
  • 27. 26 Why NVIDIA Xavier? 0 5 10 15 20 25 30 35 Computing Power (TOPS) Deep Learning Computing Throughput NVIDIA Xavier FPGA NVIDIA Parker TI TDA2xx TOPS
  • 28. 27 XPU Software Stack NVIDIA Xavier SoC Aurix MCU Hypervisor NVIDIA Foundations QNX OS and BSP/Drivers NVIDIA System Software NvMeida/CUDA/CuDNN/TensorRT … NVIDIA Drive Works XPilot Frameworks (Project Eagle) NVIDIA Tier-1 AUTOSAR OTA Data Camera Service CAN Service (Radar, IMU/GNSS, Vehicle IO) XPilot Autonomous Driving Applications Perception, Localization Prediction, Path Planning Control, … XPU HW NVIDIA/Tier- SW XPU Platform SW XPilot SW Visualization Launcher Monitor Diagnostic Service Xpilot Safety App
  • 29. 28 Driving hierarchy w/ safety intervention AEB Driver: Human Driver: XPilot Collision Warnings 5 SAFETY Independent AEB System
  • 30. 29 Summary • XPENG Motors develop FUN, CONNECTED and INTELLIGENT EVs tailored for the young and tech-savvy Chinese millennials • Roadmap for XPENG Motors’ Autonomous Driving Solution • System architecture design powered by Xavier
  • 31. 30 E28 is coming… To be revealed at Auto Shanghai April 16