SlideShare a Scribd company logo
0
Developing Autonomous Driving EVs for the
China Market XPENG Motors’ Approach
Junli Gu
VP of Autonomous Driving, XPENG
motors
March 18, 2019
1
Agenda
1. XPENG Motors Introduction and Background
2. Roadmap for XPENG Motors’ Autonomous Driving Solution
3. System Architecture Design Powered by Xavier
2
Who is XPENG?
We develop FUN, CONNECTED and INTELLIGENT EVs tailored for
the young and tech-savvy Chinese Millennials
2
• Aimed at young Internet users in China, with autonomous driving and
intelligent connection as the core differences
• 2014: Founded in Guangzhou, China
• Dec 2018: Mass production and official launch of G3 (electrical SUV)
• Q1 2019: Mass production of E28 (electrical sedan)
3
Strong R&D capabilities and investments
Shanghai
Intelligent Connected
Vehicle
Navigation R&D
Silicon Valley &
San Diego
Machine Learning
Autonomous Driving
R&D
Guangzhou
Vehicle and VCU
R&D
V2X Testing
Trial and Production
Lead-in
Beijing
Artificial Intelligence
R&D
R&D footprint
Our R&D headcount accounts for over 70% of our total number of employees.
4
Your Smart Driving Assistant
Connectivity
Xmart OS
X-pilot
Artificial
Intelligence
5
X-center
XPENG Headquarter
5
6
Agenda
1. XPENG Motors Introduction and Background
2. Roadmap for XPENG Motors’ Autonomous Driving Solution
3. System Architecture Design Powered by Xavier
7
L3 Products: Highly-Autonomous Highway Features
L4 Products: Fully-Autonomous
Urban & Highway Features
- Driverless Robo Taxi
- Driverless Robo Bus
- Human Driver vehicles
L2+ Products: Semi-Autonomous Highway/Urban Features
- Human Driver vehicles
Self-Driving Two Separate Branches…
Comfort Driving with safety guarantees
Where are we heading…
• Key differentiation through XPENG’s intelligent EV strategy
• Focus on in-house software solutions running on leading
computer hardware platforms
• Focus on enhancing driver assistance features towards L3
capabilities in 2020
• Focus on feature optimization for Chinese market and
Chinese consumers
8
9
Roadmap for XPENG Motors’ Autonomous Driving Solution XPilot
2018-2019 2020 2021-2022 2024-2025
CarModel
Autonomous
Driving
Achievement
&Goal
• Xpilot 2.0:
Full scenario auto
parking + LCC + ACC
• Xpilot 3.0:
Super Memory Parking
+ Highway Autopilot
• Xpilot 4.0:
AVP + Highway/Urban
Autopilot
• Xpilot x.0:
Full Automation in
limited scenarios
(highway, parking, etc.)
• First generation
solution for
commercialization
with partial self
developed IPs
• Fully self developed
end-to-end SW IP
• Next gen HW
platform with
optimized sensor cost
• First level-4 solution
in consumer vehicle
A Class SUV (G3) B Class Sedan (E28) B Class SUV
10
XPENG G3
By AI,
irregular lots
By memory
Roadmap for XPENG Motors’ Autonomous Driving Solution-XPilot
parking functions
XPENG E28
Alleviate people’s parking anxiety in parallel, vertical, perpendicular, irregular lots…
parking functions
By voice
By Vision
By Ultrasonic
11
Use Case Example: Super Memory Parking
12
Use Case Example: Highway Auto-Pilot
13
2km ahead
Xpilot’s Surrounding Reality
Ego
Traffic
Point of interest
Road side object
Lane condition
14
Agenda
1. XPENG Motors introduction and background
2. Roadmap for XPENG Motors’ Autonomous Driving Solution
3. System architecture design powered by Xavier
15
Driving
Big Data
AI and
Perception
High-perf
chips
Customized
Sensor
Structure
- -
Chinese Traffic Patterns
Local adaption is a must
- -
• Chinese style lane change and close cutting in
• Very large variety of obstacles
• Dense traffic
• Irregular Pattern
16
Challenge: Perception & Creating a Representative 3D Environmental Model
Compute (MP/s)
Quality raw sensor input with cost
constraints
2
1
Preponderance of training data
(especially corner cases)
3
17
Challenge: Perception & Creating a Representative 3D Environmental Model
Real stream taken from E28 camera sets; ISP developed in house;
18
Challenge: Extending to Day/Night, All Weather, All locations
1) Time (Location of Sun: Day/Night/NotDawn/NotDusk)
2) Select Weather Conditions
3) Availability of GNSS & RTK
4) Place (GeoFenced)
5) Select Speed Range
6) Road/Traffic Conditions
Sensing/Perception challenges (due
to insufficient quality of raw data
and/or compute power)
Mapping challenges
Driving policy
challenges
Ultrasonic Sensors
(6 in Front)
Tri-focal Cameras
(2M pixels, FOV 28,
52, 100, 60/15fps)
Surround-view
Camera (1 at Back)
Rear-view Camera
(2M pixels,FOV 52,
30fps)
In-Car Intelligent
Camera
Radars
(5 in Total)
Surround-view Camera
(1 in Front)
Ultrasonic Sensors
(6 at Back)
Surround-view
Camera (2 on Sides)
Cut-In Prevention
Camera
1M pixels, 60fps)Rear-view Camera
(1M pixels, 30fps)
Sensor System for E28 (Mass production in 2020)
19
Note: We use first vehicle G3’s picture as E28’s design is not revealed yet.
20
XPilot Camera Coverage and Functions for E28
360 coverage; Designed to cover traffic scenarios in China
HFOV 100
HFOV 52
21
System Differentiators
22
1828x948@15fps
(for Highway Driving)
457x237@60fps
(for Urban Driving)
Long Range CNN
(Perception at > 200m)
Close Proximity CNN
(Responds x4 faster)
Cameras
Variable fps Network for China Specific Drive Conditions
(Close Vehicle Proximity and Abrupt Cut-ins)
1
23
HighwayUrban Canyon
START POINT /
END POINT
55 Km route (Approx. 2.5hr)
2.5hrs x 3600 x 1Hz = 9,000 samples
GuangzhouRoute8
Absolute
Localization
Reference
Antenna +
GNSS/INS
2 GNSS / INS
20cm absolute-localization-accuracy at 95% (2 σ)
20cm absolute-localization-accuracy for at 95% (2 σ) of Highway route in white
24
Front Radars
Right Front
Corner Radar
Left Front
Corner Radar
Left Rear
Corner Radar
Right Rear
Corner Radar
3 RADAR
Five Radars of High Angular Resolution: 2x improvement
5th Generation of Radar Technology
25
Industry Leading Computing Platform
XPilot Unit (XPU) powered by NVIDIA Xavier
NVIDIA Xavier
Safety MCU
Camera Des
Camera Des
Camera Des
Memory
EMMC
Storage
CAN
Transceiver
Ethernet
Switch
Power
Management
CAN Ethernet
4
26
Why NVIDIA Xavier?
0
5
10
15
20
25
30
35
Computing Power (TOPS)
Deep Learning Computing Throughput
NVIDIA Xavier FPGA NVIDIA Parker TI TDA2xx
TOPS
27
XPU Software Stack
NVIDIA Xavier SoC Aurix MCU
Hypervisor
NVIDIA
Foundations
QNX OS and BSP/Drivers
NVIDIA System Software NvMeida/CUDA/CuDNN/TensorRT …
NVIDIA Drive Works
XPilot Frameworks
(Project Eagle)
NVIDIA
Tier-1
AUTOSAR
OTA Data
Camera
Service
CAN
Service
(Radar,
IMU/GNSS,
Vehicle IO)
XPilot
Autonomous
Driving
Applications
Perception,
Localization
Prediction, Path
Planning
Control, …
XPU HW NVIDIA/Tier- SW XPU Platform SW XPilot SW
Visualization Launcher
Monitor
Diagnostic
Service
Xpilot
Safety
App
28
Driving hierarchy w/ safety intervention
AEB
Driver: Human Driver: XPilot
Collision
Warnings
5 SAFETY
Independent AEB System
29
Summary
• XPENG Motors develop FUN, CONNECTED and INTELLIGENT EVs tailored for the
young and tech-savvy Chinese millennials
• Roadmap for XPENG Motors’ Autonomous Driving Solution
• System architecture design powered by Xavier
30
E28 is coming…
To be revealed at Auto Shanghai April 16

More Related Content

What's hot

SOFTWARE-DEFINED SUCCESS: THE NEXT GENERATION OF AUTOMOTIVE LIDAR
SOFTWARE-DEFINED SUCCESS: THE NEXT GENERATION OF AUTOMOTIVE LIDARSOFTWARE-DEFINED SUCCESS: THE NEXT GENERATION OF AUTOMOTIVE LIDAR
SOFTWARE-DEFINED SUCCESS: THE NEXT GENERATION OF AUTOMOTIVE LIDAR
iQHub
 
Detection of fraud in financial blockchain-based transactions through big dat...
Detection of fraud in financial blockchain-based transactions through big dat...Detection of fraud in financial blockchain-based transactions through big dat...
Detection of fraud in financial blockchain-based transactions through big dat...
CARLOS III UNIVERSITY OF MADRID
 
ODCA Board Best Practice: High Performance Computing at BMW
ODCA Board Best Practice: High Performance Computing at BMWODCA Board Best Practice: High Performance Computing at BMW
ODCA Board Best Practice: High Performance Computing at BMW
Open Data Center Alliance
 
FIA16: Leonardo Aircraft Division: M-346 programme - the dual role concept
FIA16: Leonardo Aircraft Division: M-346 programme - the dual role conceptFIA16: Leonardo Aircraft Division: M-346 programme - the dual role concept
FIA16: Leonardo Aircraft Division: M-346 programme - the dual role concept
Leonardo
 
Computer Vision for autonomous driving
Computer Vision for autonomous drivingComputer Vision for autonomous driving
Computer Vision for autonomous driving
Bill Liu
 
Real-time drone tracking - direct Remote ID modules. Security and legislation.
Real-time drone tracking - direct Remote ID modules. Security and legislation.Real-time drone tracking - direct Remote ID modules. Security and legislation.
Real-time drone tracking - direct Remote ID modules. Security and legislation.
MartaStenopiedis
 
Machine Learning & Self-Driving Cars
Machine Learning & Self-Driving CarsMachine Learning & Self-Driving Cars
Machine Learning & Self-Driving Cars
Christopher Mohritz
 
Predictive Maintenance - Portland Machine Learning Meetup
Predictive Maintenance - Portland Machine Learning MeetupPredictive Maintenance - Portland Machine Learning Meetup
Predictive Maintenance - Portland Machine Learning Meetup
Ian Downard
 
LiDARs for Automotive and Industrial Applications 2018 Report by Yole Develop...
LiDARs for Automotive and Industrial Applications 2018 Report by Yole Develop...LiDARs for Automotive and Industrial Applications 2018 Report by Yole Develop...
LiDARs for Automotive and Industrial Applications 2018 Report by Yole Develop...
Yole Developpement
 
V2X Communications: Getting our Cars Talking
V2X Communications: Getting our Cars TalkingV2X Communications: Getting our Cars Talking
V2X Communications: Getting our Cars Talking
Alison Chaiken
 
Connected & Autonomous vehicles: cybersecurity on a grand scale v1
Connected & Autonomous vehicles: cybersecurity on a grand scale v1Connected & Autonomous vehicles: cybersecurity on a grand scale v1
Connected & Autonomous vehicles: cybersecurity on a grand scale v1
Bill Harpley
 
Verification of IVI Over-The-Air using UML/OCL
Verification of IVI Over-The-Air using UML/OCLVerification of IVI Over-The-Air using UML/OCL
Verification of IVI Over-The-Air using UML/OCL
Seungjoo Kim
 
Applying ML for Log Analysis
Applying ML for Log AnalysisApplying ML for Log Analysis
Applying ML for Log Analysis
DoiT International
 
Results of model-based testing in automotive
Results of model-based testing in automotiveResults of model-based testing in automotive
Results of model-based testing in automotive
Anthony Faucogney
 
F 35 brief
F 35 briefF 35 brief
F 35 brief
Picard578
 
An AI accelerator ASIC architecture
An AI accelerator ASIC architectureAn AI accelerator ASIC architecture
An AI accelerator ASIC architecture
Khanh Le
 
Automated Testing of Autonomous Driving Assistance Systems
Automated Testing of Autonomous Driving Assistance SystemsAutomated Testing of Autonomous Driving Assistance Systems
Automated Testing of Autonomous Driving Assistance Systems
Lionel Briand
 
Quadcopter
QuadcopterQuadcopter
Quadcopter
Aakash Goyal
 
Advanced driver assistance systems
Advanced driver assistance systemsAdvanced driver assistance systems
Advanced driver assistance systems
Car Leasing Made Simple
 
"Computer Vision in Cars: Status, Challenges, and Trends," a Presentation fro...
"Computer Vision in Cars: Status, Challenges, and Trends," a Presentation fro..."Computer Vision in Cars: Status, Challenges, and Trends," a Presentation fro...
"Computer Vision in Cars: Status, Challenges, and Trends," a Presentation fro...
Edge AI and Vision Alliance
 

What's hot (20)

SOFTWARE-DEFINED SUCCESS: THE NEXT GENERATION OF AUTOMOTIVE LIDAR
SOFTWARE-DEFINED SUCCESS: THE NEXT GENERATION OF AUTOMOTIVE LIDARSOFTWARE-DEFINED SUCCESS: THE NEXT GENERATION OF AUTOMOTIVE LIDAR
SOFTWARE-DEFINED SUCCESS: THE NEXT GENERATION OF AUTOMOTIVE LIDAR
 
Detection of fraud in financial blockchain-based transactions through big dat...
Detection of fraud in financial blockchain-based transactions through big dat...Detection of fraud in financial blockchain-based transactions through big dat...
Detection of fraud in financial blockchain-based transactions through big dat...
 
ODCA Board Best Practice: High Performance Computing at BMW
ODCA Board Best Practice: High Performance Computing at BMWODCA Board Best Practice: High Performance Computing at BMW
ODCA Board Best Practice: High Performance Computing at BMW
 
FIA16: Leonardo Aircraft Division: M-346 programme - the dual role concept
FIA16: Leonardo Aircraft Division: M-346 programme - the dual role conceptFIA16: Leonardo Aircraft Division: M-346 programme - the dual role concept
FIA16: Leonardo Aircraft Division: M-346 programme - the dual role concept
 
Computer Vision for autonomous driving
Computer Vision for autonomous drivingComputer Vision for autonomous driving
Computer Vision for autonomous driving
 
Real-time drone tracking - direct Remote ID modules. Security and legislation.
Real-time drone tracking - direct Remote ID modules. Security and legislation.Real-time drone tracking - direct Remote ID modules. Security and legislation.
Real-time drone tracking - direct Remote ID modules. Security and legislation.
 
Machine Learning & Self-Driving Cars
Machine Learning & Self-Driving CarsMachine Learning & Self-Driving Cars
Machine Learning & Self-Driving Cars
 
Predictive Maintenance - Portland Machine Learning Meetup
Predictive Maintenance - Portland Machine Learning MeetupPredictive Maintenance - Portland Machine Learning Meetup
Predictive Maintenance - Portland Machine Learning Meetup
 
LiDARs for Automotive and Industrial Applications 2018 Report by Yole Develop...
LiDARs for Automotive and Industrial Applications 2018 Report by Yole Develop...LiDARs for Automotive and Industrial Applications 2018 Report by Yole Develop...
LiDARs for Automotive and Industrial Applications 2018 Report by Yole Develop...
 
V2X Communications: Getting our Cars Talking
V2X Communications: Getting our Cars TalkingV2X Communications: Getting our Cars Talking
V2X Communications: Getting our Cars Talking
 
Connected & Autonomous vehicles: cybersecurity on a grand scale v1
Connected & Autonomous vehicles: cybersecurity on a grand scale v1Connected & Autonomous vehicles: cybersecurity on a grand scale v1
Connected & Autonomous vehicles: cybersecurity on a grand scale v1
 
Verification of IVI Over-The-Air using UML/OCL
Verification of IVI Over-The-Air using UML/OCLVerification of IVI Over-The-Air using UML/OCL
Verification of IVI Over-The-Air using UML/OCL
 
Applying ML for Log Analysis
Applying ML for Log AnalysisApplying ML for Log Analysis
Applying ML for Log Analysis
 
Results of model-based testing in automotive
Results of model-based testing in automotiveResults of model-based testing in automotive
Results of model-based testing in automotive
 
F 35 brief
F 35 briefF 35 brief
F 35 brief
 
An AI accelerator ASIC architecture
An AI accelerator ASIC architectureAn AI accelerator ASIC architecture
An AI accelerator ASIC architecture
 
Automated Testing of Autonomous Driving Assistance Systems
Automated Testing of Autonomous Driving Assistance SystemsAutomated Testing of Autonomous Driving Assistance Systems
Automated Testing of Autonomous Driving Assistance Systems
 
Quadcopter
QuadcopterQuadcopter
Quadcopter
 
Advanced driver assistance systems
Advanced driver assistance systemsAdvanced driver assistance systems
Advanced driver assistance systems
 
"Computer Vision in Cars: Status, Challenges, and Trends," a Presentation fro...
"Computer Vision in Cars: Status, Challenges, and Trends," a Presentation fro..."Computer Vision in Cars: Status, Challenges, and Trends," a Presentation fro...
"Computer Vision in Cars: Status, Challenges, and Trends," a Presentation fro...
 

Similar to Xpeng Motors' P7's self-driving roadmap and system design

“Market Analysis on SoCs for Imaging, Vision and Deep Learning in Automotive ...
“Market Analysis on SoCs for Imaging, Vision and Deep Learning in Automotive ...“Market Analysis on SoCs for Imaging, Vision and Deep Learning in Automotive ...
“Market Analysis on SoCs for Imaging, Vision and Deep Learning in Automotive ...
Edge AI and Vision Alliance
 
Smart infrastructure for autonomous vehicles
Smart infrastructure for autonomous vehicles Smart infrastructure for autonomous vehicles
Smart infrastructure for autonomous vehicles
Jeffrey Funk
 
Self-driving: AI evolution and Massive deployment in production cars
Self-driving: AI evolution and Massive deployment in production carsSelf-driving: AI evolution and Massive deployment in production cars
Self-driving: AI evolution and Massive deployment in production cars
Junli Gu
 
Semi-Autonomous Vehicle
Semi-Autonomous VehicleSemi-Autonomous Vehicle
Semi-Autonomous Vehicle
IRJET Journal
 
smartcar-parkingsystem-180508104143 (1).pdf
smartcar-parkingsystem-180508104143 (1).pdfsmartcar-parkingsystem-180508104143 (1).pdf
smartcar-parkingsystem-180508104143 (1).pdf
kannaradhas
 
SMART CAR-PARKING SYSTEM USING IOT
SMART CAR-PARKING SYSTEM USING IOTSMART CAR-PARKING SYSTEM USING IOT
SMART CAR-PARKING SYSTEM USING IOT
Saipandu143
 
Fullstop.ai (1)
Fullstop.ai (1)Fullstop.ai (1)
Fullstop.ai (1)
BheemaiahAnilK
 
Smart Parking Solution using Camera Networks and Real-time Computer Vision
Smart Parking Solution using Camera Networks and Real-time Computer VisionSmart Parking Solution using Camera Networks and Real-time Computer Vision
Smart Parking Solution using Camera Networks and Real-time Computer Vision
IRJET Journal
 
Design of Image Segmentation Algorithm for Autonomous Vehicle Navigationusing...
Design of Image Segmentation Algorithm for Autonomous Vehicle Navigationusing...Design of Image Segmentation Algorithm for Autonomous Vehicle Navigationusing...
Design of Image Segmentation Algorithm for Autonomous Vehicle Navigationusing...
IJEEE
 
IRJET-V8I686.pdf
IRJET-V8I686.pdfIRJET-V8I686.pdf
IRJET-V8I686.pdf
BelkacemHedadi1
 
Key trends of smart transportation
Key trends of smart transportationKey trends of smart transportation
Key trends of smart transportation
Yoshifumi Sakamoto
 
DE - Smart Parking System.pptx
DE - Smart Parking System.pptxDE - Smart Parking System.pptx
DE - Smart Parking System.pptx
BhavikSanghar
 
SMART MONITORING OF AUTOMOBILE USING IOT
SMART MONITORING OF AUTOMOBILE USING IOTSMART MONITORING OF AUTOMOBILE USING IOT
SMART MONITORING OF AUTOMOBILE USING IOT
Journal For Research
 
Google's Driverless Car
Google's Driverless CarGoogle's Driverless Car
Google's Driverless Car
aishu nischala
 
IRJET- Self Driving Car using Raspberry-Pi and Machine Learning
IRJET- Self Driving Car using Raspberry-Pi and Machine LearningIRJET- Self Driving Car using Raspberry-Pi and Machine Learning
IRJET- Self Driving Car using Raspberry-Pi and Machine Learning
IRJET Journal
 
Automatic gate control
Automatic gate controlAutomatic gate control
Automatic gate control
Dipankar Haloi
 
IRJET-Smart Parking System
IRJET-Smart Parking SystemIRJET-Smart Parking System
IRJET-Smart Parking System
IRJET Journal
 
Practices of AI guided traffic analysis
Practices of AI guided traffic analysisPractices of AI guided traffic analysis
Practices of AI guided traffic analysis
JumpingJaq
 
"2D and 3D Sensing: Markets, Applications, and Technologies," a Presentation ...
"2D and 3D Sensing: Markets, Applications, and Technologies," a Presentation ..."2D and 3D Sensing: Markets, Applications, and Technologies," a Presentation ...
"2D and 3D Sensing: Markets, Applications, and Technologies," a Presentation ...
Edge AI and Vision Alliance
 
5G Automotive, V2X Opportunity and Challenges
5G Automotive, V2X Opportunity and Challenges5G Automotive, V2X Opportunity and Challenges
5G Automotive, V2X Opportunity and Challenges
Marie-Paule Odini
 

Similar to Xpeng Motors' P7's self-driving roadmap and system design (20)

“Market Analysis on SoCs for Imaging, Vision and Deep Learning in Automotive ...
“Market Analysis on SoCs for Imaging, Vision and Deep Learning in Automotive ...“Market Analysis on SoCs for Imaging, Vision and Deep Learning in Automotive ...
“Market Analysis on SoCs for Imaging, Vision and Deep Learning in Automotive ...
 
Smart infrastructure for autonomous vehicles
Smart infrastructure for autonomous vehicles Smart infrastructure for autonomous vehicles
Smart infrastructure for autonomous vehicles
 
Self-driving: AI evolution and Massive deployment in production cars
Self-driving: AI evolution and Massive deployment in production carsSelf-driving: AI evolution and Massive deployment in production cars
Self-driving: AI evolution and Massive deployment in production cars
 
Semi-Autonomous Vehicle
Semi-Autonomous VehicleSemi-Autonomous Vehicle
Semi-Autonomous Vehicle
 
smartcar-parkingsystem-180508104143 (1).pdf
smartcar-parkingsystem-180508104143 (1).pdfsmartcar-parkingsystem-180508104143 (1).pdf
smartcar-parkingsystem-180508104143 (1).pdf
 
SMART CAR-PARKING SYSTEM USING IOT
SMART CAR-PARKING SYSTEM USING IOTSMART CAR-PARKING SYSTEM USING IOT
SMART CAR-PARKING SYSTEM USING IOT
 
Fullstop.ai (1)
Fullstop.ai (1)Fullstop.ai (1)
Fullstop.ai (1)
 
Smart Parking Solution using Camera Networks and Real-time Computer Vision
Smart Parking Solution using Camera Networks and Real-time Computer VisionSmart Parking Solution using Camera Networks and Real-time Computer Vision
Smart Parking Solution using Camera Networks and Real-time Computer Vision
 
Design of Image Segmentation Algorithm for Autonomous Vehicle Navigationusing...
Design of Image Segmentation Algorithm for Autonomous Vehicle Navigationusing...Design of Image Segmentation Algorithm for Autonomous Vehicle Navigationusing...
Design of Image Segmentation Algorithm for Autonomous Vehicle Navigationusing...
 
IRJET-V8I686.pdf
IRJET-V8I686.pdfIRJET-V8I686.pdf
IRJET-V8I686.pdf
 
Key trends of smart transportation
Key trends of smart transportationKey trends of smart transportation
Key trends of smart transportation
 
DE - Smart Parking System.pptx
DE - Smart Parking System.pptxDE - Smart Parking System.pptx
DE - Smart Parking System.pptx
 
SMART MONITORING OF AUTOMOBILE USING IOT
SMART MONITORING OF AUTOMOBILE USING IOTSMART MONITORING OF AUTOMOBILE USING IOT
SMART MONITORING OF AUTOMOBILE USING IOT
 
Google's Driverless Car
Google's Driverless CarGoogle's Driverless Car
Google's Driverless Car
 
IRJET- Self Driving Car using Raspberry-Pi and Machine Learning
IRJET- Self Driving Car using Raspberry-Pi and Machine LearningIRJET- Self Driving Car using Raspberry-Pi and Machine Learning
IRJET- Self Driving Car using Raspberry-Pi and Machine Learning
 
Automatic gate control
Automatic gate controlAutomatic gate control
Automatic gate control
 
IRJET-Smart Parking System
IRJET-Smart Parking SystemIRJET-Smart Parking System
IRJET-Smart Parking System
 
Practices of AI guided traffic analysis
Practices of AI guided traffic analysisPractices of AI guided traffic analysis
Practices of AI guided traffic analysis
 
"2D and 3D Sensing: Markets, Applications, and Technologies," a Presentation ...
"2D and 3D Sensing: Markets, Applications, and Technologies," a Presentation ..."2D and 3D Sensing: Markets, Applications, and Technologies," a Presentation ...
"2D and 3D Sensing: Markets, Applications, and Technologies," a Presentation ...
 
5G Automotive, V2X Opportunity and Challenges
5G Automotive, V2X Opportunity and Challenges5G Automotive, V2X Opportunity and Challenges
5G Automotive, V2X Opportunity and Challenges
 

Recently uploaded

Statistics5,c.xz,c.;c.;d.c;d;ssssss.pptx
Statistics5,c.xz,c.;c.;d.c;d;ssssss.pptxStatistics5,c.xz,c.;c.;d.c;d;ssssss.pptx
Statistics5,c.xz,c.;c.;d.c;d;ssssss.pptx
coc7987515756
 
Why Is Your BMW X3 Hood Not Responding To Release Commands
Why Is Your BMW X3 Hood Not Responding To Release CommandsWhy Is Your BMW X3 Hood Not Responding To Release Commands
Why Is Your BMW X3 Hood Not Responding To Release Commands
Dart Auto
 
What Exactly Is The Common Rail Direct Injection System & How Does It Work
What Exactly Is The Common Rail Direct Injection System & How Does It WorkWhat Exactly Is The Common Rail Direct Injection System & How Does It Work
What Exactly Is The Common Rail Direct Injection System & How Does It Work
Motor Cars International
 
gtyccccccccccccccccccccccccccccccccccccccccccccccccccccccc
gtycccccccccccccccccccccccccccccccccccccccccccccccccccccccgtyccccccccccccccccccccccccccccccccccccccccccccccccccccccc
gtyccccccccccccccccccccccccccccccccccccccccccccccccccccccc
4thzenzstar
 
Things to remember while upgrading the brakes of your car
Things to remember while upgrading the brakes of your carThings to remember while upgrading the brakes of your car
Things to remember while upgrading the brakes of your car
jennifermiller8137
 
5 Warning Signs Your BMW's Intelligent Battery Sensor Needs Attention
5 Warning Signs Your BMW's Intelligent Battery Sensor Needs Attention5 Warning Signs Your BMW's Intelligent Battery Sensor Needs Attention
5 Warning Signs Your BMW's Intelligent Battery Sensor Needs Attention
Bertini's German Motors
 
Wondering if Your Mercedes EIS is at Fault Here’s How to Tell
Wondering if Your Mercedes EIS is at Fault Here’s How to TellWondering if Your Mercedes EIS is at Fault Here’s How to Tell
Wondering if Your Mercedes EIS is at Fault Here’s How to Tell
Vic Auto Collision & Repair
 
What Causes 'Trans Failsafe Prog' to Trigger in BMW X5
What Causes 'Trans Failsafe Prog' to Trigger in BMW X5What Causes 'Trans Failsafe Prog' to Trigger in BMW X5
What Causes 'Trans Failsafe Prog' to Trigger in BMW X5
European Service Center
 
Tyre Industrymarket overview with examples of CEAT
Tyre Industrymarket overview with examples of CEATTyre Industrymarket overview with examples of CEAT
Tyre Industrymarket overview with examples of CEAT
kshamashah95
 
Core technology of Hyundai Motor Group's EV platform 'E-GMP'
Core technology of Hyundai Motor Group's EV platform 'E-GMP'Core technology of Hyundai Motor Group's EV platform 'E-GMP'
Core technology of Hyundai Motor Group's EV platform 'E-GMP'
Hyundai Motor Group
 
Ec330B Lc Excavator Volvo Service Repair.pdf
Ec330B Lc Excavator Volvo Service Repair.pdfEc330B Lc Excavator Volvo Service Repair.pdf
Ec330B Lc Excavator Volvo Service Repair.pdf
Excavator
 
Antique Plastic Traders Company Profile
Antique Plastic Traders Company ProfileAntique Plastic Traders Company Profile
Antique Plastic Traders Company Profile
Antique Plastic Traders
 
一比一原版SDSU毕业证圣地亚哥州立大学毕业证成绩单如何办理
一比一原版SDSU毕业证圣地亚哥州立大学毕业证成绩单如何办理一比一原版SDSU毕业证圣地亚哥州立大学毕业证成绩单如何办理
一比一原版SDSU毕业证圣地亚哥州立大学毕业证成绩单如何办理
psavhef
 
What Does the PARKTRONIC Inoperative, See Owner's Manual Message Mean for You...
What Does the PARKTRONIC Inoperative, See Owner's Manual Message Mean for You...What Does the PARKTRONIC Inoperative, See Owner's Manual Message Mean for You...
What Does the PARKTRONIC Inoperative, See Owner's Manual Message Mean for You...
Autohaus Service and Sales
 
Ec460b lc Excavator Volvo Service Repair.pdf
Ec460b lc Excavator Volvo Service Repair.pdfEc460b lc Excavator Volvo Service Repair.pdf
Ec460b lc Excavator Volvo Service Repair.pdf
Excavator
 
What Does the Active Steering Malfunction Warning Mean for Your BMW
What Does the Active Steering Malfunction Warning Mean for Your BMWWhat Does the Active Steering Malfunction Warning Mean for Your BMW
What Does the Active Steering Malfunction Warning Mean for Your BMW
Tanner Motors
 
Empowering Limpopo Entrepreneurs Consulting SMEs.pptx
Empowering Limpopo Entrepreneurs  Consulting SMEs.pptxEmpowering Limpopo Entrepreneurs  Consulting SMEs.pptx
Empowering Limpopo Entrepreneurs Consulting SMEs.pptx
Precious Mvulane CA (SA),RA
 
一比一原版BC毕业证波士顿学院毕业证成绩单如何办理
一比一原版BC毕业证波士顿学院毕业证成绩单如何办理一比一原版BC毕业证波士顿学院毕业证成绩单如何办理
一比一原版BC毕业证波士顿学院毕业证成绩单如何办理
amvovau
 
Why Isn't Your BMW X5's Comfort Access Functioning Properly Find Out Here
Why Isn't Your BMW X5's Comfort Access Functioning Properly Find Out HereWhy Isn't Your BMW X5's Comfort Access Functioning Properly Find Out Here
Why Isn't Your BMW X5's Comfort Access Functioning Properly Find Out Here
Masters European & Gapanese Auto Repair
 

Recently uploaded (19)

Statistics5,c.xz,c.;c.;d.c;d;ssssss.pptx
Statistics5,c.xz,c.;c.;d.c;d;ssssss.pptxStatistics5,c.xz,c.;c.;d.c;d;ssssss.pptx
Statistics5,c.xz,c.;c.;d.c;d;ssssss.pptx
 
Why Is Your BMW X3 Hood Not Responding To Release Commands
Why Is Your BMW X3 Hood Not Responding To Release CommandsWhy Is Your BMW X3 Hood Not Responding To Release Commands
Why Is Your BMW X3 Hood Not Responding To Release Commands
 
What Exactly Is The Common Rail Direct Injection System & How Does It Work
What Exactly Is The Common Rail Direct Injection System & How Does It WorkWhat Exactly Is The Common Rail Direct Injection System & How Does It Work
What Exactly Is The Common Rail Direct Injection System & How Does It Work
 
gtyccccccccccccccccccccccccccccccccccccccccccccccccccccccc
gtycccccccccccccccccccccccccccccccccccccccccccccccccccccccgtyccccccccccccccccccccccccccccccccccccccccccccccccccccccc
gtyccccccccccccccccccccccccccccccccccccccccccccccccccccccc
 
Things to remember while upgrading the brakes of your car
Things to remember while upgrading the brakes of your carThings to remember while upgrading the brakes of your car
Things to remember while upgrading the brakes of your car
 
5 Warning Signs Your BMW's Intelligent Battery Sensor Needs Attention
5 Warning Signs Your BMW's Intelligent Battery Sensor Needs Attention5 Warning Signs Your BMW's Intelligent Battery Sensor Needs Attention
5 Warning Signs Your BMW's Intelligent Battery Sensor Needs Attention
 
Wondering if Your Mercedes EIS is at Fault Here’s How to Tell
Wondering if Your Mercedes EIS is at Fault Here’s How to TellWondering if Your Mercedes EIS is at Fault Here’s How to Tell
Wondering if Your Mercedes EIS is at Fault Here’s How to Tell
 
What Causes 'Trans Failsafe Prog' to Trigger in BMW X5
What Causes 'Trans Failsafe Prog' to Trigger in BMW X5What Causes 'Trans Failsafe Prog' to Trigger in BMW X5
What Causes 'Trans Failsafe Prog' to Trigger in BMW X5
 
Tyre Industrymarket overview with examples of CEAT
Tyre Industrymarket overview with examples of CEATTyre Industrymarket overview with examples of CEAT
Tyre Industrymarket overview with examples of CEAT
 
Core technology of Hyundai Motor Group's EV platform 'E-GMP'
Core technology of Hyundai Motor Group's EV platform 'E-GMP'Core technology of Hyundai Motor Group's EV platform 'E-GMP'
Core technology of Hyundai Motor Group's EV platform 'E-GMP'
 
Ec330B Lc Excavator Volvo Service Repair.pdf
Ec330B Lc Excavator Volvo Service Repair.pdfEc330B Lc Excavator Volvo Service Repair.pdf
Ec330B Lc Excavator Volvo Service Repair.pdf
 
Antique Plastic Traders Company Profile
Antique Plastic Traders Company ProfileAntique Plastic Traders Company Profile
Antique Plastic Traders Company Profile
 
一比一原版SDSU毕业证圣地亚哥州立大学毕业证成绩单如何办理
一比一原版SDSU毕业证圣地亚哥州立大学毕业证成绩单如何办理一比一原版SDSU毕业证圣地亚哥州立大学毕业证成绩单如何办理
一比一原版SDSU毕业证圣地亚哥州立大学毕业证成绩单如何办理
 
What Does the PARKTRONIC Inoperative, See Owner's Manual Message Mean for You...
What Does the PARKTRONIC Inoperative, See Owner's Manual Message Mean for You...What Does the PARKTRONIC Inoperative, See Owner's Manual Message Mean for You...
What Does the PARKTRONIC Inoperative, See Owner's Manual Message Mean for You...
 
Ec460b lc Excavator Volvo Service Repair.pdf
Ec460b lc Excavator Volvo Service Repair.pdfEc460b lc Excavator Volvo Service Repair.pdf
Ec460b lc Excavator Volvo Service Repair.pdf
 
What Does the Active Steering Malfunction Warning Mean for Your BMW
What Does the Active Steering Malfunction Warning Mean for Your BMWWhat Does the Active Steering Malfunction Warning Mean for Your BMW
What Does the Active Steering Malfunction Warning Mean for Your BMW
 
Empowering Limpopo Entrepreneurs Consulting SMEs.pptx
Empowering Limpopo Entrepreneurs  Consulting SMEs.pptxEmpowering Limpopo Entrepreneurs  Consulting SMEs.pptx
Empowering Limpopo Entrepreneurs Consulting SMEs.pptx
 
一比一原版BC毕业证波士顿学院毕业证成绩单如何办理
一比一原版BC毕业证波士顿学院毕业证成绩单如何办理一比一原版BC毕业证波士顿学院毕业证成绩单如何办理
一比一原版BC毕业证波士顿学院毕业证成绩单如何办理
 
Why Isn't Your BMW X5's Comfort Access Functioning Properly Find Out Here
Why Isn't Your BMW X5's Comfort Access Functioning Properly Find Out HereWhy Isn't Your BMW X5's Comfort Access Functioning Properly Find Out Here
Why Isn't Your BMW X5's Comfort Access Functioning Properly Find Out Here
 

Xpeng Motors' P7's self-driving roadmap and system design

  • 1. 0 Developing Autonomous Driving EVs for the China Market XPENG Motors’ Approach Junli Gu VP of Autonomous Driving, XPENG motors March 18, 2019
  • 2. 1 Agenda 1. XPENG Motors Introduction and Background 2. Roadmap for XPENG Motors’ Autonomous Driving Solution 3. System Architecture Design Powered by Xavier
  • 3. 2 Who is XPENG? We develop FUN, CONNECTED and INTELLIGENT EVs tailored for the young and tech-savvy Chinese Millennials 2 • Aimed at young Internet users in China, with autonomous driving and intelligent connection as the core differences • 2014: Founded in Guangzhou, China • Dec 2018: Mass production and official launch of G3 (electrical SUV) • Q1 2019: Mass production of E28 (electrical sedan)
  • 4. 3 Strong R&D capabilities and investments Shanghai Intelligent Connected Vehicle Navigation R&D Silicon Valley & San Diego Machine Learning Autonomous Driving R&D Guangzhou Vehicle and VCU R&D V2X Testing Trial and Production Lead-in Beijing Artificial Intelligence R&D R&D footprint Our R&D headcount accounts for over 70% of our total number of employees.
  • 5. 4 Your Smart Driving Assistant Connectivity Xmart OS X-pilot Artificial Intelligence
  • 7. 6 Agenda 1. XPENG Motors Introduction and Background 2. Roadmap for XPENG Motors’ Autonomous Driving Solution 3. System Architecture Design Powered by Xavier
  • 8. 7 L3 Products: Highly-Autonomous Highway Features L4 Products: Fully-Autonomous Urban & Highway Features - Driverless Robo Taxi - Driverless Robo Bus - Human Driver vehicles L2+ Products: Semi-Autonomous Highway/Urban Features - Human Driver vehicles Self-Driving Two Separate Branches…
  • 9. Comfort Driving with safety guarantees Where are we heading… • Key differentiation through XPENG’s intelligent EV strategy • Focus on in-house software solutions running on leading computer hardware platforms • Focus on enhancing driver assistance features towards L3 capabilities in 2020 • Focus on feature optimization for Chinese market and Chinese consumers 8
  • 10. 9 Roadmap for XPENG Motors’ Autonomous Driving Solution XPilot 2018-2019 2020 2021-2022 2024-2025 CarModel Autonomous Driving Achievement &Goal • Xpilot 2.0: Full scenario auto parking + LCC + ACC • Xpilot 3.0: Super Memory Parking + Highway Autopilot • Xpilot 4.0: AVP + Highway/Urban Autopilot • Xpilot x.0: Full Automation in limited scenarios (highway, parking, etc.) • First generation solution for commercialization with partial self developed IPs • Fully self developed end-to-end SW IP • Next gen HW platform with optimized sensor cost • First level-4 solution in consumer vehicle A Class SUV (G3) B Class Sedan (E28) B Class SUV
  • 11. 10 XPENG G3 By AI, irregular lots By memory Roadmap for XPENG Motors’ Autonomous Driving Solution-XPilot parking functions XPENG E28 Alleviate people’s parking anxiety in parallel, vertical, perpendicular, irregular lots… parking functions By voice By Vision By Ultrasonic
  • 12. 11 Use Case Example: Super Memory Parking
  • 13. 12 Use Case Example: Highway Auto-Pilot
  • 14. 13 2km ahead Xpilot’s Surrounding Reality Ego Traffic Point of interest Road side object Lane condition
  • 15. 14 Agenda 1. XPENG Motors introduction and background 2. Roadmap for XPENG Motors’ Autonomous Driving Solution 3. System architecture design powered by Xavier
  • 16. 15 Driving Big Data AI and Perception High-perf chips Customized Sensor Structure - - Chinese Traffic Patterns Local adaption is a must - - • Chinese style lane change and close cutting in • Very large variety of obstacles • Dense traffic • Irregular Pattern
  • 17. 16 Challenge: Perception & Creating a Representative 3D Environmental Model Compute (MP/s) Quality raw sensor input with cost constraints 2 1 Preponderance of training data (especially corner cases) 3
  • 18. 17 Challenge: Perception & Creating a Representative 3D Environmental Model Real stream taken from E28 camera sets; ISP developed in house;
  • 19. 18 Challenge: Extending to Day/Night, All Weather, All locations 1) Time (Location of Sun: Day/Night/NotDawn/NotDusk) 2) Select Weather Conditions 3) Availability of GNSS & RTK 4) Place (GeoFenced) 5) Select Speed Range 6) Road/Traffic Conditions Sensing/Perception challenges (due to insufficient quality of raw data and/or compute power) Mapping challenges Driving policy challenges
  • 20. Ultrasonic Sensors (6 in Front) Tri-focal Cameras (2M pixels, FOV 28, 52, 100, 60/15fps) Surround-view Camera (1 at Back) Rear-view Camera (2M pixels,FOV 52, 30fps) In-Car Intelligent Camera Radars (5 in Total) Surround-view Camera (1 in Front) Ultrasonic Sensors (6 at Back) Surround-view Camera (2 on Sides) Cut-In Prevention Camera 1M pixels, 60fps)Rear-view Camera (1M pixels, 30fps) Sensor System for E28 (Mass production in 2020) 19 Note: We use first vehicle G3’s picture as E28’s design is not revealed yet.
  • 21. 20 XPilot Camera Coverage and Functions for E28 360 coverage; Designed to cover traffic scenarios in China HFOV 100 HFOV 52
  • 23. 22 1828x948@15fps (for Highway Driving) 457x237@60fps (for Urban Driving) Long Range CNN (Perception at > 200m) Close Proximity CNN (Responds x4 faster) Cameras Variable fps Network for China Specific Drive Conditions (Close Vehicle Proximity and Abrupt Cut-ins) 1
  • 24. 23 HighwayUrban Canyon START POINT / END POINT 55 Km route (Approx. 2.5hr) 2.5hrs x 3600 x 1Hz = 9,000 samples GuangzhouRoute8 Absolute Localization Reference Antenna + GNSS/INS 2 GNSS / INS 20cm absolute-localization-accuracy at 95% (2 σ) 20cm absolute-localization-accuracy for at 95% (2 σ) of Highway route in white
  • 25. 24 Front Radars Right Front Corner Radar Left Front Corner Radar Left Rear Corner Radar Right Rear Corner Radar 3 RADAR Five Radars of High Angular Resolution: 2x improvement 5th Generation of Radar Technology
  • 26. 25 Industry Leading Computing Platform XPilot Unit (XPU) powered by NVIDIA Xavier NVIDIA Xavier Safety MCU Camera Des Camera Des Camera Des Memory EMMC Storage CAN Transceiver Ethernet Switch Power Management CAN Ethernet 4
  • 27. 26 Why NVIDIA Xavier? 0 5 10 15 20 25 30 35 Computing Power (TOPS) Deep Learning Computing Throughput NVIDIA Xavier FPGA NVIDIA Parker TI TDA2xx TOPS
  • 28. 27 XPU Software Stack NVIDIA Xavier SoC Aurix MCU Hypervisor NVIDIA Foundations QNX OS and BSP/Drivers NVIDIA System Software NvMeida/CUDA/CuDNN/TensorRT … NVIDIA Drive Works XPilot Frameworks (Project Eagle) NVIDIA Tier-1 AUTOSAR OTA Data Camera Service CAN Service (Radar, IMU/GNSS, Vehicle IO) XPilot Autonomous Driving Applications Perception, Localization Prediction, Path Planning Control, … XPU HW NVIDIA/Tier- SW XPU Platform SW XPilot SW Visualization Launcher Monitor Diagnostic Service Xpilot Safety App
  • 29. 28 Driving hierarchy w/ safety intervention AEB Driver: Human Driver: XPilot Collision Warnings 5 SAFETY Independent AEB System
  • 30. 29 Summary • XPENG Motors develop FUN, CONNECTED and INTELLIGENT EVs tailored for the young and tech-savvy Chinese millennials • Roadmap for XPENG Motors’ Autonomous Driving Solution • System architecture design powered by Xavier
  • 31. 30 E28 is coming… To be revealed at Auto Shanghai April 16