www.luxoft.com
ENGINEERING
SOFTWARE
TECHNOLOGY AUTOMOTIVE
TRAVEL
AND AVIATION
ENERGY TELECOM
FINANCIAL SERVICES
COMPUTER VISION FOR
ADVANCED DRIVER
ASSISTANCE SYSTEMS
www.luxoft.com
Vision
www.luxoft.com
Rinspeed XChange
www.luxoft.com
www.luxoft.com
Levels of Autonomous Driving
Active ADAS
Autonomous
Driving
Informational ADAS
DISPLAY
Augmented
Reality
HUD
Top View
ACC
Lane keeping
LDW
distance
rear cam
Piloted
Parking …
Source: Intel
www.luxoft.com
Computer Vision and Augmented Reality Applications
COMPUTER
VISION
Pattern
Recognition
Image
Processing
Physics
Signal
Processing
Arfificial
Intelligence
Mathematic
s
City Driving Pattern
Augmented Navigation
Help in low visibility mode
Signs recognition Infographics
Next Gen of Adaptive Cruise
Active Park Search
www.luxoft.com
Active ADAS
www.luxoft.com
Input Sources Concept
www.luxoft.com
In-Vehicle Architecture
Computer Vision Box/Head Unit
DSP Camera
HD Camera
Sensors/CAN Navigation System/Map Data -
Positioning
HUD
LCD
Glasses
Digital Cluster
Telematics/V2X
www.luxoft.com
Computer Vision Capabilities
www.luxoft.com
Car Network - V2X
MIT Technology Review
Announced V2X
communication as one of the
10 breakthrough
technologies 2015.
https://www.technologyreview.
com/s/534981/car-to-car-
communication/
www.luxoft.com
Infrastructure for Autonomous Driving
According to the Nikkei Asian
Review, Tokyo-based Dynamic
Map Planning is developing high
definition and three-dimensional
maps for self-driving cars.
The map will enable the vehicles
to drive smoothly, relaying critical
information such as traffic lights,
sharp turns, slopes in roads and
road construction works.
www.luxoft.com
Self-Driving Taxis
BMW Nazca C2 Concept
Rinspeed Budii
www.luxoft.com
Technical Concept
www.luxoft.com
Unique Solution
We offer a Unique Solution capable to create Augmented, mixed visual Reality for drivers and passengers based
on Computer Vision, vehicle sensors, map data, telematics, navigation guidance using Data Fusion technique.
CVNAR
SolutionAutomotive Cameras
Sensors/CAN
Navigation System/Map Data
Vehicle displays
Projection on wind shield
Smart Glasses
VR devices
Telematics/V2X
www.luxoft.com
CVNAR Features
Natural Augmented Reality
1. Basic vehicle data
2. Lanes and road boundaries
3. Road signs and cautions
4. Navigation data and hints
5. Facades highlights
6. Parking Places
7. Narrow street infographics
8. Street names and Complex Junctions
boards
9. POI and OEM specific information
Highlights:
◆ CPU, GPU; OS: Linux, QNX, Android
◆ HW: Intel, nVidia, TI, Renesas
◆ Extrapolation engines for latency
avoidance
◆ Neural networks: CNN, DNN, Deep
Learning
Road scene recognition and objects tracking
◆ Road boundaries
◆ Lane detection
◆ Vehicle recognition and tracking
◆ Distance and time to collision estimation
◆ Pedestrian detection and tracking
◆ Facade recognition and texture extraction
◆ Road signs recognition
◆ Parking slot recognition
Positioning
◆ Precise relative and absolute positioning
◆ Flexible data fusion and smooth Map Matching
◆ Automotive constrained SLAM
Integration and Fusion
1. Sensor data
2. External positioner data (optional)
3. External recognition engine integration
4. Pupil tracking
5. Telematics: V2I and V2V
www.luxoft.com
Projects
www.luxoft.com
Projects
www.luxoft.com
Projects
www.luxoft.com
Further Strategic
Concepts
www.luxoft.com
Positioner Solution
Reference solutionOur solution
www.luxoft.com
Universal Energy Minimization for MRF-based Formulations
Depth map retrieving based on synchronized stereo pair – Energy minimization
www.luxoft.com
MRF-BASED VIDEO STITCHING
Normal case – two images
Highly distorted case – several images
Smooth, seamless and computational efficient stitching of video from calibrated cameras
www.luxoft.com
Dynamic Information & Learning Navigation
Compact Delta Information
is compiled using
collected and preprocessed
data
Backend access and analyses
different cloud sources
(Learning Navigation) for
compilation
Each car provides collected
data to the backend
Dynamic Navigation
Information is provided to
users via OTA
Cars collect actual navigation
data from roads using built-in
cameras & sensors
Dynamic
Data
External
Navigation data
providers
www.luxoft.com
Recognition-based Update of Navigation DB
◆ Lanes recognition for DB update:
◆ Number of lanes
◆ Highway exit recognition and localization
◆ Lane marking type recognition
◆ Temporal/new road signs recognition for DB update
www.luxoft.com
HMI Concept
www.luxoft.com
Head Unit LCD Display
www.luxoft.com
Collision Warning
www.luxoft.com
POIs, House numbers,
Destination Highlighting
www.luxoft.com
Head Up Display
www.luxoft.com
www.luxoft.com
THANK YOU
“Our mission is to GO BEYOND the client expectations by bringing together
technology, talent, innovation and highest quality standards.”

Computer Vision for Advanced Driver Assistance Systems (Olga Mirkina Technology Stream)