SlideShare a Scribd company logo
1 of 31
Download to read offline
DETECTION AND CLASSIFICATION OF
VEHICLES USING STEREO VISION
UNIVERSITÀ DEGLI STUDI DI PARMA
FACOLTÀ DI INGEGNERIA
CORSO DI LAUREA SPECIALISTICA IN INGEGNERIA
INFORMATICA
Piero Micelli
STEREO VISION USED FOR THE EXTRACTION OF
3D INFORMATION FROM HOMOLOGOUS POINTS
19/05/2014 2
COMPUTE DISPARITY MAP
Piero Micelli
• Vehicles counting
• Vehicles counting per direction
• Vehicle classification
GOALS
19/05/2014 3
INPUTS
• Stereo video sequences
• Relative disparity map
Piero Micelli
ALGORITHM STEPS
19/05/2014 4
OBJECT DETECTION
TRACKING
OBJECT CLASSIFICATION
Piero Micelli
OBJECT DETECTION
19/05/2014 5
• Use of v-disparity to localize an object
V-DISPARITY OF FREE ROAD
IS A STRAIGHT LINE
PATTERN OF AN OBJECT ON THE
ROAD
Piero Micelli
OBJECT DETECTION
19/05/2014 6
• ISSUE: different vehicles give different patterns
Piero Micelli19/05/2014 7
OBJECT DETECTION
• SOLUTION: create a model of the free road and
use it to use as baseline
Piero Micelli
OBJECT DETECTION
19/05/2014 8
• SOLUTION: use the model of road to find the pattern
(spotting the difference from the baseline)
Piero Micelli
OBJECT DETECTION
19/05/2014 9
1. The v-disparity does not give information about
the width, but only on the length
2. What if there are two objects in parallel?
FURTHER IUSSES
SOLUTION
• Use the u-disparity
Piero Micelli19/05/2014 10
OBJECT DETECTION
• Use of u-disparity to check the object presence
U-DISPARITY OF FREE ROAD OBJECT PATTERNU-DISPARITY IN PRESENCE
OF VEHICLE
Piero Micelli
OBJECT DETECTION
19/05/2014 11
v-disparity and u-disparity models
Piero Micelli19/05/2014 12
CASES
1. The u-disparity shows a single object: OK
2. More object are detected on the u-disparity: ?
3. No object on u-disparity: ?
OBJECT DETECTION
Use the foreground image for a third comparison!
If an object is detected using the v-disparity, we look
at the u-disparity for further information
Piero Micelli19/05/2014 13
• Example 1: one or two object on the right lane?
OBJECT DETECTION (Uncertain Case)
Piero Micelli19/05/2014 14
• Example 1: foreground confirm two object
OBJECT DETECTION (Uncertain Case)
Piero Micelli19/05/2014 15
OBJECT DETECTION (Uncertain Case)
• Example 2: one or two object on left lane?
Piero Micelli
OBJECT DETECTION (Uncertain Case)
19/05/2014 16
• Example 2: foreground confirm one object
Piero Micelli
OBJECT DETECTION (Uncertain Case)
19/05/2014 17
• Example 3: one or no object on left lane?
Piero Micelli
OBJECT DETECTION (Uncertain Case)
19/05/2014 18
• Example 3: foreground confirm one object
Piero Micelli
OBJECT DETECTION
19/05/2014 19
• Detect objects separately for each side of the road
• Centroid Id
Piero Micelli
OBJECT DETECTION
19/05/2014 20
CID
• Bounds
• Width
• Height
• Length
• Lane
Piero Micelli
TRACKING
19/05/2014 21
• Tracking for each lane of the detected CIDs
Piero Micelli
TRACKING
19/05/2014 22
• A vehicle could travel across the two-lane
• A vehicle could move from one lane to another
IUSSES
SOLUTIONS
• Tracking of CIDs detected on both lanes
• Association of CIDs to a vehicle (VID)
Piero Micelli
TRACKING
19/05/2014 23
When two CIDs are the same vehicle?
Edge shared and same direction CIDs belongs to same vehicle
Piero Micelli
TRACKING
19/05/2014 24
Piero Micelli
TRACKING
19/05/2014 25
Piero Micelli
TRACKING
19/05/2014 26
• VEHICLE ID
VID
• CIDs Bounds
• VID Bounds
• Position History
• Width Histoty
• Height History
• Length History
• Direction
Piero Micelli19/05/2014 27
OBJECT CLASSIFICATION
FEATURES:
• W: vehicle width (u-disparity)
• L: vehicle length (v-disparity)
• H: vehicle height (v-disparity)
Piero Micelli19/05/2014 28
OBJECT CLASSIFICATION
• Decision tree
VEHICLES
4 WHEELS
TRUCK
4 WHEELS TRUCK
2 WHEELS
W<Sth
W>Sth1, L>Sth2, H >Sth3
Piero Micelli19/05/2014 29
RESULTS
Analyzed video sequences:
• Number: 6
• Recorded during different seasons
• Recorded during different daytime hours
• Similar point of view
Piero Micelli19/05/2014 30
RESULTS
CATEGORIA TOTALE ERRORI ERRORE (%)
VEHICLES 744 0 0 %
4 WHEELS 705 4 0.6 %
TRUCK 13 2 15 %
2 WHEELS 26 1 3 %
SUD NORD
TOTALE ERRORI TOTALE ERRORI
VEHICLES 419 1 325 0
o CLASSIFICATION
o DIRECTION
Piero Micelli19/05/2014 31
FUTURE DEVELOPMENTS
• Try to train and to use a classifier (Support Vector
Machines ...)
• Try to use more features (SIFT)
• Use an algorithm to detect roadsides

More Related Content

What's hot

What's hot (20)

Yolov5
Yolov5 Yolov5
Yolov5
 
Deep learning based object detection basics
Deep learning based object detection basicsDeep learning based object detection basics
Deep learning based object detection basics
 
You only look once (YOLO) : unified real time object detection
You only look once (YOLO) : unified real time object detectionYou only look once (YOLO) : unified real time object detection
You only look once (YOLO) : unified real time object detection
 
Lec13: Clustering Based Medical Image Segmentation Methods
Lec13: Clustering Based Medical Image Segmentation MethodsLec13: Clustering Based Medical Image Segmentation Methods
Lec13: Clustering Based Medical Image Segmentation Methods
 
“An Introduction to Data Augmentation Techniques in ML Frameworks,” a Present...
“An Introduction to Data Augmentation Techniques in ML Frameworks,” a Present...“An Introduction to Data Augmentation Techniques in ML Frameworks,” a Present...
“An Introduction to Data Augmentation Techniques in ML Frameworks,” a Present...
 
Neural network for real time traffic signal control
Neural network for real time traffic signal controlNeural network for real time traffic signal control
Neural network for real time traffic signal control
 
Object recognition
Object recognitionObject recognition
Object recognition
 
DATA MINING FRAMEWORK TO ANALYZE ROAD ACCIDENT DATA
DATA MINING FRAMEWORK TO ANALYZE ROAD ACCIDENT DATADATA MINING FRAMEWORK TO ANALYZE ROAD ACCIDENT DATA
DATA MINING FRAMEWORK TO ANALYZE ROAD ACCIDENT DATA
 
Yolo
YoloYolo
Yolo
 
Object detection
Object detectionObject detection
Object detection
 
Object Detection & Tracking
Object Detection & TrackingObject Detection & Tracking
Object Detection & Tracking
 
Autonomous Driving
Autonomous DrivingAutonomous Driving
Autonomous Driving
 
PR-207: YOLOv3: An Incremental Improvement
PR-207: YOLOv3: An Incremental ImprovementPR-207: YOLOv3: An Incremental Improvement
PR-207: YOLOv3: An Incremental Improvement
 
Object tracking
Object trackingObject tracking
Object tracking
 
Yolov3
Yolov3Yolov3
Yolov3
 
Deep learning for object detection
Deep learning for object detectionDeep learning for object detection
Deep learning for object detection
 
You only look once
You only look onceYou only look once
You only look once
 
DATA MINING FRAMEWORK TO ANALYZE ROAD ACCIDENT DATA
DATA MINING FRAMEWORK TO ANALYZE ROAD ACCIDENT DATADATA MINING FRAMEWORK TO ANALYZE ROAD ACCIDENT DATA
DATA MINING FRAMEWORK TO ANALYZE ROAD ACCIDENT DATA
 
Deep Learning for Computer Vision: Object Detection (UPC 2016)
Deep Learning for Computer Vision: Object Detection (UPC 2016)Deep Learning for Computer Vision: Object Detection (UPC 2016)
Deep Learning for Computer Vision: Object Detection (UPC 2016)
 
Data Augmentation
Data AugmentationData Augmentation
Data Augmentation
 

Recently uploaded

Standard vs Custom Battery Packs - Decoding the Power Play
Standard vs Custom Battery Packs - Decoding the Power PlayStandard vs Custom Battery Packs - Decoding the Power Play
Standard vs Custom Battery Packs - Decoding the Power Play
Epec Engineered Technologies
 

Recently uploaded (20)

UNIT 4 PTRP final Convergence in probability.pptx
UNIT 4 PTRP final Convergence in probability.pptxUNIT 4 PTRP final Convergence in probability.pptx
UNIT 4 PTRP final Convergence in probability.pptx
 
Introduction to Data Visualization,Matplotlib.pdf
Introduction to Data Visualization,Matplotlib.pdfIntroduction to Data Visualization,Matplotlib.pdf
Introduction to Data Visualization,Matplotlib.pdf
 
HAND TOOLS USED AT ELECTRONICS WORK PRESENTED BY KOUSTAV SARKAR
HAND TOOLS USED AT ELECTRONICS WORK PRESENTED BY KOUSTAV SARKARHAND TOOLS USED AT ELECTRONICS WORK PRESENTED BY KOUSTAV SARKAR
HAND TOOLS USED AT ELECTRONICS WORK PRESENTED BY KOUSTAV SARKAR
 
Electromagnetic relays used for power system .pptx
Electromagnetic relays used for power system .pptxElectromagnetic relays used for power system .pptx
Electromagnetic relays used for power system .pptx
 
Online electricity billing project report..pdf
Online electricity billing project report..pdfOnline electricity billing project report..pdf
Online electricity billing project report..pdf
 
School management system project Report.pdf
School management system project Report.pdfSchool management system project Report.pdf
School management system project Report.pdf
 
Ground Improvement Technique: Earth Reinforcement
Ground Improvement Technique: Earth ReinforcementGround Improvement Technique: Earth Reinforcement
Ground Improvement Technique: Earth Reinforcement
 
Unit 4_Part 1 CSE2001 Exception Handling and Function Template and Class Temp...
Unit 4_Part 1 CSE2001 Exception Handling and Function Template and Class Temp...Unit 4_Part 1 CSE2001 Exception Handling and Function Template and Class Temp...
Unit 4_Part 1 CSE2001 Exception Handling and Function Template and Class Temp...
 
Employee leave management system project.
Employee leave management system project.Employee leave management system project.
Employee leave management system project.
 
8086 Microprocessor Architecture: 16-bit microprocessor
8086 Microprocessor Architecture: 16-bit microprocessor8086 Microprocessor Architecture: 16-bit microprocessor
8086 Microprocessor Architecture: 16-bit microprocessor
 
NO1 Top No1 Amil Baba In Azad Kashmir, Kashmir Black Magic Specialist Expert ...
NO1 Top No1 Amil Baba In Azad Kashmir, Kashmir Black Magic Specialist Expert ...NO1 Top No1 Amil Baba In Azad Kashmir, Kashmir Black Magic Specialist Expert ...
NO1 Top No1 Amil Baba In Azad Kashmir, Kashmir Black Magic Specialist Expert ...
 
PE 459 LECTURE 2- natural gas basic concepts and properties
PE 459 LECTURE 2- natural gas basic concepts and propertiesPE 459 LECTURE 2- natural gas basic concepts and properties
PE 459 LECTURE 2- natural gas basic concepts and properties
 
S1S2 B.Arch MGU - HOA1&2 Module 3 -Temple Architecture of Kerala.pptx
S1S2 B.Arch MGU - HOA1&2 Module 3 -Temple Architecture of Kerala.pptxS1S2 B.Arch MGU - HOA1&2 Module 3 -Temple Architecture of Kerala.pptx
S1S2 B.Arch MGU - HOA1&2 Module 3 -Temple Architecture of Kerala.pptx
 
Memory Interfacing of 8086 with DMA 8257
Memory Interfacing of 8086 with DMA 8257Memory Interfacing of 8086 with DMA 8257
Memory Interfacing of 8086 with DMA 8257
 
Linux Systems Programming: Inter Process Communication (IPC) using Pipes
Linux Systems Programming: Inter Process Communication (IPC) using PipesLinux Systems Programming: Inter Process Communication (IPC) using Pipes
Linux Systems Programming: Inter Process Communication (IPC) using Pipes
 
HOA1&2 - Module 3 - PREHISTORCI ARCHITECTURE OF KERALA.pptx
HOA1&2 - Module 3 - PREHISTORCI ARCHITECTURE OF KERALA.pptxHOA1&2 - Module 3 - PREHISTORCI ARCHITECTURE OF KERALA.pptx
HOA1&2 - Module 3 - PREHISTORCI ARCHITECTURE OF KERALA.pptx
 
COST-EFFETIVE and Energy Efficient BUILDINGS ptx
COST-EFFETIVE  and Energy Efficient BUILDINGS ptxCOST-EFFETIVE  and Energy Efficient BUILDINGS ptx
COST-EFFETIVE and Energy Efficient BUILDINGS ptx
 
Standard vs Custom Battery Packs - Decoding the Power Play
Standard vs Custom Battery Packs - Decoding the Power PlayStandard vs Custom Battery Packs - Decoding the Power Play
Standard vs Custom Battery Packs - Decoding the Power Play
 
Computer Networks Basics of Network Devices
Computer Networks  Basics of Network DevicesComputer Networks  Basics of Network Devices
Computer Networks Basics of Network Devices
 
AIRCANVAS[1].pdf mini project for btech students
AIRCANVAS[1].pdf mini project for btech studentsAIRCANVAS[1].pdf mini project for btech students
AIRCANVAS[1].pdf mini project for btech students
 

Detection and classification of vehicles using stereo vision