This document discusses a method for detecting and classifying vehicles using stereo vision. It involves computing a disparity map from stereo video sequences and using v-disparity and u-disparity to detect objects. Tracking links detections between frames to associate them with individual vehicles. Classification then identifies vehicles as trucks, cars or motorcycles based on width, length and height features using a decision tree. The method was tested on 6 video sequences with high accuracy for detection, direction and classification.
Detection and classification of vehicles using stereo vision
1. DETECTION AND CLASSIFICATION OF
VEHICLES USING STEREO VISION
UNIVERSITÀ DEGLI STUDI DI PARMA
FACOLTÀ DI INGEGNERIA
CORSO DI LAUREA SPECIALISTICA IN INGEGNERIA
INFORMATICA
2. Piero Micelli
STEREO VISION USED FOR THE EXTRACTION OF
3D INFORMATION FROM HOMOLOGOUS POINTS
19/05/2014 2
COMPUTE DISPARITY MAP
3. Piero Micelli
• Vehicles counting
• Vehicles counting per direction
• Vehicle classification
GOALS
19/05/2014 3
INPUTS
• Stereo video sequences
• Relative disparity map
9. Piero Micelli
OBJECT DETECTION
19/05/2014 9
1. The v-disparity does not give information about
the width, but only on the length
2. What if there are two objects in parallel?
FURTHER IUSSES
SOLUTION
• Use the u-disparity
10. Piero Micelli19/05/2014 10
OBJECT DETECTION
• Use of u-disparity to check the object presence
U-DISPARITY OF FREE ROAD OBJECT PATTERNU-DISPARITY IN PRESENCE
OF VEHICLE
12. Piero Micelli19/05/2014 12
CASES
1. The u-disparity shows a single object: OK
2. More object are detected on the u-disparity: ?
3. No object on u-disparity: ?
OBJECT DETECTION
Use the foreground image for a third comparison!
If an object is detected using the v-disparity, we look
at the u-disparity for further information
22. Piero Micelli
TRACKING
19/05/2014 22
• A vehicle could travel across the two-lane
• A vehicle could move from one lane to another
IUSSES
SOLUTIONS
• Tracking of CIDs detected on both lanes
• Association of CIDs to a vehicle (VID)
26. Piero Micelli
TRACKING
19/05/2014 26
• VEHICLE ID
VID
• CIDs Bounds
• VID Bounds
• Position History
• Width Histoty
• Height History
• Length History
• Direction
29. Piero Micelli19/05/2014 29
RESULTS
Analyzed video sequences:
• Number: 6
• Recorded during different seasons
• Recorded during different daytime hours
• Similar point of view
30. Piero Micelli19/05/2014 30
RESULTS
CATEGORIA TOTALE ERRORI ERRORE (%)
VEHICLES 744 0 0 %
4 WHEELS 705 4 0.6 %
TRUCK 13 2 15 %
2 WHEELS 26 1 3 %
SUD NORD
TOTALE ERRORI TOTALE ERRORI
VEHICLES 419 1 325 0
o CLASSIFICATION
o DIRECTION
31. Piero Micelli19/05/2014 31
FUTURE DEVELOPMENTS
• Try to train and to use a classifier (Support Vector
Machines ...)
• Try to use more features (SIFT)
• Use an algorithm to detect roadsides