SlideShare a Scribd company logo
1 of 4
Download to read offline
International Journal of Advanced Engineering, Management and Science (IJAEMS) [Vol-2, Issue-6, June- 2016]
Infogain Publication (Infogainpublication.com) ISSN : 2454-1311
www.ijaems.com Page | 600
Efficient Real Time Vehicles Detection Approach
for Complex Urban Traffic Management
Mr. Rushikesh D. Dongre, Asst. Prof. Praful R. Pardhi
Ramdeobaba College of Engineering & Management , Nagpur, Maharashtra, INDIA
Abstract—Vehicles now a day are becoming very necessary
part of our life this is leading to increase in congested traffic
conditions around the world. With our research in this
domain of vehicle detection with image processing we are
focusing on detection of vehicles. This is then combined with
car size detection. Our approach is to first work on the
feature of four wheeler i.e., windshield of the car. Then to
work with saliency generation of the region of interest which
will be containing only windshield part for the vehicles in the
frame. With conversion of this frame into HSV color model.
From HSV the saturation value within certain limit is kept for
the segmentation then on from that leading to the detection of
the vehicles in the given frame. Vehicle size detection we
have considered eagle eye view for taking out area and on
the basis of that deciding threshold for the vehicles into
different categories. Categories of vehicles include small,
medium, large vehicles for four wheelers.
Keywords—Saliency generation, Part Based Modeling,
HSV Color Model, Type detection.
I. INTRODUCTION
In city traffic conditions because of many numbers of
companies and ease of purchasing a four wheeler there are
coming more number of cars coming on roads day by day.
This is making urban traffic much more congested and
crowded. On the other side there is need of traffic
management to this problem. In that sense a system which
should be helpful for monitoring traffic remotely. In this all
vehicles detection and its processing is important. That to in
real time basis makes the system more useful. Our system
works for real time feeds of traffic in urban traffic conditions.
Our main aim is to work on real time and from that detection
of the vehicles here we are concentrating more on the
detection of the four wheelers.
In our approach we are considering real time traffic videos
taken from congested and crowded urban traffic conditions.
To work on real time we first need to have frame by frame
extraction so that vehicles containing four wheelers with
most feature covered. We have worked on the region of
interest to get best possible region wherein we get most of the
vehicles covered in a given frame. Saliency is generated for
each frame followed by conversion into RGB to HSV color
model. HSV color model gives certain range of values for
feature of car i.e., car windshield with that a threshold is set
for segmentation for keeping those pixels as it is. Since we
are working on real time basis we are having conditions of
foreground and background in the images. For that case we
have considered entropy of the pixels. Here in those pixels
are having highest entropy which is taken as 1 are considered
as foreground pixels and which are low entropy are
considered as background pixels considered as 0.
In detection of the vehicles all above methodology goes to
check for each frame checking the entropy into consideration
so that the detection and count is obtained for each frame.
While doing so we need to consider area entropy calculation
for each pixel, here in highest energy pixel within the average
is taken and from comparing with each pixels so that with
highest considered as 1. Then with comparison and threshold
we can get the vehicle detection and count for detected
vehicles. The methods used is given in brief as follows—
1. Saliency map Detection
Saliency map is a technique involving many types but we
have considered is one with color contrast feature and
intensity feature. In saliency map detection region based
entropy detection and mean of those entropies are calculated
to take out region with object detection. This includes
contrast feature and intensity feature can be given as follows-
For intensity feature it uses difference between centre pixel
and the surrounding pixels.
I(c, s) = | I(c) Ө I(s)|
The color contrast feature differences in the color values to
get the contrast, can be given as
RG(c, s) = | (R(c) - G(c)) Ө (G(s) - R(s)) |
Operated denoted by Ө: Interpolation to finer scale and point-
to-point subtraction.
II. APPROACH
Our approach mainly concentrated on vehicle detection and
its count for that we are following certain steps to work out
International Journal of Advanced Engineering, Management and Science (IJAEMS)
Infogain Publication (Infogainpublication.com
www.ijaems.com
our approach this can be given with the help of block
diagram-
Fig. 1
1. Input Frame: Working on real time feeds from given
road traffic and then on extracting frames for vehicle
detection. Extracted frame containing most types of
vehicle covered for the selection of region of interest
such that each frame with maximum number of vehicle
is selected. This region of interest selection with
separation between background and foreground.
2. Region of Interest: Appearance of vehicles in image
has various ratios because of its many kinds of models
such as sedan, SUV and truck. Our region of interest
mainly is on four wheelers so to help next process of
segmentation we need to focus only on the region of
vehicles. This is achieved with help of saliency map
detection for a given frame.
3. HSV Model: Given frame in RGB within the saliency
is converted into HSV color model. The reason for
converting into HSV model is to work on Part Based
model approach i.e., to work on features of the vehicle.
Main feature of a car we are working on windshield of a
car so considering the HSV values for that.
4. Segmentation: With HSV values, saturation value for
car windshield is in the range of 0.85 and around so that
pixel keeping as it is and then segmenting the rest.
Binarizing the HSV image which gives a certain green
color to the windshield pixel of car. This leads to fo
ground part and the back ground part for the given
International Journal of Advanced Engineering, Management and Science (IJAEMS)
Infogainpublication.com)
our approach this can be given with the help of block
Working on real time feeds from given
road traffic and then on extracting frames for vehicle
detection. Extracted frame containing most types of
vehicle covered for the selection of region of interest
such that each frame with maximum number of vehicle
selected. This region of interest selection with
separation between background and foreground.
Appearance of vehicles in image
has various ratios because of its many kinds of models
such as sedan, SUV and truck. Our region of interest
mainly is on four wheelers so to help next process of
segmentation we need to focus only on the region of
vehicles. This is achieved with help of saliency map
Given frame in RGB within the saliency
o HSV color model. The reason for
converting into HSV model is to work on Part Based
model approach i.e., to work on features of the vehicle.
Main feature of a car we are working on windshield of a
car so considering the HSV values for that.
With HSV values, saturation value for
car windshield is in the range of 0.85 and around so that
pixel keeping as it is and then segmenting the rest.
Binarizing the HSV image which gives a certain green
color to the windshield pixel of car. This leads to fore
ground part and the back ground part for the given
image which is important for the detection of occlusion
between the vehicles.
5. Entropy calculation and Detection:
Foreground and background detection leads to need of
entropy calculation in the image
Highest energy component
Low energy component
For the best possible entropy Gaussian filter is applied
to the given image, that region is extracted from image.
Best possible energy is considered as 1 unit to apply the
threshold for detection of which is compared with each
region of interest the vehicle windshield coming in the
next frames. For the coming cars different values for the
entropy are taken and their mean is calculated. For the
coming cars different values for the entrop
and their mean is calculated. Removing rest pixel
values, counting the number of regions where for that
area value is greater than the mean this gives the car
count.
III. IMPLEMENTATION
With our approach defined above we are working on dataset
contains videos and images of vehicles under regular Indian
(local) road condition. First with frame extraction from given
urban road condition and then region of interest, saliency
detection for each frame .this output can be given as
follows—
Original image—
Fig. 2
Saliency generated image
Fig. 3
[Vol-2, Issue-6, June- 2016]
) ISSN : 2454-1311
Page | 601
image which is important for the detection of occlusion
Entropy calculation and Detection:
Foreground and background detection leads to need of
entropy calculation in the image
ighest energy component foreground
Low energy component background
For the best possible entropy Gaussian filter is applied
to the given image, that region is extracted from image.
Best possible energy is considered as 1 unit to apply the
r detection of which is compared with each
region of interest the vehicle windshield coming in the
next frames. For the coming cars different values for the
entropy are taken and their mean is calculated. For the
coming cars different values for the entropy are taken
and their mean is calculated. Removing rest pixel
values, counting the number of regions where for that
area value is greater than the mean this gives the car
IMPLEMENTATION
With our approach defined above we are working on dataset
ains videos and images of vehicles under regular Indian
(local) road condition. First with frame extraction from given
urban road condition and then region of interest, saliency
detection for each frame .this output can be given as
Fig. 2
Saliency generated image—
Fig. 3
International Journal of Advanced Engineering, Management and Science (IJAEMS)
Infogain Publication (Infogainpublication.com
www.ijaems.com
our approach this can be given with the help of block
diagram-
Fig. 1
1. Input Frame: Working on real time feeds from given
road traffic and then on extracting frames for vehicle
detection. Extracted frame containing most types of
vehicle covered for the selection of region of interest
such that each frame with maximum number of vehicle
is selected. This region of interest selection with
separation between background and foreground.
2. Region of Interest: Appearance of vehicles in image
has various ratios because of its many kinds of models
such as sedan, SUV and truck. Our region of interest
mainly is on four wheelers so to help next process of
segmentation we need to focus only on the region of
vehicles. This is achieved with help of saliency map
detection for a given frame.
3. HSV Model: Given frame in RGB within the saliency
is converted into HSV color model. The reason for
converting into HSV model is to work on Part Based
model approach i.e., to work on features of the vehicle.
Main feature of a car we are working on windshield of a
car so considering the HSV values for that.
4. Segmentation: With HSV values, saturation value for
car windshield is in the range of 0.85 and around so that
pixel keeping as it is and then segmenting the rest.
Binarizing the HSV image which gives a certain green
color to the windshield pixel of car. This leads to fo
ground part and the back ground part for the given
International Journal of Advanced Engineering, Management and Science (IJAEMS)
Infogainpublication.com)
our approach this can be given with the help of block
Working on real time feeds from given
road traffic and then on extracting frames for vehicle
detection. Extracted frame containing most types of
vehicle covered for the selection of region of interest
such that each frame with maximum number of vehicle
selected. This region of interest selection with
separation between background and foreground.
Appearance of vehicles in image
has various ratios because of its many kinds of models
such as sedan, SUV and truck. Our region of interest
mainly is on four wheelers so to help next process of
segmentation we need to focus only on the region of
vehicles. This is achieved with help of saliency map
Given frame in RGB within the saliency
o HSV color model. The reason for
converting into HSV model is to work on Part Based
model approach i.e., to work on features of the vehicle.
Main feature of a car we are working on windshield of a
car so considering the HSV values for that.
With HSV values, saturation value for
car windshield is in the range of 0.85 and around so that
pixel keeping as it is and then segmenting the rest.
Binarizing the HSV image which gives a certain green
color to the windshield pixel of car. This leads to fore
ground part and the back ground part for the given
image which is important for the detection of occlusion
between the vehicles.
5. Entropy calculation and Detection:
Foreground and background detection leads to need of
entropy calculation in the image
Highest energy component
Low energy component
For the best possible entropy Gaussian filter is applied
to the given image, that region is extracted from image.
Best possible energy is considered as 1 unit to apply the
threshold for detection of which is compared with each
region of interest the vehicle windshield coming in the
next frames. For the coming cars different values for the
entropy are taken and their mean is calculated. For the
coming cars different values for the entrop
and their mean is calculated. Removing rest pixel
values, counting the number of regions where for that
area value is greater than the mean this gives the car
count.
III. IMPLEMENTATION
With our approach defined above we are working on dataset
contains videos and images of vehicles under regular Indian
(local) road condition. First with frame extraction from given
urban road condition and then region of interest, saliency
detection for each frame .this output can be given as
follows—
Original image—
Fig. 2
Saliency generated image
Fig. 3
[Vol-2, Issue-6, June- 2016]
) ISSN : 2454-1311
Page | 601
image which is important for the detection of occlusion
Entropy calculation and Detection:
Foreground and background detection leads to need of
entropy calculation in the image
ighest energy component foreground
Low energy component background
For the best possible entropy Gaussian filter is applied
to the given image, that region is extracted from image.
Best possible energy is considered as 1 unit to apply the
r detection of which is compared with each
region of interest the vehicle windshield coming in the
next frames. For the coming cars different values for the
entropy are taken and their mean is calculated. For the
coming cars different values for the entropy are taken
and their mean is calculated. Removing rest pixel
values, counting the number of regions where for that
area value is greater than the mean this gives the car
IMPLEMENTATION
With our approach defined above we are working on dataset
ains videos and images of vehicles under regular Indian
(local) road condition. First with frame extraction from given
urban road condition and then region of interest, saliency
detection for each frame .this output can be given as
Fig. 2
Saliency generated image—
Fig. 3
International Journal of Advanced Engineering, Management and Science (IJAEMS) [Vol-2, Issue-6, June- 2016]
Infogain Publication (Infogainpublication.com) ISSN : 2454-1311
www.ijaems.com Page | 603
[2] Real-time Vehicle Detection using Haar-SURF Mixed
Features and Gentle AdaBoost Classifier, Sun Shujuan,
Xu Zhize, Wang Xingang, Huang Guan, Wu Wenqi, Xu
De1,2015
[3] Symmetrical SURF and Its Applications to Vehicle
Detection and Vehicle Make and Model Recognition,
Jun-Wei Hsieh, Li-Chih Chen, and Duan-Yu Chen,2014
[4] On-road precise vehicle detection system using ROI
estimation, Jisu Kim, Jeonghyun Baek and Euntai
Kim,2014
[5] Sun Z, Bebis G, Miller R, On-road vehicle detection: A
review, IEEE Transactions on Pattern Analysis and
Machine Intelligence, Vol.28, No.5, 694-711, 2006.
[6] S. Sivaraman and M.M. Trivedi, “Looking at vehicles
on the road: a survey of vision-based vehicle detection,
tracking, and behavior analysis,” IEEE Transactions on
Intelligent Transportation Systems, vol. 14, no. 4, 2013.
[7] W.-C. Chang, C.-W. Cho, Real-Time Side Vehicle
Tracking using Parts- Based Boosting, IEEE
International Conference on Systems, Man and
Cybernetics, 3370-3375, 2008.
[8] Z. Sun, G. Bebis and R. Miller, “On-road vehicle
detection using evolutionary gabor filter optimization,”
IEEE transactions on Intelligent Transportation
Systems, vol.6, no. 2, pp. 125-137, 2005.
[9] Bay H, Tuytelaars T, Van Gool L, Surf: Speeded up
robust features, Computer Vision–ECCV 2006, 404-
417, 2006.
[10]Saliency Detection: A Boolean Map Approach Jianming
Zhang Stan Sclaroff Department of Computer Science,
Boston University,IEEE International Conference on
Computer Vision (ICCV), 2013

More Related Content

What's hot

What's hot (19)

Driving behaviors for adas and autonomous driving XII
Driving behaviors for adas and autonomous driving XIIDriving behaviors for adas and autonomous driving XII
Driving behaviors for adas and autonomous driving XII
 
Driving Behavior for ADAS and Autonomous Driving V
Driving Behavior for ADAS and Autonomous Driving VDriving Behavior for ADAS and Autonomous Driving V
Driving Behavior for ADAS and Autonomous Driving V
 
BEV Semantic Segmentation
BEV Semantic SegmentationBEV Semantic Segmentation
BEV Semantic Segmentation
 
Fisheye-Omnidirectional View in Autonomous Driving III
Fisheye-Omnidirectional View in Autonomous Driving IIIFisheye-Omnidirectional View in Autonomous Driving III
Fisheye-Omnidirectional View in Autonomous Driving III
 
Pedestrian behavior/intention modeling for autonomous driving IV
Pedestrian behavior/intention modeling for autonomous driving IVPedestrian behavior/intention modeling for autonomous driving IV
Pedestrian behavior/intention modeling for autonomous driving IV
 
Deep VO and SLAM
Deep VO and SLAMDeep VO and SLAM
Deep VO and SLAM
 
Pedestrian behavior/intention modeling for autonomous driving II
Pedestrian behavior/intention modeling for autonomous driving IIPedestrian behavior/intention modeling for autonomous driving II
Pedestrian behavior/intention modeling for autonomous driving II
 
3-d interpretation from stereo images for autonomous driving
3-d interpretation from stereo images for autonomous driving3-d interpretation from stereo images for autonomous driving
3-d interpretation from stereo images for autonomous driving
 
Driving Behavior for ADAS and Autonomous Driving IX
Driving Behavior for ADAS and Autonomous Driving IXDriving Behavior for ADAS and Autonomous Driving IX
Driving Behavior for ADAS and Autonomous Driving IX
 
Driving behaviors for adas and autonomous driving xiv
Driving behaviors for adas and autonomous driving xivDriving behaviors for adas and autonomous driving xiv
Driving behaviors for adas and autonomous driving xiv
 
Jointly mapping, localization, perception, prediction and planning
Jointly mapping, localization, perception, prediction and planningJointly mapping, localization, perception, prediction and planning
Jointly mapping, localization, perception, prediction and planning
 
Driving Behavior for ADAS and Autonomous Driving VIII
Driving Behavior for ADAS and Autonomous Driving VIIIDriving Behavior for ADAS and Autonomous Driving VIII
Driving Behavior for ADAS and Autonomous Driving VIII
 
Driving behaviors for adas and autonomous driving XIII
Driving behaviors for adas and autonomous driving XIIIDriving behaviors for adas and autonomous driving XIII
Driving behaviors for adas and autonomous driving XIII
 
Pedestrian behavior/intention modeling for autonomous driving III
Pedestrian behavior/intention modeling for autonomous driving IIIPedestrian behavior/intention modeling for autonomous driving III
Pedestrian behavior/intention modeling for autonomous driving III
 
camera-based Lane detection by deep learning
camera-based Lane detection by deep learningcamera-based Lane detection by deep learning
camera-based Lane detection by deep learning
 
3-d interpretation from single 2-d image IV
3-d interpretation from single 2-d image IV3-d interpretation from single 2-d image IV
3-d interpretation from single 2-d image IV
 
Deep Learning’s Application in Radar Signal Data II
Deep Learning’s Application in Radar Signal Data IIDeep Learning’s Application in Radar Signal Data II
Deep Learning’s Application in Radar Signal Data II
 
Pedestrian Behavior/Intention Modeling for Autonomous Driving VI
Pedestrian Behavior/Intention Modeling for Autonomous Driving VIPedestrian Behavior/Intention Modeling for Autonomous Driving VI
Pedestrian Behavior/Intention Modeling for Autonomous Driving VI
 
Pedestrian behavior/intention modeling for autonomous driving V
Pedestrian behavior/intention modeling for autonomous driving VPedestrian behavior/intention modeling for autonomous driving V
Pedestrian behavior/intention modeling for autonomous driving V
 

Similar to efficient real time vehicles detection approach for complex urban traffic management

OCR optimization for vehicle number plate Identification based on Template ma...
OCR optimization for vehicle number plate Identification based on Template ma...OCR optimization for vehicle number plate Identification based on Template ma...
OCR optimization for vehicle number plate Identification based on Template ma...
IJEEE
 
Image Processing Applied To Traffic Queue Detection Algorithm
Image Processing Applied To Traffic Queue Detection AlgorithmImage Processing Applied To Traffic Queue Detection Algorithm
Image Processing Applied To Traffic Queue Detection Algorithm
guest673189
 

Similar to efficient real time vehicles detection approach for complex urban traffic management (20)

Automatic Vehicle Detection Using Pixelwise Classification Approach
Automatic Vehicle Detection Using Pixelwise Classification ApproachAutomatic Vehicle Detection Using Pixelwise Classification Approach
Automatic Vehicle Detection Using Pixelwise Classification Approach
 
21.Demir.pdf
21.Demir.pdf21.Demir.pdf
21.Demir.pdf
 
OCR optimization for vehicle number plate Identification based on Template ma...
OCR optimization for vehicle number plate Identification based on Template ma...OCR optimization for vehicle number plate Identification based on Template ma...
OCR optimization for vehicle number plate Identification based on Template ma...
 
40120140501008
4012014050100840120140501008
40120140501008
 
A Study on Single Camera Based ANPR System for Improvement of Vehicle Number ...
A Study on Single Camera Based ANPR System for Improvement of Vehicle Number ...A Study on Single Camera Based ANPR System for Improvement of Vehicle Number ...
A Study on Single Camera Based ANPR System for Improvement of Vehicle Number ...
 
The Third Eye
The Third EyeThe Third Eye
The Third Eye
 
Advanced Lane Finding
Advanced Lane FindingAdvanced Lane Finding
Advanced Lane Finding
 
Image Processing Applied To Traffic Queue Detection Algorithm
Image Processing Applied To Traffic Queue Detection AlgorithmImage Processing Applied To Traffic Queue Detection Algorithm
Image Processing Applied To Traffic Queue Detection Algorithm
 
Automatic Number Plate Recognition System A Histogram Based Approach
Automatic Number Plate Recognition System  A Histogram Based ApproachAutomatic Number Plate Recognition System  A Histogram Based Approach
Automatic Number Plate Recognition System A Histogram Based Approach
 
E011142632
E011142632E011142632
E011142632
 
License Plate Recognition using Morphological Operation.
License Plate Recognition using Morphological Operation. License Plate Recognition using Morphological Operation.
License Plate Recognition using Morphological Operation.
 
IRJET- Dynamic Traffic Management System
IRJET- Dynamic Traffic Management SystemIRJET- Dynamic Traffic Management System
IRJET- Dynamic Traffic Management System
 
Number Plate Recognition of Still Images in Vehicular Parking System
Number Plate Recognition of Still Images in Vehicular Parking SystemNumber Plate Recognition of Still Images in Vehicular Parking System
Number Plate Recognition of Still Images in Vehicular Parking System
 
IRJET- Vehicle Number Plate Recognition System
IRJET- Vehicle Number Plate Recognition SystemIRJET- Vehicle Number Plate Recognition System
IRJET- Vehicle Number Plate Recognition System
 
Vehicle counting for traffic management
Vehicle counting for traffic management Vehicle counting for traffic management
Vehicle counting for traffic management
 
Shadow Detection and Removal for Traffic Surveillance System
Shadow Detection and Removal for Traffic Surveillance SystemShadow Detection and Removal for Traffic Surveillance System
Shadow Detection and Removal for Traffic Surveillance System
 
An Efficient Model to Identify A Vehicle by Recognizing the Alphanumeric Char...
An Efficient Model to Identify A Vehicle by Recognizing the Alphanumeric Char...An Efficient Model to Identify A Vehicle by Recognizing the Alphanumeric Char...
An Efficient Model to Identify A Vehicle by Recognizing the Alphanumeric Char...
 
Udacity project: Vehicle detection and tracking
Udacity project: Vehicle detection and trackingUdacity project: Vehicle detection and tracking
Udacity project: Vehicle detection and tracking
 
Real-Time Multiple License Plate Recognition System
Real-Time Multiple License Plate Recognition SystemReal-Time Multiple License Plate Recognition System
Real-Time Multiple License Plate Recognition System
 
Barcode Based Parking Management System
Barcode Based Parking Management SystemBarcode Based Parking Management System
Barcode Based Parking Management System
 

Recently uploaded

Tembisa Central Terminating Pills +27838792658 PHOMOLONG Top Abortion Pills F...
Tembisa Central Terminating Pills +27838792658 PHOMOLONG Top Abortion Pills F...Tembisa Central Terminating Pills +27838792658 PHOMOLONG Top Abortion Pills F...
Tembisa Central Terminating Pills +27838792658 PHOMOLONG Top Abortion Pills F...
drjose256
 
Final DBMS Manual (2).pdf final lab manual
Final DBMS Manual (2).pdf final lab manualFinal DBMS Manual (2).pdf final lab manual
Final DBMS Manual (2).pdf final lab manual
BalamuruganV28
 

Recently uploaded (20)

21scheme vtu syllabus of visveraya technological university
21scheme vtu syllabus of visveraya technological university21scheme vtu syllabus of visveraya technological university
21scheme vtu syllabus of visveraya technological university
 
CLOUD COMPUTING SERVICES - Cloud Reference Modal
CLOUD COMPUTING SERVICES - Cloud Reference ModalCLOUD COMPUTING SERVICES - Cloud Reference Modal
CLOUD COMPUTING SERVICES - Cloud Reference Modal
 
litvinenko_Henry_Intrusion_Hong-Kong_2024.pdf
litvinenko_Henry_Intrusion_Hong-Kong_2024.pdflitvinenko_Henry_Intrusion_Hong-Kong_2024.pdf
litvinenko_Henry_Intrusion_Hong-Kong_2024.pdf
 
Theory of Time 2024 (Universal Theory for Everything)
Theory of Time 2024 (Universal Theory for Everything)Theory of Time 2024 (Universal Theory for Everything)
Theory of Time 2024 (Universal Theory for Everything)
 
Tembisa Central Terminating Pills +27838792658 PHOMOLONG Top Abortion Pills F...
Tembisa Central Terminating Pills +27838792658 PHOMOLONG Top Abortion Pills F...Tembisa Central Terminating Pills +27838792658 PHOMOLONG Top Abortion Pills F...
Tembisa Central Terminating Pills +27838792658 PHOMOLONG Top Abortion Pills F...
 
Artificial Intelligence in due diligence
Artificial Intelligence in due diligenceArtificial Intelligence in due diligence
Artificial Intelligence in due diligence
 
Passive Air Cooling System and Solar Water Heater.ppt
Passive Air Cooling System and Solar Water Heater.pptPassive Air Cooling System and Solar Water Heater.ppt
Passive Air Cooling System and Solar Water Heater.ppt
 
History of Indian Railways - the story of Growth & Modernization
History of Indian Railways - the story of Growth & ModernizationHistory of Indian Railways - the story of Growth & Modernization
History of Indian Railways - the story of Growth & Modernization
 
Fuzzy logic method-based stress detector with blood pressure and body tempera...
Fuzzy logic method-based stress detector with blood pressure and body tempera...Fuzzy logic method-based stress detector with blood pressure and body tempera...
Fuzzy logic method-based stress detector with blood pressure and body tempera...
 
Seismic Hazard Assessment Software in Python by Prof. Dr. Costas Sachpazis
Seismic Hazard Assessment Software in Python by Prof. Dr. Costas SachpazisSeismic Hazard Assessment Software in Python by Prof. Dr. Costas Sachpazis
Seismic Hazard Assessment Software in Python by Prof. Dr. Costas Sachpazis
 
Adsorption (mass transfer operations 2) ppt
Adsorption (mass transfer operations 2) pptAdsorption (mass transfer operations 2) ppt
Adsorption (mass transfer operations 2) ppt
 
NEWLETTER FRANCE HELICES/ SDS SURFACE DRIVES - MAY 2024
NEWLETTER FRANCE HELICES/ SDS SURFACE DRIVES - MAY 2024NEWLETTER FRANCE HELICES/ SDS SURFACE DRIVES - MAY 2024
NEWLETTER FRANCE HELICES/ SDS SURFACE DRIVES - MAY 2024
 
analog-vs-digital-communication (concept of analog and digital).pptx
analog-vs-digital-communication (concept of analog and digital).pptxanalog-vs-digital-communication (concept of analog and digital).pptx
analog-vs-digital-communication (concept of analog and digital).pptx
 
UNIT-2 image enhancement.pdf Image Processing Unit 2 AKTU
UNIT-2 image enhancement.pdf Image Processing Unit 2 AKTUUNIT-2 image enhancement.pdf Image Processing Unit 2 AKTU
UNIT-2 image enhancement.pdf Image Processing Unit 2 AKTU
 
Worksharing and 3D Modeling with Revit.pptx
Worksharing and 3D Modeling with Revit.pptxWorksharing and 3D Modeling with Revit.pptx
Worksharing and 3D Modeling with Revit.pptx
 
Insurance management system project report.pdf
Insurance management system project report.pdfInsurance management system project report.pdf
Insurance management system project report.pdf
 
UNIT 4 PTRP final Convergence in probability.pptx
UNIT 4 PTRP final Convergence in probability.pptxUNIT 4 PTRP final Convergence in probability.pptx
UNIT 4 PTRP final Convergence in probability.pptx
 
NO1 Best Powerful Vashikaran Specialist Baba Vashikaran Specialist For Love V...
NO1 Best Powerful Vashikaran Specialist Baba Vashikaran Specialist For Love V...NO1 Best Powerful Vashikaran Specialist Baba Vashikaran Specialist For Love V...
NO1 Best Powerful Vashikaran Specialist Baba Vashikaran Specialist For Love V...
 
8th International Conference on Soft Computing, Mathematics and Control (SMC ...
8th International Conference on Soft Computing, Mathematics and Control (SMC ...8th International Conference on Soft Computing, Mathematics and Control (SMC ...
8th International Conference on Soft Computing, Mathematics and Control (SMC ...
 
Final DBMS Manual (2).pdf final lab manual
Final DBMS Manual (2).pdf final lab manualFinal DBMS Manual (2).pdf final lab manual
Final DBMS Manual (2).pdf final lab manual
 

efficient real time vehicles detection approach for complex urban traffic management

  • 1. International Journal of Advanced Engineering, Management and Science (IJAEMS) [Vol-2, Issue-6, June- 2016] Infogain Publication (Infogainpublication.com) ISSN : 2454-1311 www.ijaems.com Page | 600 Efficient Real Time Vehicles Detection Approach for Complex Urban Traffic Management Mr. Rushikesh D. Dongre, Asst. Prof. Praful R. Pardhi Ramdeobaba College of Engineering & Management , Nagpur, Maharashtra, INDIA Abstract—Vehicles now a day are becoming very necessary part of our life this is leading to increase in congested traffic conditions around the world. With our research in this domain of vehicle detection with image processing we are focusing on detection of vehicles. This is then combined with car size detection. Our approach is to first work on the feature of four wheeler i.e., windshield of the car. Then to work with saliency generation of the region of interest which will be containing only windshield part for the vehicles in the frame. With conversion of this frame into HSV color model. From HSV the saturation value within certain limit is kept for the segmentation then on from that leading to the detection of the vehicles in the given frame. Vehicle size detection we have considered eagle eye view for taking out area and on the basis of that deciding threshold for the vehicles into different categories. Categories of vehicles include small, medium, large vehicles for four wheelers. Keywords—Saliency generation, Part Based Modeling, HSV Color Model, Type detection. I. INTRODUCTION In city traffic conditions because of many numbers of companies and ease of purchasing a four wheeler there are coming more number of cars coming on roads day by day. This is making urban traffic much more congested and crowded. On the other side there is need of traffic management to this problem. In that sense a system which should be helpful for monitoring traffic remotely. In this all vehicles detection and its processing is important. That to in real time basis makes the system more useful. Our system works for real time feeds of traffic in urban traffic conditions. Our main aim is to work on real time and from that detection of the vehicles here we are concentrating more on the detection of the four wheelers. In our approach we are considering real time traffic videos taken from congested and crowded urban traffic conditions. To work on real time we first need to have frame by frame extraction so that vehicles containing four wheelers with most feature covered. We have worked on the region of interest to get best possible region wherein we get most of the vehicles covered in a given frame. Saliency is generated for each frame followed by conversion into RGB to HSV color model. HSV color model gives certain range of values for feature of car i.e., car windshield with that a threshold is set for segmentation for keeping those pixels as it is. Since we are working on real time basis we are having conditions of foreground and background in the images. For that case we have considered entropy of the pixels. Here in those pixels are having highest entropy which is taken as 1 are considered as foreground pixels and which are low entropy are considered as background pixels considered as 0. In detection of the vehicles all above methodology goes to check for each frame checking the entropy into consideration so that the detection and count is obtained for each frame. While doing so we need to consider area entropy calculation for each pixel, here in highest energy pixel within the average is taken and from comparing with each pixels so that with highest considered as 1. Then with comparison and threshold we can get the vehicle detection and count for detected vehicles. The methods used is given in brief as follows— 1. Saliency map Detection Saliency map is a technique involving many types but we have considered is one with color contrast feature and intensity feature. In saliency map detection region based entropy detection and mean of those entropies are calculated to take out region with object detection. This includes contrast feature and intensity feature can be given as follows- For intensity feature it uses difference between centre pixel and the surrounding pixels. I(c, s) = | I(c) Ө I(s)| The color contrast feature differences in the color values to get the contrast, can be given as RG(c, s) = | (R(c) - G(c)) Ө (G(s) - R(s)) | Operated denoted by Ө: Interpolation to finer scale and point- to-point subtraction. II. APPROACH Our approach mainly concentrated on vehicle detection and its count for that we are following certain steps to work out
  • 2. International Journal of Advanced Engineering, Management and Science (IJAEMS) Infogain Publication (Infogainpublication.com www.ijaems.com our approach this can be given with the help of block diagram- Fig. 1 1. Input Frame: Working on real time feeds from given road traffic and then on extracting frames for vehicle detection. Extracted frame containing most types of vehicle covered for the selection of region of interest such that each frame with maximum number of vehicle is selected. This region of interest selection with separation between background and foreground. 2. Region of Interest: Appearance of vehicles in image has various ratios because of its many kinds of models such as sedan, SUV and truck. Our region of interest mainly is on four wheelers so to help next process of segmentation we need to focus only on the region of vehicles. This is achieved with help of saliency map detection for a given frame. 3. HSV Model: Given frame in RGB within the saliency is converted into HSV color model. The reason for converting into HSV model is to work on Part Based model approach i.e., to work on features of the vehicle. Main feature of a car we are working on windshield of a car so considering the HSV values for that. 4. Segmentation: With HSV values, saturation value for car windshield is in the range of 0.85 and around so that pixel keeping as it is and then segmenting the rest. Binarizing the HSV image which gives a certain green color to the windshield pixel of car. This leads to fo ground part and the back ground part for the given International Journal of Advanced Engineering, Management and Science (IJAEMS) Infogainpublication.com) our approach this can be given with the help of block Working on real time feeds from given road traffic and then on extracting frames for vehicle detection. Extracted frame containing most types of vehicle covered for the selection of region of interest such that each frame with maximum number of vehicle selected. This region of interest selection with separation between background and foreground. Appearance of vehicles in image has various ratios because of its many kinds of models such as sedan, SUV and truck. Our region of interest mainly is on four wheelers so to help next process of segmentation we need to focus only on the region of vehicles. This is achieved with help of saliency map Given frame in RGB within the saliency o HSV color model. The reason for converting into HSV model is to work on Part Based model approach i.e., to work on features of the vehicle. Main feature of a car we are working on windshield of a car so considering the HSV values for that. With HSV values, saturation value for car windshield is in the range of 0.85 and around so that pixel keeping as it is and then segmenting the rest. Binarizing the HSV image which gives a certain green color to the windshield pixel of car. This leads to fore ground part and the back ground part for the given image which is important for the detection of occlusion between the vehicles. 5. Entropy calculation and Detection: Foreground and background detection leads to need of entropy calculation in the image Highest energy component Low energy component For the best possible entropy Gaussian filter is applied to the given image, that region is extracted from image. Best possible energy is considered as 1 unit to apply the threshold for detection of which is compared with each region of interest the vehicle windshield coming in the next frames. For the coming cars different values for the entropy are taken and their mean is calculated. For the coming cars different values for the entrop and their mean is calculated. Removing rest pixel values, counting the number of regions where for that area value is greater than the mean this gives the car count. III. IMPLEMENTATION With our approach defined above we are working on dataset contains videos and images of vehicles under regular Indian (local) road condition. First with frame extraction from given urban road condition and then region of interest, saliency detection for each frame .this output can be given as follows— Original image— Fig. 2 Saliency generated image Fig. 3 [Vol-2, Issue-6, June- 2016] ) ISSN : 2454-1311 Page | 601 image which is important for the detection of occlusion Entropy calculation and Detection: Foreground and background detection leads to need of entropy calculation in the image ighest energy component foreground Low energy component background For the best possible entropy Gaussian filter is applied to the given image, that region is extracted from image. Best possible energy is considered as 1 unit to apply the r detection of which is compared with each region of interest the vehicle windshield coming in the next frames. For the coming cars different values for the entropy are taken and their mean is calculated. For the coming cars different values for the entropy are taken and their mean is calculated. Removing rest pixel values, counting the number of regions where for that area value is greater than the mean this gives the car IMPLEMENTATION With our approach defined above we are working on dataset ains videos and images of vehicles under regular Indian (local) road condition. First with frame extraction from given urban road condition and then region of interest, saliency detection for each frame .this output can be given as Fig. 2 Saliency generated image— Fig. 3
  • 3. International Journal of Advanced Engineering, Management and Science (IJAEMS) Infogain Publication (Infogainpublication.com www.ijaems.com our approach this can be given with the help of block diagram- Fig. 1 1. Input Frame: Working on real time feeds from given road traffic and then on extracting frames for vehicle detection. Extracted frame containing most types of vehicle covered for the selection of region of interest such that each frame with maximum number of vehicle is selected. This region of interest selection with separation between background and foreground. 2. Region of Interest: Appearance of vehicles in image has various ratios because of its many kinds of models such as sedan, SUV and truck. Our region of interest mainly is on four wheelers so to help next process of segmentation we need to focus only on the region of vehicles. This is achieved with help of saliency map detection for a given frame. 3. HSV Model: Given frame in RGB within the saliency is converted into HSV color model. The reason for converting into HSV model is to work on Part Based model approach i.e., to work on features of the vehicle. Main feature of a car we are working on windshield of a car so considering the HSV values for that. 4. Segmentation: With HSV values, saturation value for car windshield is in the range of 0.85 and around so that pixel keeping as it is and then segmenting the rest. Binarizing the HSV image which gives a certain green color to the windshield pixel of car. This leads to fo ground part and the back ground part for the given International Journal of Advanced Engineering, Management and Science (IJAEMS) Infogainpublication.com) our approach this can be given with the help of block Working on real time feeds from given road traffic and then on extracting frames for vehicle detection. Extracted frame containing most types of vehicle covered for the selection of region of interest such that each frame with maximum number of vehicle selected. This region of interest selection with separation between background and foreground. Appearance of vehicles in image has various ratios because of its many kinds of models such as sedan, SUV and truck. Our region of interest mainly is on four wheelers so to help next process of segmentation we need to focus only on the region of vehicles. This is achieved with help of saliency map Given frame in RGB within the saliency o HSV color model. The reason for converting into HSV model is to work on Part Based model approach i.e., to work on features of the vehicle. Main feature of a car we are working on windshield of a car so considering the HSV values for that. With HSV values, saturation value for car windshield is in the range of 0.85 and around so that pixel keeping as it is and then segmenting the rest. Binarizing the HSV image which gives a certain green color to the windshield pixel of car. This leads to fore ground part and the back ground part for the given image which is important for the detection of occlusion between the vehicles. 5. Entropy calculation and Detection: Foreground and background detection leads to need of entropy calculation in the image Highest energy component Low energy component For the best possible entropy Gaussian filter is applied to the given image, that region is extracted from image. Best possible energy is considered as 1 unit to apply the threshold for detection of which is compared with each region of interest the vehicle windshield coming in the next frames. For the coming cars different values for the entropy are taken and their mean is calculated. For the coming cars different values for the entrop and their mean is calculated. Removing rest pixel values, counting the number of regions where for that area value is greater than the mean this gives the car count. III. IMPLEMENTATION With our approach defined above we are working on dataset contains videos and images of vehicles under regular Indian (local) road condition. First with frame extraction from given urban road condition and then region of interest, saliency detection for each frame .this output can be given as follows— Original image— Fig. 2 Saliency generated image Fig. 3 [Vol-2, Issue-6, June- 2016] ) ISSN : 2454-1311 Page | 601 image which is important for the detection of occlusion Entropy calculation and Detection: Foreground and background detection leads to need of entropy calculation in the image ighest energy component foreground Low energy component background For the best possible entropy Gaussian filter is applied to the given image, that region is extracted from image. Best possible energy is considered as 1 unit to apply the r detection of which is compared with each region of interest the vehicle windshield coming in the next frames. For the coming cars different values for the entropy are taken and their mean is calculated. For the coming cars different values for the entropy are taken and their mean is calculated. Removing rest pixel values, counting the number of regions where for that area value is greater than the mean this gives the car IMPLEMENTATION With our approach defined above we are working on dataset ains videos and images of vehicles under regular Indian (local) road condition. First with frame extraction from given urban road condition and then region of interest, saliency detection for each frame .this output can be given as Fig. 2 Saliency generated image— Fig. 3
  • 4. International Journal of Advanced Engineering, Management and Science (IJAEMS) [Vol-2, Issue-6, June- 2016] Infogain Publication (Infogainpublication.com) ISSN : 2454-1311 www.ijaems.com Page | 603 [2] Real-time Vehicle Detection using Haar-SURF Mixed Features and Gentle AdaBoost Classifier, Sun Shujuan, Xu Zhize, Wang Xingang, Huang Guan, Wu Wenqi, Xu De1,2015 [3] Symmetrical SURF and Its Applications to Vehicle Detection and Vehicle Make and Model Recognition, Jun-Wei Hsieh, Li-Chih Chen, and Duan-Yu Chen,2014 [4] On-road precise vehicle detection system using ROI estimation, Jisu Kim, Jeonghyun Baek and Euntai Kim,2014 [5] Sun Z, Bebis G, Miller R, On-road vehicle detection: A review, IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol.28, No.5, 694-711, 2006. [6] S. Sivaraman and M.M. Trivedi, “Looking at vehicles on the road: a survey of vision-based vehicle detection, tracking, and behavior analysis,” IEEE Transactions on Intelligent Transportation Systems, vol. 14, no. 4, 2013. [7] W.-C. Chang, C.-W. Cho, Real-Time Side Vehicle Tracking using Parts- Based Boosting, IEEE International Conference on Systems, Man and Cybernetics, 3370-3375, 2008. [8] Z. Sun, G. Bebis and R. Miller, “On-road vehicle detection using evolutionary gabor filter optimization,” IEEE transactions on Intelligent Transportation Systems, vol.6, no. 2, pp. 125-137, 2005. [9] Bay H, Tuytelaars T, Van Gool L, Surf: Speeded up robust features, Computer Vision–ECCV 2006, 404- 417, 2006. [10]Saliency Detection: A Boolean Map Approach Jianming Zhang Stan Sclaroff Department of Computer Science, Boston University,IEEE International Conference on Computer Vision (ICCV), 2013