SlideShare a Scribd company logo
1 of 10
Download to read offline
TELKOMNIKA, Vol.17, No.4, August 2019, pp.2048~2057
ISSN: 1693-6930, accredited First Grade by Kemenristekdikti, Decree No: 21/E/KPT/2018
DOI: 10.12928/TELKOMNIKA.v17i4.12759 ◼ 2048
Received August 29, 2018; Revised February 19, 2019; Accepted March 13, 2019
Road markers classification using binary scanning
and slope contours
Zamani Md Sani*1
, Hadhrami Abd Ghani2
, Rosli Besar3
, Azizul Azizan4
1
Faculty of Electrical Engineering, Universiti Teknikal Malaysia Melaka, Malaysia
2,3
Faculty of Engineering and Technology, Multimedia University, Malaysia
4
Advanced Informatics School, Universiti Teknologi Malaysia, Malaysia
*Corresponding author, e-mail: zamanisani@utem.edu.my1
, hadhrami.abdghani@mmu.edu.my2
,
rosli@mmu.edu.my3
, azizulazizan@utm.my4
Abstract
Road markers guide the driver while driving on the road to control the traffic for the safety of
the road users. With the booming autonomous car technology, the road markers classification is important
in its vision segment to navigate the autonomous car. A new method is proposed in this paper to classify
five types of road markers namely dashed, single, double, solid-dashed and dashed-solid which are
commonly found on the two lane single carriageway. The classification is using unique feature acquired
from the binary image by scanning on each of the images to calculate the frequency of binary transition.
Another feature which is the slopes between the two centroids which allow the proposed method, to
perform the classification within the same video frame period. This proposed method has been observed to
achieve an accuracy value of at least 93%, which is higher than the accuracy value achieved by
the existing methods.
Keywords: autonomous car, binary scan, road marker, slope contour
Copyright © 2019 Universitas Ahmad Dahlan. All rights reserved.
1. Introduction
The road markers are essential to control the road traffic and avoid traffic hazards by
guiding the road users to safely decide either to maintain the course in the middle of the lane or
to overtake the front vehicles. Road markers are categorized in different types subject to
the types of the roads such as urban, non-urban and highway, on which the sizes of the road
markers may slightly vary. Existing research work have been extensively carried out to solve
the lane detection and tracking problems for Auto-Assist Driving System (ADS) [1–6].
The schemes proposed are mainly about detecting and tracking the lanes, without focusing on
classifying the road markers. Others, had worked on the road symbols, alphabets and
customize markers [7-10] which also used as the information to alert the drivers. Nevertheless,
road marker classification still have some room for improvement as there are different types of
markers can be found globally [11, 12].
A frequency analysis method for the urban road marker classification had been
proposed in [13] which uses the inverse perspective mapping (IPM) to produce a bird-eye view
of the road and produce a modified Hough Transform (HT) for better lane detection.
Then the power spectrum and Fourier analysis are applied to detect three types of markers,
namely; single solid, dashed, and merged road markers which are commonly found at the urban
road. Schubert et al. reported in [14] about a lane changing approach based on the road traffic
surrounding situation including the type of the road marker. However the marker type’s
classification is limited to only dashed and solid road markers. In a work presented by
Lindner et al. [15], an edge detector technique was designed to subsequently search for a
different objects on the road to detect the road markers. Even though four types of road
markerscan be detected, it only concentrates on the dashed lines with different sizes.
In another approach by Suchitra et al. [16], a modular approach is used to classify three
road markers namely; dashed, solid and zigzag. To classify either dashed or solid, Basic Lane
Marking (BLM), which is based on continuity properties is applied. This approach however,
applies the temporal information in the classification operation, which renders slower detection
when the road marker type changes whilst driving on the road. Nedevschi et al. [17] able to
TELKOMNIKA ISSN: 1693-6930 ◼
Road markers classification using binary scanning … (Zamani Md Sani)
2049
classify road markers into four types namely double solid, single solid, merged, and dashed
using a periodic histogram and ego-localization.
Paula et al [18-20] had worked on the five types of road marker. A detection method
based on Bayesian approach for classifying the road markers has been proposed. Although it is
able to classify five types of road markers, the method suffers outlier problems especially at
transitions between two types of markers. The results of the classification were found to have
changed abruptly on each frame, which caused inconsistent results while driving.
Mathibela et al. [21] concentrate on the road markers found at the urban area and able to
classify seven types, namely; double boundary, single boundary, zig-zag, separator, boxed
junction, intersectionand special lanes by using a unique set of geometric features which
function within a probabilistic RUSBoost and Conditional Random Field (CRF) network.
However, this research is mainly carried out on a static image. The latest publication from
Zamani et al. [22, 23] using the features extracted from the road lane, and fed into the Artificial
Neural Network (ANN). The initial research starts with two types of lane markers and later
expanded to five types of markers classification [24] which the features extracted from
the customized Region of Interest (ROI). Nevertheless, the algorithm requires temporal values
from to lot of image sequence before it can make a decision on type’s transition due to its small
ROI. This may lags the information to alert the drivers. The aforementioned methods have been
proposed to address different types of road markers subject to the physical features of the roads
including the dimension, colour and size of the markers. In our research, the types of road
markers which are normally found at the non-urban carriageway are classified using a machine
vision system attached to a car. The road markers include solid, dashed, dashed-solid,
double-solid and solid-dashed, as shown in Figure 1.
(a) (b) (c) (d) (e)
Figure 1. Road Markers found at two lane single carriageway (a) dashed (D)
(b) dashed-solid (DS) (c) double solid (DD) (d) solid-dashed (SD) (e) single solid (SS)
2. Research Method
The proposed classification process is using a two-layer classifier as shown as in
Figure 2. First layer will classify three classes of markers whereas the next layer will classify
another two more classes. The first layer is using the scanning the binary image to get
the percentage of the binary transition and the second layer classifier is using the slope value
from the two contours detected in the same image. Before all these process can be done,
the Region of Interest (ROI) will be determined from the video image, and this would require
the camera location to be adjusted at the front of the camera.
Figure 2. Two-layer classifier
First Layer Classifier
SINGLE SOLID DASHEDDOUBLE
SOLID
Second layer Classifier
SOLID-
DASHED
DASHED-
SOLID
◼ ISSN: 1693-6930
TELKOMNIKA Vol. 17, No. 4, August 2019: 2048-2057
2050
2.1. Camera Setup for Region of Interest (ROI) selection
A new method in selecting the ROI based on its calibrated camera’s height and Field of
View (FOV) are used. For the initial setup, a camera with a resolution of 1280x720 located at
the center of the lane, is calibrated on its position with its FOV adjusted towards the planar road
surface captured by the camera as shown in Figures 3 (a) and 3 (b). To calibrate the position of
the camera, two horizontal lines, h1 and h2, are set on the FOV to equally divide into 3 sections
as in Figure 3 (c), where the h1 horizontal line in the image must cross the intersection point
between the rightmost lane, the off-road region and the border of the image to maximize
the ROI.
The ROI selection is then applied to the video and the output for the ROI is labelled as
r(x,y) as in Figure 4 which contains the information of the marker, by dividing the image into two
halves before selecting two third of from the right, as indicated by the red box, which is bordered
by the two horizontal lines. With this method, the ROI contains the largest visible road marker of
the image.
(a) (b)
(c)
Figure 3. The camera setup (a) camera position (b) 3D camera coordinate system
(c) camera height adjustment with h1 and h2 horizontal lines
Figure 4. ROI selection
TELKOMNIKA ISSN: 1693-6930 ◼
Road markers classification using binary scanning … (Zamani Md Sani)
2051
The ROI, r(x,y) which is in two dimension (2D) will represents the video images in pixels
and will go through the pre-processing prior to the feature extraction and classification process.
The raw image in Red Green Blue (RGB) video images will be filtered through the Gaussian
filter for 2D as in (1). The parameter x is the horizontal length from the origin and y is the vertical
length from the origin and σ is the standard deviation of the Gaussian distribution [25].
𝐺(𝑥, 𝑦) =
1
2𝜋𝜎2
𝑒
−
𝑥2+𝑦2
2𝜎2
(1)
This Gaussian operation will reduce the noise generated in the segmentation process to
produce a good binary image for thresholding operation on Hue, Saturation and Luminance
format (HSL). In this process, the normal RGB colour image is converted to HSL. Since
the typically white lane marker is on a grey background, the luminance value is adjusted as
the threshold, use to convert the image to binary format.
2.2. Extracting The Road Marking Cues
After investigating the best ROI for processing the image, the next step is to extract
the road marking cues. The ROI will be scanned from the top to the bottom and from the left to
the right as shown by the arrows in Figure 5 (b). A binary column vector 𝑓𝑥, which is extracted
from the x-th column of the binary image having binary pixels of 𝑓(𝑥, 𝑦) ∈ {0,1}
for 𝑥 = 0,1, ⋯ , 𝑁𝑥 and 𝑦 = 0,1, ⋯ , 𝑁𝑦, is defined as follows
𝑓𝑥[𝑦] = {
0, 𝑓(𝑥, 𝑦) = 0
1, 𝑓(𝑥, 𝑦) = 1
(2)
This binary column vector tells how many white pixels found on the x-th column. When
there are road markers crossing the column, the number of white pixels will increase. In order to
reduce the computational complexity, not all columns will be read, or horizontally scanned over
the image. It is sufficient to horizontally scan the image for obtaining the values over a constant
horizontal interval of δx as in Figure 5 (b), which is the number of pixel columns of the binary
image which are skipped and not scanned, as long as the road marker can be correctly classify.
Example of scanning process on the image shown in Figure 5, with various type of road
markers and different value of δx.
By using an example of a 420x260 pixel size for an ROI, it will requires 41 times of lines
scanning using with interval size of δx=10 pixels, producing 41 binary column vectors 𝒇 𝑥, where
𝑁𝑥 = 260 (the Height size). Every binary column vector, 𝒇 𝑥 will be processed to detect and
count the number of transitions, 𝑁𝑡 from 0 to 1 and from 1 to 0 in it by using a bitwise exclusive
OR operation between itself, 𝒇 𝑥 and 𝒇 𝑥𝑟, which is a vector produced from shifting 𝒇 𝑥 by one
binary bit or element as shown in an example.
- bitwise shift to the right by adding 0 to the first bit and shift the rest to the right
𝒇 𝑥
𝑻
= [0001111000], 𝒇 𝑥𝑟
𝑻
= [0000111100]
- perform the exclusive OR with original value resulting only transition bits are left
- 𝒇 𝑡 = 𝒇 𝑥
𝑻
⨁𝒇 𝑥𝑟
𝑻
= [0001111000] ⊕ [0000111100] = [0001000100]
- count the number of transitions on every scan line or binary column vector
𝑁𝑡 = ∑ 𝑓𝑡[𝑦]
𝑁 𝑥
𝑦=1 = 2
The numbers of transitions in each binary column vector obtained from the scanning
line are saved into a vector, 𝒇 𝑵 𝒕
. An example of this vector produced from scanning an ROI with
an interval size of 10 pixels is given in Figure 6. The number of transitions are in each binary
column vector is observed to be either 0, 2 or 4. For the road marker SS, there are at most 2
transitions in each vector whereas for D, the number of transitions is either 0 or 2. For DD,
the number of transitions is 4, whereas for SD and DS, the number of transitions is either 2 or 4.
To differentiate between SD and DS, additional features will be extracted to differentiate
between these two classes.
◼ ISSN: 1693-6930
TELKOMNIKA Vol. 17, No. 4, August 2019: 2048-2057
2052
(a) (b)
(c) (d)
Figure 5. Example of scanning image with different interval size with different road markers
Vector 𝒇𝒕 will be processed where the number of transitions will be grouped and
the percentage of 𝑁𝑡, or the numbers of transitions will be stored in vector 𝒇 𝑵 𝒕
as formulated by
𝑁𝑡
p
in (3), which is applied to calculate the percentage of 𝑁𝑡 for five different classes as
tabulated in Table 1. According to this table, 𝑁1 = 0, 𝑁2 = 2 and 𝑁3 = 4.
𝑁𝑡
p
=
Frequency of 𝑁𝑡
Total frequency
× 100% (3)
Table 1. Example of Transition Percentages from 𝒇 𝑵 𝒕
(from DS Image Figure 6)
𝑁𝑡 Frequency of 𝑁𝑡 𝑁𝑡
p
(%)
0 1 2.44
2 26 63.41
4 14 34.15
𝒇 𝑵 𝒕
= [2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2,
2, 2, 2,2, 2, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4,
4, 4, 2, 2, 2, 2, 2, 2, 0]
Figure 6. Example of result for 𝐟 𝐍 𝐭
after scanning process
TELKOMNIKA ISSN: 1693-6930 ◼
Road markers classification using binary scanning … (Zamani Md Sani)
2053
2.3. The First and Second Layer Classification
2.3.1. Designing the Filtering Table for First Layer Classification
The percentages of 𝑁𝑡 obtained when processing 100 frames from each of the five
classes are plotted in Figure 7. The X-axis represents 𝑁𝑡 whereas Y-axis represents 𝑁𝑡
p
, which
is the percentage of 𝑁𝑡. In our method, we use 10 pixels as the interval size for the scanning
process. From observation, a threshold can be set from the data to enable the classification for
the markers. At threshold value of 20% as shown as red dash line, a filtering table can be
designed as in Table 2. At least 2 types of markers can be classified, whereas SS and DS/SD
classes could produced the same result. To improve this problem, an additional percentage
value is introduced, which is 𝑁4
p
= 6, which is a multiplication of 𝑁2
p
= 2 and 𝑁3
p
= 4 and later
gain by 2 as formulated in (4) are plotted in Figures 7 (a)-(e) as inside the blue dash box. From
this additional percentage value, the filtering table can be improved as in Table 2 to classify
three road marker types namely D, DD and SS. As for SD and DS road marker type,
the algorithm will proceed to the second classifier as described in the next section.
𝑁4
p
= (𝑁2
p
× 𝑁3
p
) ∗ 2 (4)
(a) (b)
(c) (d)
(e)
Figure 1. Plotting Percentage of 𝑁𝑡 (%) for 5 different classes with 20% threshold line with,
𝑁4
p
= 6 included as inside the blue dash box (a) DD (b)D (c) DS (d) SD (e)SS
◼ ISSN: 1693-6930
TELKOMNIKA Vol. 17, No. 4, August 2019: 2048-2057
2054
Table 2. Filtering Table Construction from the Graph Observation Inclusive of 𝑁4
p
= 6
Condition for classifying 𝑁𝑡
p
> 20%
Binary transition 𝑁𝑡 0 2 4 6
Dashed (D) C1 Yes Yes/No No No
Double Solid (DD) C2 No No Yes Yes/No
Single (SS) C3 No Yes No No
Solid-Dashed (SD) C4 No Yes Yes/No Yes
Dashed-Solid (DS) C5 No Yes Yes/No Yes
2.3.2. Contours Slope (Second Layer Classifier)
In the second layer classification, the aim is to separate the DS and SD classes which
requires the process to detect the contours (long and short markers). A DS class is recognized
by the location of the shorter contour (of the dashed marker) below the longer contour (the solid
marker) and an SD class is recognized vice versa. In Figure 8, the longer contour is indicated by
two points, A and B, and its both ends. The shorter contour is indicated by point C, which is
the centroid of the shorter contour. Hence by knowing the location of C, whether it’s below or
above the longer contour, the class SD or DS can be identified.
(a) (b)
Figure 2. Three points to calculate the slope (a) DS class (b) SD class
The slope of 𝑚 𝐴𝐶 =
𝐴 𝑦− 𝐶 𝑦
𝐴 𝑥−𝐶 𝑥
, between A and C will be smaller than the slope of
𝑚 𝐴𝐵 =
𝐴 𝑦− 𝐵 𝑦
𝐴 𝑥−𝐵 𝑥
between A and B, if the shorter contour is below the longer contour which is
found in DS class. On the other hand, the slope of 𝑚 𝐴𝐶, will be larger than the slope, 𝑚 𝐴𝐶, if
the shorter contour is below the longer contour for SD class. If both 𝑚 𝐴𝐶 and 𝑚 𝐴𝐵 are multiplied
with( )( )xxxx BACA −− , then the result of the multiplication,
( )( ) ( )( )xxyyxxxxAC BACABACAm −−=−− , (5)
will still be smaller than the result of another multiplication for DS class.
( )( ) ( )( )xxyyxxxxAB CABABACAm −−=−− , (6)
If the difference between these two multiplications is denoted as , the following
equation yields
( )( ) ( )( )xxyyxxyy CABABACA −−−−−= , (7)
then the value of  can be used as the feature to determine or segregate between SD and DS
classes. If the  < 0, then the road marker is classified as DS class. If ,0 then the road
marker is classified as SD class. Since the classification is only carried out to identify between
TELKOMNIKA ISSN: 1693-6930 ◼
Road markers classification using binary scanning … (Zamani Md Sani)
2055
SD and DS for this second layer classification, the value of  will not equivalent as zero as C
will never be located on the straight line between A and B.
2.3.3. Outliers and Improving the Classification Result
By observing the graphs in Figure 7, there are potential outliers generated due to
the values calculated near to the threshold values at 20% as indicated by the red circle in
Figures 7 (a), (c) and (e). Other than introducing 𝑁4
p
= 6, this possible false error can also be
resolved by using temporal values between the video images. The markers tend to be
the similarly labeled for a set of adjacent frames. By using this possibility, the previous
classification result would be stored and if there is a transition of a class or marker type, it will
confirm on the next ten (10) frames of sequence. This method also improved the issue related
to the vehicle blocking the road marker as there is no firm classification result when this occurs
and the result will hold the last classification result as reference. Hence the validation for
transition types of marker requires 10*0.033s=0.33s at the most.
3. Results and Analysis
The proposed two-layer classification methods are implemented to classify the road
markers from a number of video clips recorded when driving at different road scenarios with
different road markers. The speed of the car while these video clips were taken was between
70-80 km/hr. In order to run the proposed road marker classification model, the features from
the first three video clips given in Table 3 are extracted and analyzed to see the significant
patterns for the classification process and it contain all types of the road markers which are
aimed to be classified. Manual comparison is performed on the predicted road marker type of
the algorithm with the ground truth on every frame and the accuracy is calculated as in (8)
where the total frames classified correctly from the ground truth ∑ 𝐹𝑇𝑃 is divided with the total
frames, ∑ 𝐹𝑇. It can be observed that the accuracy achieved in the training videos are well
above 98% except clip number 3 at 93% which due to the faint lane markers detected in
the video. This is essential to ensure that the classification performance achieved when running
this model on the testing videos is as good as possible.
𝐴𝑐𝑐𝑢𝑟𝑎𝑐𝑦 =
∑ 𝐹 𝑇𝑃
∑ 𝐹 𝑇
𝑋 100% (8)
Table 3. Various Clips and Accuracy
Clip Name Resolution FPS Type Frames Features Analysis Test Accuracy (%)
1 Vid24 1280x720 30 D-DD-SD 1840 x x 98.04%
2 Vid25 1280x720 30 DD-DS 1099 x x 100%
3 Vid23 1280x720 30 DD-S 357 x x 93.84%
4 Vid_1_Test 1280x720 30 DD-DS-D 2019 x 97.17%
5 Vid_2_Test 1280x720 30 DD-D 796 x 94.47%
6 Vid_3_Test 1280x720 30 D-SD-DD 1287 x 100%
7 Vid_4_Test 1280x720 30 DD-D-SD 1547 x 97.54%
8 Vid_5_Test 1920x1080 30 SS 763 x 100%
The proposed classification model was later tested with five video clips, which are
numbered from 4 to 8 in Table 3. In video clip Vid_2_Test, which contains 796 frames having
road markers of types DD and D, the recorded accuracy is 94.47%, which still higher than 90%
but stands as the lowest amongst all other accuracy values achieved. This is mainly due to
the quality of this video clip which is more blurry compared on the other clips. The marker
transition had shown minimum effect on the classification accuracy as the algorithm
successfully revalidated between the false and true transition and contributed on
the accucarcy calculation.
As for the confusion matrix as in Table 4, we can find out that most error is coming from
the DD class due to the thresholding process resulting the output of combined contour at the top
of the lanes which is very hard to distinguish its threshold value. Examples of the thresholded
images are as in Figure 9 as in the blue circle. In this circle area, the scanning process will
resulted this as 𝑁𝑡 = 2 instead of 𝑁𝑡 = 2 and the classification would lead to SD instead of DD.
◼ ISSN: 1693-6930
TELKOMNIKA Vol. 17, No. 4, August 2019: 2048-2057
2056
Figure 9. Thresholding output for DD
Table 4. Confusion Matrix Table
Predicted Class
Dashed Double Solid Single Solid-Dashed Dashed-Solid
Actual Class
C1 C2 C3 C4 C5
C1 1254 32 0 0 0 97.44%
C2 0 2476 0 128 0 94.83%
C3 0 0 763 0 0 100%
C4 0 0 0 1080 0 100%
C5 0 0 0 0 679 100%
4. Conclusion
The paper presented a new approach for lane marker classification. The ROI selection
is based on the camera position to capture the road image. The ROI is processed and
the features of the lane marking are extracted for the training purposes and later for
the classification process. This new algorithm was tested with the local new videos and
the ground truth. Experimental results have shown that the accuracy values achieved by
the proposed new method achieved more than 93%. The errors from the classification operation
are mainly due to the faint road marker which caused wrong pre-processing result, sudden
illumination changes and the difference in the dimension of the lane markers.
Acknowledgements
The authors would like to acknowledge the funding support received from Universiti
Teknikal Malaysia Melaka (UTeM) from PJP/2014/FKE(15D)/S01357–Road Lane Recognition
Using Vision and Artificial Intelligence for Auto Assist Driver Alert System.
References
[1] Doyle DD, Jennings AL, Black JT. Optical Flow Background Estimation for Real-Time Pan/Tilt
Camera Object Tracking. Measurement 2014; 48: 195–207.
[2] Liu W, Zhang Z, Li S, Tao D. Road Detection By Using A Generalized Hough Transform. Remote
Sens. 2017; 9(6): 590.
[3] Son J, Yoo H, Kim S, Sohn K. Real-time Illumination Invariant Lane Detection for Lane Departure
Warning System. Expert Syst Appl. 2015; 42(4): 1816–1824.
[4] Dorj B, Lee DJ. A Precise Lane Detection Algorithm Based on Top View Image Transformation and
Least-Square Approaches. J Sensors. 2016; 2016.
[5] Satzoda, RK, Trivedi, MM. Vision-Based Lane Analysis: Exploration of Issues and Approaches for
Embedded Realization. IEEE Computer Society Conference on Computer Vision and Pattern
Recognition Workshops. 2013: 604–609.
[6] An X, Shang E, Song J, Li J, He H. Real-Time Lane Departure Warning System Based On A Single
FPGA. EURASIP Journal on Image and Video Processing. 2013: 38.
[7] Chira IM, Chibulcutean A, Danescu RG. Real-Time Detection of Road Markings for Driving Assistance
Applications. Computer Engineering and Systems ICCES 2010 International Conference. 2010:
158–163.
[8] Wu T, Ranganathan A. A Practical System For Road Marking Detection And Recognition. IEEE
Intelligent Vehicles Symposium, Proceedings, 2012: 25–30.
[9] Kheyrollahi A, Breckon TP. Automatic real-time road marking recognition using a feature driven
approach. Machine Vision and Applications. 2012; 23(1): 123–133.
TELKOMNIKA ISSN: 1693-6930 ◼
Road markers classification using binary scanning … (Zamani Md Sani)
2057
[10] Mc Call JC, Trivedi MM. Video-Based Lane Estimation and Tracking for Driver Assistance: Survey,
System, and Evaluation. IEEE Transactions on Intelligent Transportation Systems. 2006; 7(1): 20–37.
[11] Yenikaya S, Yenikaya G, Düven E. Keeping the Vehicle on the Road: A Survey on On-road Lane
Detection Systems. ACM Comput. Surv. 2013; 46(1): 43.
[12] Bar Hillel A, Lerner R, Levi D, Raz G. Recent Progress In Road And Lane Detection: A Survey.
Machine Vision and Applications. 2014; 25(3): 727–745.
[13] Collado JM, Hilario C, De La Escalera A, Armingol JM. Detection And Classification of Road Lanes
With A Frequency Analysis. In: IEEE Intelligent Vehicles Symposium, Proceedings. 2005: 78–83.
[14] Schubert R, Schulze K, Wanielik G. Situation Assessment For Automatic Lane-Change Maneuvers.
IEEE Trans Intell Transp Syst. 2010; 11: 607–616
[15] Lindner P, Richter E, Wanielik G, Takagi K, Isogai A. Multi-Channel Lidar Processing for Lane
Detection And Estimation. In: IEEE Conference on Intelligent Transportation Systems, Proceedings,
ITSC. 2009: 02–207.
[16] Suchitra S, Satzoda RK, Srikanthan T. Identifying Lane Types: A Modular Approach. In: IEEE
Conference on Intelligent Transportation Systems, Proceedings, ITSC. 2013: 1929–1934.
[17] Danescu R, Sobol S, Nedevschi S, Graf T. Stereovision-Based Side Lane And Guardrail Detection.
2006 IEEE Intell Transp Syst Conf. 2006; 1156–1161
[18] MB de Paula, CR Jung. Real-Time Detection and Classification of Road Lane Markings. XXVI Conf.
Graph. Patterns Images. 2013: 83–90.
[19] MB De Paula, CR Jung, LG Da Silveira. Automatic On-The-Fly Extrinsic Camera Calibration of
Onboard Vehicular Cameras. Expert Syst. Appl. 2014; 41(4 PART 2): 1997–2007.
[20] MB De Paula, CR Jung. Automatic Detection and Classification of Road Lane Markings Using
Onboard Vehicular Cameras. IEEE Trans Intell Transp Syst. 2015; 16: 3160–3169.
[21] Mathibela B, Newman P, Posner I. Reading the Road: Road Marking Classification and Interpretation.
IEEE Trans Intell Transp Syst. 2015; 16: 2072–2081.
[22] ZM Sani, HA. Ghani, LW Sen R. Daytime Road Marker Recognition Using Grayscale Histogram and
Pixel Values. Internetworking Indonesia Journal. 2016; 8(1): 11-16.
[23] ZM Sani, HA Ghani, R Besar, L W Sen. Real-Time Daytime Road Marker Recognition Using Features
Vectors And Neural Network. IEEE Conference on Sustainable Utilization And Development In
Engineering and Technology (CSUDET). 2015: 1-6.
[24] ZM Sani, HA Ghani, R Besar, A Azizan, H Abas. Real-Time Video Processing using Contour Numbers
and Angles for Non-urban Road Marker Classification. International Journal of Electrical and
Computer Engineering (IJECE). 2018; 4(8): 2540-2548.
[25] JC Russ, JC Russ. Introduction to Image Processing and Analysis. CRC Press, Boca Raton.
2008: 72-79.

More Related Content

What's hot

Real-Time Multiple License Plate Recognition System
Real-Time Multiple License Plate Recognition SystemReal-Time Multiple License Plate Recognition System
Real-Time Multiple License Plate Recognition SystemIJORCS
 
Ieeepro techno solutions 2013 ieee embedded project - integrated lane and ...
Ieeepro techno solutions   2013 ieee embedded project  - integrated lane and ...Ieeepro techno solutions   2013 ieee embedded project  - integrated lane and ...
Ieeepro techno solutions 2013 ieee embedded project - integrated lane and ...srinivasanece7
 
Performance evaluation of different automatic seed point generation technique...
Performance evaluation of different automatic seed point generation technique...Performance evaluation of different automatic seed point generation technique...
Performance evaluation of different automatic seed point generation technique...IAEME Publication
 
Simulation of Urban Mobility (Sumo) For Evaluating Qos Parameters For Vehicul...
Simulation of Urban Mobility (Sumo) For Evaluating Qos Parameters For Vehicul...Simulation of Urban Mobility (Sumo) For Evaluating Qos Parameters For Vehicul...
Simulation of Urban Mobility (Sumo) For Evaluating Qos Parameters For Vehicul...iosrjce
 
A Study on Single Camera Based ANPR System for Improvement of Vehicle Number ...
A Study on Single Camera Based ANPR System for Improvement of Vehicle Number ...A Study on Single Camera Based ANPR System for Improvement of Vehicle Number ...
A Study on Single Camera Based ANPR System for Improvement of Vehicle Number ...journal ijrtem
 
Ijarcet vol-2-issue-4-1309-1313
Ijarcet vol-2-issue-4-1309-1313Ijarcet vol-2-issue-4-1309-1313
Ijarcet vol-2-issue-4-1309-1313Editor IJARCET
 
Design Approach for a Novel Traffic Sign Recognition System by Using LDA and ...
Design Approach for a Novel Traffic Sign Recognition System by Using LDA and ...Design Approach for a Novel Traffic Sign Recognition System by Using LDA and ...
Design Approach for a Novel Traffic Sign Recognition System by Using LDA and ...IJERA Editor
 
Knowledge-based Expert System for Route Selection of Road Alignment
Knowledge-based Expert System for Route Selection of Road AlignmentKnowledge-based Expert System for Route Selection of Road Alignment
Knowledge-based Expert System for Route Selection of Road AlignmentUCSI University
 
Optimal Path Planning using Equilateral Spaces Oriented Visibility Graph Method
Optimal Path Planning using Equilateral Spaces Oriented Visibility Graph Method Optimal Path Planning using Equilateral Spaces Oriented Visibility Graph Method
Optimal Path Planning using Equilateral Spaces Oriented Visibility Graph Method IJECEIAES
 
Optimal Path Planning using Equilateral Spaces Oriented Visibility Graph Method
Optimal Path Planning using Equilateral Spaces Oriented Visibility Graph Method Optimal Path Planning using Equilateral Spaces Oriented Visibility Graph Method
Optimal Path Planning using Equilateral Spaces Oriented Visibility Graph Method IJECEIAES
 
IRJET - Analysis of Different Arbitration Algorithms for Amba Ahb Bus Protoco...
IRJET - Analysis of Different Arbitration Algorithms for Amba Ahb Bus Protoco...IRJET - Analysis of Different Arbitration Algorithms for Amba Ahb Bus Protoco...
IRJET - Analysis of Different Arbitration Algorithms for Amba Ahb Bus Protoco...IRJET Journal
 
Cyber-physical system based on image recognition to improve traffic flow: A cas...
Cyber-physical system based on image recognition to improve traffic flow: A cas...Cyber-physical system based on image recognition to improve traffic flow: A cas...
Cyber-physical system based on image recognition to improve traffic flow: A cas...IJECEIAES
 
IMPORTANCE OF REALISTIC MOBILITY MODELS FOR VANET NETWORK SIMULATION
IMPORTANCE OF REALISTIC MOBILITY MODELS FOR VANET NETWORK SIMULATIONIMPORTANCE OF REALISTIC MOBILITY MODELS FOR VANET NETWORK SIMULATION
IMPORTANCE OF REALISTIC MOBILITY MODELS FOR VANET NETWORK SIMULATIONIJCNCJournal
 
Highway route location
Highway route locationHighway route location
Highway route locationwrya hade
 

What's hot (18)

Real-Time Multiple License Plate Recognition System
Real-Time Multiple License Plate Recognition SystemReal-Time Multiple License Plate Recognition System
Real-Time Multiple License Plate Recognition System
 
Ieeepro techno solutions 2013 ieee embedded project - integrated lane and ...
Ieeepro techno solutions   2013 ieee embedded project  - integrated lane and ...Ieeepro techno solutions   2013 ieee embedded project  - integrated lane and ...
Ieeepro techno solutions 2013 ieee embedded project - integrated lane and ...
 
Performance evaluation of different automatic seed point generation technique...
Performance evaluation of different automatic seed point generation technique...Performance evaluation of different automatic seed point generation technique...
Performance evaluation of different automatic seed point generation technique...
 
Simulation of Urban Mobility (Sumo) For Evaluating Qos Parameters For Vehicul...
Simulation of Urban Mobility (Sumo) For Evaluating Qos Parameters For Vehicul...Simulation of Urban Mobility (Sumo) For Evaluating Qos Parameters For Vehicul...
Simulation of Urban Mobility (Sumo) For Evaluating Qos Parameters For Vehicul...
 
Amj fuzzy slides
Amj fuzzy slidesAmj fuzzy slides
Amj fuzzy slides
 
A Study on Single Camera Based ANPR System for Improvement of Vehicle Number ...
A Study on Single Camera Based ANPR System for Improvement of Vehicle Number ...A Study on Single Camera Based ANPR System for Improvement of Vehicle Number ...
A Study on Single Camera Based ANPR System for Improvement of Vehicle Number ...
 
Ijarcet vol-2-issue-4-1309-1313
Ijarcet vol-2-issue-4-1309-1313Ijarcet vol-2-issue-4-1309-1313
Ijarcet vol-2-issue-4-1309-1313
 
Design Approach for a Novel Traffic Sign Recognition System by Using LDA and ...
Design Approach for a Novel Traffic Sign Recognition System by Using LDA and ...Design Approach for a Novel Traffic Sign Recognition System by Using LDA and ...
Design Approach for a Novel Traffic Sign Recognition System by Using LDA and ...
 
Knowledge-based Expert System for Route Selection of Road Alignment
Knowledge-based Expert System for Route Selection of Road AlignmentKnowledge-based Expert System for Route Selection of Road Alignment
Knowledge-based Expert System for Route Selection of Road Alignment
 
O & d survey
O & d survey O & d survey
O & d survey
 
Optimal Path Planning using Equilateral Spaces Oriented Visibility Graph Method
Optimal Path Planning using Equilateral Spaces Oriented Visibility Graph Method Optimal Path Planning using Equilateral Spaces Oriented Visibility Graph Method
Optimal Path Planning using Equilateral Spaces Oriented Visibility Graph Method
 
Optimal Path Planning using Equilateral Spaces Oriented Visibility Graph Method
Optimal Path Planning using Equilateral Spaces Oriented Visibility Graph Method Optimal Path Planning using Equilateral Spaces Oriented Visibility Graph Method
Optimal Path Planning using Equilateral Spaces Oriented Visibility Graph Method
 
Cf35465468
Cf35465468Cf35465468
Cf35465468
 
IRJET - Analysis of Different Arbitration Algorithms for Amba Ahb Bus Protoco...
IRJET - Analysis of Different Arbitration Algorithms for Amba Ahb Bus Protoco...IRJET - Analysis of Different Arbitration Algorithms for Amba Ahb Bus Protoco...
IRJET - Analysis of Different Arbitration Algorithms for Amba Ahb Bus Protoco...
 
Cyber-physical system based on image recognition to improve traffic flow: A cas...
Cyber-physical system based on image recognition to improve traffic flow: A cas...Cyber-physical system based on image recognition to improve traffic flow: A cas...
Cyber-physical system based on image recognition to improve traffic flow: A cas...
 
CE 361 Design Project
CE 361 Design ProjectCE 361 Design Project
CE 361 Design Project
 
IMPORTANCE OF REALISTIC MOBILITY MODELS FOR VANET NETWORK SIMULATION
IMPORTANCE OF REALISTIC MOBILITY MODELS FOR VANET NETWORK SIMULATIONIMPORTANCE OF REALISTIC MOBILITY MODELS FOR VANET NETWORK SIMULATION
IMPORTANCE OF REALISTIC MOBILITY MODELS FOR VANET NETWORK SIMULATION
 
Highway route location
Highway route locationHighway route location
Highway route location
 

Similar to Road markers classification using binary scanning and slope contours

A computer vision-based lane detection approach for an autonomous vehicle usi...
A computer vision-based lane detection approach for an autonomous vehicle usi...A computer vision-based lane detection approach for an autonomous vehicle usi...
A computer vision-based lane detection approach for an autonomous vehicle usi...Md. Faishal Rahaman
 
Traffic flow measurement for smart traffic light system design
Traffic flow measurement for smart traffic light system designTraffic flow measurement for smart traffic light system design
Traffic flow measurement for smart traffic light system designTELKOMNIKA JOURNAL
 
Application of neural network method for road crack detection
Application of neural network method for road crack detectionApplication of neural network method for road crack detection
Application of neural network method for road crack detectionTELKOMNIKA JOURNAL
 
Realtime Road Lane Detection
Realtime Road Lane DetectionRealtime Road Lane Detection
Realtime Road Lane DetectionIRJET Journal
 
IRJET- Road Recognition from Remote Sensing Imagery using Machine Learning
IRJET- Road Recognition from Remote Sensing Imagery using Machine LearningIRJET- Road Recognition from Remote Sensing Imagery using Machine Learning
IRJET- Road Recognition from Remote Sensing Imagery using Machine LearningIRJET Journal
 
A brawny multicolor lane detection method to indian scenarios
A brawny multicolor lane detection method to indian scenariosA brawny multicolor lane detection method to indian scenarios
A brawny multicolor lane detection method to indian scenarioseSAT Journals
 
A brawny multicolor lane detection method to indian scenarios
A brawny multicolor lane detection method to indian scenariosA brawny multicolor lane detection method to indian scenarios
A brawny multicolor lane detection method to indian scenarioseSAT Publishing House
 
LANE CHANGE DETECTION AND TRACKING FOR A SAFE-LANE APPROACH IN REAL TIME VISI...
LANE CHANGE DETECTION AND TRACKING FOR A SAFE-LANE APPROACH IN REAL TIME VISI...LANE CHANGE DETECTION AND TRACKING FOR A SAFE-LANE APPROACH IN REAL TIME VISI...
LANE CHANGE DETECTION AND TRACKING FOR A SAFE-LANE APPROACH IN REAL TIME VISI...cscpconf
 
TRAFFIC-SIGN RECOGNITION FOR AN INTELLIGENT VEHICLE/DRIVER ASSISTANT SYSTEM U...
TRAFFIC-SIGN RECOGNITION FOR AN INTELLIGENT VEHICLE/DRIVER ASSISTANT SYSTEM U...TRAFFIC-SIGN RECOGNITION FOR AN INTELLIGENT VEHICLE/DRIVER ASSISTANT SYSTEM U...
TRAFFIC-SIGN RECOGNITION FOR AN INTELLIGENT VEHICLE/DRIVER ASSISTANT SYSTEM U...cseij
 
A survey on road extraction from color image using vectorization
A survey on road extraction from color image using vectorizationA survey on road extraction from color image using vectorization
A survey on road extraction from color image using vectorizationeSAT Journals
 
A survey on road extraction from color image using
A survey on road extraction from color image usingA survey on road extraction from color image using
A survey on road extraction from color image usingeSAT Publishing House
 
1 s2.0-s1110982317300820-main
1 s2.0-s1110982317300820-main1 s2.0-s1110982317300820-main
1 s2.0-s1110982317300820-mainahmadahmad237
 
International Journal of Computational Engineering Research(IJCER)
International Journal of Computational Engineering Research(IJCER)International Journal of Computational Engineering Research(IJCER)
International Journal of Computational Engineering Research(IJCER)ijceronline
 
Enhancement performance of road recognition system of autonomous robots in sh...
Enhancement performance of road recognition system of autonomous robots in sh...Enhancement performance of road recognition system of autonomous robots in sh...
Enhancement performance of road recognition system of autonomous robots in sh...sipij
 
Recognition of road markings from street-level panoramic images for automated...
Recognition of road markings from street-level panoramic images for automated...Recognition of road markings from street-level panoramic images for automated...
Recognition of road markings from street-level panoramic images for automated...Thomas Woudsma
 
Road Sign Detection and Recognition by using Local Energy Based Shape Histogr...
Road Sign Detection and Recognition by using Local Energy Based Shape Histogr...Road Sign Detection and Recognition by using Local Energy Based Shape Histogr...
Road Sign Detection and Recognition by using Local Energy Based Shape Histogr...CSCJournals
 
Vehicle detection and tracking techniques a concise review
Vehicle detection and tracking techniques  a concise reviewVehicle detection and tracking techniques  a concise review
Vehicle detection and tracking techniques a concise reviewsipij
 
Street Mark Detection Using Raspberry PI for Self-driving System
Street Mark Detection Using Raspberry PI for Self-driving SystemStreet Mark Detection Using Raspberry PI for Self-driving System
Street Mark Detection Using Raspberry PI for Self-driving SystemTELKOMNIKA JOURNAL
 

Similar to Road markers classification using binary scanning and slope contours (20)

A computer vision-based lane detection approach for an autonomous vehicle usi...
A computer vision-based lane detection approach for an autonomous vehicle usi...A computer vision-based lane detection approach for an autonomous vehicle usi...
A computer vision-based lane detection approach for an autonomous vehicle usi...
 
Traffic flow measurement for smart traffic light system design
Traffic flow measurement for smart traffic light system designTraffic flow measurement for smart traffic light system design
Traffic flow measurement for smart traffic light system design
 
Application of neural network method for road crack detection
Application of neural network method for road crack detectionApplication of neural network method for road crack detection
Application of neural network method for road crack detection
 
Realtime Road Lane Detection
Realtime Road Lane DetectionRealtime Road Lane Detection
Realtime Road Lane Detection
 
IRJET- Road Recognition from Remote Sensing Imagery using Machine Learning
IRJET- Road Recognition from Remote Sensing Imagery using Machine LearningIRJET- Road Recognition from Remote Sensing Imagery using Machine Learning
IRJET- Road Recognition from Remote Sensing Imagery using Machine Learning
 
A brawny multicolor lane detection method to indian scenarios
A brawny multicolor lane detection method to indian scenariosA brawny multicolor lane detection method to indian scenarios
A brawny multicolor lane detection method to indian scenarios
 
A brawny multicolor lane detection method to indian scenarios
A brawny multicolor lane detection method to indian scenariosA brawny multicolor lane detection method to indian scenarios
A brawny multicolor lane detection method to indian scenarios
 
LANE CHANGE DETECTION AND TRACKING FOR A SAFE-LANE APPROACH IN REAL TIME VISI...
LANE CHANGE DETECTION AND TRACKING FOR A SAFE-LANE APPROACH IN REAL TIME VISI...LANE CHANGE DETECTION AND TRACKING FOR A SAFE-LANE APPROACH IN REAL TIME VISI...
LANE CHANGE DETECTION AND TRACKING FOR A SAFE-LANE APPROACH IN REAL TIME VISI...
 
TRAFFIC-SIGN RECOGNITION FOR AN INTELLIGENT VEHICLE/DRIVER ASSISTANT SYSTEM U...
TRAFFIC-SIGN RECOGNITION FOR AN INTELLIGENT VEHICLE/DRIVER ASSISTANT SYSTEM U...TRAFFIC-SIGN RECOGNITION FOR AN INTELLIGENT VEHICLE/DRIVER ASSISTANT SYSTEM U...
TRAFFIC-SIGN RECOGNITION FOR AN INTELLIGENT VEHICLE/DRIVER ASSISTANT SYSTEM U...
 
A survey on road extraction from color image using vectorization
A survey on road extraction from color image using vectorizationA survey on road extraction from color image using vectorization
A survey on road extraction from color image using vectorization
 
A survey on road extraction from color image using
A survey on road extraction from color image usingA survey on road extraction from color image using
A survey on road extraction from color image using
 
1 s2.0-s1110982317300820-main
1 s2.0-s1110982317300820-main1 s2.0-s1110982317300820-main
1 s2.0-s1110982317300820-main
 
International Journal of Computational Engineering Research(IJCER)
International Journal of Computational Engineering Research(IJCER)International Journal of Computational Engineering Research(IJCER)
International Journal of Computational Engineering Research(IJCER)
 
Enhancement performance of road recognition system of autonomous robots in sh...
Enhancement performance of road recognition system of autonomous robots in sh...Enhancement performance of road recognition system of autonomous robots in sh...
Enhancement performance of road recognition system of autonomous robots in sh...
 
A017430110
A017430110A017430110
A017430110
 
Recognition of road markings from street-level panoramic images for automated...
Recognition of road markings from street-level panoramic images for automated...Recognition of road markings from street-level panoramic images for automated...
Recognition of road markings from street-level panoramic images for automated...
 
B04410814
B04410814B04410814
B04410814
 
Road Sign Detection and Recognition by using Local Energy Based Shape Histogr...
Road Sign Detection and Recognition by using Local Energy Based Shape Histogr...Road Sign Detection and Recognition by using Local Energy Based Shape Histogr...
Road Sign Detection and Recognition by using Local Energy Based Shape Histogr...
 
Vehicle detection and tracking techniques a concise review
Vehicle detection and tracking techniques  a concise reviewVehicle detection and tracking techniques  a concise review
Vehicle detection and tracking techniques a concise review
 
Street Mark Detection Using Raspberry PI for Self-driving System
Street Mark Detection Using Raspberry PI for Self-driving SystemStreet Mark Detection Using Raspberry PI for Self-driving System
Street Mark Detection Using Raspberry PI for Self-driving System
 

More from TELKOMNIKA JOURNAL

Amazon products reviews classification based on machine learning, deep learni...
Amazon products reviews classification based on machine learning, deep learni...Amazon products reviews classification based on machine learning, deep learni...
Amazon products reviews classification based on machine learning, deep learni...TELKOMNIKA JOURNAL
 
Design, simulation, and analysis of microstrip patch antenna for wireless app...
Design, simulation, and analysis of microstrip patch antenna for wireless app...Design, simulation, and analysis of microstrip patch antenna for wireless app...
Design, simulation, and analysis of microstrip patch antenna for wireless app...TELKOMNIKA JOURNAL
 
Design and simulation an optimal enhanced PI controller for congestion avoida...
Design and simulation an optimal enhanced PI controller for congestion avoida...Design and simulation an optimal enhanced PI controller for congestion avoida...
Design and simulation an optimal enhanced PI controller for congestion avoida...TELKOMNIKA JOURNAL
 
Improving the detection of intrusion in vehicular ad-hoc networks with modifi...
Improving the detection of intrusion in vehicular ad-hoc networks with modifi...Improving the detection of intrusion in vehicular ad-hoc networks with modifi...
Improving the detection of intrusion in vehicular ad-hoc networks with modifi...TELKOMNIKA JOURNAL
 
Conceptual model of internet banking adoption with perceived risk and trust f...
Conceptual model of internet banking adoption with perceived risk and trust f...Conceptual model of internet banking adoption with perceived risk and trust f...
Conceptual model of internet banking adoption with perceived risk and trust f...TELKOMNIKA JOURNAL
 
Efficient combined fuzzy logic and LMS algorithm for smart antenna
Efficient combined fuzzy logic and LMS algorithm for smart antennaEfficient combined fuzzy logic and LMS algorithm for smart antenna
Efficient combined fuzzy logic and LMS algorithm for smart antennaTELKOMNIKA JOURNAL
 
Design and implementation of a LoRa-based system for warning of forest fire
Design and implementation of a LoRa-based system for warning of forest fireDesign and implementation of a LoRa-based system for warning of forest fire
Design and implementation of a LoRa-based system for warning of forest fireTELKOMNIKA JOURNAL
 
Wavelet-based sensing technique in cognitive radio network
Wavelet-based sensing technique in cognitive radio networkWavelet-based sensing technique in cognitive radio network
Wavelet-based sensing technique in cognitive radio networkTELKOMNIKA JOURNAL
 
A novel compact dual-band bandstop filter with enhanced rejection bands
A novel compact dual-band bandstop filter with enhanced rejection bandsA novel compact dual-band bandstop filter with enhanced rejection bands
A novel compact dual-band bandstop filter with enhanced rejection bandsTELKOMNIKA JOURNAL
 
Deep learning approach to DDoS attack with imbalanced data at the application...
Deep learning approach to DDoS attack with imbalanced data at the application...Deep learning approach to DDoS attack with imbalanced data at the application...
Deep learning approach to DDoS attack with imbalanced data at the application...TELKOMNIKA JOURNAL
 
Brief note on match and miss-match uncertainties
Brief note on match and miss-match uncertaintiesBrief note on match and miss-match uncertainties
Brief note on match and miss-match uncertaintiesTELKOMNIKA JOURNAL
 
Implementation of FinFET technology based low power 4×4 Wallace tree multipli...
Implementation of FinFET technology based low power 4×4 Wallace tree multipli...Implementation of FinFET technology based low power 4×4 Wallace tree multipli...
Implementation of FinFET technology based low power 4×4 Wallace tree multipli...TELKOMNIKA JOURNAL
 
Evaluation of the weighted-overlap add model with massive MIMO in a 5G system
Evaluation of the weighted-overlap add model with massive MIMO in a 5G systemEvaluation of the weighted-overlap add model with massive MIMO in a 5G system
Evaluation of the weighted-overlap add model with massive MIMO in a 5G systemTELKOMNIKA JOURNAL
 
Reflector antenna design in different frequencies using frequency selective s...
Reflector antenna design in different frequencies using frequency selective s...Reflector antenna design in different frequencies using frequency selective s...
Reflector antenna design in different frequencies using frequency selective s...TELKOMNIKA JOURNAL
 
Reagentless iron detection in water based on unclad fiber optical sensor
Reagentless iron detection in water based on unclad fiber optical sensorReagentless iron detection in water based on unclad fiber optical sensor
Reagentless iron detection in water based on unclad fiber optical sensorTELKOMNIKA JOURNAL
 
Impact of CuS counter electrode calcination temperature on quantum dot sensit...
Impact of CuS counter electrode calcination temperature on quantum dot sensit...Impact of CuS counter electrode calcination temperature on quantum dot sensit...
Impact of CuS counter electrode calcination temperature on quantum dot sensit...TELKOMNIKA JOURNAL
 
A progressive learning for structural tolerance online sequential extreme lea...
A progressive learning for structural tolerance online sequential extreme lea...A progressive learning for structural tolerance online sequential extreme lea...
A progressive learning for structural tolerance online sequential extreme lea...TELKOMNIKA JOURNAL
 
Electroencephalography-based brain-computer interface using neural networks
Electroencephalography-based brain-computer interface using neural networksElectroencephalography-based brain-computer interface using neural networks
Electroencephalography-based brain-computer interface using neural networksTELKOMNIKA JOURNAL
 
Adaptive segmentation algorithm based on level set model in medical imaging
Adaptive segmentation algorithm based on level set model in medical imagingAdaptive segmentation algorithm based on level set model in medical imaging
Adaptive segmentation algorithm based on level set model in medical imagingTELKOMNIKA JOURNAL
 
Automatic channel selection using shuffled frog leaping algorithm for EEG bas...
Automatic channel selection using shuffled frog leaping algorithm for EEG bas...Automatic channel selection using shuffled frog leaping algorithm for EEG bas...
Automatic channel selection using shuffled frog leaping algorithm for EEG bas...TELKOMNIKA JOURNAL
 

More from TELKOMNIKA JOURNAL (20)

Amazon products reviews classification based on machine learning, deep learni...
Amazon products reviews classification based on machine learning, deep learni...Amazon products reviews classification based on machine learning, deep learni...
Amazon products reviews classification based on machine learning, deep learni...
 
Design, simulation, and analysis of microstrip patch antenna for wireless app...
Design, simulation, and analysis of microstrip patch antenna for wireless app...Design, simulation, and analysis of microstrip patch antenna for wireless app...
Design, simulation, and analysis of microstrip patch antenna for wireless app...
 
Design and simulation an optimal enhanced PI controller for congestion avoida...
Design and simulation an optimal enhanced PI controller for congestion avoida...Design and simulation an optimal enhanced PI controller for congestion avoida...
Design and simulation an optimal enhanced PI controller for congestion avoida...
 
Improving the detection of intrusion in vehicular ad-hoc networks with modifi...
Improving the detection of intrusion in vehicular ad-hoc networks with modifi...Improving the detection of intrusion in vehicular ad-hoc networks with modifi...
Improving the detection of intrusion in vehicular ad-hoc networks with modifi...
 
Conceptual model of internet banking adoption with perceived risk and trust f...
Conceptual model of internet banking adoption with perceived risk and trust f...Conceptual model of internet banking adoption with perceived risk and trust f...
Conceptual model of internet banking adoption with perceived risk and trust f...
 
Efficient combined fuzzy logic and LMS algorithm for smart antenna
Efficient combined fuzzy logic and LMS algorithm for smart antennaEfficient combined fuzzy logic and LMS algorithm for smart antenna
Efficient combined fuzzy logic and LMS algorithm for smart antenna
 
Design and implementation of a LoRa-based system for warning of forest fire
Design and implementation of a LoRa-based system for warning of forest fireDesign and implementation of a LoRa-based system for warning of forest fire
Design and implementation of a LoRa-based system for warning of forest fire
 
Wavelet-based sensing technique in cognitive radio network
Wavelet-based sensing technique in cognitive radio networkWavelet-based sensing technique in cognitive radio network
Wavelet-based sensing technique in cognitive radio network
 
A novel compact dual-band bandstop filter with enhanced rejection bands
A novel compact dual-band bandstop filter with enhanced rejection bandsA novel compact dual-band bandstop filter with enhanced rejection bands
A novel compact dual-band bandstop filter with enhanced rejection bands
 
Deep learning approach to DDoS attack with imbalanced data at the application...
Deep learning approach to DDoS attack with imbalanced data at the application...Deep learning approach to DDoS attack with imbalanced data at the application...
Deep learning approach to DDoS attack with imbalanced data at the application...
 
Brief note on match and miss-match uncertainties
Brief note on match and miss-match uncertaintiesBrief note on match and miss-match uncertainties
Brief note on match and miss-match uncertainties
 
Implementation of FinFET technology based low power 4×4 Wallace tree multipli...
Implementation of FinFET technology based low power 4×4 Wallace tree multipli...Implementation of FinFET technology based low power 4×4 Wallace tree multipli...
Implementation of FinFET technology based low power 4×4 Wallace tree multipli...
 
Evaluation of the weighted-overlap add model with massive MIMO in a 5G system
Evaluation of the weighted-overlap add model with massive MIMO in a 5G systemEvaluation of the weighted-overlap add model with massive MIMO in a 5G system
Evaluation of the weighted-overlap add model with massive MIMO in a 5G system
 
Reflector antenna design in different frequencies using frequency selective s...
Reflector antenna design in different frequencies using frequency selective s...Reflector antenna design in different frequencies using frequency selective s...
Reflector antenna design in different frequencies using frequency selective s...
 
Reagentless iron detection in water based on unclad fiber optical sensor
Reagentless iron detection in water based on unclad fiber optical sensorReagentless iron detection in water based on unclad fiber optical sensor
Reagentless iron detection in water based on unclad fiber optical sensor
 
Impact of CuS counter electrode calcination temperature on quantum dot sensit...
Impact of CuS counter electrode calcination temperature on quantum dot sensit...Impact of CuS counter electrode calcination temperature on quantum dot sensit...
Impact of CuS counter electrode calcination temperature on quantum dot sensit...
 
A progressive learning for structural tolerance online sequential extreme lea...
A progressive learning for structural tolerance online sequential extreme lea...A progressive learning for structural tolerance online sequential extreme lea...
A progressive learning for structural tolerance online sequential extreme lea...
 
Electroencephalography-based brain-computer interface using neural networks
Electroencephalography-based brain-computer interface using neural networksElectroencephalography-based brain-computer interface using neural networks
Electroencephalography-based brain-computer interface using neural networks
 
Adaptive segmentation algorithm based on level set model in medical imaging
Adaptive segmentation algorithm based on level set model in medical imagingAdaptive segmentation algorithm based on level set model in medical imaging
Adaptive segmentation algorithm based on level set model in medical imaging
 
Automatic channel selection using shuffled frog leaping algorithm for EEG bas...
Automatic channel selection using shuffled frog leaping algorithm for EEG bas...Automatic channel selection using shuffled frog leaping algorithm for EEG bas...
Automatic channel selection using shuffled frog leaping algorithm for EEG bas...
 

Recently uploaded

Processing & Properties of Floor and Wall Tiles.pptx
Processing & Properties of Floor and Wall Tiles.pptxProcessing & Properties of Floor and Wall Tiles.pptx
Processing & Properties of Floor and Wall Tiles.pptxpranjaldaimarysona
 
High Profile Call Girls Nagpur Isha Call 7001035870 Meet With Nagpur Escorts
High Profile Call Girls Nagpur Isha Call 7001035870 Meet With Nagpur EscortsHigh Profile Call Girls Nagpur Isha Call 7001035870 Meet With Nagpur Escorts
High Profile Call Girls Nagpur Isha Call 7001035870 Meet With Nagpur Escortsranjana rawat
 
(MEERA) Dapodi Call Girls Just Call 7001035870 [ Cash on Delivery ] Pune Escorts
(MEERA) Dapodi Call Girls Just Call 7001035870 [ Cash on Delivery ] Pune Escorts(MEERA) Dapodi Call Girls Just Call 7001035870 [ Cash on Delivery ] Pune Escorts
(MEERA) Dapodi Call Girls Just Call 7001035870 [ Cash on Delivery ] Pune Escortsranjana rawat
 
Introduction to Multiple Access Protocol.pptx
Introduction to Multiple Access Protocol.pptxIntroduction to Multiple Access Protocol.pptx
Introduction to Multiple Access Protocol.pptxupamatechverse
 
Software Development Life Cycle By Team Orange (Dept. of Pharmacy)
Software Development Life Cycle By  Team Orange (Dept. of Pharmacy)Software Development Life Cycle By  Team Orange (Dept. of Pharmacy)
Software Development Life Cycle By Team Orange (Dept. of Pharmacy)Suman Mia
 
HARDNESS, FRACTURE TOUGHNESS AND STRENGTH OF CERAMICS
HARDNESS, FRACTURE TOUGHNESS AND STRENGTH OF CERAMICSHARDNESS, FRACTURE TOUGHNESS AND STRENGTH OF CERAMICS
HARDNESS, FRACTURE TOUGHNESS AND STRENGTH OF CERAMICSRajkumarAkumalla
 
Call Girls Service Nagpur Tanvi Call 7001035870 Meet With Nagpur Escorts
Call Girls Service Nagpur Tanvi Call 7001035870 Meet With Nagpur EscortsCall Girls Service Nagpur Tanvi Call 7001035870 Meet With Nagpur Escorts
Call Girls Service Nagpur Tanvi Call 7001035870 Meet With Nagpur EscortsCall Girls in Nagpur High Profile
 
Introduction to IEEE STANDARDS and its different types.pptx
Introduction to IEEE STANDARDS and its different types.pptxIntroduction to IEEE STANDARDS and its different types.pptx
Introduction to IEEE STANDARDS and its different types.pptxupamatechverse
 
High Profile Call Girls Nagpur Meera Call 7001035870 Meet With Nagpur Escorts
High Profile Call Girls Nagpur Meera Call 7001035870 Meet With Nagpur EscortsHigh Profile Call Girls Nagpur Meera Call 7001035870 Meet With Nagpur Escorts
High Profile Call Girls Nagpur Meera Call 7001035870 Meet With Nagpur EscortsCall Girls in Nagpur High Profile
 
MANUFACTURING PROCESS-II UNIT-5 NC MACHINE TOOLS
MANUFACTURING PROCESS-II UNIT-5 NC MACHINE TOOLSMANUFACTURING PROCESS-II UNIT-5 NC MACHINE TOOLS
MANUFACTURING PROCESS-II UNIT-5 NC MACHINE TOOLSSIVASHANKAR N
 
(RIA) Call Girls Bhosari ( 7001035870 ) HI-Fi Pune Escorts Service
(RIA) Call Girls Bhosari ( 7001035870 ) HI-Fi Pune Escorts Service(RIA) Call Girls Bhosari ( 7001035870 ) HI-Fi Pune Escorts Service
(RIA) Call Girls Bhosari ( 7001035870 ) HI-Fi Pune Escorts Serviceranjana rawat
 
Architect Hassan Khalil Portfolio for 2024
Architect Hassan Khalil Portfolio for 2024Architect Hassan Khalil Portfolio for 2024
Architect Hassan Khalil Portfolio for 2024hassan khalil
 
GDSC ASEB Gen AI study jams presentation
GDSC ASEB Gen AI study jams presentationGDSC ASEB Gen AI study jams presentation
GDSC ASEB Gen AI study jams presentationGDSCAESB
 
SPICE PARK APR2024 ( 6,793 SPICE Models )
SPICE PARK APR2024 ( 6,793 SPICE Models )SPICE PARK APR2024 ( 6,793 SPICE Models )
SPICE PARK APR2024 ( 6,793 SPICE Models )Tsuyoshi Horigome
 
College Call Girls Nashik Nehal 7001305949 Independent Escort Service Nashik
College Call Girls Nashik Nehal 7001305949 Independent Escort Service NashikCollege Call Girls Nashik Nehal 7001305949 Independent Escort Service Nashik
College Call Girls Nashik Nehal 7001305949 Independent Escort Service NashikCall Girls in Nagpur High Profile
 
Decoding Kotlin - Your guide to solving the mysterious in Kotlin.pptx
Decoding Kotlin - Your guide to solving the mysterious in Kotlin.pptxDecoding Kotlin - Your guide to solving the mysterious in Kotlin.pptx
Decoding Kotlin - Your guide to solving the mysterious in Kotlin.pptxJoão Esperancinha
 

Recently uploaded (20)

DJARUM4D - SLOT GACOR ONLINE | SLOT DEMO ONLINE
DJARUM4D - SLOT GACOR ONLINE | SLOT DEMO ONLINEDJARUM4D - SLOT GACOR ONLINE | SLOT DEMO ONLINE
DJARUM4D - SLOT GACOR ONLINE | SLOT DEMO ONLINE
 
Processing & Properties of Floor and Wall Tiles.pptx
Processing & Properties of Floor and Wall Tiles.pptxProcessing & Properties of Floor and Wall Tiles.pptx
Processing & Properties of Floor and Wall Tiles.pptx
 
High Profile Call Girls Nagpur Isha Call 7001035870 Meet With Nagpur Escorts
High Profile Call Girls Nagpur Isha Call 7001035870 Meet With Nagpur EscortsHigh Profile Call Girls Nagpur Isha Call 7001035870 Meet With Nagpur Escorts
High Profile Call Girls Nagpur Isha Call 7001035870 Meet With Nagpur Escorts
 
(MEERA) Dapodi Call Girls Just Call 7001035870 [ Cash on Delivery ] Pune Escorts
(MEERA) Dapodi Call Girls Just Call 7001035870 [ Cash on Delivery ] Pune Escorts(MEERA) Dapodi Call Girls Just Call 7001035870 [ Cash on Delivery ] Pune Escorts
(MEERA) Dapodi Call Girls Just Call 7001035870 [ Cash on Delivery ] Pune Escorts
 
Introduction to Multiple Access Protocol.pptx
Introduction to Multiple Access Protocol.pptxIntroduction to Multiple Access Protocol.pptx
Introduction to Multiple Access Protocol.pptx
 
Software Development Life Cycle By Team Orange (Dept. of Pharmacy)
Software Development Life Cycle By  Team Orange (Dept. of Pharmacy)Software Development Life Cycle By  Team Orange (Dept. of Pharmacy)
Software Development Life Cycle By Team Orange (Dept. of Pharmacy)
 
9953056974 Call Girls In South Ex, Escorts (Delhi) NCR.pdf
9953056974 Call Girls In South Ex, Escorts (Delhi) NCR.pdf9953056974 Call Girls In South Ex, Escorts (Delhi) NCR.pdf
9953056974 Call Girls In South Ex, Escorts (Delhi) NCR.pdf
 
★ CALL US 9953330565 ( HOT Young Call Girls In Badarpur delhi NCR
★ CALL US 9953330565 ( HOT Young Call Girls In Badarpur delhi NCR★ CALL US 9953330565 ( HOT Young Call Girls In Badarpur delhi NCR
★ CALL US 9953330565 ( HOT Young Call Girls In Badarpur delhi NCR
 
HARDNESS, FRACTURE TOUGHNESS AND STRENGTH OF CERAMICS
HARDNESS, FRACTURE TOUGHNESS AND STRENGTH OF CERAMICSHARDNESS, FRACTURE TOUGHNESS AND STRENGTH OF CERAMICS
HARDNESS, FRACTURE TOUGHNESS AND STRENGTH OF CERAMICS
 
Call Girls Service Nagpur Tanvi Call 7001035870 Meet With Nagpur Escorts
Call Girls Service Nagpur Tanvi Call 7001035870 Meet With Nagpur EscortsCall Girls Service Nagpur Tanvi Call 7001035870 Meet With Nagpur Escorts
Call Girls Service Nagpur Tanvi Call 7001035870 Meet With Nagpur Escorts
 
Introduction to IEEE STANDARDS and its different types.pptx
Introduction to IEEE STANDARDS and its different types.pptxIntroduction to IEEE STANDARDS and its different types.pptx
Introduction to IEEE STANDARDS and its different types.pptx
 
High Profile Call Girls Nagpur Meera Call 7001035870 Meet With Nagpur Escorts
High Profile Call Girls Nagpur Meera Call 7001035870 Meet With Nagpur EscortsHigh Profile Call Girls Nagpur Meera Call 7001035870 Meet With Nagpur Escorts
High Profile Call Girls Nagpur Meera Call 7001035870 Meet With Nagpur Escorts
 
MANUFACTURING PROCESS-II UNIT-5 NC MACHINE TOOLS
MANUFACTURING PROCESS-II UNIT-5 NC MACHINE TOOLSMANUFACTURING PROCESS-II UNIT-5 NC MACHINE TOOLS
MANUFACTURING PROCESS-II UNIT-5 NC MACHINE TOOLS
 
(RIA) Call Girls Bhosari ( 7001035870 ) HI-Fi Pune Escorts Service
(RIA) Call Girls Bhosari ( 7001035870 ) HI-Fi Pune Escorts Service(RIA) Call Girls Bhosari ( 7001035870 ) HI-Fi Pune Escorts Service
(RIA) Call Girls Bhosari ( 7001035870 ) HI-Fi Pune Escorts Service
 
Architect Hassan Khalil Portfolio for 2024
Architect Hassan Khalil Portfolio for 2024Architect Hassan Khalil Portfolio for 2024
Architect Hassan Khalil Portfolio for 2024
 
GDSC ASEB Gen AI study jams presentation
GDSC ASEB Gen AI study jams presentationGDSC ASEB Gen AI study jams presentation
GDSC ASEB Gen AI study jams presentation
 
Call Us -/9953056974- Call Girls In Vikaspuri-/- Delhi NCR
Call Us -/9953056974- Call Girls In Vikaspuri-/- Delhi NCRCall Us -/9953056974- Call Girls In Vikaspuri-/- Delhi NCR
Call Us -/9953056974- Call Girls In Vikaspuri-/- Delhi NCR
 
SPICE PARK APR2024 ( 6,793 SPICE Models )
SPICE PARK APR2024 ( 6,793 SPICE Models )SPICE PARK APR2024 ( 6,793 SPICE Models )
SPICE PARK APR2024 ( 6,793 SPICE Models )
 
College Call Girls Nashik Nehal 7001305949 Independent Escort Service Nashik
College Call Girls Nashik Nehal 7001305949 Independent Escort Service NashikCollege Call Girls Nashik Nehal 7001305949 Independent Escort Service Nashik
College Call Girls Nashik Nehal 7001305949 Independent Escort Service Nashik
 
Decoding Kotlin - Your guide to solving the mysterious in Kotlin.pptx
Decoding Kotlin - Your guide to solving the mysterious in Kotlin.pptxDecoding Kotlin - Your guide to solving the mysterious in Kotlin.pptx
Decoding Kotlin - Your guide to solving the mysterious in Kotlin.pptx
 

Road markers classification using binary scanning and slope contours

  • 1. TELKOMNIKA, Vol.17, No.4, August 2019, pp.2048~2057 ISSN: 1693-6930, accredited First Grade by Kemenristekdikti, Decree No: 21/E/KPT/2018 DOI: 10.12928/TELKOMNIKA.v17i4.12759 ◼ 2048 Received August 29, 2018; Revised February 19, 2019; Accepted March 13, 2019 Road markers classification using binary scanning and slope contours Zamani Md Sani*1 , Hadhrami Abd Ghani2 , Rosli Besar3 , Azizul Azizan4 1 Faculty of Electrical Engineering, Universiti Teknikal Malaysia Melaka, Malaysia 2,3 Faculty of Engineering and Technology, Multimedia University, Malaysia 4 Advanced Informatics School, Universiti Teknologi Malaysia, Malaysia *Corresponding author, e-mail: zamanisani@utem.edu.my1 , hadhrami.abdghani@mmu.edu.my2 , rosli@mmu.edu.my3 , azizulazizan@utm.my4 Abstract Road markers guide the driver while driving on the road to control the traffic for the safety of the road users. With the booming autonomous car technology, the road markers classification is important in its vision segment to navigate the autonomous car. A new method is proposed in this paper to classify five types of road markers namely dashed, single, double, solid-dashed and dashed-solid which are commonly found on the two lane single carriageway. The classification is using unique feature acquired from the binary image by scanning on each of the images to calculate the frequency of binary transition. Another feature which is the slopes between the two centroids which allow the proposed method, to perform the classification within the same video frame period. This proposed method has been observed to achieve an accuracy value of at least 93%, which is higher than the accuracy value achieved by the existing methods. Keywords: autonomous car, binary scan, road marker, slope contour Copyright © 2019 Universitas Ahmad Dahlan. All rights reserved. 1. Introduction The road markers are essential to control the road traffic and avoid traffic hazards by guiding the road users to safely decide either to maintain the course in the middle of the lane or to overtake the front vehicles. Road markers are categorized in different types subject to the types of the roads such as urban, non-urban and highway, on which the sizes of the road markers may slightly vary. Existing research work have been extensively carried out to solve the lane detection and tracking problems for Auto-Assist Driving System (ADS) [1–6]. The schemes proposed are mainly about detecting and tracking the lanes, without focusing on classifying the road markers. Others, had worked on the road symbols, alphabets and customize markers [7-10] which also used as the information to alert the drivers. Nevertheless, road marker classification still have some room for improvement as there are different types of markers can be found globally [11, 12]. A frequency analysis method for the urban road marker classification had been proposed in [13] which uses the inverse perspective mapping (IPM) to produce a bird-eye view of the road and produce a modified Hough Transform (HT) for better lane detection. Then the power spectrum and Fourier analysis are applied to detect three types of markers, namely; single solid, dashed, and merged road markers which are commonly found at the urban road. Schubert et al. reported in [14] about a lane changing approach based on the road traffic surrounding situation including the type of the road marker. However the marker type’s classification is limited to only dashed and solid road markers. In a work presented by Lindner et al. [15], an edge detector technique was designed to subsequently search for a different objects on the road to detect the road markers. Even though four types of road markerscan be detected, it only concentrates on the dashed lines with different sizes. In another approach by Suchitra et al. [16], a modular approach is used to classify three road markers namely; dashed, solid and zigzag. To classify either dashed or solid, Basic Lane Marking (BLM), which is based on continuity properties is applied. This approach however, applies the temporal information in the classification operation, which renders slower detection when the road marker type changes whilst driving on the road. Nedevschi et al. [17] able to
  • 2. TELKOMNIKA ISSN: 1693-6930 ◼ Road markers classification using binary scanning … (Zamani Md Sani) 2049 classify road markers into four types namely double solid, single solid, merged, and dashed using a periodic histogram and ego-localization. Paula et al [18-20] had worked on the five types of road marker. A detection method based on Bayesian approach for classifying the road markers has been proposed. Although it is able to classify five types of road markers, the method suffers outlier problems especially at transitions between two types of markers. The results of the classification were found to have changed abruptly on each frame, which caused inconsistent results while driving. Mathibela et al. [21] concentrate on the road markers found at the urban area and able to classify seven types, namely; double boundary, single boundary, zig-zag, separator, boxed junction, intersectionand special lanes by using a unique set of geometric features which function within a probabilistic RUSBoost and Conditional Random Field (CRF) network. However, this research is mainly carried out on a static image. The latest publication from Zamani et al. [22, 23] using the features extracted from the road lane, and fed into the Artificial Neural Network (ANN). The initial research starts with two types of lane markers and later expanded to five types of markers classification [24] which the features extracted from the customized Region of Interest (ROI). Nevertheless, the algorithm requires temporal values from to lot of image sequence before it can make a decision on type’s transition due to its small ROI. This may lags the information to alert the drivers. The aforementioned methods have been proposed to address different types of road markers subject to the physical features of the roads including the dimension, colour and size of the markers. In our research, the types of road markers which are normally found at the non-urban carriageway are classified using a machine vision system attached to a car. The road markers include solid, dashed, dashed-solid, double-solid and solid-dashed, as shown in Figure 1. (a) (b) (c) (d) (e) Figure 1. Road Markers found at two lane single carriageway (a) dashed (D) (b) dashed-solid (DS) (c) double solid (DD) (d) solid-dashed (SD) (e) single solid (SS) 2. Research Method The proposed classification process is using a two-layer classifier as shown as in Figure 2. First layer will classify three classes of markers whereas the next layer will classify another two more classes. The first layer is using the scanning the binary image to get the percentage of the binary transition and the second layer classifier is using the slope value from the two contours detected in the same image. Before all these process can be done, the Region of Interest (ROI) will be determined from the video image, and this would require the camera location to be adjusted at the front of the camera. Figure 2. Two-layer classifier First Layer Classifier SINGLE SOLID DASHEDDOUBLE SOLID Second layer Classifier SOLID- DASHED DASHED- SOLID
  • 3. ◼ ISSN: 1693-6930 TELKOMNIKA Vol. 17, No. 4, August 2019: 2048-2057 2050 2.1. Camera Setup for Region of Interest (ROI) selection A new method in selecting the ROI based on its calibrated camera’s height and Field of View (FOV) are used. For the initial setup, a camera with a resolution of 1280x720 located at the center of the lane, is calibrated on its position with its FOV adjusted towards the planar road surface captured by the camera as shown in Figures 3 (a) and 3 (b). To calibrate the position of the camera, two horizontal lines, h1 and h2, are set on the FOV to equally divide into 3 sections as in Figure 3 (c), where the h1 horizontal line in the image must cross the intersection point between the rightmost lane, the off-road region and the border of the image to maximize the ROI. The ROI selection is then applied to the video and the output for the ROI is labelled as r(x,y) as in Figure 4 which contains the information of the marker, by dividing the image into two halves before selecting two third of from the right, as indicated by the red box, which is bordered by the two horizontal lines. With this method, the ROI contains the largest visible road marker of the image. (a) (b) (c) Figure 3. The camera setup (a) camera position (b) 3D camera coordinate system (c) camera height adjustment with h1 and h2 horizontal lines Figure 4. ROI selection
  • 4. TELKOMNIKA ISSN: 1693-6930 ◼ Road markers classification using binary scanning … (Zamani Md Sani) 2051 The ROI, r(x,y) which is in two dimension (2D) will represents the video images in pixels and will go through the pre-processing prior to the feature extraction and classification process. The raw image in Red Green Blue (RGB) video images will be filtered through the Gaussian filter for 2D as in (1). The parameter x is the horizontal length from the origin and y is the vertical length from the origin and σ is the standard deviation of the Gaussian distribution [25]. 𝐺(𝑥, 𝑦) = 1 2𝜋𝜎2 𝑒 − 𝑥2+𝑦2 2𝜎2 (1) This Gaussian operation will reduce the noise generated in the segmentation process to produce a good binary image for thresholding operation on Hue, Saturation and Luminance format (HSL). In this process, the normal RGB colour image is converted to HSL. Since the typically white lane marker is on a grey background, the luminance value is adjusted as the threshold, use to convert the image to binary format. 2.2. Extracting The Road Marking Cues After investigating the best ROI for processing the image, the next step is to extract the road marking cues. The ROI will be scanned from the top to the bottom and from the left to the right as shown by the arrows in Figure 5 (b). A binary column vector 𝑓𝑥, which is extracted from the x-th column of the binary image having binary pixels of 𝑓(𝑥, 𝑦) ∈ {0,1} for 𝑥 = 0,1, ⋯ , 𝑁𝑥 and 𝑦 = 0,1, ⋯ , 𝑁𝑦, is defined as follows 𝑓𝑥[𝑦] = { 0, 𝑓(𝑥, 𝑦) = 0 1, 𝑓(𝑥, 𝑦) = 1 (2) This binary column vector tells how many white pixels found on the x-th column. When there are road markers crossing the column, the number of white pixels will increase. In order to reduce the computational complexity, not all columns will be read, or horizontally scanned over the image. It is sufficient to horizontally scan the image for obtaining the values over a constant horizontal interval of δx as in Figure 5 (b), which is the number of pixel columns of the binary image which are skipped and not scanned, as long as the road marker can be correctly classify. Example of scanning process on the image shown in Figure 5, with various type of road markers and different value of δx. By using an example of a 420x260 pixel size for an ROI, it will requires 41 times of lines scanning using with interval size of δx=10 pixels, producing 41 binary column vectors 𝒇 𝑥, where 𝑁𝑥 = 260 (the Height size). Every binary column vector, 𝒇 𝑥 will be processed to detect and count the number of transitions, 𝑁𝑡 from 0 to 1 and from 1 to 0 in it by using a bitwise exclusive OR operation between itself, 𝒇 𝑥 and 𝒇 𝑥𝑟, which is a vector produced from shifting 𝒇 𝑥 by one binary bit or element as shown in an example. - bitwise shift to the right by adding 0 to the first bit and shift the rest to the right 𝒇 𝑥 𝑻 = [0001111000], 𝒇 𝑥𝑟 𝑻 = [0000111100] - perform the exclusive OR with original value resulting only transition bits are left - 𝒇 𝑡 = 𝒇 𝑥 𝑻 ⨁𝒇 𝑥𝑟 𝑻 = [0001111000] ⊕ [0000111100] = [0001000100] - count the number of transitions on every scan line or binary column vector 𝑁𝑡 = ∑ 𝑓𝑡[𝑦] 𝑁 𝑥 𝑦=1 = 2 The numbers of transitions in each binary column vector obtained from the scanning line are saved into a vector, 𝒇 𝑵 𝒕 . An example of this vector produced from scanning an ROI with an interval size of 10 pixels is given in Figure 6. The number of transitions are in each binary column vector is observed to be either 0, 2 or 4. For the road marker SS, there are at most 2 transitions in each vector whereas for D, the number of transitions is either 0 or 2. For DD, the number of transitions is 4, whereas for SD and DS, the number of transitions is either 2 or 4. To differentiate between SD and DS, additional features will be extracted to differentiate between these two classes.
  • 5. ◼ ISSN: 1693-6930 TELKOMNIKA Vol. 17, No. 4, August 2019: 2048-2057 2052 (a) (b) (c) (d) Figure 5. Example of scanning image with different interval size with different road markers Vector 𝒇𝒕 will be processed where the number of transitions will be grouped and the percentage of 𝑁𝑡, or the numbers of transitions will be stored in vector 𝒇 𝑵 𝒕 as formulated by 𝑁𝑡 p in (3), which is applied to calculate the percentage of 𝑁𝑡 for five different classes as tabulated in Table 1. According to this table, 𝑁1 = 0, 𝑁2 = 2 and 𝑁3 = 4. 𝑁𝑡 p = Frequency of 𝑁𝑡 Total frequency × 100% (3) Table 1. Example of Transition Percentages from 𝒇 𝑵 𝒕 (from DS Image Figure 6) 𝑁𝑡 Frequency of 𝑁𝑡 𝑁𝑡 p (%) 0 1 2.44 2 26 63.41 4 14 34.15 𝒇 𝑵 𝒕 = [2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2, 2,2, 2, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 4, 2, 2, 2, 2, 2, 2, 0] Figure 6. Example of result for 𝐟 𝐍 𝐭 after scanning process
  • 6. TELKOMNIKA ISSN: 1693-6930 ◼ Road markers classification using binary scanning … (Zamani Md Sani) 2053 2.3. The First and Second Layer Classification 2.3.1. Designing the Filtering Table for First Layer Classification The percentages of 𝑁𝑡 obtained when processing 100 frames from each of the five classes are plotted in Figure 7. The X-axis represents 𝑁𝑡 whereas Y-axis represents 𝑁𝑡 p , which is the percentage of 𝑁𝑡. In our method, we use 10 pixels as the interval size for the scanning process. From observation, a threshold can be set from the data to enable the classification for the markers. At threshold value of 20% as shown as red dash line, a filtering table can be designed as in Table 2. At least 2 types of markers can be classified, whereas SS and DS/SD classes could produced the same result. To improve this problem, an additional percentage value is introduced, which is 𝑁4 p = 6, which is a multiplication of 𝑁2 p = 2 and 𝑁3 p = 4 and later gain by 2 as formulated in (4) are plotted in Figures 7 (a)-(e) as inside the blue dash box. From this additional percentage value, the filtering table can be improved as in Table 2 to classify three road marker types namely D, DD and SS. As for SD and DS road marker type, the algorithm will proceed to the second classifier as described in the next section. 𝑁4 p = (𝑁2 p × 𝑁3 p ) ∗ 2 (4) (a) (b) (c) (d) (e) Figure 1. Plotting Percentage of 𝑁𝑡 (%) for 5 different classes with 20% threshold line with, 𝑁4 p = 6 included as inside the blue dash box (a) DD (b)D (c) DS (d) SD (e)SS
  • 7. ◼ ISSN: 1693-6930 TELKOMNIKA Vol. 17, No. 4, August 2019: 2048-2057 2054 Table 2. Filtering Table Construction from the Graph Observation Inclusive of 𝑁4 p = 6 Condition for classifying 𝑁𝑡 p > 20% Binary transition 𝑁𝑡 0 2 4 6 Dashed (D) C1 Yes Yes/No No No Double Solid (DD) C2 No No Yes Yes/No Single (SS) C3 No Yes No No Solid-Dashed (SD) C4 No Yes Yes/No Yes Dashed-Solid (DS) C5 No Yes Yes/No Yes 2.3.2. Contours Slope (Second Layer Classifier) In the second layer classification, the aim is to separate the DS and SD classes which requires the process to detect the contours (long and short markers). A DS class is recognized by the location of the shorter contour (of the dashed marker) below the longer contour (the solid marker) and an SD class is recognized vice versa. In Figure 8, the longer contour is indicated by two points, A and B, and its both ends. The shorter contour is indicated by point C, which is the centroid of the shorter contour. Hence by knowing the location of C, whether it’s below or above the longer contour, the class SD or DS can be identified. (a) (b) Figure 2. Three points to calculate the slope (a) DS class (b) SD class The slope of 𝑚 𝐴𝐶 = 𝐴 𝑦− 𝐶 𝑦 𝐴 𝑥−𝐶 𝑥 , between A and C will be smaller than the slope of 𝑚 𝐴𝐵 = 𝐴 𝑦− 𝐵 𝑦 𝐴 𝑥−𝐵 𝑥 between A and B, if the shorter contour is below the longer contour which is found in DS class. On the other hand, the slope of 𝑚 𝐴𝐶, will be larger than the slope, 𝑚 𝐴𝐶, if the shorter contour is below the longer contour for SD class. If both 𝑚 𝐴𝐶 and 𝑚 𝐴𝐵 are multiplied with( )( )xxxx BACA −− , then the result of the multiplication, ( )( ) ( )( )xxyyxxxxAC BACABACAm −−=−− , (5) will still be smaller than the result of another multiplication for DS class. ( )( ) ( )( )xxyyxxxxAB CABABACAm −−=−− , (6) If the difference between these two multiplications is denoted as , the following equation yields ( )( ) ( )( )xxyyxxyy CABABACA −−−−−= , (7) then the value of  can be used as the feature to determine or segregate between SD and DS classes. If the  < 0, then the road marker is classified as DS class. If ,0 then the road marker is classified as SD class. Since the classification is only carried out to identify between
  • 8. TELKOMNIKA ISSN: 1693-6930 ◼ Road markers classification using binary scanning … (Zamani Md Sani) 2055 SD and DS for this second layer classification, the value of  will not equivalent as zero as C will never be located on the straight line between A and B. 2.3.3. Outliers and Improving the Classification Result By observing the graphs in Figure 7, there are potential outliers generated due to the values calculated near to the threshold values at 20% as indicated by the red circle in Figures 7 (a), (c) and (e). Other than introducing 𝑁4 p = 6, this possible false error can also be resolved by using temporal values between the video images. The markers tend to be the similarly labeled for a set of adjacent frames. By using this possibility, the previous classification result would be stored and if there is a transition of a class or marker type, it will confirm on the next ten (10) frames of sequence. This method also improved the issue related to the vehicle blocking the road marker as there is no firm classification result when this occurs and the result will hold the last classification result as reference. Hence the validation for transition types of marker requires 10*0.033s=0.33s at the most. 3. Results and Analysis The proposed two-layer classification methods are implemented to classify the road markers from a number of video clips recorded when driving at different road scenarios with different road markers. The speed of the car while these video clips were taken was between 70-80 km/hr. In order to run the proposed road marker classification model, the features from the first three video clips given in Table 3 are extracted and analyzed to see the significant patterns for the classification process and it contain all types of the road markers which are aimed to be classified. Manual comparison is performed on the predicted road marker type of the algorithm with the ground truth on every frame and the accuracy is calculated as in (8) where the total frames classified correctly from the ground truth ∑ 𝐹𝑇𝑃 is divided with the total frames, ∑ 𝐹𝑇. It can be observed that the accuracy achieved in the training videos are well above 98% except clip number 3 at 93% which due to the faint lane markers detected in the video. This is essential to ensure that the classification performance achieved when running this model on the testing videos is as good as possible. 𝐴𝑐𝑐𝑢𝑟𝑎𝑐𝑦 = ∑ 𝐹 𝑇𝑃 ∑ 𝐹 𝑇 𝑋 100% (8) Table 3. Various Clips and Accuracy Clip Name Resolution FPS Type Frames Features Analysis Test Accuracy (%) 1 Vid24 1280x720 30 D-DD-SD 1840 x x 98.04% 2 Vid25 1280x720 30 DD-DS 1099 x x 100% 3 Vid23 1280x720 30 DD-S 357 x x 93.84% 4 Vid_1_Test 1280x720 30 DD-DS-D 2019 x 97.17% 5 Vid_2_Test 1280x720 30 DD-D 796 x 94.47% 6 Vid_3_Test 1280x720 30 D-SD-DD 1287 x 100% 7 Vid_4_Test 1280x720 30 DD-D-SD 1547 x 97.54% 8 Vid_5_Test 1920x1080 30 SS 763 x 100% The proposed classification model was later tested with five video clips, which are numbered from 4 to 8 in Table 3. In video clip Vid_2_Test, which contains 796 frames having road markers of types DD and D, the recorded accuracy is 94.47%, which still higher than 90% but stands as the lowest amongst all other accuracy values achieved. This is mainly due to the quality of this video clip which is more blurry compared on the other clips. The marker transition had shown minimum effect on the classification accuracy as the algorithm successfully revalidated between the false and true transition and contributed on the accucarcy calculation. As for the confusion matrix as in Table 4, we can find out that most error is coming from the DD class due to the thresholding process resulting the output of combined contour at the top of the lanes which is very hard to distinguish its threshold value. Examples of the thresholded images are as in Figure 9 as in the blue circle. In this circle area, the scanning process will resulted this as 𝑁𝑡 = 2 instead of 𝑁𝑡 = 2 and the classification would lead to SD instead of DD.
  • 9. ◼ ISSN: 1693-6930 TELKOMNIKA Vol. 17, No. 4, August 2019: 2048-2057 2056 Figure 9. Thresholding output for DD Table 4. Confusion Matrix Table Predicted Class Dashed Double Solid Single Solid-Dashed Dashed-Solid Actual Class C1 C2 C3 C4 C5 C1 1254 32 0 0 0 97.44% C2 0 2476 0 128 0 94.83% C3 0 0 763 0 0 100% C4 0 0 0 1080 0 100% C5 0 0 0 0 679 100% 4. Conclusion The paper presented a new approach for lane marker classification. The ROI selection is based on the camera position to capture the road image. The ROI is processed and the features of the lane marking are extracted for the training purposes and later for the classification process. This new algorithm was tested with the local new videos and the ground truth. Experimental results have shown that the accuracy values achieved by the proposed new method achieved more than 93%. The errors from the classification operation are mainly due to the faint road marker which caused wrong pre-processing result, sudden illumination changes and the difference in the dimension of the lane markers. Acknowledgements The authors would like to acknowledge the funding support received from Universiti Teknikal Malaysia Melaka (UTeM) from PJP/2014/FKE(15D)/S01357–Road Lane Recognition Using Vision and Artificial Intelligence for Auto Assist Driver Alert System. References [1] Doyle DD, Jennings AL, Black JT. Optical Flow Background Estimation for Real-Time Pan/Tilt Camera Object Tracking. Measurement 2014; 48: 195–207. [2] Liu W, Zhang Z, Li S, Tao D. Road Detection By Using A Generalized Hough Transform. Remote Sens. 2017; 9(6): 590. [3] Son J, Yoo H, Kim S, Sohn K. Real-time Illumination Invariant Lane Detection for Lane Departure Warning System. Expert Syst Appl. 2015; 42(4): 1816–1824. [4] Dorj B, Lee DJ. A Precise Lane Detection Algorithm Based on Top View Image Transformation and Least-Square Approaches. J Sensors. 2016; 2016. [5] Satzoda, RK, Trivedi, MM. Vision-Based Lane Analysis: Exploration of Issues and Approaches for Embedded Realization. IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops. 2013: 604–609. [6] An X, Shang E, Song J, Li J, He H. Real-Time Lane Departure Warning System Based On A Single FPGA. EURASIP Journal on Image and Video Processing. 2013: 38. [7] Chira IM, Chibulcutean A, Danescu RG. Real-Time Detection of Road Markings for Driving Assistance Applications. Computer Engineering and Systems ICCES 2010 International Conference. 2010: 158–163. [8] Wu T, Ranganathan A. A Practical System For Road Marking Detection And Recognition. IEEE Intelligent Vehicles Symposium, Proceedings, 2012: 25–30. [9] Kheyrollahi A, Breckon TP. Automatic real-time road marking recognition using a feature driven approach. Machine Vision and Applications. 2012; 23(1): 123–133.
  • 10. TELKOMNIKA ISSN: 1693-6930 ◼ Road markers classification using binary scanning … (Zamani Md Sani) 2057 [10] Mc Call JC, Trivedi MM. Video-Based Lane Estimation and Tracking for Driver Assistance: Survey, System, and Evaluation. IEEE Transactions on Intelligent Transportation Systems. 2006; 7(1): 20–37. [11] Yenikaya S, Yenikaya G, Düven E. Keeping the Vehicle on the Road: A Survey on On-road Lane Detection Systems. ACM Comput. Surv. 2013; 46(1): 43. [12] Bar Hillel A, Lerner R, Levi D, Raz G. Recent Progress In Road And Lane Detection: A Survey. Machine Vision and Applications. 2014; 25(3): 727–745. [13] Collado JM, Hilario C, De La Escalera A, Armingol JM. Detection And Classification of Road Lanes With A Frequency Analysis. In: IEEE Intelligent Vehicles Symposium, Proceedings. 2005: 78–83. [14] Schubert R, Schulze K, Wanielik G. Situation Assessment For Automatic Lane-Change Maneuvers. IEEE Trans Intell Transp Syst. 2010; 11: 607–616 [15] Lindner P, Richter E, Wanielik G, Takagi K, Isogai A. Multi-Channel Lidar Processing for Lane Detection And Estimation. In: IEEE Conference on Intelligent Transportation Systems, Proceedings, ITSC. 2009: 02–207. [16] Suchitra S, Satzoda RK, Srikanthan T. Identifying Lane Types: A Modular Approach. In: IEEE Conference on Intelligent Transportation Systems, Proceedings, ITSC. 2013: 1929–1934. [17] Danescu R, Sobol S, Nedevschi S, Graf T. Stereovision-Based Side Lane And Guardrail Detection. 2006 IEEE Intell Transp Syst Conf. 2006; 1156–1161 [18] MB de Paula, CR Jung. Real-Time Detection and Classification of Road Lane Markings. XXVI Conf. Graph. Patterns Images. 2013: 83–90. [19] MB De Paula, CR Jung, LG Da Silveira. Automatic On-The-Fly Extrinsic Camera Calibration of Onboard Vehicular Cameras. Expert Syst. Appl. 2014; 41(4 PART 2): 1997–2007. [20] MB De Paula, CR Jung. Automatic Detection and Classification of Road Lane Markings Using Onboard Vehicular Cameras. IEEE Trans Intell Transp Syst. 2015; 16: 3160–3169. [21] Mathibela B, Newman P, Posner I. Reading the Road: Road Marking Classification and Interpretation. IEEE Trans Intell Transp Syst. 2015; 16: 2072–2081. [22] ZM Sani, HA. Ghani, LW Sen R. Daytime Road Marker Recognition Using Grayscale Histogram and Pixel Values. Internetworking Indonesia Journal. 2016; 8(1): 11-16. [23] ZM Sani, HA Ghani, R Besar, L W Sen. Real-Time Daytime Road Marker Recognition Using Features Vectors And Neural Network. IEEE Conference on Sustainable Utilization And Development In Engineering and Technology (CSUDET). 2015: 1-6. [24] ZM Sani, HA Ghani, R Besar, A Azizan, H Abas. Real-Time Video Processing using Contour Numbers and Angles for Non-urban Road Marker Classification. International Journal of Electrical and Computer Engineering (IJECE). 2018; 4(8): 2540-2548. [25] JC Russ, JC Russ. Introduction to Image Processing and Analysis. CRC Press, Boca Raton. 2008: 72-79.