SlideShare a Scribd company logo
TELKOMNIKA Telecommunication, Computing, Electronics and Control
Vol. 18, No. 3, June 2020, pp. 1514~1521
ISSN: 1693-6930, accredited First Grade by Kemenristekdikti, Decree No: 21/E/KPT/2018
DOI: 10.12928/TELKOMNIKA.v18i3.14829  1514
Journal homepage: http://journal.uad.ac.id/index.php/TELKOMNIKA
Stereo vision-based obstacle avoidance
module on 3D point cloud data
Eko Purbo Wahyono1
, Endah Suryawati Ningrum2
, Raden Sanggar Dewanto3
, Dadet Pramadihanto4
1
Department of Electrical Engineering, Politeknik Elektronika Negeri Surabaya, Indonesia
2
Department of Mechanical and Energy Engineering, Politeknik Elektronika Negeri Surabaya, Indonesia
3
Department of Information Engineering, Politeknik Elektronika Negeri Surabaya, Indonesia
4
Robotics and Intelligent System Center, Indonesia
Article Info ABSTRACT
Article history:
Received Aug 23, 2019
Revised Jan 29, 2020
Accepted Feb 26, 2020
This paper deals in building a 3D vision-based obstacle avoidance and
navigation. In order for an autonomous system to work in real life condition,
a capability of gaining surrounding environment data, interpret the data and
take appropriate action is needed. One of the required capability in this matter
for an autonomous system is a capability to navigate cluttered, unorganized
environment and avoiding collision with any present obstacle, defined as any
data with vertical orientation and able to take decision when environment
update exist. Proposed in this work are two-step strategy of extracting
the obstacle position and orientation from point cloud data using plane based
segmentation and the resultant segmentation are mapped based on obstacle
point position relative to camera using occupancy grid map to acquire obstacle
cluster position and recorded the occupancy grid map for future use and global
navigation, obstacle position gained in grid map is used to plan the navigation
path towards target goal without going through obstacle position and modify
the navigation path to avoid collision when environment update is present or
platform movement is not aligned with navigation path based on timed elastic
band method.
Keywords:
3D Vision
Obstacle avoidance
Obstacle extraction
Timed elastic band
This is an open access article under the CC BY-SA license.
Corresponding Author:
Eko Purbo Wahyono,
Department of Electrical Engineering,
Politeknik Eplektronika Negeri Surabaya,
Kampus PENS, Jl. Raya ITS, Keputih, Kec. Sukolilo, Kota SBY, Jawa Timur 60111, Surabaya, Indonesia.
Email: eko.pw00@gmail.com
1. INTRODUCTION
Recent development on autonomous platform geared towards assisting human in their daily activity
mandates all autonomous platform to have a capability to perceive the surrounding environment, and make a
suitable decision for action. One essential action is to safely navigate cluttered environment and avoiding
collision with any obstacle that presents within the environment. One challenge present is avoiding collision
with obstacle and navigating in an unstructured environment [1]. Since unstructured environment have so many
possibilities of obstacle position, orientation and or shape, challenge present involved in gaining obstacle
position, orientation and size in order to safely plan a path to avoid a collision. One commonly used solution
to deal with these problems is 3D vision [2, 3] based solution to gain obstacle position, orientation and size
since with 3D vision the system did not need to recognize and learn the object to acquire the information on
object position, orientation and size since the raw data itself is already 3D. Many solutions exist on the field of
gaining 3D information from the environment, one of the solution is using computer stereo vision [4–6] to
TELKOMNIKA Telecommun Comput El Control 
Stereo vision-based obstacle avoidance module on 3D point cloud data (Eko Purbo Wahyono)
1515
create an point cloud data [7]. On solving the problems on 3D vision and obstacle avoidance, as the system
become progressively more complex and demanding with processing power, the demands for more details on
input on environment and faster execution time become more clear. From the input processing side, with 3D
vision that create a 3D representation of surrounding environment with great details comes with the price of
enormous data size and demand more processing power to process the data. One solution to this problem is to
reduce data size while keeping the characteristics, normally this result in reduced environment details.
RANSAC (random sample consensus) based method with SAC model [8] is one of the most used method
used to reduce data size without sacrificing too much details on environment data and robust in presence of
noise [9], This work uses NaN, passthrough and voxel grid filter based on RANSAC to reduce data size. To
further reduce computation, parallel computing are used [9–11]. Based from [9] comparison this work used
CUDA (compute unified device architecture) parallel computing based on [12]. The reason for parallel
computing is to minimize execution time in order to enable the obstacle avoidance module to be in a processing
unit combined with another function for platform movement and automation.
Environment data must be classified into regions with similar characteristic to facilitate further
processing. One of data classifying is data segmentation. This process was required to differentiate data to
acquire usable environment data [13-16]. This work using plane-based segmentation to differentiate between
obstacle which defined as any point cloud data with vertical plane orientation and the horizontal walking plane
itself. This step is used to segment the walking plane and obstacle data.Obstacle data, a representation of
environment condition are used to plan the collisionfree path. Since the platform movement lies on x,y axis,
the obstacle data in form of point cloud can be converted to grid map [17, 18]. Recent research produce an
algorithm that not only able to plan safe path but also deal with environment change and platform disturbances
that cause the platform to stray from planned path. One of the algorithm is timed-elastic-band [19]. Many
research has been done on improving TEB (timed elastic band) method [20–24], this work base the TEB
application from research by [20, 22]. The final goal of this work is a system module with integrated processing
for 3D point cloud data similar to [25] with an output of obstacle detection and obstacle position information
to produce path planning with an ability of updating the path to deal with environment changes and or platform
deviation while record the environment data for future usage and subsequent global path planning.
2. PROPOSED SYSTEM OVERVIEW
Below are the general overview of steps taken to process environment data to plan the obstacle
avoidance action:
− Pre-Processing. Raw point cloud data from a stereo camera are filtered to down sample the data using voxel
grid method and remove unnecessary points.
− Obstacle extraction. Environment data in form of point cloud are separated between vertical and horizontal
plane based on point data orientation, environment interpreted into a grid to get the information of safe
moving space and obstacle area, the resultant grid are recorded for future use and global navigation.
− Path planning. Plan a path towards goal through safe moving area using occupancy map, keeping clear of
obstacles area while updating environment grid and adapt the path when environment data and platform
position are changed, publish array of waypoints along the global path and create new waypoints array
towards global path target.
3. RESEARCH METHOD
3.1. Point cloud engine
On camera initialization, camera calibration and pre-set parameters are loaded to enable image
acquisition. Data taken from Stereo 2D camera with focal point 𝑓 and baseline 𝐽 are stereo matched,
and triangulated to gain depth data by:
𝑑 =
(𝐽 ∗ 𝑓)
(𝑋𝑙, 𝑌𝑙 − 𝑋𝑟, 𝑌𝑙)
(1)
where 𝑋𝑙, 𝑌𝑙 and 𝑋𝑟, 𝑌𝑟 are matching pixel between left and right camera respectively, the resultant depth data
is combined with RGB data from the camera and converted into 3D point cloud data format by normalizing
the pixel coordinate 𝑂(𝑋, 𝑌, 𝑑) into 3D coordinate 𝑃(𝑥, 𝑦, 𝑧) with camera baseline 𝐽 using:
𝑦 = 𝑑, 𝑥 =
𝑥𝑙 ∗ 𝑑
𝐽
, 𝑧 =
𝑦𝑙 ∗ 𝑑
𝐽
(2)
to be processed afterwards by subsequent sub-systems. Point cloud resultant of 1 and 2 have parallel planes in
real condition shown as parallel planes, therefore eliminating the need of calculating camera perspective.
All these processes are done in an early stage inside the camera itself.
 ISSN: 1693-6930
TELKOMNIKA Telecommun Comput El Control, Vol. 18, No. 3, June 2020: 1514 - 1521
1516
3.2. Filtering
Since dense point cloud data while provide more details on environment leads to longer execution
time needed for processing, therefore a method for keeping environment details while reducing point count
that leads to faster execution is needed [26]. This system uses voxel grid filtering which group data with similar
characteristics and replace the group a single data that represent the whole group, this filter was chosen for the
robust characteristic of the filter. Point cloud data is down-sampled using voxel grid method. A defined
Oriented bounding box 𝐵 along with the minimum and maximum value of point cloud in 𝑥, 𝑦, 𝑧 axis are used
to calculate voxel grid 𝐷 𝑘𝑙𝑚 in size of 𝑣𝑥 × 𝑣 𝑦 × 𝑣𝑧 which defined as:
𝐷 𝑘𝑙𝑚(0 < 𝑘 < 𝑥, 0 < 𝑙 < 𝑦, 0 < 𝑚 < 𝑧) (3)
with the voxel grid size defined, assign each grid to each point 𝑃𝑛 in point cloud 𝑃. After each grid 𝐷 𝑘𝑙𝑚
assigned and the center gravity point 𝑣𝑥𝑦𝑧 for each grid 𝐷 𝑘𝑙𝑚 with 𝑘𝑖, 𝑙𝑖, 𝑚𝑖 and 𝑘 𝑛, 𝑙 𝑛, 𝑚 𝑛 as
the outmost point of the 𝐷 𝑘𝑙𝑚 grid calculated by:
𝑣𝑥 =
𝐷 𝑘 𝑖
+ 𝐷 𝑘 𝑛
2
, 𝑣 𝑦 =
𝐷𝑡 𝑖
+ 𝐷𝑡 𝑛
2
, 𝑣𝑧 =
𝐷 𝑚 𝑖
+ 𝐷 𝑚 𝑛
2
(4)
all points 𝑃𝑥𝑦𝑧 in voxel are replaced by center gravity point of each grid 𝑣𝑥𝑦𝑧 with final position point set 𝑃´.
Process all voxel grid to acquire 𝑃´ by:
𝑃′
= 𝑋 𝑣 𝑥𝑦𝑧
(0 < 𝑥 < 𝑥 𝑚𝑎𝑥,0 < 𝑦 < 𝑦 𝑚𝑎𝑥, 0 < 𝑧 < 𝑧 𝑚𝑎𝑥) (5)
Defined size of a voxel is used to group neighbouring point of an initial point Pi with similar
characteristics and using the Pi as centroid all other point removed leaving the centroid point data afterwards.
Small voxel size, while keep more details of raw point cloud data, leads to longer execution time while bigger
voxel size have smaller execution time but loses more details. Resultant of this step are as shown on Figure 1
while voxel grid is slower, it represents the underlying surface more accurately without sacrificing keypoint
of 3D point cloud data [27]. This characteristic will enable the segmentation process to segment the data
properly. The resultant data from this step still contains all data within camera’s field of view, since the system
do not need roof information and existence of roof data in occupancy grid map process can lead to no available
moving space, hence the removal of roof point cloud data is needed. The system use a passthrough filter with
maximum vertical parameters to exclude roof point cloud [27], if passthrough filter is not exist, the roof
segmented will be defined as an obstacle since the roof plane itself lies parallel with walking plane, this
happened because the segmentation process only separate vertical and horizontal point cloud data orientation.
Because the roof will not hinder platform movement and including roof as obstacles result in no free obstacle
area, the system exclude ceiling point cloud data from being processed by the segmentation process by filter
the data using passthrough method:
𝑃𝑥𝑦𝑧 = 𝑋 𝑝 𝑥𝑦𝑧
(𝑧|𝑚 < 𝑧 < 𝑛) (6)
with P as the resultant point cloud, 𝑝 as an individual point, m as the minimum z axis value and n as maximum
z axis value.
Figure 1. Filtering result
TELKOMNIKA Telecommun Comput El Control 
Stereo vision-based obstacle avoidance module on 3D point cloud data (Eko Purbo Wahyono)
1517
3.3. Segmentation
After pre-processing step, the point cloud data segmented to gain information on walking plane as
free moving region and obstacle data. With the definition of walking plane as a plane in 𝑥, 𝑦 axis.
By defining the plane’s mathematical model as:
𝜑 = 𝛼𝑥 + 𝛽𝑦 + 𝛾𝑧 + 𝛿 = 0 (7)
where 𝛼, 𝛽, 𝛾 on (8) are the parameters of the mathematical model of the plane and k,l,m are
the independent variables of the model to define a plane. To determine if point 𝑃 = (𝑥0, 𝑦0, 𝑧0) fit plane
𝜑 = 𝛼 × 𝑘 + 𝛽 × 𝑙 + 𝛾 × 𝑚 + 𝛿, the perpendicular distance of the point to the plane was calculated using:
𝑅( 𝑃, 𝜙) =
|𝛼 × 𝑥0 + 𝛽 × 𝑦0 + 𝛾 × 𝑧0 + 𝛿|
√𝛼2 + 𝛽2 + 𝛾22 (8)
If the point is below the threshold value, it can be considered as an inlier to the plane. By using (7) to
define the walking plane model and isolate the walking plane point cloud data from others using (8) resulted
in separation of the plane inlier from other point, the system has gained both free region in form of inlier points
and the obstacle point cloud data itself to plan the obstacle avoidance path. Result of this step is shown
by Figure 2.
Figure 2. Segmentation step comparison
3.4. Occupancy grid map
Segmented point cloud data are used for building occupancy grid map to acquire obstacle position
relative to the platform and the subsequent map can be recorded for future use or for global path planning to
already recorded area. Occupancy grid map created using obstacle point cloud data to determine if a grid
occupied by an obstacle that will cause collision [18]. Each cell Ci = x, y with a fixed size for each
point Pi = x, y, z
𝐹𝑙𝑎𝑔 𝑓𝑟𝑒𝑒 {
𝐹𝑎𝑙𝑠𝑒∀𝑃𝑖 𝑥,𝑦
= 𝐶𝑖 𝑥,𝑦
𝑇𝑅𝑈𝐸∀𝑜𝑡ℎ𝑒𝑟𝑤𝑖𝑠𝑒 (9)
This step gains areas where the platform can safely move without risk of collision without the need
of single out every obstacle and calculate the centroid and position of each obstacle by measuring each area
and comparing the width with the minimum width required by the platform. The result as shown on Figure 3.
3.5. Path planning
This part of the system have two parallel process, the first one, path planner create a global solution
for the platform to move towards the target. The second system handle disturbance force on a platform
and output correction command to deal with small changes in environment and unexpected obstacle.
Based on timed-elastic-band method by Quinlan [19] with development on sparse model [21] to advanced
trajectories [20] with MPC approach towards TEB methods [22]. Overview of this step is as shhown on
Figure 4. This method was used because the behavior of the platform is not determined at the planning level,
yet local disturbances will not hinder the system ability to reach goals. This system deals with local disturbances
by deforming the path when environment changes are detected. Despite this step, the system still maintain a
complete collision-free path towards a determined goal. Find the shortest path towards determined goals.
 ISSN: 1693-6930
TELKOMNIKA Telecommun Comput El Control, Vol. 18, No. 3, June 2020: 1514 - 1521
1518
Figure 3. Occupancy grid map result
Figure 4. Path planning
𝑤( 𝑣, 𝑆𝑖) = {
0
min{𝑤(( 𝑢, 𝑣)) + 𝑑(𝑣, 𝑆𝑖)}
∞
(10)
With (10) produces global path result that used by TEB to create a series of waypoints. The shortest path, taken
as a series of a fixed number 𝑛 of waypoint 𝑃𝑖 with tolerance radius 𝑟 which comprise.
𝑃𝑖 = (
𝑥𝑖
𝑦𝑖
) (11)
Array of waypoint 𝑃𝑖 can be denoted as:
𝑄 = { 𝑃𝑖}𝑖=1,2,….,𝑛 (12)
TELKOMNIKA Telecommun Comput El Control 
Stereo vision-based obstacle avoidance module on 3D point cloud data (Eko Purbo Wahyono)
1519
This system does not pursue fastest trajectory and in a context of timed elastic band, it only optimizes
the location of intermediate waypoint as the system does not have a boundary of final platform state, therefore
the change in time for each consecutive waypoint (∆𝑇𝑖) are fixed and can be denoted as (13).
𝜏 = {Δ𝑇𝑖}𝑖=1,2,…,𝑛−1 (13)
Timed elastic band function consisted of (14).
𝐵 ∶= (𝑄, 𝜏) (14)
Optimal band calculation is calculated by minimizing the objective function.
𝑓( 𝐵) = ∑ 𝛾 𝑘Γk(𝐵)
𝑘
(15)
With an array of waypoints Pi from path planning result, the system compare current platform position
and orientation information with waypoints coordinate and update waypoints array when the system achieve
waypoints or if the system stray from global path and previous waypoint array.
4. RESULTS AND ANALYSIS
The result of voxel grid filtering with 0.05 m size voxel, the resultant cloud shows a drop of 98.2% in
point cloud count from 921600 point to 16664 point. With only 1.8% of the data remains while maintains
similar characteristics with the raw data. This result shows that voxel grid preserved underlying plane
of the raw point cloud data while reducing point cloud data size as shown on Figure 1. Filtering sub-system
takes 86 ms average execution time with 720p raw data size with an acceptable result for segmentation while
reducing the data size and removal of unnecessary data proven by the success on segmentation step as shown
on 2a, faster execution time leads to more loss of details, which result in failure of segmentation. Execution
time for filtering subsystem can be improved by the usage of parallel computing for each filtering model for
faster execution. Similar method can be applied for segmentation subsystem which takes 260 ms average
execution time. Shorter execution time leads to faster map update and faster decision result. Segmentation
resulted in all point cloud data with vertical plane orientation are separated from the point cloud data with
horizontal plane orientation. Compared to colour based point cloud clustering, the result shows that
the colour based segmentation result are still detecting some vertical object as a same group as the horizontal
walking plane, while the system’s segmentation based on each point orientation separate all points with vertical
plane orientation. Despite system success of segmentation between horizontal walking plane and obstacle data,
the system fail to process some data when stereo matching failure exist, this characteristics make neighbouring
pixel with a significant distance in 3D environment result in an almost horizontal gradient, therefore the system
segmentation does not segment this area. The comparison between plane based segmentation and colour based
segmentation are shown on Figure 2 occupancy grid map resulted in information of each obstacle data position
therefore safe moving area are acquired where no obstacle are present.
The system will calculate the safe area around the obstacle grid to account for platform size and
odometry drift. All these information are successfully recorded proven by the ability of the system to plan
navigation path through already mapped area Figure 3 show that where obstacle point cloud exist,
the corresponding cells show as black cells with no failure for all obstacle point information. Path planning
resulted the shortest path in regard to platform size to avoid collision with obstacle area and modify initial path
to target to avoid an obstacle and adapt to new environment data this is proven by moving the camera according
to path planning resulted in arriving to target coordinate without any collision shown on Figure 5 (a) and
Figure 5 (b) shows the same goal position with updated environment information and platform position.
Figure 5 (b) shows the system update the path plan towards the goal when the platform is moved outside the
planned path and new obstacle information is acquired from the environment and update path when the
platform moved inside planned path Figure 5 (c). The system only produce goal array position as long as the
area width for the path planning are wider than the required width of the platform and will terminate the path
planning when the required condition are not met, the system will produce path as close as the target as possible
when the condition are met, shown on Figure 5 (d), farthest arrow’s position have area width of more than
0.7 m, or shown at the Figure 5 (d) as the blue circle diameter are 7 grid with each grid have the width of
0.1 m, while further possible position did not met this requirement, therefore the system are fulfilling the target
of creating safe path without possible collision.
 ISSN: 1693-6930
TELKOMNIKA Telecommun Comput El Control, Vol. 18, No. 3, June 2020: 1514 - 1521
1520
(a) (b)
(c) (d)
Figure 5. Obstacle avoidance path modification, (a) initial path data, (b) after environment and position
update (c) After position update, (d) Minimum width requirement not met
4. CONCLUSION
Filtering sub-system perform amicably with total execution time of 96ms on average. This result
of execution time is done on 720p raw point cloud data size with 0.05m voxel size and limit passthrough
of 1.2m above ground. All sub-sub-system of filtering step perform as intended.Obstacle Extraction sub-system
extract all obstacle data and mapped with appropriate result compared to the real environment. While
segmentation process have a point of failure when the resultant of stereo matching did not produce the same
result as the real condition which result in segmentation failure while occupancy grid map produces the exact
result of every segmented obstacle data.
Path planning sub-system produces appropriate path and correction command when dealing with
environment and platform update while keeping the recorded data for future use and for global navigation.
This system did not deal with global path planning with previously mapped environment and has no
superposition odometry present. This system has provided a capability of obstacle avoidance based on 3D point
cloud data interpreted by equation 10 to form basic intelligence based on TEB model to deal with collisionfree
path planning and deals with platform deviation.
REFERENCES
[1] K. Sabe, et al., “Obstacle avoidance and path planning for humanoid robots using stereo vision,”
IEEE International Conference on Robotics and Automation, vol. 1, pp. 592–597, 2004.
[2] S. Kumar, D. Gupta, and S. Yadav, “Sensor fusion of laser & stereo vision camera for depth estimation and obstacle
avoidance,” International Journal of Computer Applications, vol. 1, no. 26, pp. 22–27, 2010.
[3] P. S. Sharma and D. N. G. Chitaliya, “Obstacle avoidance using stereo vision: a survey,” International Journal of
Innovative Research in Computer and Communication Engineering, vol. 3, no. 1, pp. 24-29, 2015.
[4] A. Hidalgo-Paniagua, et al., “A comparative study of parallel RANSAC implementations in 3D space,”
Int. J. Parallel Program., vol. 43, no. 5, pp. 703–720, 2015.
[5] D. Pramadihanto, et al., “Merging of depth image between stereo camera and structure sensor on robot flow vision,”
Int. J. on Advan. Sci., Enginee. and Inform. Tech., vol. 7, no. 3, pp. 1014-1025, 2017.
[6] S. A. Waskitho, et al., “FloW vision: Depth image enhancement by combining stereo RGB-depth sensor,”
International Conference on Knowledge Creation and Intelligent Computing, pp. 182–187, 2016.
TELKOMNIKA Telecommun Comput El Control 
Stereo vision-based obstacle avoidance module on 3D point cloud data (Eko Purbo Wahyono)
1521
[7] S. Ghosh and J. Biswas, “Joint perception and planning for efficient obstacle avoidance using stereo vision,”
IEEE/RSJ International Conference on Intelligent Robots and Systems, pp. 1026–1031, 2017.
[8] R. B. Rusu and S. Cousins, “3D is here: Point Cloud Library (PCL),” IEEE International Conference on Robotics
and Automation, pp. 1–4, 2011.
[9] S. A. Waskitho, et al., “Point cloud library (PCL): Module sample consensus,” International Conference on
Knowledge Creation and Intelligent Computing, pp. 182–187, 2016.
[10] A. Hidalgo-Paniagua, et al., “A comparative study of´ Parallel RANSAC implementations in 3D space,” International
Journal of Parallel Programming, vol. 43, no. 5, pp. 703–720, 2015.
[11] R. B. Rusu and S. Cousins, “3D is here: Point Cloud Library (PCL),” IEEE International Conference on Robotics
and Automation, vol. 42, no. 3, pp. 1-4, 2011.
[12] L. Vinet and A. Zhedanov, “A missing’ family of classical orthogonal polynomials,” Journal of Physics A:
Mathematical and Theoretical, vol. 44, no. 8, pp. 085201, 2011.
[13] C. Moreno and M. Li, “A comparative study of filtering methods for point clouds in real-time video streaming,”
Lecture Notes in Engineering and Computer Science, vol. 1, pp. 388-393, 2016.
[14] A. Nguyen and B. Le, “3D point cloud segmentation: A survey,” 6th IEEE Conference on Robotics, Automation and
Mechatronics (RAM), pp. 225–230, 2013.
[15] B. Sun and P. Mordohai, “Oriented point sampling for plane detection in unorganized point clouds,” International
Conference on Robotics and Automation, pp. 2917–2923, 2019.
[16] F. A. Limberger and M. M. Oliveira, “Real-time detection of planar regions in unorganized point clouds,” Pattern
Recognition, vol. 48, no. 6, pp. 2043–2053, 2015.
[17] X. Lin, J. R. Casas, and M. Pardas, “3D point cloud segmentation using a fully connected conditional random field,”
25th European Signal Processing Conference, vol. 2017, pp. 66–70, 2017.
[18] Y. Li, and Y. Ruichek, “Building variable resolution occupancy grid map from stereoscopic system &#x2014; A
quadtree based approach,” IEEE Intelligent Vehicles Symposium, pp. 744–749, 2013.
[19] E. Horvath and C. R. Pozna, “Probabilistic occupancy grid map building for Neobotix MP500 robot,” 13th Workshop
on Positioning, Navigation and Communications, pp. 1–4, 2016.
[20] S. Quinlan, and O. Khatib, “Elastic bands: connecting path planning and control,” Proceedings IEEE International
Conference on Robotics and Automation, pp. 802–807, 2016.
[21] M. Keller, et al., “Planning of optimal collision avoidance trajectories with timed elastic bands,” IFAC Proceedings
Volumes, vol. 47, no. 3, pp. 9822–9827, 2014.
[22] C. Rosmann, et al., “Efficient trajectory optimization using a sparse model,” 2013 European Conference on Mobile
Robots, pp. 138–143, 2013.
[23] C. Rosmann, F. Hoffmann, and T. Bertram, “Timed-Elastic-Bands for time-optimal pointto-point nonlinear model
predictive control,” European Control Conference, pp. 3352–3357, 2015.
[24] F. Ulbrich, et al., “Stable timed elastic bands with loose ends,” IEEE Intelligent Vehicles Symposium,
pp. 186–192, 2017.
[25] B. Magyar, et al., “Timed-elastic bands for manipulation motion planning,” IEEE Robotics and Automation Letters,
vol. 4, no. 4, pp. 3513–3520, 2019.
[26] C. Moreno and M. Li, “A comparative study of filtering methods for point clouds in real-time video streaming,”
International Conference on Knowledge Creation and Intelligent Computing, pp. 182–187, 2016.
[27] J. Bedkowski, et al., “Open source robotic 3D mapping framework with ROS robot operating system, PCL Point
Cloud Library and Cloud Compare,” International Conference on Electrical Engineering and Informatics,
pp. 644–649, 2015.

More Related Content

What's hot

A novel approach for satellite imagery storage by classify
A novel approach for satellite imagery storage by classifyA novel approach for satellite imagery storage by classify
A novel approach for satellite imagery storage by classifyiaemedu
 
A novel approach for satellite imagery storage by classifying the non duplica...
A novel approach for satellite imagery storage by classifying the non duplica...A novel approach for satellite imagery storage by classifying the non duplica...
A novel approach for satellite imagery storage by classifying the non duplica...IAEME Publication
 
Image confusion and diffusion based on multi-chaotic system and mix-column
Image confusion and diffusion based on multi-chaotic system and mix-columnImage confusion and diffusion based on multi-chaotic system and mix-column
Image confusion and diffusion based on multi-chaotic system and mix-column
journalBEEI
 
Fast Full Search for Block Matching Algorithms
Fast Full Search for Block Matching AlgorithmsFast Full Search for Block Matching Algorithms
Fast Full Search for Block Matching Algorithms
ijsrd.com
 
Background Estimation Using Principal Component Analysis Based on Limited Mem...
Background Estimation Using Principal Component Analysis Based on Limited Mem...Background Estimation Using Principal Component Analysis Based on Limited Mem...
Background Estimation Using Principal Component Analysis Based on Limited Mem...
IJECEIAES
 
Be36338341
Be36338341Be36338341
Be36338341
IJERA Editor
 
Integration of poses to enhance the shape of the object tracking from a singl...
Integration of poses to enhance the shape of the object tracking from a singl...Integration of poses to enhance the shape of the object tracking from a singl...
Integration of poses to enhance the shape of the object tracking from a singl...
eSAT Journals
 
Performance analysis of real-time and general-purpose operating systems for p...
Performance analysis of real-time and general-purpose operating systems for p...Performance analysis of real-time and general-purpose operating systems for p...
Performance analysis of real-time and general-purpose operating systems for p...
IJECEIAES
 
QUALITY ASSESSMENT OF PIXEL-LEVEL IMAGE FUSION USING FUZZY LOGIC
QUALITY ASSESSMENT OF PIXEL-LEVEL IMAGE FUSION USING FUZZY LOGICQUALITY ASSESSMENT OF PIXEL-LEVEL IMAGE FUSION USING FUZZY LOGIC
QUALITY ASSESSMENT OF PIXEL-LEVEL IMAGE FUSION USING FUZZY LOGIC
ijsc
 
An enhanced difference pair mapping steganography method to improve embedding...
An enhanced difference pair mapping steganography method to improve embedding...An enhanced difference pair mapping steganography method to improve embedding...
An enhanced difference pair mapping steganography method to improve embedding...
eSAT Publishing House
 
Median based parallel steering kernel regression for image reconstruction
Median based parallel steering kernel regression for image reconstructionMedian based parallel steering kernel regression for image reconstruction
Median based parallel steering kernel regression for image reconstruction
csandit
 
MEDIAN BASED PARALLEL STEERING KERNEL REGRESSION FOR IMAGE RECONSTRUCTION
MEDIAN BASED PARALLEL STEERING KERNEL REGRESSION FOR IMAGE RECONSTRUCTIONMEDIAN BASED PARALLEL STEERING KERNEL REGRESSION FOR IMAGE RECONSTRUCTION
MEDIAN BASED PARALLEL STEERING KERNEL REGRESSION FOR IMAGE RECONSTRUCTION
csandit
 
An enhanced fireworks algorithm to generate prime key for multiple users in f...
An enhanced fireworks algorithm to generate prime key for multiple users in f...An enhanced fireworks algorithm to generate prime key for multiple users in f...
An enhanced fireworks algorithm to generate prime key for multiple users in f...
journalBEEI
 
cuSTINGER: Supporting Dynamic Graph Aigorithms for GPUs : NOTES
cuSTINGER: Supporting Dynamic Graph Aigorithms for GPUs : NOTEScuSTINGER: Supporting Dynamic Graph Aigorithms for GPUs : NOTES
cuSTINGER: Supporting Dynamic Graph Aigorithms for GPUs : NOTES
Subhajit Sahu
 
Expert system of single magnetic lens using JESS in Focused Ion Beam
Expert system of single magnetic lens using JESS in Focused Ion BeamExpert system of single magnetic lens using JESS in Focused Ion Beam
Expert system of single magnetic lens using JESS in Focused Ion Beam
ijcsa
 
cuSTINGER: Supporting Dynamic Graph Aigorithms for GPUs (NOTES)
cuSTINGER: Supporting Dynamic Graph Aigorithms for GPUs (NOTES)cuSTINGER: Supporting Dynamic Graph Aigorithms for GPUs (NOTES)
cuSTINGER: Supporting Dynamic Graph Aigorithms for GPUs (NOTES)
Subhajit Sahu
 
Review paper on segmentation methods for multiobject feature extraction
Review paper on segmentation methods for multiobject feature extractionReview paper on segmentation methods for multiobject feature extraction
Review paper on segmentation methods for multiobject feature extraction
eSAT Journals
 
Inertial Sensor Array Calibration Made Easy !
Inertial Sensor Array Calibration Made Easy !Inertial Sensor Array Calibration Made Easy !
Inertial Sensor Array Calibration Made Easy !
oblu.io
 

What's hot (19)

A novel approach for satellite imagery storage by classify
A novel approach for satellite imagery storage by classifyA novel approach for satellite imagery storage by classify
A novel approach for satellite imagery storage by classify
 
A novel approach for satellite imagery storage by classifying the non duplica...
A novel approach for satellite imagery storage by classifying the non duplica...A novel approach for satellite imagery storage by classifying the non duplica...
A novel approach for satellite imagery storage by classifying the non duplica...
 
Image confusion and diffusion based on multi-chaotic system and mix-column
Image confusion and diffusion based on multi-chaotic system and mix-columnImage confusion and diffusion based on multi-chaotic system and mix-column
Image confusion and diffusion based on multi-chaotic system and mix-column
 
Fast Full Search for Block Matching Algorithms
Fast Full Search for Block Matching AlgorithmsFast Full Search for Block Matching Algorithms
Fast Full Search for Block Matching Algorithms
 
Background Estimation Using Principal Component Analysis Based on Limited Mem...
Background Estimation Using Principal Component Analysis Based on Limited Mem...Background Estimation Using Principal Component Analysis Based on Limited Mem...
Background Estimation Using Principal Component Analysis Based on Limited Mem...
 
Be36338341
Be36338341Be36338341
Be36338341
 
Integration of poses to enhance the shape of the object tracking from a singl...
Integration of poses to enhance the shape of the object tracking from a singl...Integration of poses to enhance the shape of the object tracking from a singl...
Integration of poses to enhance the shape of the object tracking from a singl...
 
Performance analysis of real-time and general-purpose operating systems for p...
Performance analysis of real-time and general-purpose operating systems for p...Performance analysis of real-time and general-purpose operating systems for p...
Performance analysis of real-time and general-purpose operating systems for p...
 
QUALITY ASSESSMENT OF PIXEL-LEVEL IMAGE FUSION USING FUZZY LOGIC
QUALITY ASSESSMENT OF PIXEL-LEVEL IMAGE FUSION USING FUZZY LOGICQUALITY ASSESSMENT OF PIXEL-LEVEL IMAGE FUSION USING FUZZY LOGIC
QUALITY ASSESSMENT OF PIXEL-LEVEL IMAGE FUSION USING FUZZY LOGIC
 
3 video segmentation
3 video segmentation3 video segmentation
3 video segmentation
 
An enhanced difference pair mapping steganography method to improve embedding...
An enhanced difference pair mapping steganography method to improve embedding...An enhanced difference pair mapping steganography method to improve embedding...
An enhanced difference pair mapping steganography method to improve embedding...
 
Median based parallel steering kernel regression for image reconstruction
Median based parallel steering kernel regression for image reconstructionMedian based parallel steering kernel regression for image reconstruction
Median based parallel steering kernel regression for image reconstruction
 
MEDIAN BASED PARALLEL STEERING KERNEL REGRESSION FOR IMAGE RECONSTRUCTION
MEDIAN BASED PARALLEL STEERING KERNEL REGRESSION FOR IMAGE RECONSTRUCTIONMEDIAN BASED PARALLEL STEERING KERNEL REGRESSION FOR IMAGE RECONSTRUCTION
MEDIAN BASED PARALLEL STEERING KERNEL REGRESSION FOR IMAGE RECONSTRUCTION
 
An enhanced fireworks algorithm to generate prime key for multiple users in f...
An enhanced fireworks algorithm to generate prime key for multiple users in f...An enhanced fireworks algorithm to generate prime key for multiple users in f...
An enhanced fireworks algorithm to generate prime key for multiple users in f...
 
cuSTINGER: Supporting Dynamic Graph Aigorithms for GPUs : NOTES
cuSTINGER: Supporting Dynamic Graph Aigorithms for GPUs : NOTEScuSTINGER: Supporting Dynamic Graph Aigorithms for GPUs : NOTES
cuSTINGER: Supporting Dynamic Graph Aigorithms for GPUs : NOTES
 
Expert system of single magnetic lens using JESS in Focused Ion Beam
Expert system of single magnetic lens using JESS in Focused Ion BeamExpert system of single magnetic lens using JESS in Focused Ion Beam
Expert system of single magnetic lens using JESS in Focused Ion Beam
 
cuSTINGER: Supporting Dynamic Graph Aigorithms for GPUs (NOTES)
cuSTINGER: Supporting Dynamic Graph Aigorithms for GPUs (NOTES)cuSTINGER: Supporting Dynamic Graph Aigorithms for GPUs (NOTES)
cuSTINGER: Supporting Dynamic Graph Aigorithms for GPUs (NOTES)
 
Review paper on segmentation methods for multiobject feature extraction
Review paper on segmentation methods for multiobject feature extractionReview paper on segmentation methods for multiobject feature extraction
Review paper on segmentation methods for multiobject feature extraction
 
Inertial Sensor Array Calibration Made Easy !
Inertial Sensor Array Calibration Made Easy !Inertial Sensor Array Calibration Made Easy !
Inertial Sensor Array Calibration Made Easy !
 

Similar to Stereo vision-based obstacle avoidance module on 3D point cloud data

Stereo matching based on absolute differences for multiple objects detection
Stereo matching based on absolute differences for multiple objects detectionStereo matching based on absolute differences for multiple objects detection
Stereo matching based on absolute differences for multiple objects detection
TELKOMNIKA JOURNAL
 
Stereo matching algorithm using census transform and segment tree for depth e...
Stereo matching algorithm using census transform and segment tree for depth e...Stereo matching algorithm using census transform and segment tree for depth e...
Stereo matching algorithm using census transform and segment tree for depth e...
TELKOMNIKA JOURNAL
 
Multimode system condition monitoring using sparsity reconstruction for quali...
Multimode system condition monitoring using sparsity reconstruction for quali...Multimode system condition monitoring using sparsity reconstruction for quali...
Multimode system condition monitoring using sparsity reconstruction for quali...
IJECEIAES
 
10.1007@978 3-319-29504-657
10.1007@978 3-319-29504-65710.1007@978 3-319-29504-657
10.1007@978 3-319-29504-657
Manish Gupta
 
IRJET- Geological Boundary Detection for Satellite Images using AI Technique
IRJET- Geological Boundary Detection for Satellite Images using AI TechniqueIRJET- Geological Boundary Detection for Satellite Images using AI Technique
IRJET- Geological Boundary Detection for Satellite Images using AI Technique
IRJET Journal
 
AUTOMATIC IDENTIFICATION OF CLOUD COVER REGIONS USING SURF
AUTOMATIC IDENTIFICATION OF CLOUD COVER REGIONS USING SURF AUTOMATIC IDENTIFICATION OF CLOUD COVER REGIONS USING SURF
AUTOMATIC IDENTIFICATION OF CLOUD COVER REGIONS USING SURF
ijcseit
 
A NOVEL APPROACH TO SMOOTHING ON 3D STRUCTURED ADAPTIVE MESH OF THE KINECT-BA...
A NOVEL APPROACH TO SMOOTHING ON 3D STRUCTURED ADAPTIVE MESH OF THE KINECT-BA...A NOVEL APPROACH TO SMOOTHING ON 3D STRUCTURED ADAPTIVE MESH OF THE KINECT-BA...
A NOVEL APPROACH TO SMOOTHING ON 3D STRUCTURED ADAPTIVE MESH OF THE KINECT-BA...
cscpconf
 
IRJET- 3D Reconstruction of Surface Topography using Ultrasonic Transducer
IRJET- 3D Reconstruction of Surface Topography using Ultrasonic TransducerIRJET- 3D Reconstruction of Surface Topography using Ultrasonic Transducer
IRJET- 3D Reconstruction of Surface Topography using Ultrasonic Transducer
IRJET Journal
 
Robust foreground modelling to segment and detect multiple moving objects in ...
Robust foreground modelling to segment and detect multiple moving objects in ...Robust foreground modelling to segment and detect multiple moving objects in ...
Robust foreground modelling to segment and detect multiple moving objects in ...
IJECEIAES
 
Development of stereo matching algorithm based on sum of absolute RGB color d...
Development of stereo matching algorithm based on sum of absolute RGB color d...Development of stereo matching algorithm based on sum of absolute RGB color d...
Development of stereo matching algorithm based on sum of absolute RGB color d...
IJECEIAES
 
CONFIGURABLE TASK MAPPING FOR MULTIPLE OBJECTIVES IN MACRO-PROGRAMMING OF WIR...
CONFIGURABLE TASK MAPPING FOR MULTIPLE OBJECTIVES IN MACRO-PROGRAMMING OF WIR...CONFIGURABLE TASK MAPPING FOR MULTIPLE OBJECTIVES IN MACRO-PROGRAMMING OF WIR...
CONFIGURABLE TASK MAPPING FOR MULTIPLE OBJECTIVES IN MACRO-PROGRAMMING OF WIR...
ijassn
 
CONFIGURABLE TASK MAPPING FOR MULTIPLE OBJECTIVES IN MACRO-PROGRAMMING OF WIR...
CONFIGURABLE TASK MAPPING FOR MULTIPLE OBJECTIVES IN MACRO-PROGRAMMING OF WIR...CONFIGURABLE TASK MAPPING FOR MULTIPLE OBJECTIVES IN MACRO-PROGRAMMING OF WIR...
CONFIGURABLE TASK MAPPING FOR MULTIPLE OBJECTIVES IN MACRO-PROGRAMMING OF WIR...
ijassn
 
crowd counting.pptx
crowd counting.pptxcrowd counting.pptx
crowd counting.pptx
shubhampawar445982
 
An efficient reconfigurable optimal source detection and beam allocation algo...
An efficient reconfigurable optimal source detection and beam allocation algo...An efficient reconfigurable optimal source detection and beam allocation algo...
An efficient reconfigurable optimal source detection and beam allocation algo...
IJECEIAES
 
A novel wind power prediction model using graph attention networks and bi-dir...
A novel wind power prediction model using graph attention networks and bi-dir...A novel wind power prediction model using graph attention networks and bi-dir...
A novel wind power prediction model using graph attention networks and bi-dir...
IJECEIAES
 
MEDIAN BASED PARALLEL STEERING KERNEL REGRESSION FOR IMAGE RECONSTRUCTION
MEDIAN BASED PARALLEL STEERING KERNEL REGRESSION FOR IMAGE RECONSTRUCTIONMEDIAN BASED PARALLEL STEERING KERNEL REGRESSION FOR IMAGE RECONSTRUCTION
MEDIAN BASED PARALLEL STEERING KERNEL REGRESSION FOR IMAGE RECONSTRUCTION
cscpconf
 
A new function of stereo matching algorithm based on hybrid convolutional neu...
A new function of stereo matching algorithm based on hybrid convolutional neu...A new function of stereo matching algorithm based on hybrid convolutional neu...
A new function of stereo matching algorithm based on hybrid convolutional neu...
IJEECSIAES
 
A new function of stereo matching algorithm based on hybrid convolutional neu...
A new function of stereo matching algorithm based on hybrid convolutional neu...A new function of stereo matching algorithm based on hybrid convolutional neu...
A new function of stereo matching algorithm based on hybrid convolutional neu...
nooriasukmaningtyas
 
Comparative study of optimization algorithms on convolutional network for aut...
Comparative study of optimization algorithms on convolutional network for aut...Comparative study of optimization algorithms on convolutional network for aut...
Comparative study of optimization algorithms on convolutional network for aut...
IJECEIAES
 
Parallel field programmable gate array implementation of the sum of absolute ...
Parallel field programmable gate array implementation of the sum of absolute ...Parallel field programmable gate array implementation of the sum of absolute ...
Parallel field programmable gate array implementation of the sum of absolute ...
TELKOMNIKA JOURNAL
 

Similar to Stereo vision-based obstacle avoidance module on 3D point cloud data (20)

Stereo matching based on absolute differences for multiple objects detection
Stereo matching based on absolute differences for multiple objects detectionStereo matching based on absolute differences for multiple objects detection
Stereo matching based on absolute differences for multiple objects detection
 
Stereo matching algorithm using census transform and segment tree for depth e...
Stereo matching algorithm using census transform and segment tree for depth e...Stereo matching algorithm using census transform and segment tree for depth e...
Stereo matching algorithm using census transform and segment tree for depth e...
 
Multimode system condition monitoring using sparsity reconstruction for quali...
Multimode system condition monitoring using sparsity reconstruction for quali...Multimode system condition monitoring using sparsity reconstruction for quali...
Multimode system condition monitoring using sparsity reconstruction for quali...
 
10.1007@978 3-319-29504-657
10.1007@978 3-319-29504-65710.1007@978 3-319-29504-657
10.1007@978 3-319-29504-657
 
IRJET- Geological Boundary Detection for Satellite Images using AI Technique
IRJET- Geological Boundary Detection for Satellite Images using AI TechniqueIRJET- Geological Boundary Detection for Satellite Images using AI Technique
IRJET- Geological Boundary Detection for Satellite Images using AI Technique
 
AUTOMATIC IDENTIFICATION OF CLOUD COVER REGIONS USING SURF
AUTOMATIC IDENTIFICATION OF CLOUD COVER REGIONS USING SURF AUTOMATIC IDENTIFICATION OF CLOUD COVER REGIONS USING SURF
AUTOMATIC IDENTIFICATION OF CLOUD COVER REGIONS USING SURF
 
A NOVEL APPROACH TO SMOOTHING ON 3D STRUCTURED ADAPTIVE MESH OF THE KINECT-BA...
A NOVEL APPROACH TO SMOOTHING ON 3D STRUCTURED ADAPTIVE MESH OF THE KINECT-BA...A NOVEL APPROACH TO SMOOTHING ON 3D STRUCTURED ADAPTIVE MESH OF THE KINECT-BA...
A NOVEL APPROACH TO SMOOTHING ON 3D STRUCTURED ADAPTIVE MESH OF THE KINECT-BA...
 
IRJET- 3D Reconstruction of Surface Topography using Ultrasonic Transducer
IRJET- 3D Reconstruction of Surface Topography using Ultrasonic TransducerIRJET- 3D Reconstruction of Surface Topography using Ultrasonic Transducer
IRJET- 3D Reconstruction of Surface Topography using Ultrasonic Transducer
 
Robust foreground modelling to segment and detect multiple moving objects in ...
Robust foreground modelling to segment and detect multiple moving objects in ...Robust foreground modelling to segment and detect multiple moving objects in ...
Robust foreground modelling to segment and detect multiple moving objects in ...
 
Development of stereo matching algorithm based on sum of absolute RGB color d...
Development of stereo matching algorithm based on sum of absolute RGB color d...Development of stereo matching algorithm based on sum of absolute RGB color d...
Development of stereo matching algorithm based on sum of absolute RGB color d...
 
CONFIGURABLE TASK MAPPING FOR MULTIPLE OBJECTIVES IN MACRO-PROGRAMMING OF WIR...
CONFIGURABLE TASK MAPPING FOR MULTIPLE OBJECTIVES IN MACRO-PROGRAMMING OF WIR...CONFIGURABLE TASK MAPPING FOR MULTIPLE OBJECTIVES IN MACRO-PROGRAMMING OF WIR...
CONFIGURABLE TASK MAPPING FOR MULTIPLE OBJECTIVES IN MACRO-PROGRAMMING OF WIR...
 
CONFIGURABLE TASK MAPPING FOR MULTIPLE OBJECTIVES IN MACRO-PROGRAMMING OF WIR...
CONFIGURABLE TASK MAPPING FOR MULTIPLE OBJECTIVES IN MACRO-PROGRAMMING OF WIR...CONFIGURABLE TASK MAPPING FOR MULTIPLE OBJECTIVES IN MACRO-PROGRAMMING OF WIR...
CONFIGURABLE TASK MAPPING FOR MULTIPLE OBJECTIVES IN MACRO-PROGRAMMING OF WIR...
 
crowd counting.pptx
crowd counting.pptxcrowd counting.pptx
crowd counting.pptx
 
An efficient reconfigurable optimal source detection and beam allocation algo...
An efficient reconfigurable optimal source detection and beam allocation algo...An efficient reconfigurable optimal source detection and beam allocation algo...
An efficient reconfigurable optimal source detection and beam allocation algo...
 
A novel wind power prediction model using graph attention networks and bi-dir...
A novel wind power prediction model using graph attention networks and bi-dir...A novel wind power prediction model using graph attention networks and bi-dir...
A novel wind power prediction model using graph attention networks and bi-dir...
 
MEDIAN BASED PARALLEL STEERING KERNEL REGRESSION FOR IMAGE RECONSTRUCTION
MEDIAN BASED PARALLEL STEERING KERNEL REGRESSION FOR IMAGE RECONSTRUCTIONMEDIAN BASED PARALLEL STEERING KERNEL REGRESSION FOR IMAGE RECONSTRUCTION
MEDIAN BASED PARALLEL STEERING KERNEL REGRESSION FOR IMAGE RECONSTRUCTION
 
A new function of stereo matching algorithm based on hybrid convolutional neu...
A new function of stereo matching algorithm based on hybrid convolutional neu...A new function of stereo matching algorithm based on hybrid convolutional neu...
A new function of stereo matching algorithm based on hybrid convolutional neu...
 
A new function of stereo matching algorithm based on hybrid convolutional neu...
A new function of stereo matching algorithm based on hybrid convolutional neu...A new function of stereo matching algorithm based on hybrid convolutional neu...
A new function of stereo matching algorithm based on hybrid convolutional neu...
 
Comparative study of optimization algorithms on convolutional network for aut...
Comparative study of optimization algorithms on convolutional network for aut...Comparative study of optimization algorithms on convolutional network for aut...
Comparative study of optimization algorithms on convolutional network for aut...
 
Parallel field programmable gate array implementation of the sum of absolute ...
Parallel field programmable gate array implementation of the sum of absolute ...Parallel field programmable gate array implementation of the sum of absolute ...
Parallel field programmable gate array implementation of the sum of absolute ...
 

More from TELKOMNIKA JOURNAL

Amazon products reviews classification based on machine learning, deep learni...
Amazon products reviews classification based on machine learning, deep learni...Amazon products reviews classification based on machine learning, deep learni...
Amazon products reviews classification based on machine learning, deep learni...
TELKOMNIKA JOURNAL
 
Design, simulation, and analysis of microstrip patch antenna for wireless app...
Design, simulation, and analysis of microstrip patch antenna for wireless app...Design, simulation, and analysis of microstrip patch antenna for wireless app...
Design, simulation, and analysis of microstrip patch antenna for wireless app...
TELKOMNIKA JOURNAL
 
Design and simulation an optimal enhanced PI controller for congestion avoida...
Design and simulation an optimal enhanced PI controller for congestion avoida...Design and simulation an optimal enhanced PI controller for congestion avoida...
Design and simulation an optimal enhanced PI controller for congestion avoida...
TELKOMNIKA JOURNAL
 
Improving the detection of intrusion in vehicular ad-hoc networks with modifi...
Improving the detection of intrusion in vehicular ad-hoc networks with modifi...Improving the detection of intrusion in vehicular ad-hoc networks with modifi...
Improving the detection of intrusion in vehicular ad-hoc networks with modifi...
TELKOMNIKA JOURNAL
 
Conceptual model of internet banking adoption with perceived risk and trust f...
Conceptual model of internet banking adoption with perceived risk and trust f...Conceptual model of internet banking adoption with perceived risk and trust f...
Conceptual model of internet banking adoption with perceived risk and trust f...
TELKOMNIKA JOURNAL
 
Efficient combined fuzzy logic and LMS algorithm for smart antenna
Efficient combined fuzzy logic and LMS algorithm for smart antennaEfficient combined fuzzy logic and LMS algorithm for smart antenna
Efficient combined fuzzy logic and LMS algorithm for smart antenna
TELKOMNIKA JOURNAL
 
Design and implementation of a LoRa-based system for warning of forest fire
Design and implementation of a LoRa-based system for warning of forest fireDesign and implementation of a LoRa-based system for warning of forest fire
Design and implementation of a LoRa-based system for warning of forest fire
TELKOMNIKA JOURNAL
 
Wavelet-based sensing technique in cognitive radio network
Wavelet-based sensing technique in cognitive radio networkWavelet-based sensing technique in cognitive radio network
Wavelet-based sensing technique in cognitive radio network
TELKOMNIKA JOURNAL
 
A novel compact dual-band bandstop filter with enhanced rejection bands
A novel compact dual-band bandstop filter with enhanced rejection bandsA novel compact dual-band bandstop filter with enhanced rejection bands
A novel compact dual-band bandstop filter with enhanced rejection bands
TELKOMNIKA JOURNAL
 
Deep learning approach to DDoS attack with imbalanced data at the application...
Deep learning approach to DDoS attack with imbalanced data at the application...Deep learning approach to DDoS attack with imbalanced data at the application...
Deep learning approach to DDoS attack with imbalanced data at the application...
TELKOMNIKA JOURNAL
 
Brief note on match and miss-match uncertainties
Brief note on match and miss-match uncertaintiesBrief note on match and miss-match uncertainties
Brief note on match and miss-match uncertainties
TELKOMNIKA JOURNAL
 
Implementation of FinFET technology based low power 4×4 Wallace tree multipli...
Implementation of FinFET technology based low power 4×4 Wallace tree multipli...Implementation of FinFET technology based low power 4×4 Wallace tree multipli...
Implementation of FinFET technology based low power 4×4 Wallace tree multipli...
TELKOMNIKA JOURNAL
 
Evaluation of the weighted-overlap add model with massive MIMO in a 5G system
Evaluation of the weighted-overlap add model with massive MIMO in a 5G systemEvaluation of the weighted-overlap add model with massive MIMO in a 5G system
Evaluation of the weighted-overlap add model with massive MIMO in a 5G system
TELKOMNIKA JOURNAL
 
Reflector antenna design in different frequencies using frequency selective s...
Reflector antenna design in different frequencies using frequency selective s...Reflector antenna design in different frequencies using frequency selective s...
Reflector antenna design in different frequencies using frequency selective s...
TELKOMNIKA JOURNAL
 
Reagentless iron detection in water based on unclad fiber optical sensor
Reagentless iron detection in water based on unclad fiber optical sensorReagentless iron detection in water based on unclad fiber optical sensor
Reagentless iron detection in water based on unclad fiber optical sensor
TELKOMNIKA JOURNAL
 
Impact of CuS counter electrode calcination temperature on quantum dot sensit...
Impact of CuS counter electrode calcination temperature on quantum dot sensit...Impact of CuS counter electrode calcination temperature on quantum dot sensit...
Impact of CuS counter electrode calcination temperature on quantum dot sensit...
TELKOMNIKA JOURNAL
 
A progressive learning for structural tolerance online sequential extreme lea...
A progressive learning for structural tolerance online sequential extreme lea...A progressive learning for structural tolerance online sequential extreme lea...
A progressive learning for structural tolerance online sequential extreme lea...
TELKOMNIKA JOURNAL
 
Electroencephalography-based brain-computer interface using neural networks
Electroencephalography-based brain-computer interface using neural networksElectroencephalography-based brain-computer interface using neural networks
Electroencephalography-based brain-computer interface using neural networks
TELKOMNIKA JOURNAL
 
Adaptive segmentation algorithm based on level set model in medical imaging
Adaptive segmentation algorithm based on level set model in medical imagingAdaptive segmentation algorithm based on level set model in medical imaging
Adaptive segmentation algorithm based on level set model in medical imaging
TELKOMNIKA JOURNAL
 
Automatic channel selection using shuffled frog leaping algorithm for EEG bas...
Automatic channel selection using shuffled frog leaping algorithm for EEG bas...Automatic channel selection using shuffled frog leaping algorithm for EEG bas...
Automatic channel selection using shuffled frog leaping algorithm for EEG bas...
TELKOMNIKA JOURNAL
 

More from TELKOMNIKA JOURNAL (20)

Amazon products reviews classification based on machine learning, deep learni...
Amazon products reviews classification based on machine learning, deep learni...Amazon products reviews classification based on machine learning, deep learni...
Amazon products reviews classification based on machine learning, deep learni...
 
Design, simulation, and analysis of microstrip patch antenna for wireless app...
Design, simulation, and analysis of microstrip patch antenna for wireless app...Design, simulation, and analysis of microstrip patch antenna for wireless app...
Design, simulation, and analysis of microstrip patch antenna for wireless app...
 
Design and simulation an optimal enhanced PI controller for congestion avoida...
Design and simulation an optimal enhanced PI controller for congestion avoida...Design and simulation an optimal enhanced PI controller for congestion avoida...
Design and simulation an optimal enhanced PI controller for congestion avoida...
 
Improving the detection of intrusion in vehicular ad-hoc networks with modifi...
Improving the detection of intrusion in vehicular ad-hoc networks with modifi...Improving the detection of intrusion in vehicular ad-hoc networks with modifi...
Improving the detection of intrusion in vehicular ad-hoc networks with modifi...
 
Conceptual model of internet banking adoption with perceived risk and trust f...
Conceptual model of internet banking adoption with perceived risk and trust f...Conceptual model of internet banking adoption with perceived risk and trust f...
Conceptual model of internet banking adoption with perceived risk and trust f...
 
Efficient combined fuzzy logic and LMS algorithm for smart antenna
Efficient combined fuzzy logic and LMS algorithm for smart antennaEfficient combined fuzzy logic and LMS algorithm for smart antenna
Efficient combined fuzzy logic and LMS algorithm for smart antenna
 
Design and implementation of a LoRa-based system for warning of forest fire
Design and implementation of a LoRa-based system for warning of forest fireDesign and implementation of a LoRa-based system for warning of forest fire
Design and implementation of a LoRa-based system for warning of forest fire
 
Wavelet-based sensing technique in cognitive radio network
Wavelet-based sensing technique in cognitive radio networkWavelet-based sensing technique in cognitive radio network
Wavelet-based sensing technique in cognitive radio network
 
A novel compact dual-band bandstop filter with enhanced rejection bands
A novel compact dual-band bandstop filter with enhanced rejection bandsA novel compact dual-band bandstop filter with enhanced rejection bands
A novel compact dual-band bandstop filter with enhanced rejection bands
 
Deep learning approach to DDoS attack with imbalanced data at the application...
Deep learning approach to DDoS attack with imbalanced data at the application...Deep learning approach to DDoS attack with imbalanced data at the application...
Deep learning approach to DDoS attack with imbalanced data at the application...
 
Brief note on match and miss-match uncertainties
Brief note on match and miss-match uncertaintiesBrief note on match and miss-match uncertainties
Brief note on match and miss-match uncertainties
 
Implementation of FinFET technology based low power 4×4 Wallace tree multipli...
Implementation of FinFET technology based low power 4×4 Wallace tree multipli...Implementation of FinFET technology based low power 4×4 Wallace tree multipli...
Implementation of FinFET technology based low power 4×4 Wallace tree multipli...
 
Evaluation of the weighted-overlap add model with massive MIMO in a 5G system
Evaluation of the weighted-overlap add model with massive MIMO in a 5G systemEvaluation of the weighted-overlap add model with massive MIMO in a 5G system
Evaluation of the weighted-overlap add model with massive MIMO in a 5G system
 
Reflector antenna design in different frequencies using frequency selective s...
Reflector antenna design in different frequencies using frequency selective s...Reflector antenna design in different frequencies using frequency selective s...
Reflector antenna design in different frequencies using frequency selective s...
 
Reagentless iron detection in water based on unclad fiber optical sensor
Reagentless iron detection in water based on unclad fiber optical sensorReagentless iron detection in water based on unclad fiber optical sensor
Reagentless iron detection in water based on unclad fiber optical sensor
 
Impact of CuS counter electrode calcination temperature on quantum dot sensit...
Impact of CuS counter electrode calcination temperature on quantum dot sensit...Impact of CuS counter electrode calcination temperature on quantum dot sensit...
Impact of CuS counter electrode calcination temperature on quantum dot sensit...
 
A progressive learning for structural tolerance online sequential extreme lea...
A progressive learning for structural tolerance online sequential extreme lea...A progressive learning for structural tolerance online sequential extreme lea...
A progressive learning for structural tolerance online sequential extreme lea...
 
Electroencephalography-based brain-computer interface using neural networks
Electroencephalography-based brain-computer interface using neural networksElectroencephalography-based brain-computer interface using neural networks
Electroencephalography-based brain-computer interface using neural networks
 
Adaptive segmentation algorithm based on level set model in medical imaging
Adaptive segmentation algorithm based on level set model in medical imagingAdaptive segmentation algorithm based on level set model in medical imaging
Adaptive segmentation algorithm based on level set model in medical imaging
 
Automatic channel selection using shuffled frog leaping algorithm for EEG bas...
Automatic channel selection using shuffled frog leaping algorithm for EEG bas...Automatic channel selection using shuffled frog leaping algorithm for EEG bas...
Automatic channel selection using shuffled frog leaping algorithm for EEG bas...
 

Recently uploaded

AP LAB PPT.pdf ap lab ppt no title specific
AP LAB PPT.pdf ap lab ppt no title specificAP LAB PPT.pdf ap lab ppt no title specific
AP LAB PPT.pdf ap lab ppt no title specific
BrazilAccount1
 
block diagram and signal flow graph representation
block diagram and signal flow graph representationblock diagram and signal flow graph representation
block diagram and signal flow graph representation
Divya Somashekar
 
Student information management system project report ii.pdf
Student information management system project report ii.pdfStudent information management system project report ii.pdf
Student information management system project report ii.pdf
Kamal Acharya
 
Sachpazis:Terzaghi Bearing Capacity Estimation in simple terms with Calculati...
Sachpazis:Terzaghi Bearing Capacity Estimation in simple terms with Calculati...Sachpazis:Terzaghi Bearing Capacity Estimation in simple terms with Calculati...
Sachpazis:Terzaghi Bearing Capacity Estimation in simple terms with Calculati...
Dr.Costas Sachpazis
 
Governing Equations for Fundamental Aerodynamics_Anderson2010.pdf
Governing Equations for Fundamental Aerodynamics_Anderson2010.pdfGoverning Equations for Fundamental Aerodynamics_Anderson2010.pdf
Governing Equations for Fundamental Aerodynamics_Anderson2010.pdf
WENKENLI1
 
Pile Foundation by Venkatesh Taduvai (Sub Geotechnical Engineering II)-conver...
Pile Foundation by Venkatesh Taduvai (Sub Geotechnical Engineering II)-conver...Pile Foundation by Venkatesh Taduvai (Sub Geotechnical Engineering II)-conver...
Pile Foundation by Venkatesh Taduvai (Sub Geotechnical Engineering II)-conver...
AJAYKUMARPUND1
 
RAT: Retrieval Augmented Thoughts Elicit Context-Aware Reasoning in Long-Hori...
RAT: Retrieval Augmented Thoughts Elicit Context-Aware Reasoning in Long-Hori...RAT: Retrieval Augmented Thoughts Elicit Context-Aware Reasoning in Long-Hori...
RAT: Retrieval Augmented Thoughts Elicit Context-Aware Reasoning in Long-Hori...
thanhdowork
 
一比一原版(UofT毕业证)多伦多大学毕业证成绩单如何办理
一比一原版(UofT毕业证)多伦多大学毕业证成绩单如何办理一比一原版(UofT毕业证)多伦多大学毕业证成绩单如何办理
一比一原版(UofT毕业证)多伦多大学毕业证成绩单如何办理
ydteq
 
一比一原版(SFU毕业证)西蒙菲莎大学毕业证成绩单如何办理
一比一原版(SFU毕业证)西蒙菲莎大学毕业证成绩单如何办理一比一原版(SFU毕业证)西蒙菲莎大学毕业证成绩单如何办理
一比一原版(SFU毕业证)西蒙菲莎大学毕业证成绩单如何办理
bakpo1
 
CME397 Surface Engineering- Professional Elective
CME397 Surface Engineering- Professional ElectiveCME397 Surface Engineering- Professional Elective
CME397 Surface Engineering- Professional Elective
karthi keyan
 
Hierarchical Digital Twin of a Naval Power System
Hierarchical Digital Twin of a Naval Power SystemHierarchical Digital Twin of a Naval Power System
Hierarchical Digital Twin of a Naval Power System
Kerry Sado
 
The Benefits and Techniques of Trenchless Pipe Repair.pdf
The Benefits and Techniques of Trenchless Pipe Repair.pdfThe Benefits and Techniques of Trenchless Pipe Repair.pdf
The Benefits and Techniques of Trenchless Pipe Repair.pdf
Pipe Restoration Solutions
 
The role of big data in decision making.
The role of big data in decision making.The role of big data in decision making.
The role of big data in decision making.
ankuprajapati0525
 
power quality voltage fluctuation UNIT - I.pptx
power quality voltage fluctuation UNIT - I.pptxpower quality voltage fluctuation UNIT - I.pptx
power quality voltage fluctuation UNIT - I.pptx
ViniHema
 
Fundamentals of Electric Drives and its applications.pptx
Fundamentals of Electric Drives and its applications.pptxFundamentals of Electric Drives and its applications.pptx
Fundamentals of Electric Drives and its applications.pptx
manasideore6
 
Cosmetic shop management system project report.pdf
Cosmetic shop management system project report.pdfCosmetic shop management system project report.pdf
Cosmetic shop management system project report.pdf
Kamal Acharya
 
Nuclear Power Economics and Structuring 2024
Nuclear Power Economics and Structuring 2024Nuclear Power Economics and Structuring 2024
Nuclear Power Economics and Structuring 2024
Massimo Talia
 
Standard Reomte Control Interface - Neometrix
Standard Reomte Control Interface - NeometrixStandard Reomte Control Interface - Neometrix
Standard Reomte Control Interface - Neometrix
Neometrix_Engineering_Pvt_Ltd
 
WATER CRISIS and its solutions-pptx 1234
WATER CRISIS and its solutions-pptx 1234WATER CRISIS and its solutions-pptx 1234
WATER CRISIS and its solutions-pptx 1234
AafreenAbuthahir2
 
Architectural Portfolio Sean Lockwood
Architectural Portfolio Sean LockwoodArchitectural Portfolio Sean Lockwood
Architectural Portfolio Sean Lockwood
seandesed
 

Recently uploaded (20)

AP LAB PPT.pdf ap lab ppt no title specific
AP LAB PPT.pdf ap lab ppt no title specificAP LAB PPT.pdf ap lab ppt no title specific
AP LAB PPT.pdf ap lab ppt no title specific
 
block diagram and signal flow graph representation
block diagram and signal flow graph representationblock diagram and signal flow graph representation
block diagram and signal flow graph representation
 
Student information management system project report ii.pdf
Student information management system project report ii.pdfStudent information management system project report ii.pdf
Student information management system project report ii.pdf
 
Sachpazis:Terzaghi Bearing Capacity Estimation in simple terms with Calculati...
Sachpazis:Terzaghi Bearing Capacity Estimation in simple terms with Calculati...Sachpazis:Terzaghi Bearing Capacity Estimation in simple terms with Calculati...
Sachpazis:Terzaghi Bearing Capacity Estimation in simple terms with Calculati...
 
Governing Equations for Fundamental Aerodynamics_Anderson2010.pdf
Governing Equations for Fundamental Aerodynamics_Anderson2010.pdfGoverning Equations for Fundamental Aerodynamics_Anderson2010.pdf
Governing Equations for Fundamental Aerodynamics_Anderson2010.pdf
 
Pile Foundation by Venkatesh Taduvai (Sub Geotechnical Engineering II)-conver...
Pile Foundation by Venkatesh Taduvai (Sub Geotechnical Engineering II)-conver...Pile Foundation by Venkatesh Taduvai (Sub Geotechnical Engineering II)-conver...
Pile Foundation by Venkatesh Taduvai (Sub Geotechnical Engineering II)-conver...
 
RAT: Retrieval Augmented Thoughts Elicit Context-Aware Reasoning in Long-Hori...
RAT: Retrieval Augmented Thoughts Elicit Context-Aware Reasoning in Long-Hori...RAT: Retrieval Augmented Thoughts Elicit Context-Aware Reasoning in Long-Hori...
RAT: Retrieval Augmented Thoughts Elicit Context-Aware Reasoning in Long-Hori...
 
一比一原版(UofT毕业证)多伦多大学毕业证成绩单如何办理
一比一原版(UofT毕业证)多伦多大学毕业证成绩单如何办理一比一原版(UofT毕业证)多伦多大学毕业证成绩单如何办理
一比一原版(UofT毕业证)多伦多大学毕业证成绩单如何办理
 
一比一原版(SFU毕业证)西蒙菲莎大学毕业证成绩单如何办理
一比一原版(SFU毕业证)西蒙菲莎大学毕业证成绩单如何办理一比一原版(SFU毕业证)西蒙菲莎大学毕业证成绩单如何办理
一比一原版(SFU毕业证)西蒙菲莎大学毕业证成绩单如何办理
 
CME397 Surface Engineering- Professional Elective
CME397 Surface Engineering- Professional ElectiveCME397 Surface Engineering- Professional Elective
CME397 Surface Engineering- Professional Elective
 
Hierarchical Digital Twin of a Naval Power System
Hierarchical Digital Twin of a Naval Power SystemHierarchical Digital Twin of a Naval Power System
Hierarchical Digital Twin of a Naval Power System
 
The Benefits and Techniques of Trenchless Pipe Repair.pdf
The Benefits and Techniques of Trenchless Pipe Repair.pdfThe Benefits and Techniques of Trenchless Pipe Repair.pdf
The Benefits and Techniques of Trenchless Pipe Repair.pdf
 
The role of big data in decision making.
The role of big data in decision making.The role of big data in decision making.
The role of big data in decision making.
 
power quality voltage fluctuation UNIT - I.pptx
power quality voltage fluctuation UNIT - I.pptxpower quality voltage fluctuation UNIT - I.pptx
power quality voltage fluctuation UNIT - I.pptx
 
Fundamentals of Electric Drives and its applications.pptx
Fundamentals of Electric Drives and its applications.pptxFundamentals of Electric Drives and its applications.pptx
Fundamentals of Electric Drives and its applications.pptx
 
Cosmetic shop management system project report.pdf
Cosmetic shop management system project report.pdfCosmetic shop management system project report.pdf
Cosmetic shop management system project report.pdf
 
Nuclear Power Economics and Structuring 2024
Nuclear Power Economics and Structuring 2024Nuclear Power Economics and Structuring 2024
Nuclear Power Economics and Structuring 2024
 
Standard Reomte Control Interface - Neometrix
Standard Reomte Control Interface - NeometrixStandard Reomte Control Interface - Neometrix
Standard Reomte Control Interface - Neometrix
 
WATER CRISIS and its solutions-pptx 1234
WATER CRISIS and its solutions-pptx 1234WATER CRISIS and its solutions-pptx 1234
WATER CRISIS and its solutions-pptx 1234
 
Architectural Portfolio Sean Lockwood
Architectural Portfolio Sean LockwoodArchitectural Portfolio Sean Lockwood
Architectural Portfolio Sean Lockwood
 

Stereo vision-based obstacle avoidance module on 3D point cloud data

  • 1. TELKOMNIKA Telecommunication, Computing, Electronics and Control Vol. 18, No. 3, June 2020, pp. 1514~1521 ISSN: 1693-6930, accredited First Grade by Kemenristekdikti, Decree No: 21/E/KPT/2018 DOI: 10.12928/TELKOMNIKA.v18i3.14829  1514 Journal homepage: http://journal.uad.ac.id/index.php/TELKOMNIKA Stereo vision-based obstacle avoidance module on 3D point cloud data Eko Purbo Wahyono1 , Endah Suryawati Ningrum2 , Raden Sanggar Dewanto3 , Dadet Pramadihanto4 1 Department of Electrical Engineering, Politeknik Elektronika Negeri Surabaya, Indonesia 2 Department of Mechanical and Energy Engineering, Politeknik Elektronika Negeri Surabaya, Indonesia 3 Department of Information Engineering, Politeknik Elektronika Negeri Surabaya, Indonesia 4 Robotics and Intelligent System Center, Indonesia Article Info ABSTRACT Article history: Received Aug 23, 2019 Revised Jan 29, 2020 Accepted Feb 26, 2020 This paper deals in building a 3D vision-based obstacle avoidance and navigation. In order for an autonomous system to work in real life condition, a capability of gaining surrounding environment data, interpret the data and take appropriate action is needed. One of the required capability in this matter for an autonomous system is a capability to navigate cluttered, unorganized environment and avoiding collision with any present obstacle, defined as any data with vertical orientation and able to take decision when environment update exist. Proposed in this work are two-step strategy of extracting the obstacle position and orientation from point cloud data using plane based segmentation and the resultant segmentation are mapped based on obstacle point position relative to camera using occupancy grid map to acquire obstacle cluster position and recorded the occupancy grid map for future use and global navigation, obstacle position gained in grid map is used to plan the navigation path towards target goal without going through obstacle position and modify the navigation path to avoid collision when environment update is present or platform movement is not aligned with navigation path based on timed elastic band method. Keywords: 3D Vision Obstacle avoidance Obstacle extraction Timed elastic band This is an open access article under the CC BY-SA license. Corresponding Author: Eko Purbo Wahyono, Department of Electrical Engineering, Politeknik Eplektronika Negeri Surabaya, Kampus PENS, Jl. Raya ITS, Keputih, Kec. Sukolilo, Kota SBY, Jawa Timur 60111, Surabaya, Indonesia. Email: eko.pw00@gmail.com 1. INTRODUCTION Recent development on autonomous platform geared towards assisting human in their daily activity mandates all autonomous platform to have a capability to perceive the surrounding environment, and make a suitable decision for action. One essential action is to safely navigate cluttered environment and avoiding collision with any obstacle that presents within the environment. One challenge present is avoiding collision with obstacle and navigating in an unstructured environment [1]. Since unstructured environment have so many possibilities of obstacle position, orientation and or shape, challenge present involved in gaining obstacle position, orientation and size in order to safely plan a path to avoid a collision. One commonly used solution to deal with these problems is 3D vision [2, 3] based solution to gain obstacle position, orientation and size since with 3D vision the system did not need to recognize and learn the object to acquire the information on object position, orientation and size since the raw data itself is already 3D. Many solutions exist on the field of gaining 3D information from the environment, one of the solution is using computer stereo vision [4–6] to
  • 2. TELKOMNIKA Telecommun Comput El Control  Stereo vision-based obstacle avoidance module on 3D point cloud data (Eko Purbo Wahyono) 1515 create an point cloud data [7]. On solving the problems on 3D vision and obstacle avoidance, as the system become progressively more complex and demanding with processing power, the demands for more details on input on environment and faster execution time become more clear. From the input processing side, with 3D vision that create a 3D representation of surrounding environment with great details comes with the price of enormous data size and demand more processing power to process the data. One solution to this problem is to reduce data size while keeping the characteristics, normally this result in reduced environment details. RANSAC (random sample consensus) based method with SAC model [8] is one of the most used method used to reduce data size without sacrificing too much details on environment data and robust in presence of noise [9], This work uses NaN, passthrough and voxel grid filter based on RANSAC to reduce data size. To further reduce computation, parallel computing are used [9–11]. Based from [9] comparison this work used CUDA (compute unified device architecture) parallel computing based on [12]. The reason for parallel computing is to minimize execution time in order to enable the obstacle avoidance module to be in a processing unit combined with another function for platform movement and automation. Environment data must be classified into regions with similar characteristic to facilitate further processing. One of data classifying is data segmentation. This process was required to differentiate data to acquire usable environment data [13-16]. This work using plane-based segmentation to differentiate between obstacle which defined as any point cloud data with vertical plane orientation and the horizontal walking plane itself. This step is used to segment the walking plane and obstacle data.Obstacle data, a representation of environment condition are used to plan the collisionfree path. Since the platform movement lies on x,y axis, the obstacle data in form of point cloud can be converted to grid map [17, 18]. Recent research produce an algorithm that not only able to plan safe path but also deal with environment change and platform disturbances that cause the platform to stray from planned path. One of the algorithm is timed-elastic-band [19]. Many research has been done on improving TEB (timed elastic band) method [20–24], this work base the TEB application from research by [20, 22]. The final goal of this work is a system module with integrated processing for 3D point cloud data similar to [25] with an output of obstacle detection and obstacle position information to produce path planning with an ability of updating the path to deal with environment changes and or platform deviation while record the environment data for future usage and subsequent global path planning. 2. PROPOSED SYSTEM OVERVIEW Below are the general overview of steps taken to process environment data to plan the obstacle avoidance action: − Pre-Processing. Raw point cloud data from a stereo camera are filtered to down sample the data using voxel grid method and remove unnecessary points. − Obstacle extraction. Environment data in form of point cloud are separated between vertical and horizontal plane based on point data orientation, environment interpreted into a grid to get the information of safe moving space and obstacle area, the resultant grid are recorded for future use and global navigation. − Path planning. Plan a path towards goal through safe moving area using occupancy map, keeping clear of obstacles area while updating environment grid and adapt the path when environment data and platform position are changed, publish array of waypoints along the global path and create new waypoints array towards global path target. 3. RESEARCH METHOD 3.1. Point cloud engine On camera initialization, camera calibration and pre-set parameters are loaded to enable image acquisition. Data taken from Stereo 2D camera with focal point 𝑓 and baseline 𝐽 are stereo matched, and triangulated to gain depth data by: 𝑑 = (𝐽 ∗ 𝑓) (𝑋𝑙, 𝑌𝑙 − 𝑋𝑟, 𝑌𝑙) (1) where 𝑋𝑙, 𝑌𝑙 and 𝑋𝑟, 𝑌𝑟 are matching pixel between left and right camera respectively, the resultant depth data is combined with RGB data from the camera and converted into 3D point cloud data format by normalizing the pixel coordinate 𝑂(𝑋, 𝑌, 𝑑) into 3D coordinate 𝑃(𝑥, 𝑦, 𝑧) with camera baseline 𝐽 using: 𝑦 = 𝑑, 𝑥 = 𝑥𝑙 ∗ 𝑑 𝐽 , 𝑧 = 𝑦𝑙 ∗ 𝑑 𝐽 (2) to be processed afterwards by subsequent sub-systems. Point cloud resultant of 1 and 2 have parallel planes in real condition shown as parallel planes, therefore eliminating the need of calculating camera perspective. All these processes are done in an early stage inside the camera itself.
  • 3.  ISSN: 1693-6930 TELKOMNIKA Telecommun Comput El Control, Vol. 18, No. 3, June 2020: 1514 - 1521 1516 3.2. Filtering Since dense point cloud data while provide more details on environment leads to longer execution time needed for processing, therefore a method for keeping environment details while reducing point count that leads to faster execution is needed [26]. This system uses voxel grid filtering which group data with similar characteristics and replace the group a single data that represent the whole group, this filter was chosen for the robust characteristic of the filter. Point cloud data is down-sampled using voxel grid method. A defined Oriented bounding box 𝐵 along with the minimum and maximum value of point cloud in 𝑥, 𝑦, 𝑧 axis are used to calculate voxel grid 𝐷 𝑘𝑙𝑚 in size of 𝑣𝑥 × 𝑣 𝑦 × 𝑣𝑧 which defined as: 𝐷 𝑘𝑙𝑚(0 < 𝑘 < 𝑥, 0 < 𝑙 < 𝑦, 0 < 𝑚 < 𝑧) (3) with the voxel grid size defined, assign each grid to each point 𝑃𝑛 in point cloud 𝑃. After each grid 𝐷 𝑘𝑙𝑚 assigned and the center gravity point 𝑣𝑥𝑦𝑧 for each grid 𝐷 𝑘𝑙𝑚 with 𝑘𝑖, 𝑙𝑖, 𝑚𝑖 and 𝑘 𝑛, 𝑙 𝑛, 𝑚 𝑛 as the outmost point of the 𝐷 𝑘𝑙𝑚 grid calculated by: 𝑣𝑥 = 𝐷 𝑘 𝑖 + 𝐷 𝑘 𝑛 2 , 𝑣 𝑦 = 𝐷𝑡 𝑖 + 𝐷𝑡 𝑛 2 , 𝑣𝑧 = 𝐷 𝑚 𝑖 + 𝐷 𝑚 𝑛 2 (4) all points 𝑃𝑥𝑦𝑧 in voxel are replaced by center gravity point of each grid 𝑣𝑥𝑦𝑧 with final position point set 𝑃´. Process all voxel grid to acquire 𝑃´ by: 𝑃′ = 𝑋 𝑣 𝑥𝑦𝑧 (0 < 𝑥 < 𝑥 𝑚𝑎𝑥,0 < 𝑦 < 𝑦 𝑚𝑎𝑥, 0 < 𝑧 < 𝑧 𝑚𝑎𝑥) (5) Defined size of a voxel is used to group neighbouring point of an initial point Pi with similar characteristics and using the Pi as centroid all other point removed leaving the centroid point data afterwards. Small voxel size, while keep more details of raw point cloud data, leads to longer execution time while bigger voxel size have smaller execution time but loses more details. Resultant of this step are as shown on Figure 1 while voxel grid is slower, it represents the underlying surface more accurately without sacrificing keypoint of 3D point cloud data [27]. This characteristic will enable the segmentation process to segment the data properly. The resultant data from this step still contains all data within camera’s field of view, since the system do not need roof information and existence of roof data in occupancy grid map process can lead to no available moving space, hence the removal of roof point cloud data is needed. The system use a passthrough filter with maximum vertical parameters to exclude roof point cloud [27], if passthrough filter is not exist, the roof segmented will be defined as an obstacle since the roof plane itself lies parallel with walking plane, this happened because the segmentation process only separate vertical and horizontal point cloud data orientation. Because the roof will not hinder platform movement and including roof as obstacles result in no free obstacle area, the system exclude ceiling point cloud data from being processed by the segmentation process by filter the data using passthrough method: 𝑃𝑥𝑦𝑧 = 𝑋 𝑝 𝑥𝑦𝑧 (𝑧|𝑚 < 𝑧 < 𝑛) (6) with P as the resultant point cloud, 𝑝 as an individual point, m as the minimum z axis value and n as maximum z axis value. Figure 1. Filtering result
  • 4. TELKOMNIKA Telecommun Comput El Control  Stereo vision-based obstacle avoidance module on 3D point cloud data (Eko Purbo Wahyono) 1517 3.3. Segmentation After pre-processing step, the point cloud data segmented to gain information on walking plane as free moving region and obstacle data. With the definition of walking plane as a plane in 𝑥, 𝑦 axis. By defining the plane’s mathematical model as: 𝜑 = 𝛼𝑥 + 𝛽𝑦 + 𝛾𝑧 + 𝛿 = 0 (7) where 𝛼, 𝛽, 𝛾 on (8) are the parameters of the mathematical model of the plane and k,l,m are the independent variables of the model to define a plane. To determine if point 𝑃 = (𝑥0, 𝑦0, 𝑧0) fit plane 𝜑 = 𝛼 × 𝑘 + 𝛽 × 𝑙 + 𝛾 × 𝑚 + 𝛿, the perpendicular distance of the point to the plane was calculated using: 𝑅( 𝑃, 𝜙) = |𝛼 × 𝑥0 + 𝛽 × 𝑦0 + 𝛾 × 𝑧0 + 𝛿| √𝛼2 + 𝛽2 + 𝛾22 (8) If the point is below the threshold value, it can be considered as an inlier to the plane. By using (7) to define the walking plane model and isolate the walking plane point cloud data from others using (8) resulted in separation of the plane inlier from other point, the system has gained both free region in form of inlier points and the obstacle point cloud data itself to plan the obstacle avoidance path. Result of this step is shown by Figure 2. Figure 2. Segmentation step comparison 3.4. Occupancy grid map Segmented point cloud data are used for building occupancy grid map to acquire obstacle position relative to the platform and the subsequent map can be recorded for future use or for global path planning to already recorded area. Occupancy grid map created using obstacle point cloud data to determine if a grid occupied by an obstacle that will cause collision [18]. Each cell Ci = x, y with a fixed size for each point Pi = x, y, z 𝐹𝑙𝑎𝑔 𝑓𝑟𝑒𝑒 { 𝐹𝑎𝑙𝑠𝑒∀𝑃𝑖 𝑥,𝑦 = 𝐶𝑖 𝑥,𝑦 𝑇𝑅𝑈𝐸∀𝑜𝑡ℎ𝑒𝑟𝑤𝑖𝑠𝑒 (9) This step gains areas where the platform can safely move without risk of collision without the need of single out every obstacle and calculate the centroid and position of each obstacle by measuring each area and comparing the width with the minimum width required by the platform. The result as shown on Figure 3. 3.5. Path planning This part of the system have two parallel process, the first one, path planner create a global solution for the platform to move towards the target. The second system handle disturbance force on a platform and output correction command to deal with small changes in environment and unexpected obstacle. Based on timed-elastic-band method by Quinlan [19] with development on sparse model [21] to advanced trajectories [20] with MPC approach towards TEB methods [22]. Overview of this step is as shhown on Figure 4. This method was used because the behavior of the platform is not determined at the planning level, yet local disturbances will not hinder the system ability to reach goals. This system deals with local disturbances by deforming the path when environment changes are detected. Despite this step, the system still maintain a complete collision-free path towards a determined goal. Find the shortest path towards determined goals.
  • 5.  ISSN: 1693-6930 TELKOMNIKA Telecommun Comput El Control, Vol. 18, No. 3, June 2020: 1514 - 1521 1518 Figure 3. Occupancy grid map result Figure 4. Path planning 𝑤( 𝑣, 𝑆𝑖) = { 0 min{𝑤(( 𝑢, 𝑣)) + 𝑑(𝑣, 𝑆𝑖)} ∞ (10) With (10) produces global path result that used by TEB to create a series of waypoints. The shortest path, taken as a series of a fixed number 𝑛 of waypoint 𝑃𝑖 with tolerance radius 𝑟 which comprise. 𝑃𝑖 = ( 𝑥𝑖 𝑦𝑖 ) (11) Array of waypoint 𝑃𝑖 can be denoted as: 𝑄 = { 𝑃𝑖}𝑖=1,2,….,𝑛 (12)
  • 6. TELKOMNIKA Telecommun Comput El Control  Stereo vision-based obstacle avoidance module on 3D point cloud data (Eko Purbo Wahyono) 1519 This system does not pursue fastest trajectory and in a context of timed elastic band, it only optimizes the location of intermediate waypoint as the system does not have a boundary of final platform state, therefore the change in time for each consecutive waypoint (∆𝑇𝑖) are fixed and can be denoted as (13). 𝜏 = {Δ𝑇𝑖}𝑖=1,2,…,𝑛−1 (13) Timed elastic band function consisted of (14). 𝐵 ∶= (𝑄, 𝜏) (14) Optimal band calculation is calculated by minimizing the objective function. 𝑓( 𝐵) = ∑ 𝛾 𝑘Γk(𝐵) 𝑘 (15) With an array of waypoints Pi from path planning result, the system compare current platform position and orientation information with waypoints coordinate and update waypoints array when the system achieve waypoints or if the system stray from global path and previous waypoint array. 4. RESULTS AND ANALYSIS The result of voxel grid filtering with 0.05 m size voxel, the resultant cloud shows a drop of 98.2% in point cloud count from 921600 point to 16664 point. With only 1.8% of the data remains while maintains similar characteristics with the raw data. This result shows that voxel grid preserved underlying plane of the raw point cloud data while reducing point cloud data size as shown on Figure 1. Filtering sub-system takes 86 ms average execution time with 720p raw data size with an acceptable result for segmentation while reducing the data size and removal of unnecessary data proven by the success on segmentation step as shown on 2a, faster execution time leads to more loss of details, which result in failure of segmentation. Execution time for filtering subsystem can be improved by the usage of parallel computing for each filtering model for faster execution. Similar method can be applied for segmentation subsystem which takes 260 ms average execution time. Shorter execution time leads to faster map update and faster decision result. Segmentation resulted in all point cloud data with vertical plane orientation are separated from the point cloud data with horizontal plane orientation. Compared to colour based point cloud clustering, the result shows that the colour based segmentation result are still detecting some vertical object as a same group as the horizontal walking plane, while the system’s segmentation based on each point orientation separate all points with vertical plane orientation. Despite system success of segmentation between horizontal walking plane and obstacle data, the system fail to process some data when stereo matching failure exist, this characteristics make neighbouring pixel with a significant distance in 3D environment result in an almost horizontal gradient, therefore the system segmentation does not segment this area. The comparison between plane based segmentation and colour based segmentation are shown on Figure 2 occupancy grid map resulted in information of each obstacle data position therefore safe moving area are acquired where no obstacle are present. The system will calculate the safe area around the obstacle grid to account for platform size and odometry drift. All these information are successfully recorded proven by the ability of the system to plan navigation path through already mapped area Figure 3 show that where obstacle point cloud exist, the corresponding cells show as black cells with no failure for all obstacle point information. Path planning resulted the shortest path in regard to platform size to avoid collision with obstacle area and modify initial path to target to avoid an obstacle and adapt to new environment data this is proven by moving the camera according to path planning resulted in arriving to target coordinate without any collision shown on Figure 5 (a) and Figure 5 (b) shows the same goal position with updated environment information and platform position. Figure 5 (b) shows the system update the path plan towards the goal when the platform is moved outside the planned path and new obstacle information is acquired from the environment and update path when the platform moved inside planned path Figure 5 (c). The system only produce goal array position as long as the area width for the path planning are wider than the required width of the platform and will terminate the path planning when the required condition are not met, the system will produce path as close as the target as possible when the condition are met, shown on Figure 5 (d), farthest arrow’s position have area width of more than 0.7 m, or shown at the Figure 5 (d) as the blue circle diameter are 7 grid with each grid have the width of 0.1 m, while further possible position did not met this requirement, therefore the system are fulfilling the target of creating safe path without possible collision.
  • 7.  ISSN: 1693-6930 TELKOMNIKA Telecommun Comput El Control, Vol. 18, No. 3, June 2020: 1514 - 1521 1520 (a) (b) (c) (d) Figure 5. Obstacle avoidance path modification, (a) initial path data, (b) after environment and position update (c) After position update, (d) Minimum width requirement not met 4. CONCLUSION Filtering sub-system perform amicably with total execution time of 96ms on average. This result of execution time is done on 720p raw point cloud data size with 0.05m voxel size and limit passthrough of 1.2m above ground. All sub-sub-system of filtering step perform as intended.Obstacle Extraction sub-system extract all obstacle data and mapped with appropriate result compared to the real environment. While segmentation process have a point of failure when the resultant of stereo matching did not produce the same result as the real condition which result in segmentation failure while occupancy grid map produces the exact result of every segmented obstacle data. Path planning sub-system produces appropriate path and correction command when dealing with environment and platform update while keeping the recorded data for future use and for global navigation. This system did not deal with global path planning with previously mapped environment and has no superposition odometry present. This system has provided a capability of obstacle avoidance based on 3D point cloud data interpreted by equation 10 to form basic intelligence based on TEB model to deal with collisionfree path planning and deals with platform deviation. REFERENCES [1] K. Sabe, et al., “Obstacle avoidance and path planning for humanoid robots using stereo vision,” IEEE International Conference on Robotics and Automation, vol. 1, pp. 592–597, 2004. [2] S. Kumar, D. Gupta, and S. Yadav, “Sensor fusion of laser & stereo vision camera for depth estimation and obstacle avoidance,” International Journal of Computer Applications, vol. 1, no. 26, pp. 22–27, 2010. [3] P. S. Sharma and D. N. G. Chitaliya, “Obstacle avoidance using stereo vision: a survey,” International Journal of Innovative Research in Computer and Communication Engineering, vol. 3, no. 1, pp. 24-29, 2015. [4] A. Hidalgo-Paniagua, et al., “A comparative study of parallel RANSAC implementations in 3D space,” Int. J. Parallel Program., vol. 43, no. 5, pp. 703–720, 2015. [5] D. Pramadihanto, et al., “Merging of depth image between stereo camera and structure sensor on robot flow vision,” Int. J. on Advan. Sci., Enginee. and Inform. Tech., vol. 7, no. 3, pp. 1014-1025, 2017. [6] S. A. Waskitho, et al., “FloW vision: Depth image enhancement by combining stereo RGB-depth sensor,” International Conference on Knowledge Creation and Intelligent Computing, pp. 182–187, 2016.
  • 8. TELKOMNIKA Telecommun Comput El Control  Stereo vision-based obstacle avoidance module on 3D point cloud data (Eko Purbo Wahyono) 1521 [7] S. Ghosh and J. Biswas, “Joint perception and planning for efficient obstacle avoidance using stereo vision,” IEEE/RSJ International Conference on Intelligent Robots and Systems, pp. 1026–1031, 2017. [8] R. B. Rusu and S. Cousins, “3D is here: Point Cloud Library (PCL),” IEEE International Conference on Robotics and Automation, pp. 1–4, 2011. [9] S. A. Waskitho, et al., “Point cloud library (PCL): Module sample consensus,” International Conference on Knowledge Creation and Intelligent Computing, pp. 182–187, 2016. [10] A. Hidalgo-Paniagua, et al., “A comparative study of´ Parallel RANSAC implementations in 3D space,” International Journal of Parallel Programming, vol. 43, no. 5, pp. 703–720, 2015. [11] R. B. Rusu and S. Cousins, “3D is here: Point Cloud Library (PCL),” IEEE International Conference on Robotics and Automation, vol. 42, no. 3, pp. 1-4, 2011. [12] L. Vinet and A. Zhedanov, “A missing’ family of classical orthogonal polynomials,” Journal of Physics A: Mathematical and Theoretical, vol. 44, no. 8, pp. 085201, 2011. [13] C. Moreno and M. Li, “A comparative study of filtering methods for point clouds in real-time video streaming,” Lecture Notes in Engineering and Computer Science, vol. 1, pp. 388-393, 2016. [14] A. Nguyen and B. Le, “3D point cloud segmentation: A survey,” 6th IEEE Conference on Robotics, Automation and Mechatronics (RAM), pp. 225–230, 2013. [15] B. Sun and P. Mordohai, “Oriented point sampling for plane detection in unorganized point clouds,” International Conference on Robotics and Automation, pp. 2917–2923, 2019. [16] F. A. Limberger and M. M. Oliveira, “Real-time detection of planar regions in unorganized point clouds,” Pattern Recognition, vol. 48, no. 6, pp. 2043–2053, 2015. [17] X. Lin, J. R. Casas, and M. Pardas, “3D point cloud segmentation using a fully connected conditional random field,” 25th European Signal Processing Conference, vol. 2017, pp. 66–70, 2017. [18] Y. Li, and Y. Ruichek, “Building variable resolution occupancy grid map from stereoscopic system &#x2014; A quadtree based approach,” IEEE Intelligent Vehicles Symposium, pp. 744–749, 2013. [19] E. Horvath and C. R. Pozna, “Probabilistic occupancy grid map building for Neobotix MP500 robot,” 13th Workshop on Positioning, Navigation and Communications, pp. 1–4, 2016. [20] S. Quinlan, and O. Khatib, “Elastic bands: connecting path planning and control,” Proceedings IEEE International Conference on Robotics and Automation, pp. 802–807, 2016. [21] M. Keller, et al., “Planning of optimal collision avoidance trajectories with timed elastic bands,” IFAC Proceedings Volumes, vol. 47, no. 3, pp. 9822–9827, 2014. [22] C. Rosmann, et al., “Efficient trajectory optimization using a sparse model,” 2013 European Conference on Mobile Robots, pp. 138–143, 2013. [23] C. Rosmann, F. Hoffmann, and T. Bertram, “Timed-Elastic-Bands for time-optimal pointto-point nonlinear model predictive control,” European Control Conference, pp. 3352–3357, 2015. [24] F. Ulbrich, et al., “Stable timed elastic bands with loose ends,” IEEE Intelligent Vehicles Symposium, pp. 186–192, 2017. [25] B. Magyar, et al., “Timed-elastic bands for manipulation motion planning,” IEEE Robotics and Automation Letters, vol. 4, no. 4, pp. 3513–3520, 2019. [26] C. Moreno and M. Li, “A comparative study of filtering methods for point clouds in real-time video streaming,” International Conference on Knowledge Creation and Intelligent Computing, pp. 182–187, 2016. [27] J. Bedkowski, et al., “Open source robotic 3D mapping framework with ROS robot operating system, PCL Point Cloud Library and Cloud Compare,” International Conference on Electrical Engineering and Informatics, pp. 644–649, 2015.