SlideShare a Scribd company logo
1 of 8
Download to read offline
TELKOMNIKA Telecommunication, Computing, Electronics and Control
Vol. 18, No. 2, April 2020, pp. 1030~1037
ISSN: 1693-6930, accredited First Grade by Kemenristekdikti, Decree No: 21/E/KPT/2018
DOI: 10.12928/TELKOMNIKA.v18i2.14752  1030
Journal homepage: http://journal.uad.ac.id/index.php/TELKOMNIKA
Scheme for motion estimation
based on adaptive fuzzy neural network
Fredy Martínez, Cristian Penagos, Luis Pacheco
Facultad Tecnológica, Universidad Distrital Francisco José de Caldas, Colombia
Article Info ABSTRACT
Article history:
Received Jul 13, 2019
Revised Jan 4, 2020
Accepted Feb 19, 2020
Many applications of robots in collaboration with humans require the robot to
follow the person autonomously. Depending on the tasks and their context, this
type of tracking can be a complex problem. The paper proposes and evaluates
a principle of control of autonomous robots for applications of services to
people, with the capacity of prediction and adaptation for the problem
of following people without the use of cameras (high level of privacy) and with
a low computational cost. A robot can easily have a wide set of sensors for
different variables, one of the classic sensors in a mobile robot is the distance
sensor. Some of these sensors are capable of collecting a large amount
of information sufficient to precisely define the positions of objects
(and therefore people) around the robot, providing objective and quantitative
data that can be very useful for a wide range of tasks, in particular, to perform
autonomous tasks of following people. This paper uses the estimated distance
from a person to a service robot to predict the behavior of a person, and thus
improve performance in autonomous person following tasks. For this, we use
an adaptive fuzzy neural network (AFNN) which includes a fuzzy neural
network based on Takagi-Sugeno fuzzy inference, and an adaptive learning
algorithm to update the membership functions and the rule base. The validity
of the proposal is verified both by simulation and on a real prototype.
The average RMSE of prediction over the 50 laboratory tests with different
people acting as target object was 7.33.
Keywords:
Adaptive learning algorithm
Fuzzy neural network
Motion planning
Service robot
This is an open access article under the CC BY-SA license.
Corresponding Author:
Fredy Martínez,
Facultad Tecnológica,
Universidad Distrital Francisco José de Caldas Bogotá, Colombia.
Email: fhmartinezs@udistrital.edu.co
1. INTRODUCTION
Service robotics is one of the applications of robotic systems that arouses the most interest among
the general population due to its high expectations and possibilities, but at the same time is one of the areas
with the most unsolved engineering problems [1]. Robots that interact with humans in human environments
must solve problems of path planning, image processing, interaction with the environment, fine manipulation,
communication, and in particular, direct interaction with the human being [2]. This interaction involves many
engineering problems, not only considering the safety problems for both parties during the interaction, which
is a net engineering problem [3, 4], but the interaction is conditioned by human behavior, which is quite
unpredictable. In domestic applications, for example, applications in which the robot must be attentive to
children or elderly, we expect the machine to always be close to the person under care, moving with him to
provide their services, but without interfering with his normal activity. Given the unknown nature
of the movement of people in the environment and the high complexity and dynamics of the environments,
TELKOMNIKA Telecommun Comput El Control 
Scheme for motion estimation based on adaptive fuzzy neural network (Fredy Martinez)
1031
adaptable tracking systems are required, with the ability to learn and work in real time. A typical characteristic
of service robots is that their tasks are carried out in dynamic, unstructured and unknown environments,
generally without identifiable characteristics. The robot must be able to navigate and interact in any
environment in which people find themselves, which characterizes the physical structure of the robot
(size, type of displacement, actuators, etc.) and its needs for sensing and acting (often equivalent to human).
In addition, the processing of information and the response of the robot must be in real time. This is why these
sensors are so important for autonomous robots in general [5, 6].
Currently a crucial element in the design of this type of systems are the active robotic sensors, which
have become high performance tools capable of considerably reducing the processing requirements of the robot
control unit. These systems have gained great commercial recognition, even at the military level, thanks to
their embedded structure that, together with sensors that observe physical variables directly, process this
information in real time to extract relevant information for the robot. This kind of sensors has promoted
research in information-driven strategies for the development of tasks with robots, as well as
the implementation of algorithms for digital signal processing and control schemes oriented to these sensor [4].
As minimum requirements, the robot must be able to define its distance and size. In other cases, it is also
necessary to know its height to define interaction strategies (pick up an object from a table, for example).
Depending on the application it is possible to use different kinds of sensors, in interaction with human
environments are very important optical sensors [4, 6, 7], however, when the person has been identified, and
the goal is to make a basic tracking of him, the most important sensors are the distance sensors [8, 9, 10].
The camera-supported optical sensors in robotics have been widely used to solve the problem of
identifying and tracking people. The schemes, though far from autonomous implementation, provide high
levels of performance for both problems [11, 12]. This strategy is known as Visual Servoing or Vision-Based
Robot Control (VS) and is characterized by having as feedback information the image of a camera [13].
The goal is to support robot decision making with eyes that take optical information from its own
perspective [14]. However, the use of cameras capable of continuously recording people’s personal lives
involves serious privacy issues, and despite the guarantees of encryption and non-sharing of information, fear
prevails [15]. In addition, the visual information captured by the cameras is, in fact, excessive for the realization
of certain tasks. Distance sensors are also widely used in these applications [11], and unlike video cameras,
they have greater acceptance to work between people because they record less private information. The most
important characteristic of the following task is that it is strongly focused on the person under care. This is a
common case in service robots that provide some service to a person [16-18]. Practically speaking, this means
that the robot must be aware of the person’s behavior. Similarly, the robot will ignore other elements of
the environment unless they force the robot’s response [19, 20]. In this sense, we only study in our research
the autonomous response of the robot to the behavior of the person.
In our research, we define the task of following people, in the context of service robots, as a
high-level task that the robot performs at all times in parallel with its interaction tasks [21]. In the context of
the task, the robot does not know the person’s movement dynamics, whether the person is going to remain still,
or where it is going when walking. In this way, the robot needs to infer the person’s movement beforehand and
act accordingly. In addition, the design of the movement scheme must take into account the aforementioned
aspects of navigation, interaction, and sensing, as these are key elements in the robot’s final action. These
parameters are combined with an adaptive learning scheme and an inference machine based on fuzzy inference.
These two elements form the Fuzzy Neural Network (FNN) designed for decision making, which is supplied
by our active distance sensor [22, 23].
2. PROBLEM FORMULATION
The goal of this research is to develop a robust and high-performance software tool that allows
the development of autonomous tasks of people follow-up by a small autonomous robot. The work is strongly
motivated by the need for this feature as part of the routine interaction of an assistive robot that operates in
unknown indoor environments.
Let W ⊂ ℝ2
be the closure of a contractible open set in the plane that has a connected open interior
with obstacles that represent inaccessible regions. Let 𝓞 be a set of obstacles, in which each O ⊂ 𝓞 is closed
with a connected piecewise-analytic boundary that is finite in length. The position of obstacles in
the environment changes over time in an unknown way, but they are detectable by distance sensors. In addition,
the obstacles in 𝓞 are pairwise-disjoint and countably finite in number.
Let E ⊂ W be the free space in the environment, which is the open subset of W with the obstacles
removed. This space can be freely navigated by the robot, but it can also be occupied at any time by an obstacle.
The robot knows the environment W (and E) from observations, using sensors. These observations allow him
to build an information space I. An information mapping is of the form:
 ISSN: 1693-6930
TELKOMNIKA Telecommun Comput El Control, Vol. 18, No. 2, April 2020: 1030 - 1037
1032
𝑞: 𝐸 → 𝑆 (1)
where S denote an observation space, constructed from sensor readings over time, i.e., through an observation
history of the form (2).
𝑜̃: [0, 𝑡] → 𝑆 (2)
The interpretation of this information space, i.e., I ✕ S ⟶ I, is that which allows the robot to make decisions.
The problem can be expressed as the search for a function u for a specific set of conditions between a certain
obstacle and the robot, from a set of robot sensed data y ⊂ S and a target function g.
𝑓: 𝒚 × 𝒈 → 𝒖 (3)
3. METHODOLOGY
As part of the research, the research group has previously developed an active sensor that processes
distance information to define the motion of an autonomous robot in indoor environments using real-time
analysis of raw data from a group of nine infrared sensors [22]. The infra-red sensor captures distance data in
real time producing a large database that the robot analyzes according to previous experiences to directly define
distance on the horizontal plane to the object (person). Observing the dependence of data with the topology of
the environment, the active sensor uses a model based on a long short-term memory (LSTM) network to
estimate distances [24]. Thanks to this model it is possible to define coordinates on the plane of the environment
to an obstacle of interest, regardless of the characteristics of the obstacle or its position with respect to
the robot. The historical behavior of the variables is also used to differentiate the person of interest from other
elements and obstacles of the environment, however, to differentiate between different people we have used
specific marks on the person of interest.
The active sensor delivers the coordinates x and y to the obstacle under study (person to follow) with
respect to an axis defined on the geometrical center of the robot. This sensor has a real-time processing unit
that assigns values to the raw data captured by the nine infra-red sensors using models based on an LSTM
network. These data also define the heading θ and allow to determine speed and acceleration Figure 1.
Figure 1. Variables and dimensions axes on the plane with respect to the robot
The proposed system is composed of a fuzzy neural network (FNN) and an adaptive learning
algorithm Figure 2. The neural network is made up of five layers: a layer of input variables (two-dimensional
distances from the robot to the obstacle, the relative velocity between robot and obstacle, the heading angle
and acceleration), the second layer corresponds to the membership functions, the third layer is of reasoning
rules with Takagi-Sugeno type inference, the fourth layer corresponding to the fuzzy quantification of
the output variable, and the fifth layer containing the output nodes (output variable, robot heading angle).
The input vector has the following format (4):
𝑋 = [𝛥𝑥, 𝛥𝑦, 𝛥𝑣, 𝜃, 𝑎𝑐] (4)
TELKOMNIKA Telecommun Comput El Control 
Scheme for motion estimation based on adaptive fuzzy neural network (Fredy Martinez)
1033
We define three trapezoidal fuzzy sets for each of the input variables uniformly distributed throughout
the discourse universe of each variable. This design generated a total of 243 fuzzy rules each with the following
structure (5):
𝑅𝑖: 𝐼𝐹 (∆𝑥 𝑖𝑠 𝐴𝑖) 𝑎𝑛𝑑 (∆𝑦 𝑖𝑠 𝐵𝑖) 𝑎𝑛𝑑 (∆𝑣 𝑖𝑠 𝐶𝑖)
𝑎𝑛𝑑 (𝜃 𝑖𝑠 𝐷𝑖) 𝑎𝑛𝑑 (𝑎𝑐 𝑖𝑠 𝐸𝑖)
𝑇𝐻𝐸𝑁 ℎ𝑖 𝑖𝑠 𝑓𝑖(∆𝑥, ∆𝑦, ∆𝑣, 𝜃, 𝑎𝑐)
(5)
Figure 2. Proposed prediction system architecture
A, B, C, D, and E correspond to a fuzzy set defined by its membership function, and fi corresponds to
the inference consequence for the output variable and according to the evaluated ith fuzzy rule. We use a
Takagi-Sugeno-Kang fuzzy inference in order to obtain an output membership function defined from
the input variables (a linear function defined by the input vector).
Due to the mechanical delays in the motion responses of the robot platform, we decided not to use
fuzzy sets with triangular or Gaussian shapes [25], instead, we chose trapezoidal functions that allowed
constant output behaviors for certain ranges of input variables Figure 3. The output inferred h0 is determined
as the weighted average of the outputs of each rule for the input vector X0 = [Δx0, Δy0, Δv0, θ0, ac0] (6), where
ωi is the membership degree for the ith rule.
ℎ̂0 =
∑ 𝜔𝑖 ∙ 𝑓𝑖
𝑘
𝑖=1 (∆𝑥0, ∆𝑦0, ∆𝑣0, 𝜃0, 𝑎𝑐0)
∑ 𝜔𝑖
𝑘
𝑖=1
(6)
We use a Least Squares Estimator (LSE) to perform parameter estimation by training the linear
functions. Each of these functions has the general form (7).
𝑓(𝑋) = 𝑏0 + 𝑏1 𝑋(1) + 𝑏2 𝑋(2) + 𝑏3 𝑋(3) + 𝑏4 𝑋(4) + 𝑏5 𝑋(5) (7)
To increase the performance of the prediction scheme, we use an adaptive learning algorithm to improve the
inference machine, particularly by adjusting the membership functions defined initially Figure 3 from the
behavior of the prediction error.
𝑒 = ℎ − ℎ̂ (8)
 ISSN: 1693-6930
TELKOMNIKA Telecommun Comput El Control, Vol. 18, No. 2, April 2020: 1030 - 1037
1034
During training each fuzzy set is replaced by a set that improves the performance of the estimator, i.e., produces
less error according to the behavior of the RMSE.
Figure 3. Initial membership functions of the five input variables
4. FINDINGS
Our robot platform consists of two robots integrated in a single system: Nao robot from SoftBank
Group, and our ARMOS TurtleBot 1 robot Figure 4. Our future objective is to develop our platform for service
applications, we have created a first mobile functional prototype, and we are experimenting with different
manipulator prototypes, but in the meantime, this integration of robots makes up our robotic solution. The Nao
robot is used for direct interaction with human beings taking advantage of their morphology, sensors, actuators
and responsiveness. The ARMOS TurtleBot 1 robot is used as a robust navigation platform in dynamic indoor
environments. The two robots share information via a router installed in the ARMOS TurtleBot 1. The ARMOS
TurtleBot 1 robot also has sufficient processing capacity for real-time execution of simple visual recognition
algorithms (DragonBoard 410c of Arrow Electronics with ARM Cortex-A53 Quad-core up to 1.2 GHz per
core and Qualcomm Adreno 306 @ 400MHz). The DragonBoard also collects the data read by the sensors
during robot-human interaction tests, processes them and produces the training database with the input and
output variables. The dataset was divided into 70% for training and 30% for testing. This division allows using
most of the dataset to create the model, ensuring that statistically, the population of datasets are marginally
different and that all possible patterns that will characterize the model are included. The 30% of unknown data
allows validation and testing of the model.
Figure 5 shows the final membership functions for the five input variables after the learning process.
With this structure the performance of the model was validated for different people identified by the robot.
Figure 6 shows the prediction results for the tracking of two different people under laboratory conditions.
In the tests people gently approach and move away from the robot after it has identified them as a target object.
The first person was a man of 1.71 m height and medium body (76 kg weight). The second person was a man
1.74 m high with a little more volume (89 kg weight). The entire training process was conducted with five
TELKOMNIKA Telecommun Comput El Control 
Scheme for motion estimation based on adaptive fuzzy neural network (Fredy Martinez)
1035
different people. The movements in front of the robot were slow, but corresponding to the natural behavior of
a person in human interaction. The model is not trained with high-speed behaviors because they do not
correspond to the expected operation, and because the active sensor has a response speed limit.
In the figure the black line represents the real behavior data detected by the robot sensors, while the red curve
represents the behavior predicted by the model for the same instant. In blue is the tracking error in each case.
As in the two cases shown, the results show that the proposed model can closely follow the movements of
the target person. The average RMSE of prediction over the 50 laboratory tests with different people acting as
target object was 7.33.
Figure 4. Service robot (Nao robot at the top and ARMOS TurtleBot 1 at the bottom)
used in interaction and tracking tests
Figure 5. Final membership functions of the five input variables
 ISSN: 1693-6930
TELKOMNIKA Telecommun Comput El Control, Vol. 18, No. 2, April 2020: 1030 - 1037
1036
5. CONCLUSIONS
In this paper we propose an adaptive fuzzy neural network to predict the movements of a person, in
real time, by a service robot. This scheme is integrated with other subroutines in our robotic platform in order
to develop complex tasks in the care of children, sick and elderly people. The proposed model uses as input
variables the two-dimensional coordinates of the robot in the environment over time, as well as
the estimation of its speed, orientation and acceleration. The proposed strategy presents a high performance in
predicting the behavior of the target person thanks to the optimization of the parameters in the Takagi-Sugeno
model. In addition, the adaptive learning scheme used optimizes the design of the belonging functions and the
related fuzzy rules which improves accuracy. The size and location of the fuzzy sets was adjusted in line with
the learning process. In most cases the central set was reduced, and the central value moved from the center
of the discourse universe. Laboratory experiments performed with our robotic platform demonstrate the high
performance of the strategy, and its high reliability to predict the behavior of the person from the readings of
the active distance sensor. The average RMSE of prediction over the 50 laboratory tests with different people
acting as target object was 7.33. On the model achieved it is proposed to improve the performance reducing
the errors of prediction through the presentation of new patterns with a wider set of people that includes a
greater class of characteristics to detect by the robot.
Figure 6. Predictive results for two following cases. The red curve represents the behavior predicted by
the model, while the blue curve represents the tracking error
ACKNOWLEDGMENTS
This work was supported by the Universidad Distrital Francisco José de Caldas, in part through CIDC,
and partly by the Facultad Tecnológica. The views expressed in this paper are not necessarily endorsed by
District University. The authors thank the research group ARMOS for the evaluation carried out on prototypes
of ideas and strategies.
REFERENCES
[1] J. Wirtz, W. Kunz, T. Gruber, V. Nhat, S. Paluch, and A. Martins, “Brave new world: service robots in the frontline,”
Journal of Service Management, vol. 29, no. 5, pp. 907-931, 2018. doi: https://doi.org/10.1108/JOSM-04-2018-0119
[2] I. Stanislav, W. Craig, and K. Berezina, “Adoption of robots and service automation by tourism and hospitality
companies”. Revista Turismo & Desenvolvimento, vol. 27, no. 28, pp. 1501-1517, 2017.
[3] P. Lasota, T. Fong, and J. Shah, “A survey of methods for safe human-robot interaction,” Foundations and Trends in
Robotics, vol 5, no. 4, pp. 261-349, 2017. doi: http://dx.doi.org/10.1561/2300000052
[4] C. Freundlich, Y. Zhang, A. Zhu, P. Mordohai, and M. Zavlanos, “Controlling a robotic stereo camera under image
quantization noise,” The International Journal of Robotics Research, vol. 36, no. 12, pp. 1268-1285, June 2017.
doi: 10.1177/0278364917735163
[5] S. Solak and E. D. Bolat, "Distance estimation using stereo vision for indoor mobile robot applications," 2015 9th
International Conference on Electrical and Electronics Engineering (ELECO), Bursa, pp. 685-688, 2015.
doi: 10.1109/ELECO.2015.7394442
[6] Y. Hongshan, Z. Jiang, W. Yaonan, J. Wenyan, S. Mingui, and T. Yandong, “Obstacle classificationand 3D
measurementin unstructured environmentsbased on ToF cameras”, Sensors, vol. 14, no. 1, pp. 10753-10782, 2014.
doi: 10.3390/s140610753
TELKOMNIKA Telecommun Comput El Control 
Scheme for motion estimation based on adaptive fuzzy neural network (Fredy Martinez)
1037
[7] Z. Yuanshen, G. Liang, H. Yixiang, and L. Chengliang, “A review of key techniques of vision-based control for
harvesting robot,” Computers and Electronics in Agriculture, ISSN 0168-1699, vol. 127, pp. 311-323, Sept 2016.
doi: 10.1016/j.compag.2016.06.022
[8] D. Fischinger, P. Einramhof, K. Papoutsakis, W. Wohlkinger, P. Mayer, P. Panek, S. Hofmann, T. Koertner, A.
Weiss, A. Argyros, and M. Vincze. “Hobbit, a care robot supporting independent living at home: First prototype and
lessons learned. Robotics and Autonomous Systems,” Robotics and Autonomuous System, vol. 75, pp. 60-78,
Jan 2016. doi: https://doi.org/10.1016/j.robot.2014.09.029
[9] Y. Wang, L. Zhijun, and S. Chun-Yi, “Rgb-d sensor-based visual slam for localization and navigation of indoor
mobile robot,” International Conference on Advanced Robotics and Mechatronics (ICARM 2016), pp. 82-87, Macau,
2016. doi: 10.1109/ICARM.2016.7606899
[10] F. Yang and X. Chenkun, “Human-tracking strategies for a six-legged rescue robot based on distance and view,”
Chinese Journal of Mechanical Engineering, ISSN 1000-9345, vol. 29, pp. 219-230, March 2016.
doi: https://doi.org/10.3901/CJME.2015.1212.146
[11] T. Linder and K. Arras. People Detection, “Tracking and Visualization Using ROS on a Mobile Service Robot,”
Robot Operating System (ROS). Springer, pp. 187-213, Feb 2016.
[12] M. Mahammed, A. Melhum, and F. Kochery, “Object distance measurement by stereo vision,” International Journal
of Science and Applied Information Technology, vol. 2, no 2, pp. 5-8, March 2013.
[13] C. Mao-Hsiung, L. Hao-Ting, and H. Chien-Lun, “Development of a stereo vision measurement system for a 3d
three-axial pneumatic parallel mechanism robot arm,” Sensors, vol. 11, no 2, pp. 2257-2281, Feb 2011.
doi: 10.3390/s110202257
[14] A. Mohamed, Y. Chenguang, and A. Cangelosi, “Stereo vision based object trackingcontrol for a movable robot
head,” 4th
IFAC International Conference onIntelligent Control and Automation Sciences, vol. 49, no. 5,
pp. 155-162, 2016.
[15] S. Glende, I. Conrad, L. Krezdorn, S. Klemcke, and C. Krätzel, “Increasing the acceptance of assistive robots for
older people through marketing strategies based on stakeholder needs,” International Journal of Social Robotics,
ISSN 1875-4791, vol. 8, no. 3, pp. 355-369, June 2016, doi: https://doi.org/10.1007/s12369-015-0328-5
[16] H. Gross, A. Scheidig, K. Debes, E. Einhorn, M. Eisenbach, S. Mueller, T. Schmiedel, T. Trinh, T. Weingefeld, A.
Bley, and C. Martin, “ROREAS: robot coach for walking and orientation training in clinical post-stroke
rehabilitation-prototype implementation and evaluation in field trials,” Autonomous Robots, vol. 41, no. 3,
pp. 679-698, March 2017. doi: https://doi.org/10.1007/s10514-016-9552-6
[17] M. Mast, M. Burmester, B. Graf, F. Weisshardt, G. Arbeiter, M. Spanel, Z. Materna, P. Smrz, and G. Kronreif,
“Design of the human-robot interaction for a semi-autonomous service robot to assist elderly people” Advanced
Technologies and Societal Change, vol. 1, no. 1, pp. 15-29, 2015. doi: https://doi.org/10.1007/978-3-319-11866-6_2
[18] K. Koide and J. Miura, “Identification of a specific person using color, height, and gait features for a
person following robot,” Robotics and Autonomous Systems, vol. 84, no. 1, pp. 76-87, Oct 2016.
doi: https://doi.org/10.1016/j.robot.2016.07.004
[19] R. Triebel, K. Arras, R. Alami, L. Beyer, S. Breuers, R. Chatila, M. Chetouani, D. Cremers, V. Evers, M. Fiore, H.
Hung, O. Islas, M. Joosse, H. Khambhaita, and T. Kucner, “Spencer: A socially aware service robot for passenger
guidance and help in busy airports,” Springer Tracts in Advanced Robotics, vol, 113, no. 1, pp. 607-622, 2016.
doi: https://doi.org/10.1007/978-3-319-27702-8_40
[20] M. Hersh, “Overcoming barriers and increasing independence - service robots for elderly and disabled people,”
International Journal of Advanced Robotic Systems, vol. 12, no. 8, pp. 1-33, 2015. doi: https://doi.org/10.5772/59230
[21] G. Ferrer, A. Garrell, F. Herrero, and A. Sanfeliu, “Robot social-aware navigation framework to accompany people
walking side-by-side,” Autonomous Robots, vol. 41, no. 4, pp. 775-793, 2017. doi: https://doi.org/10.1007/s10514-
016-9584-y
[22] F. Martínez, A. Rendón, and M. Arbulú, “A data-driven path planner for small autonomous robots using deep
regression models,” Lecture Notes in Computer Science, pp. 596-603, 2018. doi: https://doi.org/10.1007/978-3-319-
93803-5_56
[23] F. Martínez, D. Acero, and M. Castiblanco, “Robótica autónoma: Acercamiento a algunos problemas centrales,”
Universidad Distrital Francisco José de Caldas, 2015.
[24] F. Kratzert, D. Klotz, C. Brenner, K. Schulz, and M. Herrnegger, “Rainfall–runoff modelling using Long Short-
TermMemory (LSTM) networks,” Hydrology and Earth System Sciences, vol. 22, no. 11, pp. 6005-6022, Nov 2018.
doi: https://doi.org/10.5194/hess-22-6005-2018
[25] S. Azimi, and H. Miar, “Designing an analog CMOS fuzzy logic controller forthe inverted pendulum with
a novel triangular membership function,” Scientia Iranica, vol 26, no. 3, pp. 1736-1748, 2019.
doi: 10.24200/sci.2018.5224.1153

More Related Content

What's hot

Mobile robot controller using novel hybrid system
Mobile robot controller using novel hybrid system  Mobile robot controller using novel hybrid system
Mobile robot controller using novel hybrid system IJECEIAES
 
9694 thinking skills ai rev
9694 thinking skills ai rev9694 thinking skills ai rev
9694 thinking skills ai revmayorgam
 
Autonomous system to control a mobile robot
Autonomous system to control a mobile robotAutonomous system to control a mobile robot
Autonomous system to control a mobile robotjournalBEEI
 
Intelligent Robotics Navigation System: Problems, Methods, and Algorithm
Intelligent Robotics Navigation System: Problems,  Methods, and Algorithm Intelligent Robotics Navigation System: Problems,  Methods, and Algorithm
Intelligent Robotics Navigation System: Problems, Methods, and Algorithm IJECEIAES
 
PORTABLE CAMERA-BASED ASSISTIVE TEXT AND PRODUCT LABEL READING FROM HAND- H...
PORTABLE CAMERA-BASED  ASSISTIVE TEXT AND PRODUCT  LABEL READING FROM HAND- H...PORTABLE CAMERA-BASED  ASSISTIVE TEXT AND PRODUCT  LABEL READING FROM HAND- H...
PORTABLE CAMERA-BASED ASSISTIVE TEXT AND PRODUCT LABEL READING FROM HAND- H...Sathmica K
 
USING THE MANDELBROT SET TO GENERATE PRIMARY POPULATIONS IN THE GENETIC ALGOR...
USING THE MANDELBROT SET TO GENERATE PRIMARY POPULATIONS IN THE GENETIC ALGOR...USING THE MANDELBROT SET TO GENERATE PRIMARY POPULATIONS IN THE GENETIC ALGOR...
USING THE MANDELBROT SET TO GENERATE PRIMARY POPULATIONS IN THE GENETIC ALGOR...csandit
 
Molecules of Knowledge: Self-Organisation in Knowledge-Intensive Environments
Molecules of Knowledge: Self-Organisation in Knowledge-Intensive EnvironmentsMolecules of Knowledge: Self-Organisation in Knowledge-Intensive Environments
Molecules of Knowledge: Self-Organisation in Knowledge-Intensive EnvironmentsStefano Mariani
 
IRJET- Behavior Analysis from Videos using Motion based Feature Extraction
IRJET-  	  Behavior Analysis from Videos using Motion based Feature ExtractionIRJET-  	  Behavior Analysis from Videos using Motion based Feature Extraction
IRJET- Behavior Analysis from Videos using Motion based Feature ExtractionIRJET Journal
 
MUE2012-Space-aware Design Factors for Located Learning Activities Supported ...
MUE2012-Space-aware Design Factors for Located Learning Activities Supported ...MUE2012-Space-aware Design Factors for Located Learning Activities Supported ...
MUE2012-Space-aware Design Factors for Located Learning Activities Supported ...Mar Pérez-Sanagustín
 
IRJET- Smart Traffic Control System using Yolo
IRJET- Smart Traffic Control System using YoloIRJET- Smart Traffic Control System using Yolo
IRJET- Smart Traffic Control System using YoloIRJET Journal
 
A Robot Collision Avoidance Method Using Kinect and Global Vision
A Robot Collision Avoidance Method Using Kinect and Global VisionA Robot Collision Avoidance Method Using Kinect and Global Vision
A Robot Collision Avoidance Method Using Kinect and Global VisionTELKOMNIKA JOURNAL
 
FreddyAyalaTorchDomineering
FreddyAyalaTorchDomineeringFreddyAyalaTorchDomineering
FreddyAyalaTorchDomineeringFAYALA1987
 
Robust and Efficient Coupling of Perception to Actuation with Metric and Non-...
Robust and Efficient Coupling of Perception to Actuation with Metric and Non-...Robust and Efficient Coupling of Perception to Actuation with Metric and Non-...
Robust and Efficient Coupling of Perception to Actuation with Metric and Non-...Darius Burschka
 
In tech vision-based_obstacle_detection_module_for_a_wheeled_mobile_robot
In tech vision-based_obstacle_detection_module_for_a_wheeled_mobile_robotIn tech vision-based_obstacle_detection_module_for_a_wheeled_mobile_robot
In tech vision-based_obstacle_detection_module_for_a_wheeled_mobile_robotSudhakar Spartan
 
Deep Learning - a Path from Big Data Indexing to Robotic Applications
Deep Learning - a Path from Big Data Indexing to Robotic ApplicationsDeep Learning - a Path from Big Data Indexing to Robotic Applications
Deep Learning - a Path from Big Data Indexing to Robotic ApplicationsDarius Burschka
 

What's hot (18)

Mobile robot controller using novel hybrid system
Mobile robot controller using novel hybrid system  Mobile robot controller using novel hybrid system
Mobile robot controller using novel hybrid system
 
9694 thinking skills ai rev
9694 thinking skills ai rev9694 thinking skills ai rev
9694 thinking skills ai rev
 
Ai applications study
Ai applications  studyAi applications  study
Ai applications study
 
Autonomous system to control a mobile robot
Autonomous system to control a mobile robotAutonomous system to control a mobile robot
Autonomous system to control a mobile robot
 
Intelligent Robotics Navigation System: Problems, Methods, and Algorithm
Intelligent Robotics Navigation System: Problems,  Methods, and Algorithm Intelligent Robotics Navigation System: Problems,  Methods, and Algorithm
Intelligent Robotics Navigation System: Problems, Methods, and Algorithm
 
PORTABLE CAMERA-BASED ASSISTIVE TEXT AND PRODUCT LABEL READING FROM HAND- H...
PORTABLE CAMERA-BASED  ASSISTIVE TEXT AND PRODUCT  LABEL READING FROM HAND- H...PORTABLE CAMERA-BASED  ASSISTIVE TEXT AND PRODUCT  LABEL READING FROM HAND- H...
PORTABLE CAMERA-BASED ASSISTIVE TEXT AND PRODUCT LABEL READING FROM HAND- H...
 
USING THE MANDELBROT SET TO GENERATE PRIMARY POPULATIONS IN THE GENETIC ALGOR...
USING THE MANDELBROT SET TO GENERATE PRIMARY POPULATIONS IN THE GENETIC ALGOR...USING THE MANDELBROT SET TO GENERATE PRIMARY POPULATIONS IN THE GENETIC ALGOR...
USING THE MANDELBROT SET TO GENERATE PRIMARY POPULATIONS IN THE GENETIC ALGOR...
 
1st review
1st review1st review
1st review
 
Molecules of Knowledge: Self-Organisation in Knowledge-Intensive Environments
Molecules of Knowledge: Self-Organisation in Knowledge-Intensive EnvironmentsMolecules of Knowledge: Self-Organisation in Knowledge-Intensive Environments
Molecules of Knowledge: Self-Organisation in Knowledge-Intensive Environments
 
IRJET- Behavior Analysis from Videos using Motion based Feature Extraction
IRJET-  	  Behavior Analysis from Videos using Motion based Feature ExtractionIRJET-  	  Behavior Analysis from Videos using Motion based Feature Extraction
IRJET- Behavior Analysis from Videos using Motion based Feature Extraction
 
MUE2012-Space-aware Design Factors for Located Learning Activities Supported ...
MUE2012-Space-aware Design Factors for Located Learning Activities Supported ...MUE2012-Space-aware Design Factors for Located Learning Activities Supported ...
MUE2012-Space-aware Design Factors for Located Learning Activities Supported ...
 
IRJET- Smart Traffic Control System using Yolo
IRJET- Smart Traffic Control System using YoloIRJET- Smart Traffic Control System using Yolo
IRJET- Smart Traffic Control System using Yolo
 
A Robot Collision Avoidance Method Using Kinect and Global Vision
A Robot Collision Avoidance Method Using Kinect and Global VisionA Robot Collision Avoidance Method Using Kinect and Global Vision
A Robot Collision Avoidance Method Using Kinect and Global Vision
 
FreddyAyalaTorchDomineering
FreddyAyalaTorchDomineeringFreddyAyalaTorchDomineering
FreddyAyalaTorchDomineering
 
Deep learning
Deep learning Deep learning
Deep learning
 
Robust and Efficient Coupling of Perception to Actuation with Metric and Non-...
Robust and Efficient Coupling of Perception to Actuation with Metric and Non-...Robust and Efficient Coupling of Perception to Actuation with Metric and Non-...
Robust and Efficient Coupling of Perception to Actuation with Metric and Non-...
 
In tech vision-based_obstacle_detection_module_for_a_wheeled_mobile_robot
In tech vision-based_obstacle_detection_module_for_a_wheeled_mobile_robotIn tech vision-based_obstacle_detection_module_for_a_wheeled_mobile_robot
In tech vision-based_obstacle_detection_module_for_a_wheeled_mobile_robot
 
Deep Learning - a Path from Big Data Indexing to Robotic Applications
Deep Learning - a Path from Big Data Indexing to Robotic ApplicationsDeep Learning - a Path from Big Data Indexing to Robotic Applications
Deep Learning - a Path from Big Data Indexing to Robotic Applications
 

Similar to Scheme for motion estimation based on adaptive fuzzy neural network

A novel visual tracking scheme for unstructured indoor environments
A novel visual tracking scheme for unstructured indoor environmentsA novel visual tracking scheme for unstructured indoor environments
A novel visual tracking scheme for unstructured indoor environmentsIJECEIAES
 
Robot operating system based autonomous navigation platform with human robot ...
Robot operating system based autonomous navigation platform with human robot ...Robot operating system based autonomous navigation platform with human robot ...
Robot operating system based autonomous navigation platform with human robot ...TELKOMNIKA JOURNAL
 
A one decade survey of autonomous mobile robot systems
A one decade survey of autonomous mobile robot systems A one decade survey of autonomous mobile robot systems
A one decade survey of autonomous mobile robot systems IJECEIAES
 
Acoustic event characterization for service robot using convolutional networks
Acoustic event characterization for service robot using convolutional networksAcoustic event characterization for service robot using convolutional networks
Acoustic event characterization for service robot using convolutional networksIJECEIAES
 
LEARNING OF ROBOT NAVIGATION TASKS BY PROBABILISTIC NEURAL NETWORK
LEARNING OF ROBOT NAVIGATION TASKS BY PROBABILISTIC NEURAL NETWORKLEARNING OF ROBOT NAVIGATION TASKS BY PROBABILISTIC NEURAL NETWORK
LEARNING OF ROBOT NAVIGATION TASKS BY PROBABILISTIC NEURAL NETWORKcscpconf
 
LEARNING OF ROBOT NAVIGATION TASKS BY PROBABILISTIC NEURAL NETWORK
LEARNING OF ROBOT NAVIGATION TASKS BY PROBABILISTIC NEURAL NETWORKLEARNING OF ROBOT NAVIGATION TASKS BY PROBABILISTIC NEURAL NETWORK
LEARNING OF ROBOT NAVIGATION TASKS BY PROBABILISTIC NEURAL NETWORKcsandit
 
Swarm robotics : Design and implementation
Swarm robotics : Design and implementationSwarm robotics : Design and implementation
Swarm robotics : Design and implementationIJECEIAES
 
Cognitive Robotics: Merging AI and Robotics for Complex Tasks
Cognitive Robotics: Merging AI and Robotics for Complex TasksCognitive Robotics: Merging AI and Robotics for Complex Tasks
Cognitive Robotics: Merging AI and Robotics for Complex TasksIRJET Journal
 
Visual victim detection and quadrotor-swarm coordination control in search an...
Visual victim detection and quadrotor-swarm coordination control in search an...Visual victim detection and quadrotor-swarm coordination control in search an...
Visual victim detection and quadrotor-swarm coordination control in search an...IJECEIAES
 
Sensor Based Motion Control of Mobile Car Robot
Sensor Based Motion Control of Mobile Car RobotSensor Based Motion Control of Mobile Car Robot
Sensor Based Motion Control of Mobile Car Robotijtsrd
 
A Multi-robot System Coordination Design and Analysis on Wall Follower Robot ...
A Multi-robot System Coordination Design and Analysis on Wall Follower Robot ...A Multi-robot System Coordination Design and Analysis on Wall Follower Robot ...
A Multi-robot System Coordination Design and Analysis on Wall Follower Robot ...IJECEIAES
 
IRJET- Can Robots are Changing the World: A Review
IRJET- Can Robots are Changing the World: A ReviewIRJET- Can Robots are Changing the World: A Review
IRJET- Can Robots are Changing the World: A ReviewIRJET Journal
 
Obstacle detection for autonomous systems using stereoscopic images and bacte...
Obstacle detection for autonomous systems using stereoscopic images and bacte...Obstacle detection for autonomous systems using stereoscopic images and bacte...
Obstacle detection for autonomous systems using stereoscopic images and bacte...IJECEIAES
 
Efficient and secure real-time mobile robots cooperation using visual servoing
Efficient and secure real-time mobile robots cooperation using visual servoing Efficient and secure real-time mobile robots cooperation using visual servoing
Efficient and secure real-time mobile robots cooperation using visual servoing IJECEIAES
 
Social Service Robot using Gesture recognition technique
Social Service Robot using Gesture recognition techniqueSocial Service Robot using Gesture recognition technique
Social Service Robot using Gesture recognition techniqueChristo Ananth
 

Similar to Scheme for motion estimation based on adaptive fuzzy neural network (20)

A novel visual tracking scheme for unstructured indoor environments
A novel visual tracking scheme for unstructured indoor environmentsA novel visual tracking scheme for unstructured indoor environments
A novel visual tracking scheme for unstructured indoor environments
 
Robot operating system based autonomous navigation platform with human robot ...
Robot operating system based autonomous navigation platform with human robot ...Robot operating system based autonomous navigation platform with human robot ...
Robot operating system based autonomous navigation platform with human robot ...
 
A one decade survey of autonomous mobile robot systems
A one decade survey of autonomous mobile robot systems A one decade survey of autonomous mobile robot systems
A one decade survey of autonomous mobile robot systems
 
Acoustic event characterization for service robot using convolutional networks
Acoustic event characterization for service robot using convolutional networksAcoustic event characterization for service robot using convolutional networks
Acoustic event characterization for service robot using convolutional networks
 
Clei Tutorial 2010 - Texto
Clei Tutorial 2010 - TextoClei Tutorial 2010 - Texto
Clei Tutorial 2010 - Texto
 
LEARNING OF ROBOT NAVIGATION TASKS BY PROBABILISTIC NEURAL NETWORK
LEARNING OF ROBOT NAVIGATION TASKS BY PROBABILISTIC NEURAL NETWORKLEARNING OF ROBOT NAVIGATION TASKS BY PROBABILISTIC NEURAL NETWORK
LEARNING OF ROBOT NAVIGATION TASKS BY PROBABILISTIC NEURAL NETWORK
 
LEARNING OF ROBOT NAVIGATION TASKS BY PROBABILISTIC NEURAL NETWORK
LEARNING OF ROBOT NAVIGATION TASKS BY PROBABILISTIC NEURAL NETWORKLEARNING OF ROBOT NAVIGATION TASKS BY PROBABILISTIC NEURAL NETWORK
LEARNING OF ROBOT NAVIGATION TASKS BY PROBABILISTIC NEURAL NETWORK
 
Swarm robotics : Design and implementation
Swarm robotics : Design and implementationSwarm robotics : Design and implementation
Swarm robotics : Design and implementation
 
Cognitive Robotics: Merging AI and Robotics for Complex Tasks
Cognitive Robotics: Merging AI and Robotics for Complex TasksCognitive Robotics: Merging AI and Robotics for Complex Tasks
Cognitive Robotics: Merging AI and Robotics for Complex Tasks
 
Visual victim detection and quadrotor-swarm coordination control in search an...
Visual victim detection and quadrotor-swarm coordination control in search an...Visual victim detection and quadrotor-swarm coordination control in search an...
Visual victim detection and quadrotor-swarm coordination control in search an...
 
15mafaz wali--final (1)
15mafaz wali--final (1)15mafaz wali--final (1)
15mafaz wali--final (1)
 
Sensor Based Motion Control of Mobile Car Robot
Sensor Based Motion Control of Mobile Car RobotSensor Based Motion Control of Mobile Car Robot
Sensor Based Motion Control of Mobile Car Robot
 
IJET-V3I1P6
IJET-V3I1P6IJET-V3I1P6
IJET-V3I1P6
 
A Multi-robot System Coordination Design and Analysis on Wall Follower Robot ...
A Multi-robot System Coordination Design and Analysis on Wall Follower Robot ...A Multi-robot System Coordination Design and Analysis on Wall Follower Robot ...
A Multi-robot System Coordination Design and Analysis on Wall Follower Robot ...
 
IRJET- Can Robots are Changing the World: A Review
IRJET- Can Robots are Changing the World: A ReviewIRJET- Can Robots are Changing the World: A Review
IRJET- Can Robots are Changing the World: A Review
 
Obstacle detection for autonomous systems using stereoscopic images and bacte...
Obstacle detection for autonomous systems using stereoscopic images and bacte...Obstacle detection for autonomous systems using stereoscopic images and bacte...
Obstacle detection for autonomous systems using stereoscopic images and bacte...
 
Ts 2 b topic
Ts 2 b topicTs 2 b topic
Ts 2 b topic
 
Efficient and secure real-time mobile robots cooperation using visual servoing
Efficient and secure real-time mobile robots cooperation using visual servoing Efficient and secure real-time mobile robots cooperation using visual servoing
Efficient and secure real-time mobile robots cooperation using visual servoing
 
Content server
Content serverContent server
Content server
 
Social Service Robot using Gesture recognition technique
Social Service Robot using Gesture recognition techniqueSocial Service Robot using Gesture recognition technique
Social Service Robot using Gesture recognition technique
 

More from TELKOMNIKA JOURNAL

Amazon products reviews classification based on machine learning, deep learni...
Amazon products reviews classification based on machine learning, deep learni...Amazon products reviews classification based on machine learning, deep learni...
Amazon products reviews classification based on machine learning, deep learni...TELKOMNIKA JOURNAL
 
Design, simulation, and analysis of microstrip patch antenna for wireless app...
Design, simulation, and analysis of microstrip patch antenna for wireless app...Design, simulation, and analysis of microstrip patch antenna for wireless app...
Design, simulation, and analysis of microstrip patch antenna for wireless app...TELKOMNIKA JOURNAL
 
Design and simulation an optimal enhanced PI controller for congestion avoida...
Design and simulation an optimal enhanced PI controller for congestion avoida...Design and simulation an optimal enhanced PI controller for congestion avoida...
Design and simulation an optimal enhanced PI controller for congestion avoida...TELKOMNIKA JOURNAL
 
Improving the detection of intrusion in vehicular ad-hoc networks with modifi...
Improving the detection of intrusion in vehicular ad-hoc networks with modifi...Improving the detection of intrusion in vehicular ad-hoc networks with modifi...
Improving the detection of intrusion in vehicular ad-hoc networks with modifi...TELKOMNIKA JOURNAL
 
Conceptual model of internet banking adoption with perceived risk and trust f...
Conceptual model of internet banking adoption with perceived risk and trust f...Conceptual model of internet banking adoption with perceived risk and trust f...
Conceptual model of internet banking adoption with perceived risk and trust f...TELKOMNIKA JOURNAL
 
Efficient combined fuzzy logic and LMS algorithm for smart antenna
Efficient combined fuzzy logic and LMS algorithm for smart antennaEfficient combined fuzzy logic and LMS algorithm for smart antenna
Efficient combined fuzzy logic and LMS algorithm for smart antennaTELKOMNIKA JOURNAL
 
Design and implementation of a LoRa-based system for warning of forest fire
Design and implementation of a LoRa-based system for warning of forest fireDesign and implementation of a LoRa-based system for warning of forest fire
Design and implementation of a LoRa-based system for warning of forest fireTELKOMNIKA JOURNAL
 
Wavelet-based sensing technique in cognitive radio network
Wavelet-based sensing technique in cognitive radio networkWavelet-based sensing technique in cognitive radio network
Wavelet-based sensing technique in cognitive radio networkTELKOMNIKA JOURNAL
 
A novel compact dual-band bandstop filter with enhanced rejection bands
A novel compact dual-band bandstop filter with enhanced rejection bandsA novel compact dual-band bandstop filter with enhanced rejection bands
A novel compact dual-band bandstop filter with enhanced rejection bandsTELKOMNIKA JOURNAL
 
Deep learning approach to DDoS attack with imbalanced data at the application...
Deep learning approach to DDoS attack with imbalanced data at the application...Deep learning approach to DDoS attack with imbalanced data at the application...
Deep learning approach to DDoS attack with imbalanced data at the application...TELKOMNIKA JOURNAL
 
Brief note on match and miss-match uncertainties
Brief note on match and miss-match uncertaintiesBrief note on match and miss-match uncertainties
Brief note on match and miss-match uncertaintiesTELKOMNIKA JOURNAL
 
Implementation of FinFET technology based low power 4×4 Wallace tree multipli...
Implementation of FinFET technology based low power 4×4 Wallace tree multipli...Implementation of FinFET technology based low power 4×4 Wallace tree multipli...
Implementation of FinFET technology based low power 4×4 Wallace tree multipli...TELKOMNIKA JOURNAL
 
Evaluation of the weighted-overlap add model with massive MIMO in a 5G system
Evaluation of the weighted-overlap add model with massive MIMO in a 5G systemEvaluation of the weighted-overlap add model with massive MIMO in a 5G system
Evaluation of the weighted-overlap add model with massive MIMO in a 5G systemTELKOMNIKA JOURNAL
 
Reflector antenna design in different frequencies using frequency selective s...
Reflector antenna design in different frequencies using frequency selective s...Reflector antenna design in different frequencies using frequency selective s...
Reflector antenna design in different frequencies using frequency selective s...TELKOMNIKA JOURNAL
 
Reagentless iron detection in water based on unclad fiber optical sensor
Reagentless iron detection in water based on unclad fiber optical sensorReagentless iron detection in water based on unclad fiber optical sensor
Reagentless iron detection in water based on unclad fiber optical sensorTELKOMNIKA JOURNAL
 
Impact of CuS counter electrode calcination temperature on quantum dot sensit...
Impact of CuS counter electrode calcination temperature on quantum dot sensit...Impact of CuS counter electrode calcination temperature on quantum dot sensit...
Impact of CuS counter electrode calcination temperature on quantum dot sensit...TELKOMNIKA JOURNAL
 
A progressive learning for structural tolerance online sequential extreme lea...
A progressive learning for structural tolerance online sequential extreme lea...A progressive learning for structural tolerance online sequential extreme lea...
A progressive learning for structural tolerance online sequential extreme lea...TELKOMNIKA JOURNAL
 
Electroencephalography-based brain-computer interface using neural networks
Electroencephalography-based brain-computer interface using neural networksElectroencephalography-based brain-computer interface using neural networks
Electroencephalography-based brain-computer interface using neural networksTELKOMNIKA JOURNAL
 
Adaptive segmentation algorithm based on level set model in medical imaging
Adaptive segmentation algorithm based on level set model in medical imagingAdaptive segmentation algorithm based on level set model in medical imaging
Adaptive segmentation algorithm based on level set model in medical imagingTELKOMNIKA JOURNAL
 
Automatic channel selection using shuffled frog leaping algorithm for EEG bas...
Automatic channel selection using shuffled frog leaping algorithm for EEG bas...Automatic channel selection using shuffled frog leaping algorithm for EEG bas...
Automatic channel selection using shuffled frog leaping algorithm for EEG bas...TELKOMNIKA JOURNAL
 

More from TELKOMNIKA JOURNAL (20)

Amazon products reviews classification based on machine learning, deep learni...
Amazon products reviews classification based on machine learning, deep learni...Amazon products reviews classification based on machine learning, deep learni...
Amazon products reviews classification based on machine learning, deep learni...
 
Design, simulation, and analysis of microstrip patch antenna for wireless app...
Design, simulation, and analysis of microstrip patch antenna for wireless app...Design, simulation, and analysis of microstrip patch antenna for wireless app...
Design, simulation, and analysis of microstrip patch antenna for wireless app...
 
Design and simulation an optimal enhanced PI controller for congestion avoida...
Design and simulation an optimal enhanced PI controller for congestion avoida...Design and simulation an optimal enhanced PI controller for congestion avoida...
Design and simulation an optimal enhanced PI controller for congestion avoida...
 
Improving the detection of intrusion in vehicular ad-hoc networks with modifi...
Improving the detection of intrusion in vehicular ad-hoc networks with modifi...Improving the detection of intrusion in vehicular ad-hoc networks with modifi...
Improving the detection of intrusion in vehicular ad-hoc networks with modifi...
 
Conceptual model of internet banking adoption with perceived risk and trust f...
Conceptual model of internet banking adoption with perceived risk and trust f...Conceptual model of internet banking adoption with perceived risk and trust f...
Conceptual model of internet banking adoption with perceived risk and trust f...
 
Efficient combined fuzzy logic and LMS algorithm for smart antenna
Efficient combined fuzzy logic and LMS algorithm for smart antennaEfficient combined fuzzy logic and LMS algorithm for smart antenna
Efficient combined fuzzy logic and LMS algorithm for smart antenna
 
Design and implementation of a LoRa-based system for warning of forest fire
Design and implementation of a LoRa-based system for warning of forest fireDesign and implementation of a LoRa-based system for warning of forest fire
Design and implementation of a LoRa-based system for warning of forest fire
 
Wavelet-based sensing technique in cognitive radio network
Wavelet-based sensing technique in cognitive radio networkWavelet-based sensing technique in cognitive radio network
Wavelet-based sensing technique in cognitive radio network
 
A novel compact dual-band bandstop filter with enhanced rejection bands
A novel compact dual-band bandstop filter with enhanced rejection bandsA novel compact dual-band bandstop filter with enhanced rejection bands
A novel compact dual-band bandstop filter with enhanced rejection bands
 
Deep learning approach to DDoS attack with imbalanced data at the application...
Deep learning approach to DDoS attack with imbalanced data at the application...Deep learning approach to DDoS attack with imbalanced data at the application...
Deep learning approach to DDoS attack with imbalanced data at the application...
 
Brief note on match and miss-match uncertainties
Brief note on match and miss-match uncertaintiesBrief note on match and miss-match uncertainties
Brief note on match and miss-match uncertainties
 
Implementation of FinFET technology based low power 4×4 Wallace tree multipli...
Implementation of FinFET technology based low power 4×4 Wallace tree multipli...Implementation of FinFET technology based low power 4×4 Wallace tree multipli...
Implementation of FinFET technology based low power 4×4 Wallace tree multipli...
 
Evaluation of the weighted-overlap add model with massive MIMO in a 5G system
Evaluation of the weighted-overlap add model with massive MIMO in a 5G systemEvaluation of the weighted-overlap add model with massive MIMO in a 5G system
Evaluation of the weighted-overlap add model with massive MIMO in a 5G system
 
Reflector antenna design in different frequencies using frequency selective s...
Reflector antenna design in different frequencies using frequency selective s...Reflector antenna design in different frequencies using frequency selective s...
Reflector antenna design in different frequencies using frequency selective s...
 
Reagentless iron detection in water based on unclad fiber optical sensor
Reagentless iron detection in water based on unclad fiber optical sensorReagentless iron detection in water based on unclad fiber optical sensor
Reagentless iron detection in water based on unclad fiber optical sensor
 
Impact of CuS counter electrode calcination temperature on quantum dot sensit...
Impact of CuS counter electrode calcination temperature on quantum dot sensit...Impact of CuS counter electrode calcination temperature on quantum dot sensit...
Impact of CuS counter electrode calcination temperature on quantum dot sensit...
 
A progressive learning for structural tolerance online sequential extreme lea...
A progressive learning for structural tolerance online sequential extreme lea...A progressive learning for structural tolerance online sequential extreme lea...
A progressive learning for structural tolerance online sequential extreme lea...
 
Electroencephalography-based brain-computer interface using neural networks
Electroencephalography-based brain-computer interface using neural networksElectroencephalography-based brain-computer interface using neural networks
Electroencephalography-based brain-computer interface using neural networks
 
Adaptive segmentation algorithm based on level set model in medical imaging
Adaptive segmentation algorithm based on level set model in medical imagingAdaptive segmentation algorithm based on level set model in medical imaging
Adaptive segmentation algorithm based on level set model in medical imaging
 
Automatic channel selection using shuffled frog leaping algorithm for EEG bas...
Automatic channel selection using shuffled frog leaping algorithm for EEG bas...Automatic channel selection using shuffled frog leaping algorithm for EEG bas...
Automatic channel selection using shuffled frog leaping algorithm for EEG bas...
 

Recently uploaded

(ANJALI) Dange Chowk Call Girls Just Call 7001035870 [ Cash on Delivery ] Pun...
(ANJALI) Dange Chowk Call Girls Just Call 7001035870 [ Cash on Delivery ] Pun...(ANJALI) Dange Chowk Call Girls Just Call 7001035870 [ Cash on Delivery ] Pun...
(ANJALI) Dange Chowk Call Girls Just Call 7001035870 [ Cash on Delivery ] Pun...ranjana rawat
 
SPICE PARK APR2024 ( 6,793 SPICE Models )
SPICE PARK APR2024 ( 6,793 SPICE Models )SPICE PARK APR2024 ( 6,793 SPICE Models )
SPICE PARK APR2024 ( 6,793 SPICE Models )Tsuyoshi Horigome
 
Coefficient of Thermal Expansion and their Importance.pptx
Coefficient of Thermal Expansion and their Importance.pptxCoefficient of Thermal Expansion and their Importance.pptx
Coefficient of Thermal Expansion and their Importance.pptxAsutosh Ranjan
 
(PRIYA) Rajgurunagar Call Girls Just Call 7001035870 [ Cash on Delivery ] Pun...
(PRIYA) Rajgurunagar Call Girls Just Call 7001035870 [ Cash on Delivery ] Pun...(PRIYA) Rajgurunagar Call Girls Just Call 7001035870 [ Cash on Delivery ] Pun...
(PRIYA) Rajgurunagar Call Girls Just Call 7001035870 [ Cash on Delivery ] Pun...ranjana rawat
 
247267395-1-Symmetric-and-distributed-shared-memory-architectures-ppt (1).ppt
247267395-1-Symmetric-and-distributed-shared-memory-architectures-ppt (1).ppt247267395-1-Symmetric-and-distributed-shared-memory-architectures-ppt (1).ppt
247267395-1-Symmetric-and-distributed-shared-memory-architectures-ppt (1).pptssuser5c9d4b1
 
(TARA) Talegaon Dabhade Call Girls Just Call 7001035870 [ Cash on Delivery ] ...
(TARA) Talegaon Dabhade Call Girls Just Call 7001035870 [ Cash on Delivery ] ...(TARA) Talegaon Dabhade Call Girls Just Call 7001035870 [ Cash on Delivery ] ...
(TARA) Talegaon Dabhade Call Girls Just Call 7001035870 [ Cash on Delivery ] ...ranjana rawat
 
Model Call Girl in Narela Delhi reach out to us at 🔝8264348440🔝
Model Call Girl in Narela Delhi reach out to us at 🔝8264348440🔝Model Call Girl in Narela Delhi reach out to us at 🔝8264348440🔝
Model Call Girl in Narela Delhi reach out to us at 🔝8264348440🔝soniya singh
 
MANUFACTURING PROCESS-II UNIT-5 NC MACHINE TOOLS
MANUFACTURING PROCESS-II UNIT-5 NC MACHINE TOOLSMANUFACTURING PROCESS-II UNIT-5 NC MACHINE TOOLS
MANUFACTURING PROCESS-II UNIT-5 NC MACHINE TOOLSSIVASHANKAR N
 
Introduction and different types of Ethernet.pptx
Introduction and different types of Ethernet.pptxIntroduction and different types of Ethernet.pptx
Introduction and different types of Ethernet.pptxupamatechverse
 
IMPLICATIONS OF THE ABOVE HOLISTIC UNDERSTANDING OF HARMONY ON PROFESSIONAL E...
IMPLICATIONS OF THE ABOVE HOLISTIC UNDERSTANDING OF HARMONY ON PROFESSIONAL E...IMPLICATIONS OF THE ABOVE HOLISTIC UNDERSTANDING OF HARMONY ON PROFESSIONAL E...
IMPLICATIONS OF THE ABOVE HOLISTIC UNDERSTANDING OF HARMONY ON PROFESSIONAL E...RajaP95
 
(SHREYA) Chakan Call Girls Just Call 7001035870 [ Cash on Delivery ] Pune Esc...
(SHREYA) Chakan Call Girls Just Call 7001035870 [ Cash on Delivery ] Pune Esc...(SHREYA) Chakan Call Girls Just Call 7001035870 [ Cash on Delivery ] Pune Esc...
(SHREYA) Chakan Call Girls Just Call 7001035870 [ Cash on Delivery ] Pune Esc...ranjana rawat
 
Introduction to IEEE STANDARDS and its different types.pptx
Introduction to IEEE STANDARDS and its different types.pptxIntroduction to IEEE STANDARDS and its different types.pptx
Introduction to IEEE STANDARDS and its different types.pptxupamatechverse
 
Decoding Kotlin - Your guide to solving the mysterious in Kotlin.pptx
Decoding Kotlin - Your guide to solving the mysterious in Kotlin.pptxDecoding Kotlin - Your guide to solving the mysterious in Kotlin.pptx
Decoding Kotlin - Your guide to solving the mysterious in Kotlin.pptxJoão Esperancinha
 
Processing & Properties of Floor and Wall Tiles.pptx
Processing & Properties of Floor and Wall Tiles.pptxProcessing & Properties of Floor and Wall Tiles.pptx
Processing & Properties of Floor and Wall Tiles.pptxpranjaldaimarysona
 
Call for Papers - African Journal of Biological Sciences, E-ISSN: 2663-2187, ...
Call for Papers - African Journal of Biological Sciences, E-ISSN: 2663-2187, ...Call for Papers - African Journal of Biological Sciences, E-ISSN: 2663-2187, ...
Call for Papers - African Journal of Biological Sciences, E-ISSN: 2663-2187, ...Christo Ananth
 
Call Girls in Nagpur Suman Call 7001035870 Meet With Nagpur Escorts
Call Girls in Nagpur Suman Call 7001035870 Meet With Nagpur EscortsCall Girls in Nagpur Suman Call 7001035870 Meet With Nagpur Escorts
Call Girls in Nagpur Suman Call 7001035870 Meet With Nagpur EscortsCall Girls in Nagpur High Profile
 
OSVC_Meta-Data based Simulation Automation to overcome Verification Challenge...
OSVC_Meta-Data based Simulation Automation to overcome Verification Challenge...OSVC_Meta-Data based Simulation Automation to overcome Verification Challenge...
OSVC_Meta-Data based Simulation Automation to overcome Verification Challenge...Soham Mondal
 

Recently uploaded (20)

(ANJALI) Dange Chowk Call Girls Just Call 7001035870 [ Cash on Delivery ] Pun...
(ANJALI) Dange Chowk Call Girls Just Call 7001035870 [ Cash on Delivery ] Pun...(ANJALI) Dange Chowk Call Girls Just Call 7001035870 [ Cash on Delivery ] Pun...
(ANJALI) Dange Chowk Call Girls Just Call 7001035870 [ Cash on Delivery ] Pun...
 
Roadmap to Membership of RICS - Pathways and Routes
Roadmap to Membership of RICS - Pathways and RoutesRoadmap to Membership of RICS - Pathways and Routes
Roadmap to Membership of RICS - Pathways and Routes
 
SPICE PARK APR2024 ( 6,793 SPICE Models )
SPICE PARK APR2024 ( 6,793 SPICE Models )SPICE PARK APR2024 ( 6,793 SPICE Models )
SPICE PARK APR2024 ( 6,793 SPICE Models )
 
Coefficient of Thermal Expansion and their Importance.pptx
Coefficient of Thermal Expansion and their Importance.pptxCoefficient of Thermal Expansion and their Importance.pptx
Coefficient of Thermal Expansion and their Importance.pptx
 
(PRIYA) Rajgurunagar Call Girls Just Call 7001035870 [ Cash on Delivery ] Pun...
(PRIYA) Rajgurunagar Call Girls Just Call 7001035870 [ Cash on Delivery ] Pun...(PRIYA) Rajgurunagar Call Girls Just Call 7001035870 [ Cash on Delivery ] Pun...
(PRIYA) Rajgurunagar Call Girls Just Call 7001035870 [ Cash on Delivery ] Pun...
 
247267395-1-Symmetric-and-distributed-shared-memory-architectures-ppt (1).ppt
247267395-1-Symmetric-and-distributed-shared-memory-architectures-ppt (1).ppt247267395-1-Symmetric-and-distributed-shared-memory-architectures-ppt (1).ppt
247267395-1-Symmetric-and-distributed-shared-memory-architectures-ppt (1).ppt
 
(TARA) Talegaon Dabhade Call Girls Just Call 7001035870 [ Cash on Delivery ] ...
(TARA) Talegaon Dabhade Call Girls Just Call 7001035870 [ Cash on Delivery ] ...(TARA) Talegaon Dabhade Call Girls Just Call 7001035870 [ Cash on Delivery ] ...
(TARA) Talegaon Dabhade Call Girls Just Call 7001035870 [ Cash on Delivery ] ...
 
Model Call Girl in Narela Delhi reach out to us at 🔝8264348440🔝
Model Call Girl in Narela Delhi reach out to us at 🔝8264348440🔝Model Call Girl in Narela Delhi reach out to us at 🔝8264348440🔝
Model Call Girl in Narela Delhi reach out to us at 🔝8264348440🔝
 
MANUFACTURING PROCESS-II UNIT-5 NC MACHINE TOOLS
MANUFACTURING PROCESS-II UNIT-5 NC MACHINE TOOLSMANUFACTURING PROCESS-II UNIT-5 NC MACHINE TOOLS
MANUFACTURING PROCESS-II UNIT-5 NC MACHINE TOOLS
 
DJARUM4D - SLOT GACOR ONLINE | SLOT DEMO ONLINE
DJARUM4D - SLOT GACOR ONLINE | SLOT DEMO ONLINEDJARUM4D - SLOT GACOR ONLINE | SLOT DEMO ONLINE
DJARUM4D - SLOT GACOR ONLINE | SLOT DEMO ONLINE
 
9953056974 Call Girls In South Ex, Escorts (Delhi) NCR.pdf
9953056974 Call Girls In South Ex, Escorts (Delhi) NCR.pdf9953056974 Call Girls In South Ex, Escorts (Delhi) NCR.pdf
9953056974 Call Girls In South Ex, Escorts (Delhi) NCR.pdf
 
Introduction and different types of Ethernet.pptx
Introduction and different types of Ethernet.pptxIntroduction and different types of Ethernet.pptx
Introduction and different types of Ethernet.pptx
 
IMPLICATIONS OF THE ABOVE HOLISTIC UNDERSTANDING OF HARMONY ON PROFESSIONAL E...
IMPLICATIONS OF THE ABOVE HOLISTIC UNDERSTANDING OF HARMONY ON PROFESSIONAL E...IMPLICATIONS OF THE ABOVE HOLISTIC UNDERSTANDING OF HARMONY ON PROFESSIONAL E...
IMPLICATIONS OF THE ABOVE HOLISTIC UNDERSTANDING OF HARMONY ON PROFESSIONAL E...
 
(SHREYA) Chakan Call Girls Just Call 7001035870 [ Cash on Delivery ] Pune Esc...
(SHREYA) Chakan Call Girls Just Call 7001035870 [ Cash on Delivery ] Pune Esc...(SHREYA) Chakan Call Girls Just Call 7001035870 [ Cash on Delivery ] Pune Esc...
(SHREYA) Chakan Call Girls Just Call 7001035870 [ Cash on Delivery ] Pune Esc...
 
Introduction to IEEE STANDARDS and its different types.pptx
Introduction to IEEE STANDARDS and its different types.pptxIntroduction to IEEE STANDARDS and its different types.pptx
Introduction to IEEE STANDARDS and its different types.pptx
 
Decoding Kotlin - Your guide to solving the mysterious in Kotlin.pptx
Decoding Kotlin - Your guide to solving the mysterious in Kotlin.pptxDecoding Kotlin - Your guide to solving the mysterious in Kotlin.pptx
Decoding Kotlin - Your guide to solving the mysterious in Kotlin.pptx
 
Processing & Properties of Floor and Wall Tiles.pptx
Processing & Properties of Floor and Wall Tiles.pptxProcessing & Properties of Floor and Wall Tiles.pptx
Processing & Properties of Floor and Wall Tiles.pptx
 
Call for Papers - African Journal of Biological Sciences, E-ISSN: 2663-2187, ...
Call for Papers - African Journal of Biological Sciences, E-ISSN: 2663-2187, ...Call for Papers - African Journal of Biological Sciences, E-ISSN: 2663-2187, ...
Call for Papers - African Journal of Biological Sciences, E-ISSN: 2663-2187, ...
 
Call Girls in Nagpur Suman Call 7001035870 Meet With Nagpur Escorts
Call Girls in Nagpur Suman Call 7001035870 Meet With Nagpur EscortsCall Girls in Nagpur Suman Call 7001035870 Meet With Nagpur Escorts
Call Girls in Nagpur Suman Call 7001035870 Meet With Nagpur Escorts
 
OSVC_Meta-Data based Simulation Automation to overcome Verification Challenge...
OSVC_Meta-Data based Simulation Automation to overcome Verification Challenge...OSVC_Meta-Data based Simulation Automation to overcome Verification Challenge...
OSVC_Meta-Data based Simulation Automation to overcome Verification Challenge...
 

Scheme for motion estimation based on adaptive fuzzy neural network

  • 1. TELKOMNIKA Telecommunication, Computing, Electronics and Control Vol. 18, No. 2, April 2020, pp. 1030~1037 ISSN: 1693-6930, accredited First Grade by Kemenristekdikti, Decree No: 21/E/KPT/2018 DOI: 10.12928/TELKOMNIKA.v18i2.14752  1030 Journal homepage: http://journal.uad.ac.id/index.php/TELKOMNIKA Scheme for motion estimation based on adaptive fuzzy neural network Fredy Martínez, Cristian Penagos, Luis Pacheco Facultad Tecnológica, Universidad Distrital Francisco José de Caldas, Colombia Article Info ABSTRACT Article history: Received Jul 13, 2019 Revised Jan 4, 2020 Accepted Feb 19, 2020 Many applications of robots in collaboration with humans require the robot to follow the person autonomously. Depending on the tasks and their context, this type of tracking can be a complex problem. The paper proposes and evaluates a principle of control of autonomous robots for applications of services to people, with the capacity of prediction and adaptation for the problem of following people without the use of cameras (high level of privacy) and with a low computational cost. A robot can easily have a wide set of sensors for different variables, one of the classic sensors in a mobile robot is the distance sensor. Some of these sensors are capable of collecting a large amount of information sufficient to precisely define the positions of objects (and therefore people) around the robot, providing objective and quantitative data that can be very useful for a wide range of tasks, in particular, to perform autonomous tasks of following people. This paper uses the estimated distance from a person to a service robot to predict the behavior of a person, and thus improve performance in autonomous person following tasks. For this, we use an adaptive fuzzy neural network (AFNN) which includes a fuzzy neural network based on Takagi-Sugeno fuzzy inference, and an adaptive learning algorithm to update the membership functions and the rule base. The validity of the proposal is verified both by simulation and on a real prototype. The average RMSE of prediction over the 50 laboratory tests with different people acting as target object was 7.33. Keywords: Adaptive learning algorithm Fuzzy neural network Motion planning Service robot This is an open access article under the CC BY-SA license. Corresponding Author: Fredy Martínez, Facultad Tecnológica, Universidad Distrital Francisco José de Caldas Bogotá, Colombia. Email: fhmartinezs@udistrital.edu.co 1. INTRODUCTION Service robotics is one of the applications of robotic systems that arouses the most interest among the general population due to its high expectations and possibilities, but at the same time is one of the areas with the most unsolved engineering problems [1]. Robots that interact with humans in human environments must solve problems of path planning, image processing, interaction with the environment, fine manipulation, communication, and in particular, direct interaction with the human being [2]. This interaction involves many engineering problems, not only considering the safety problems for both parties during the interaction, which is a net engineering problem [3, 4], but the interaction is conditioned by human behavior, which is quite unpredictable. In domestic applications, for example, applications in which the robot must be attentive to children or elderly, we expect the machine to always be close to the person under care, moving with him to provide their services, but without interfering with his normal activity. Given the unknown nature of the movement of people in the environment and the high complexity and dynamics of the environments,
  • 2. TELKOMNIKA Telecommun Comput El Control  Scheme for motion estimation based on adaptive fuzzy neural network (Fredy Martinez) 1031 adaptable tracking systems are required, with the ability to learn and work in real time. A typical characteristic of service robots is that their tasks are carried out in dynamic, unstructured and unknown environments, generally without identifiable characteristics. The robot must be able to navigate and interact in any environment in which people find themselves, which characterizes the physical structure of the robot (size, type of displacement, actuators, etc.) and its needs for sensing and acting (often equivalent to human). In addition, the processing of information and the response of the robot must be in real time. This is why these sensors are so important for autonomous robots in general [5, 6]. Currently a crucial element in the design of this type of systems are the active robotic sensors, which have become high performance tools capable of considerably reducing the processing requirements of the robot control unit. These systems have gained great commercial recognition, even at the military level, thanks to their embedded structure that, together with sensors that observe physical variables directly, process this information in real time to extract relevant information for the robot. This kind of sensors has promoted research in information-driven strategies for the development of tasks with robots, as well as the implementation of algorithms for digital signal processing and control schemes oriented to these sensor [4]. As minimum requirements, the robot must be able to define its distance and size. In other cases, it is also necessary to know its height to define interaction strategies (pick up an object from a table, for example). Depending on the application it is possible to use different kinds of sensors, in interaction with human environments are very important optical sensors [4, 6, 7], however, when the person has been identified, and the goal is to make a basic tracking of him, the most important sensors are the distance sensors [8, 9, 10]. The camera-supported optical sensors in robotics have been widely used to solve the problem of identifying and tracking people. The schemes, though far from autonomous implementation, provide high levels of performance for both problems [11, 12]. This strategy is known as Visual Servoing or Vision-Based Robot Control (VS) and is characterized by having as feedback information the image of a camera [13]. The goal is to support robot decision making with eyes that take optical information from its own perspective [14]. However, the use of cameras capable of continuously recording people’s personal lives involves serious privacy issues, and despite the guarantees of encryption and non-sharing of information, fear prevails [15]. In addition, the visual information captured by the cameras is, in fact, excessive for the realization of certain tasks. Distance sensors are also widely used in these applications [11], and unlike video cameras, they have greater acceptance to work between people because they record less private information. The most important characteristic of the following task is that it is strongly focused on the person under care. This is a common case in service robots that provide some service to a person [16-18]. Practically speaking, this means that the robot must be aware of the person’s behavior. Similarly, the robot will ignore other elements of the environment unless they force the robot’s response [19, 20]. In this sense, we only study in our research the autonomous response of the robot to the behavior of the person. In our research, we define the task of following people, in the context of service robots, as a high-level task that the robot performs at all times in parallel with its interaction tasks [21]. In the context of the task, the robot does not know the person’s movement dynamics, whether the person is going to remain still, or where it is going when walking. In this way, the robot needs to infer the person’s movement beforehand and act accordingly. In addition, the design of the movement scheme must take into account the aforementioned aspects of navigation, interaction, and sensing, as these are key elements in the robot’s final action. These parameters are combined with an adaptive learning scheme and an inference machine based on fuzzy inference. These two elements form the Fuzzy Neural Network (FNN) designed for decision making, which is supplied by our active distance sensor [22, 23]. 2. PROBLEM FORMULATION The goal of this research is to develop a robust and high-performance software tool that allows the development of autonomous tasks of people follow-up by a small autonomous robot. The work is strongly motivated by the need for this feature as part of the routine interaction of an assistive robot that operates in unknown indoor environments. Let W ⊂ ℝ2 be the closure of a contractible open set in the plane that has a connected open interior with obstacles that represent inaccessible regions. Let 𝓞 be a set of obstacles, in which each O ⊂ 𝓞 is closed with a connected piecewise-analytic boundary that is finite in length. The position of obstacles in the environment changes over time in an unknown way, but they are detectable by distance sensors. In addition, the obstacles in 𝓞 are pairwise-disjoint and countably finite in number. Let E ⊂ W be the free space in the environment, which is the open subset of W with the obstacles removed. This space can be freely navigated by the robot, but it can also be occupied at any time by an obstacle. The robot knows the environment W (and E) from observations, using sensors. These observations allow him to build an information space I. An information mapping is of the form:
  • 3.  ISSN: 1693-6930 TELKOMNIKA Telecommun Comput El Control, Vol. 18, No. 2, April 2020: 1030 - 1037 1032 𝑞: 𝐸 → 𝑆 (1) where S denote an observation space, constructed from sensor readings over time, i.e., through an observation history of the form (2). 𝑜̃: [0, 𝑡] → 𝑆 (2) The interpretation of this information space, i.e., I ✕ S ⟶ I, is that which allows the robot to make decisions. The problem can be expressed as the search for a function u for a specific set of conditions between a certain obstacle and the robot, from a set of robot sensed data y ⊂ S and a target function g. 𝑓: 𝒚 × 𝒈 → 𝒖 (3) 3. METHODOLOGY As part of the research, the research group has previously developed an active sensor that processes distance information to define the motion of an autonomous robot in indoor environments using real-time analysis of raw data from a group of nine infrared sensors [22]. The infra-red sensor captures distance data in real time producing a large database that the robot analyzes according to previous experiences to directly define distance on the horizontal plane to the object (person). Observing the dependence of data with the topology of the environment, the active sensor uses a model based on a long short-term memory (LSTM) network to estimate distances [24]. Thanks to this model it is possible to define coordinates on the plane of the environment to an obstacle of interest, regardless of the characteristics of the obstacle or its position with respect to the robot. The historical behavior of the variables is also used to differentiate the person of interest from other elements and obstacles of the environment, however, to differentiate between different people we have used specific marks on the person of interest. The active sensor delivers the coordinates x and y to the obstacle under study (person to follow) with respect to an axis defined on the geometrical center of the robot. This sensor has a real-time processing unit that assigns values to the raw data captured by the nine infra-red sensors using models based on an LSTM network. These data also define the heading θ and allow to determine speed and acceleration Figure 1. Figure 1. Variables and dimensions axes on the plane with respect to the robot The proposed system is composed of a fuzzy neural network (FNN) and an adaptive learning algorithm Figure 2. The neural network is made up of five layers: a layer of input variables (two-dimensional distances from the robot to the obstacle, the relative velocity between robot and obstacle, the heading angle and acceleration), the second layer corresponds to the membership functions, the third layer is of reasoning rules with Takagi-Sugeno type inference, the fourth layer corresponding to the fuzzy quantification of the output variable, and the fifth layer containing the output nodes (output variable, robot heading angle). The input vector has the following format (4): 𝑋 = [𝛥𝑥, 𝛥𝑦, 𝛥𝑣, 𝜃, 𝑎𝑐] (4)
  • 4. TELKOMNIKA Telecommun Comput El Control  Scheme for motion estimation based on adaptive fuzzy neural network (Fredy Martinez) 1033 We define three trapezoidal fuzzy sets for each of the input variables uniformly distributed throughout the discourse universe of each variable. This design generated a total of 243 fuzzy rules each with the following structure (5): 𝑅𝑖: 𝐼𝐹 (∆𝑥 𝑖𝑠 𝐴𝑖) 𝑎𝑛𝑑 (∆𝑦 𝑖𝑠 𝐵𝑖) 𝑎𝑛𝑑 (∆𝑣 𝑖𝑠 𝐶𝑖) 𝑎𝑛𝑑 (𝜃 𝑖𝑠 𝐷𝑖) 𝑎𝑛𝑑 (𝑎𝑐 𝑖𝑠 𝐸𝑖) 𝑇𝐻𝐸𝑁 ℎ𝑖 𝑖𝑠 𝑓𝑖(∆𝑥, ∆𝑦, ∆𝑣, 𝜃, 𝑎𝑐) (5) Figure 2. Proposed prediction system architecture A, B, C, D, and E correspond to a fuzzy set defined by its membership function, and fi corresponds to the inference consequence for the output variable and according to the evaluated ith fuzzy rule. We use a Takagi-Sugeno-Kang fuzzy inference in order to obtain an output membership function defined from the input variables (a linear function defined by the input vector). Due to the mechanical delays in the motion responses of the robot platform, we decided not to use fuzzy sets with triangular or Gaussian shapes [25], instead, we chose trapezoidal functions that allowed constant output behaviors for certain ranges of input variables Figure 3. The output inferred h0 is determined as the weighted average of the outputs of each rule for the input vector X0 = [Δx0, Δy0, Δv0, θ0, ac0] (6), where ωi is the membership degree for the ith rule. ℎ̂0 = ∑ 𝜔𝑖 ∙ 𝑓𝑖 𝑘 𝑖=1 (∆𝑥0, ∆𝑦0, ∆𝑣0, 𝜃0, 𝑎𝑐0) ∑ 𝜔𝑖 𝑘 𝑖=1 (6) We use a Least Squares Estimator (LSE) to perform parameter estimation by training the linear functions. Each of these functions has the general form (7). 𝑓(𝑋) = 𝑏0 + 𝑏1 𝑋(1) + 𝑏2 𝑋(2) + 𝑏3 𝑋(3) + 𝑏4 𝑋(4) + 𝑏5 𝑋(5) (7) To increase the performance of the prediction scheme, we use an adaptive learning algorithm to improve the inference machine, particularly by adjusting the membership functions defined initially Figure 3 from the behavior of the prediction error. 𝑒 = ℎ − ℎ̂ (8)
  • 5.  ISSN: 1693-6930 TELKOMNIKA Telecommun Comput El Control, Vol. 18, No. 2, April 2020: 1030 - 1037 1034 During training each fuzzy set is replaced by a set that improves the performance of the estimator, i.e., produces less error according to the behavior of the RMSE. Figure 3. Initial membership functions of the five input variables 4. FINDINGS Our robot platform consists of two robots integrated in a single system: Nao robot from SoftBank Group, and our ARMOS TurtleBot 1 robot Figure 4. Our future objective is to develop our platform for service applications, we have created a first mobile functional prototype, and we are experimenting with different manipulator prototypes, but in the meantime, this integration of robots makes up our robotic solution. The Nao robot is used for direct interaction with human beings taking advantage of their morphology, sensors, actuators and responsiveness. The ARMOS TurtleBot 1 robot is used as a robust navigation platform in dynamic indoor environments. The two robots share information via a router installed in the ARMOS TurtleBot 1. The ARMOS TurtleBot 1 robot also has sufficient processing capacity for real-time execution of simple visual recognition algorithms (DragonBoard 410c of Arrow Electronics with ARM Cortex-A53 Quad-core up to 1.2 GHz per core and Qualcomm Adreno 306 @ 400MHz). The DragonBoard also collects the data read by the sensors during robot-human interaction tests, processes them and produces the training database with the input and output variables. The dataset was divided into 70% for training and 30% for testing. This division allows using most of the dataset to create the model, ensuring that statistically, the population of datasets are marginally different and that all possible patterns that will characterize the model are included. The 30% of unknown data allows validation and testing of the model. Figure 5 shows the final membership functions for the five input variables after the learning process. With this structure the performance of the model was validated for different people identified by the robot. Figure 6 shows the prediction results for the tracking of two different people under laboratory conditions. In the tests people gently approach and move away from the robot after it has identified them as a target object. The first person was a man of 1.71 m height and medium body (76 kg weight). The second person was a man 1.74 m high with a little more volume (89 kg weight). The entire training process was conducted with five
  • 6. TELKOMNIKA Telecommun Comput El Control  Scheme for motion estimation based on adaptive fuzzy neural network (Fredy Martinez) 1035 different people. The movements in front of the robot were slow, but corresponding to the natural behavior of a person in human interaction. The model is not trained with high-speed behaviors because they do not correspond to the expected operation, and because the active sensor has a response speed limit. In the figure the black line represents the real behavior data detected by the robot sensors, while the red curve represents the behavior predicted by the model for the same instant. In blue is the tracking error in each case. As in the two cases shown, the results show that the proposed model can closely follow the movements of the target person. The average RMSE of prediction over the 50 laboratory tests with different people acting as target object was 7.33. Figure 4. Service robot (Nao robot at the top and ARMOS TurtleBot 1 at the bottom) used in interaction and tracking tests Figure 5. Final membership functions of the five input variables
  • 7.  ISSN: 1693-6930 TELKOMNIKA Telecommun Comput El Control, Vol. 18, No. 2, April 2020: 1030 - 1037 1036 5. CONCLUSIONS In this paper we propose an adaptive fuzzy neural network to predict the movements of a person, in real time, by a service robot. This scheme is integrated with other subroutines in our robotic platform in order to develop complex tasks in the care of children, sick and elderly people. The proposed model uses as input variables the two-dimensional coordinates of the robot in the environment over time, as well as the estimation of its speed, orientation and acceleration. The proposed strategy presents a high performance in predicting the behavior of the target person thanks to the optimization of the parameters in the Takagi-Sugeno model. In addition, the adaptive learning scheme used optimizes the design of the belonging functions and the related fuzzy rules which improves accuracy. The size and location of the fuzzy sets was adjusted in line with the learning process. In most cases the central set was reduced, and the central value moved from the center of the discourse universe. Laboratory experiments performed with our robotic platform demonstrate the high performance of the strategy, and its high reliability to predict the behavior of the person from the readings of the active distance sensor. The average RMSE of prediction over the 50 laboratory tests with different people acting as target object was 7.33. On the model achieved it is proposed to improve the performance reducing the errors of prediction through the presentation of new patterns with a wider set of people that includes a greater class of characteristics to detect by the robot. Figure 6. Predictive results for two following cases. The red curve represents the behavior predicted by the model, while the blue curve represents the tracking error ACKNOWLEDGMENTS This work was supported by the Universidad Distrital Francisco José de Caldas, in part through CIDC, and partly by the Facultad Tecnológica. The views expressed in this paper are not necessarily endorsed by District University. The authors thank the research group ARMOS for the evaluation carried out on prototypes of ideas and strategies. REFERENCES [1] J. Wirtz, W. Kunz, T. Gruber, V. Nhat, S. Paluch, and A. Martins, “Brave new world: service robots in the frontline,” Journal of Service Management, vol. 29, no. 5, pp. 907-931, 2018. doi: https://doi.org/10.1108/JOSM-04-2018-0119 [2] I. Stanislav, W. Craig, and K. Berezina, “Adoption of robots and service automation by tourism and hospitality companies”. Revista Turismo & Desenvolvimento, vol. 27, no. 28, pp. 1501-1517, 2017. [3] P. Lasota, T. Fong, and J. Shah, “A survey of methods for safe human-robot interaction,” Foundations and Trends in Robotics, vol 5, no. 4, pp. 261-349, 2017. doi: http://dx.doi.org/10.1561/2300000052 [4] C. Freundlich, Y. Zhang, A. Zhu, P. Mordohai, and M. Zavlanos, “Controlling a robotic stereo camera under image quantization noise,” The International Journal of Robotics Research, vol. 36, no. 12, pp. 1268-1285, June 2017. doi: 10.1177/0278364917735163 [5] S. Solak and E. D. Bolat, "Distance estimation using stereo vision for indoor mobile robot applications," 2015 9th International Conference on Electrical and Electronics Engineering (ELECO), Bursa, pp. 685-688, 2015. doi: 10.1109/ELECO.2015.7394442 [6] Y. Hongshan, Z. Jiang, W. Yaonan, J. Wenyan, S. Mingui, and T. Yandong, “Obstacle classificationand 3D measurementin unstructured environmentsbased on ToF cameras”, Sensors, vol. 14, no. 1, pp. 10753-10782, 2014. doi: 10.3390/s140610753
  • 8. TELKOMNIKA Telecommun Comput El Control  Scheme for motion estimation based on adaptive fuzzy neural network (Fredy Martinez) 1037 [7] Z. Yuanshen, G. Liang, H. Yixiang, and L. Chengliang, “A review of key techniques of vision-based control for harvesting robot,” Computers and Electronics in Agriculture, ISSN 0168-1699, vol. 127, pp. 311-323, Sept 2016. doi: 10.1016/j.compag.2016.06.022 [8] D. Fischinger, P. Einramhof, K. Papoutsakis, W. Wohlkinger, P. Mayer, P. Panek, S. Hofmann, T. Koertner, A. Weiss, A. Argyros, and M. Vincze. “Hobbit, a care robot supporting independent living at home: First prototype and lessons learned. Robotics and Autonomous Systems,” Robotics and Autonomuous System, vol. 75, pp. 60-78, Jan 2016. doi: https://doi.org/10.1016/j.robot.2014.09.029 [9] Y. Wang, L. Zhijun, and S. Chun-Yi, “Rgb-d sensor-based visual slam for localization and navigation of indoor mobile robot,” International Conference on Advanced Robotics and Mechatronics (ICARM 2016), pp. 82-87, Macau, 2016. doi: 10.1109/ICARM.2016.7606899 [10] F. Yang and X. Chenkun, “Human-tracking strategies for a six-legged rescue robot based on distance and view,” Chinese Journal of Mechanical Engineering, ISSN 1000-9345, vol. 29, pp. 219-230, March 2016. doi: https://doi.org/10.3901/CJME.2015.1212.146 [11] T. Linder and K. Arras. People Detection, “Tracking and Visualization Using ROS on a Mobile Service Robot,” Robot Operating System (ROS). Springer, pp. 187-213, Feb 2016. [12] M. Mahammed, A. Melhum, and F. Kochery, “Object distance measurement by stereo vision,” International Journal of Science and Applied Information Technology, vol. 2, no 2, pp. 5-8, March 2013. [13] C. Mao-Hsiung, L. Hao-Ting, and H. Chien-Lun, “Development of a stereo vision measurement system for a 3d three-axial pneumatic parallel mechanism robot arm,” Sensors, vol. 11, no 2, pp. 2257-2281, Feb 2011. doi: 10.3390/s110202257 [14] A. Mohamed, Y. Chenguang, and A. Cangelosi, “Stereo vision based object trackingcontrol for a movable robot head,” 4th IFAC International Conference onIntelligent Control and Automation Sciences, vol. 49, no. 5, pp. 155-162, 2016. [15] S. Glende, I. Conrad, L. Krezdorn, S. Klemcke, and C. Krätzel, “Increasing the acceptance of assistive robots for older people through marketing strategies based on stakeholder needs,” International Journal of Social Robotics, ISSN 1875-4791, vol. 8, no. 3, pp. 355-369, June 2016, doi: https://doi.org/10.1007/s12369-015-0328-5 [16] H. Gross, A. Scheidig, K. Debes, E. Einhorn, M. Eisenbach, S. Mueller, T. Schmiedel, T. Trinh, T. Weingefeld, A. Bley, and C. Martin, “ROREAS: robot coach for walking and orientation training in clinical post-stroke rehabilitation-prototype implementation and evaluation in field trials,” Autonomous Robots, vol. 41, no. 3, pp. 679-698, March 2017. doi: https://doi.org/10.1007/s10514-016-9552-6 [17] M. Mast, M. Burmester, B. Graf, F. Weisshardt, G. Arbeiter, M. Spanel, Z. Materna, P. Smrz, and G. Kronreif, “Design of the human-robot interaction for a semi-autonomous service robot to assist elderly people” Advanced Technologies and Societal Change, vol. 1, no. 1, pp. 15-29, 2015. doi: https://doi.org/10.1007/978-3-319-11866-6_2 [18] K. Koide and J. Miura, “Identification of a specific person using color, height, and gait features for a person following robot,” Robotics and Autonomous Systems, vol. 84, no. 1, pp. 76-87, Oct 2016. doi: https://doi.org/10.1016/j.robot.2016.07.004 [19] R. Triebel, K. Arras, R. Alami, L. Beyer, S. Breuers, R. Chatila, M. Chetouani, D. Cremers, V. Evers, M. Fiore, H. Hung, O. Islas, M. Joosse, H. Khambhaita, and T. Kucner, “Spencer: A socially aware service robot for passenger guidance and help in busy airports,” Springer Tracts in Advanced Robotics, vol, 113, no. 1, pp. 607-622, 2016. doi: https://doi.org/10.1007/978-3-319-27702-8_40 [20] M. Hersh, “Overcoming barriers and increasing independence - service robots for elderly and disabled people,” International Journal of Advanced Robotic Systems, vol. 12, no. 8, pp. 1-33, 2015. doi: https://doi.org/10.5772/59230 [21] G. Ferrer, A. Garrell, F. Herrero, and A. Sanfeliu, “Robot social-aware navigation framework to accompany people walking side-by-side,” Autonomous Robots, vol. 41, no. 4, pp. 775-793, 2017. doi: https://doi.org/10.1007/s10514- 016-9584-y [22] F. Martínez, A. Rendón, and M. Arbulú, “A data-driven path planner for small autonomous robots using deep regression models,” Lecture Notes in Computer Science, pp. 596-603, 2018. doi: https://doi.org/10.1007/978-3-319- 93803-5_56 [23] F. Martínez, D. Acero, and M. Castiblanco, “Robótica autónoma: Acercamiento a algunos problemas centrales,” Universidad Distrital Francisco José de Caldas, 2015. [24] F. Kratzert, D. Klotz, C. Brenner, K. Schulz, and M. Herrnegger, “Rainfall–runoff modelling using Long Short- TermMemory (LSTM) networks,” Hydrology and Earth System Sciences, vol. 22, no. 11, pp. 6005-6022, Nov 2018. doi: https://doi.org/10.5194/hess-22-6005-2018 [25] S. Azimi, and H. Miar, “Designing an analog CMOS fuzzy logic controller forthe inverted pendulum with a novel triangular membership function,” Scientia Iranica, vol 26, no. 3, pp. 1736-1748, 2019. doi: 10.24200/sci.2018.5224.1153