SlideShare a Scribd company logo
1 of 10
Download to read offline
International Journal of Electrical and Computer Engineering (IJECE)
Vol. 9, No. 3, June 2019, pp. 1861~1870
ISSN: 2088-8708, DOI: 10.11591/ijece.v9i3.pp1861-1870  1861
Journal homepage: http://iaescore.com/journals/index.php/IJECE
Black-box modeling of nonlinear system using evolutionary
neural NARX model
Nguyen Ngoc Son, Nguyen Duy Khanh, Tran Minh Chinh
Faculty of Electronics Technology, Industrial University of Ho Chi Minh City, Viet Nam
Article Info ABSTRACT
Article history:
Received May 12, 2018
Revised Dec 18, 2018
Accepted Dec 29, 2018
Nonlinear systems with uncertainty and disturbance are very difficult to
model using mathematic approach. Therefore, a black-box modeling
approach without any prior knowledge is necessary. There are some
modeling approaches have been used to develop a black box model such as
fuzzy logic, neural network, and evolution algorithms. In this paper, an
evolutionary neural network by combining a neural network and a modified
differential evolution algorithm is applied to model a nonlinear system. The
feasibility and effectiveness of the proposed modeling are tested on a
piezoelectric actuator SISO system and an experimental quadruple tank
MIMO system.
Keywords:
Differential evolution
Evolutionary neural networks
Nonlinear system identification
Piezoelectric actuator
Quadruple tank system Copyright © 2019 Institute of Advanced Engineering and Science.
All rights reserved.
Corresponding Author:
Nguyen Ngoc Son,
Faculty of Electronics Technology,
Industrial University of Ho Chi Minh City,
12 Nguyen Van Bao Street, 4 Ward, Go Vap District, Ho Chi Minh City, Viet Nam.
Email: nguyenngocson@iuh.edu.vn
1. INTRODUCTION
Mathematical modeling of systems is a very common methodology in engineering. It is used both as
a means for achieving deeper knowledge about a system and as a basis for simulations or for the design of
controllers. However, in practice, it is not easy to obtain an accurate mathematical model of a nonlinear
system because of a lack of knowledge of the system and disturbance impact to system maybe still unknown.
In these cases, system identification can be a way of solving the modeling problem. System identification
deals with the problem of how to estimate a model of a system from measured input and output signals.
Black-Box nonlinear modeling approaches include non-parametric methods, such as neural networks, fuzzy
logic, genetic algorithm etc., [1] which do not require a priori knowledge.
Recently, the multilayer feed-forward neural network (MLP) has been widely used in nonlinear
system identification. As we know, the performance of a neural network is dependent on the training process.
A popular training algorithm is the back-propagation. However, the back-propagation (BP) algorithm only
perform a local search around the initial values and provide local optimizations [2], [3]. Therefore the meta-
heuristic algorithms based training procedures are considered as promising alternatives. The meta-heuristic
algorithms generate global optimum because of their ability to search the global solution space and avoiding
falling into a locally optimal solution. For example, a genetic algorithm [4]-[6] is used for turning the
structure and parameters of neural networks. Papers [7]-[9] introduced the particle swarm optimization (PSO)
to train the neural network model. Valian et al. [10] proposed the improved cuckoo search algorithm for
training feed-forward neural network for two benchmark classification problems. Although these proposed
methods obtained good results, two challenges that need to be further improved in training neural network
are how to find the global optimal solution and how to achieve a fast convergence speed.
 ISSN: 2088-8708
Int J Elec & Comp Eng, Vol. 9, No. 3, June 2019 : 1861 - 1870
1862
Among meta-heuristic algorithms, the differential evolution (DE) technique was regarded as a
promising stochastic global optimization algorithm. The DE algorithm was first studied and published by
Storn R. and Price K.V. [11]. Its advantages are as follows: the simple and straightforward features in
installation, better performance, fewer parameters involved, and low complexity. Over recent years, the DE
technique had been applied to learn a neural model via optimizing real and constrained integer weighting
values [12]-[15]. Nonetheless, DE technique gets the slow convergence speed for high-sized optimization
tasks. Furthermore, DE technique often seems easy to fall into a stagnant situation that is a state that the
optimum searching procedure stagnates before obtaining a global optimum solution. Some suggestions on
how to improve the DE performance on the training neural network have been studied [16]-[20]. Paper [21]
proposed the hybrid modified differential evolution plus back-propagation algorithm (MDE-BP) for training
neural network model. The performance and efficiency of the proposed MDE-BP training method are tested
on identifying some benchmark nonlinear systems. However, paper [21] only perform for SISO nonlinear
identification system. Therefore, this paper continuously studies the proposed MDE-BP training algorithm in
[21] to train a neural network for a general nonlinear identification and its approach to model a piezoelectric
actuator SISO system and an experimental quadruple tank MIMO system. These systems are suitable to test
the effectiveness of the proposed method because of its hysteresis behavior and highly nonlinearity
characteristic.
The rest of this paper is organized as follows. Section 2 introduces the proposed MDE-BP training
neural NARX model for MIMO nonlinear system identification. Section 3 presents the results and discussion.
Where Section 3.1 introduces to model a piezoelectric actuator SISO system. Section 3.2 introduces an
experimental quadruple tank setup and the identification results. Finally, Section 4 contains
some conclusions.
2. RESEARCH METHOD
Evolutionary neural NARX (ENN) model is proposed in [21] by connecting the Multi-Layer
Perceptron Neural Networks (MLP) model and NARX structure. The weight value of ENN model is
optimized by a hybridizing modified differential evolution and backpropagation training (MDE-BP)
algorithms. Based on this combination, the ENN model obtains a strongly approximating feature of the MLP
scheme and a powerful predictive feature of the NARX structure. The ENN model structure, which is used
for nonlinear MIMO system identification, is illustrated in Figure 1.
1
z 1 (k 1)u 
nb
z
MDE-BP
algorithm
Nonlinear
MIMO system1u
nu
1y
my
1
ˆy
ˆmy
MLP - NARX
error
error
1 (k )u nb
1
z
(k 1)nu 
nb
z (k )nu nb
1
z
(k 1)my 
na
z
(k )my na
1
z 1 (k 1)y 
na
z 1 (k )y na
Figure 1. The ENN model for a nonlinear system identification
Where, u(k) and y(k) represent the input and output signals of nonlinear MIMO system; na and nb
are order of output y(k) and input u(k), respectively; q is the backward time shift operator defined as q-1
u (k)
= u (k-1). vjn is the weight of input layer, vj0 is the weight of bias input layer, w1j is the weight of hidden layer,
w10 is the weight of bias hidden layer; fj(:) is sigmoid function at hidden layer, F(:) is linear activation
function at output layer; the dimension number D is the sum of the number of weights and thresholds of the
Int J Elec & Comp Eng ISSN: 2088-8708 
Black-box modeling of nonlinear system using evolutionary neural NARX model (Nguyen Ngoc Son)
1863
neural NARX model;      1 2(k) ,u ,...,unu u k k k    is the input signal vector and
     1 2(k) ,y ,...,ymy y k k k    is the output signal vector of nonlinear MIMO system. We determine the
prediction output as follows:
̂( ) (∑ (∑ ( ) ) ) (1)
Where, ( )kj is the regression vector and q is the weight vector, defined by
     
       
       1
1 ,..., , 1 ,..., ,
,...,
1 ,..., , 1 ,...,
T
T m m
n
n n
y k y k na y k y k na
k k k
u k u k nb u k u k nb
  
    
     
     
(2)
[ ] , - (3)
The modified differential evolution training algorithm is used to optimally generate the value of the
weight of the neural NARX model. The output of the neural NARX model is a prediction function ( )ˆy k q of
the synaptic weight vector  and regression vector  k .
Algorithm 1. The proposed MDE-BP training algorithm
1. Begin
2. Generate randomly initialized a population ⃗⃗⃗⃗⃗⃗ [ ]
3. Evaluate the fitness of each individual in the population
4. For G=1 to GEN do
5. For i =1 to NP do
6. jrand= randint(1,D)
7. F = rand[0:4; 1:0], CR = rand[0:7; 1:0]
8. For j =1 to D do
9. If rand[0,1] < CR or j == jrand then
10. If rand[0,1] > threshold then
11. Select randomly * +
12. ( )
13. Else
14. Select randomly * +
15. ( )
16. End if
17. Else
18.
19. End if
20. End for
21. If (⃗⃗ ) (⃗⃗ ) then
22. ⃗⃗ ⃗⃗
23. Else
24. ⃗⃗ ⃗⃗
25. End if
26. End for
27. Use ⃗⃗ as an initial point for BP algorithm
28. Replace ⃗⃗ by bp obtaining from BP algorithm
29. End for
30. End
In the training process, both the input signal u(k) and the output signal y(k) of nonlinear MIMO
system are known and the synaptic weight vector  is adapted to obtain appropriate functional mappings
from the input u(k) to the output y(k). Generally, the adaptation process can be carried out by minimizing the
network error function EN which is based on the introduction of a measure of closeness in terms of a mean
square error (MSE) criterion.
( ) ∑ , ( ) ̂( )- , ( ) ̂( )- (4)
 ISSN: 2088-8708
Int J Elec & Comp Eng, Vol. 9, No. 3, June 2019 : 1861 - 1870
1864
Where the training data
N
Z is specified by *, ( ) ( )- +. The optimization
goal is to minimize the objective function EN by optimizing the values of the network weights
[ ]1 2, ,....,
T
Dw w wq = by using the MDE-BP algorithm which is described in details at paper [21]. The
working steps involved in employing MDE-BP training algorithm as Algorithm 1.
3. RESULTS AND ANALYSIS
All of the modelings is performed by Matlab version 2013b on an Intel Core i3 computer with a
clock rate of 2.53GHz and 2.00GB of RAM.
3.1. Modeling the hysteresis behavior of the piezoelectric actuator
Micropositioning stages using piezoelectric actuator are widely used in a variety of applications
such as microgripper robot [22], energy harvesting [23], MEMs [24] and so on. The piezoelectric actuator
possesses a higher displacement accuracy, larger generation force and higher response speed than other types
of actuators. However, the nonlinearities hysteresis of the piezoelectric actuator can greatly degrade the
positioning accuracy of micropositioning systems [25], [26]. Therefore, modeling precisely and identifying
parameter effectively for piezoelectric actuator still remain a challenging problem nowadays. To describe the
hysteresis behavior of the piezoelectric actuator, many mathematical models have been proposed such as
Prandtl-Ishlinskii, Preisach model, Bouc-Wen model, KP model, Duhem model and so on [27]. However, the
difficulties in determining the parameters of the hysteresis model limit its application in practice.
Figure 2. Selection of training data for estimating and validating purposes
To overcome this problem, paper [25] proposed a parameter identification method based on artificial
neural networks for the Duhem hysteresis model. The mathematical model of the piezoelectric actuator based
Duhem model in [25] can be described as
          
          
my t ny t ky t k du t w t
w t u t cu t w t bu t
    

  
(5)
where m is the equivalent mass; n is the equivalent damping; k is the equivalent stiffness; u(t) is the input
voltage; y(t) is the output displacement; w(t) is the hysteretic state variable; parameters α, b, c controls the
shapes and amplitudes of the hysteresis loop; and d is the effective piezoelectric coefficient of the actuator. In
this paper, the ENN model trained MDE-BP algorithm is proposed to identify the nonlinearities Duhem
hysteresis of the piezoelectric actuator.
Firstly, the above system (5) is implemented in MATLAB. The training data set and validating data
set are collected form system (5) and shown in Figure 2. Secondly, the ENN structure is selected by linking
the 3-layer MLP with S1 hidden nodes and the 2nd
order NARX structure, is presented with the regression
and prediction functions, respectively. Selecting parameter S1 = 5, NP = 62 and GEN = 10000.
0 1 2 3 4 5
-5
0
5
Dataset for training
inputdata
0 1 2 3 4 5
-5
0
5
time (sec)
outputdata
0 1 2 3 4 5
-4
-2
0
2
4
Dataset for validation
0 1 2 3 4 5
-4
-2
0
2
4
time (sec)
Int J Elec & Comp Eng ISSN: 2088-8708 
Black-box modeling of nonlinear system using evolutionary neural NARX model (Nguyen Ngoc Son)
1865
Figure 3. Convergence rate in training Figure 4. Identification performance
Finally, the performance identification using the proposed ENN model is conducted. Figure 3 shows
the convergence rates of MDE-BP-ENN in the training process. Figure 4 demonstrates the errors between the
predicted output of the neural network and the formula output of Duhem model. The results indicate the
proposed method can be used to identify and predict the hysteresis behavior of the piezoelectric actuator.
3.2. Modeling a quadruple tank system
In practice, a common tank system consists of tanks, pumps, piping, valves, liquid level sensors.
During operation, depending on the technology requirements and load requirements, the valves can change
the aperture, or the liquid type in the tanks can change. This leads to a nonlinear characteristic of the system
that can vary. Moreover, the parameters of the liquid tank system such as the size and discharge coefficient of
the valves, the power factor of the pump in some cases may be still unknown. Therefore, it is not easy to
obtain an accurate theoretical model of a quadrature tank system.
To overcome the disadvantages of the theoretical modeling method, some identification approaches
have been investigated. Paper [28] proposed an adaptive fuzzy model predictive control based on the ant
colony optimization (ACO) for nonlinear process system. Paper [29] used a radial basis function neural
network as the prediction function due to its approximation ability. Then, a nonlinear model predictive
control method was proposed to guarantee the system stability and compensate the network-induced delays
and packet dropouts. Iplikci [30] proposed a support vector machine (SVM) approach to the generalized
predictive control (GPC) of an experimental three-tank system. One advantage of the black-box modeling
approach is that it is unnecessary to precisely analyze its internal mechanism or the relationship among
physical variables. In this paper, the ENN model trained MDE-BP algorithm is proposed to identify the
black-box modeling of a quadruple tank system.
3.2.1. Physical model
The quadruple tank system which is described in Figure 5 is a nonlinear plant with strong coupling
and large time delay. The quadruple tank plant can be seen as a system with two inputs, the voltages of the
pumps, and two outputs, the water levels of the lower tanks.
Where Li is the liquid level in tank i; Dti is the outlet cross-sectional area of tank i; Doi is the cross-
sectional area of tank i; i
 is the portion of the flow into the upper tank from pump i; uj is the speed setting
of pump j, with the corresponding gain kj. A mathematical model based on physical data together with its
linearization around an operating point is derived in Johansson [31].
0 2000 4000 6000 8000 10000
10
-3
10
-2
10
-1
10
0
10
1
Generation
MSEfortraining
0 1 2 3 4 5
-4
-2
0
2
4
output
0 1 2 3 4 5
-0.4
-0.2
0
0.2
time (sec)
error
actual predicted
 ISSN: 2088-8708
Int J Elec & Comp Eng, Vol. 9, No. 3, June 2019 : 1861 - 1870
1866
1
2
3
4
Pump 2 Pump 1
Figure 5. Schematic of the quadruple-tank system
3.2.2. Experimental quadruple tank setup
In this part, the experimental quadruple tank system has been studied. Figure 6 describes the
diagram block of the experimental quadruple tank system. Table 1 describes in detail the physical parameters
of the tank model system.
Table 1. The Parameters of the Quadruple-tank System
Parameters Value Unit
The outlet cross-sectional area of the tank ( 1 2 3 4, , ,t t t tD D D D ) 4.6 cm
The cross-sectional area of tank 1 and 3 ( 1 o3,oD D ) 0.8 cm
The cross-sectional area of tank 2 and 4 ( 2 o4,oD D ) 0.65 cm
The portion of the flow into the upper tank from pump 1, 1 0.7 ------
The portion of the flow into the upper tank from pump 2, 2 0.65 ------
The corresponding gain of Pump, pk 6.9 3
cm /s/V
The speed setting of the pump, ( 1 2,u u ) ------ V
The pump used in the quadruple-tank system is an Ogihara engine with a 24 V supply and a pump
flow rate of 10 liters per minute. In fact, the motors pump water into the tank in the operating range of 30% -
70% (Vmax). The Freescale Semiconductor's Strain Gauge MPX10 is used to measure water levels in tanks.
Details of the equipment parameters of the quadruple-tank system are described in Table 2.
Amplifier
NI-PCI
6221
Pressure
sensor
DAC
Matlab/Simulink ADC
Figure 6. Diagram of the experimental quadruple tank system
Table 2. The parameters of Pump and MPX10
Equipment Parameters
Pump
- Supply voltage: 24 VDC
- Flow rate: 10 liters/minute
- Power consumption: 26 W
MPX10 sensor
- Type of MPX10DP CASE 344C.
- Supply voltage: 3-6 VDC
- Sensity ∆V/∆P: 3.5 mV/kPa
- Range: 0-10 kPa
Int J Elec & Comp Eng ISSN: 2088-8708 
Black-box modeling of nonlinear system using evolutionary neural NARX model (Nguyen Ngoc Son)
1867
3.2.3. Identification inverse model results
In fact, the inverse predictive model plays an important role in the design of model-based control. In
this article, the inverse model of the quadruple-tank system is identified by using the ENN model. The
procedure consists of four basic steps as follows:
Firstly, the experimental input-output data set, applied for training and validating purposes of the
ENN based MDE-BP training algorithm, is collected from the quadruple-tank system. The input data set
consists of the input signal as the voltage for the pump motor and the output signal of tank water level 2 and
tank 4 collected from the experimental model described in Figure 7. Which, 1( )u k and 2 ( )u k are the voltage
signal for the pump 1 and pump 2. 2 ( )L k and 4 ( )L k is the water level in tank 2 and tank 4. The dataset with
the input voltage ratio has a change in amplitude from 0 to 1 and the change frequency described in Figure 7
will be used to estimate and evaluate the MDE-ENN prediction model. Where, Figure 7(a) is used to estimate
the model, Figure 7(b) is used to evaluate the model.
Figure 7. Experimental dataset for training and validation of the ENN model
Secondly, the ENN structure is selected by linking the 3-layered MLP model with the 1st
order
NARX structure and described in Figure 8. In this case, the number of hidden neurons is S1 = 12, population
size NP = 120, number of generations of trained GEN = 700, the coefficient of learning BP 0.000001  and
number of iterations for BP iter3 = 5.
e
 1
ˆu k
2 (k 1)L 1( )u k
Inverse
NNARX model
MDE-BP
1
z
e
1
z
1
z
1
z
 2
ˆu k
2 ( )u k 4 (k 1)L 
Quadruple tank
system
Figure 8. The inverse model of the quadruple-tank system
0 500 1000 1500 2000
0
0.5
1
(a)
u1e
0 500 1000 1500 2000
0
10
20
L2e
0 500 1000 1500 2000
0
0.5
1
u2e
0 500 1000 1500 2000
0
10
time (samples)
L4e
0 500 1000 1500 2000
0
0.5
1
(b)
u1v
0 500 1000 1500 2000
15
20L2v
0 500 1000 1500 2000
0
0.5
1
u2v
0 500 1000 1500 2000
10
15
time (samples)
L4v
 ISSN: 2088-8708
Int J Elec & Comp Eng, Vol. 9, No. 3, June 2019 : 1861 - 1870
1868
Finally, the estimation and validation process are conducted to identify the ENN model. Figure 9
shows the performance of MDE-BP-ENN based on the values of MSE in the training process. Figure 10
shows the performance of MDE-BP-ENN based on the average values of MSE on the validation process.
Based on the above results, we see that the ENN prediction model with weightings optimized by the MDE-
BP algorithm has been identified and predicted fairly accurately the inverse dynamic properties of the
quadruple-tank system.
Figure 9. The MSE value on the training process
Figure 10. The MSE value on the validation process
4. CONCLUSION
This paper introduces how to modeling a nonlinear SISO and MIMO system based on input-output
data using the proposed Evolutionary Neural NARX (ENN) model. The ENN scheme is used by connecting
the Multi-Layer Perceptron Neural Networks (MLP) model and NARX structure. The weight value of ENN
model is optimized by hybridizing a modified differential evolution and backpropagation training (MDE-BP)
algorithms. The effectiveness of ENN model is tested on modeling a piezoelectric actuator and a quadruple
tank system. The results prove that the ENN model has the ability to learn the dynamics model to reduce the
tracking error to nearly zero. The results will be used to initialize the design of the model-based controller for
nonlinear systems in the future research.
ACKNOWLEDGEMENTS
The study was supported by Science and Technology Incubator Youth Program, managed by the
Center for Science and Technology Development, Ho Chi Minh Communist Youth Union, the contract
number is "13/2018/HĐ-KHCN-VƯ ".
0 500 1000 1500 2000
0
0.5
1
L2 (solid) and L2_hat (dashed)
output
0 500 1000 1500 2000
-0.5
0
0.5
time (samples)
predictionerror
0 500 1000 1500 2000
0
0.5
1
L4 (solid) and L4_hat (dashed)
0 500 1000 1500 2000
-0.5
0
0.5
time (samples)
0 500 1000 1500 2000
0
0.5
1
L2 (solid) and L2_hat (dashed)
output
0 500 1000 1500 2000
-0.5
0
0.5
time (samples)
predictionerror
0 500 1000 1500 2000
0
0.5
1
L4 (solid) and L4_hat (dashed)
0 500 1000 1500 2000
-0.5
0
0.5
time (samples)
Int J Elec & Comp Eng ISSN: 2088-8708 
Black-box modeling of nonlinear system using evolutionary neural NARX model (Nguyen Ngoc Son)
1869
REFERENCES
[1] Ljung, Lennart, "System identification," Signal analysis and prediction, pp. 163-173, 1998.
[2] Wang, Lin, Yi Zeng, and Tao Chen, "Back propagation neural network with adaptive differential evolution
algorithm for time series forecasting." Expert Systems with Applications, vol 42(2), pp. 855-863, 2015.
[3] Piotrowski, Adam P., "Differential evolution algorithms applied to neural network training suffer from
stagnation." Applied Soft Computing, vol. 21, pp. 382-406, 2014.
[4] Yu, Feng, and Xiaozhong Xu, "A short-term load forecasting model of natural gas based on optimized genetic
algorithm and improved BP neural network," Applied Energy, vol. 134, pp. 102-113, 2014.
[5] Leung, Frank Hung-Fat, et al., "Tuning of the structure and parameters of a neural network using an improved
genetic algorithm," IEEE Transactions on Neural networks, vol. 14(1), pp. 79-88, 2003.
[6] Asadi, Ehsan, et al. "Multi-objective optimization for building retrofit: A model using genetic algorithm and
artificial neural network and an application," Energy and Buildings, vol. 81, pp. 444-456, 2014.
[7] Song, Ying, Zengqiang Chen, and Zhuzhi Yuan, "New chaotic PSO-based neural network predictive control for
nonlinear process," IEEE transactions on neural networks, vol. 18(2), pp. 595-601, 2007.
[8] Bashir Z. A., and M. E. El-Hawary, "Applying wavelets to short-term load forecasting using PSO-based neural
networks," IEEE transactions on power systems, vol. 24(1), pp. 20-27, 2009.
[9] Gordan, Behrouz, et al, "Prediction of seismic slope stability through combination of particle swarm optimization
and neural network," Engineering with Computers, 32(1), pp. 85-97, 2016.
[10] Valian, Ehsan, Shahram Mohanna, and Saeed Tavakoli, "Improved cuckoo search algorithm for feedforward neural
network training," International Journal of Artificial Intelligence & Applications, vol. 2(3), pp. 36-43, 2011.
[11] Storn, Rainer, and Kenneth Price, "Differential evolution–a simple and efficient heuristic for global optimization
over continuous spaces," Journal of global optimization, vol. 11(4), pp. 341-359, 1997.
[12] Ilonen, Jarmo, Joni-Kristian Kamarainen, and Jouni Lampinen, "Differential evolution training algorithm for feed-
forward neural networks," Neural Processing Letters, vol. 17(1), pp. 93-105, 2003.
[13] Baştürk, Alper, and Enis Günay, "Efficient edge detection in digital images using a cellular neural network
optimized by differential evolution algorithm," Expert Systems with Applications, vol. 36(2), pp. 2645-2650, 2009.
[14] Subudhi, Bidyadhar, and Debashisha Jena, "A differential evolution based neural network approach to nonlinear
system identification," Applied Soft Computing, vol. 11(1), pp. 861-871, 2011.
[15] Chauhan, Nikunj, Vadlamani Ravi, and D. Karthik Chandra, "Differential evolution trained wavelet neural
networks: Application to bankruptcy prediction in banks," Expert Systems with Applications, vol. 36(4),
pp.7659-7665, 2009.
[16] Wang, Lin, Yi Zeng, and Tao Chen, "Back propagation neural network with adaptive differential evolution
algorithm for time series forecasting," Expert Systems with Applications vol. 42(2), pp. 855-863, 2015.
[17] Liu, Wei, et al., "Neural network based on self-adaptive differential evolution for ultra-short-term power load
forecasting," International conference on intelligent computing. Springer, Cham, 2014.
[18] Chen, Cheng-Hung, Cheng-Jian Lin, and Chin-Teng Lin, "Nonlinear system control using adaptive neural fuzzy
networks based on a modified differential evolution." IEEE Transactions on Systems, Man, and Cybernetics, Part
C (Applications and Reviews), vol. 39(4), pp. 459-473, 2009,
[19] Slowik, Adam, "Application of an adaptive differential evolution algorithm with multiple trial vectors to artificial
neural network training," IEEE Transactions on Industrial Electronics, 58(8), pp. 3160-3167, 2011.
[20] Kumar, Jitendra, and Ashutosh Kumar Singh, "Workload prediction in cloud using artificial neural network and
adaptive differential evolution," Future Generation Computer Systems, vol. 81, pp. 41-52, 2018.
[21] Nguyen, Son Ngoc, Vinh Ho‐ Huu, and Anh Pham Huy Ho, "A neural differential evolution identification
approach to nonlinear systems and modelling of shape memory alloy actuator," Asian Journal of Control, 2018.
[22] Nah, S. K., and Z. W. Zhong, "A microgripper using piezoelectric actuation for micro-object
manipulation," Sensors and Actuators A: Physical, vol. 133(1), pp. 218-224, 2007.
[23] Bowen, C. R., et al., "Piezoelectric and ferroelectric materials and structures for energy harvesting
applications," Energy & Environmental Science, vol. 7(1), pp. 25-44, 2014.
[24] Nguyen, Cuong H., Ulrik Hanke, and Einar Halvorsen, "Actuation of Piezoelectric Layered Beams with d31 and
d33 Coupling," IEEE Transactions on Ultrasonics, Ferroelectrics, and Frequency Control, 2018.
[25] Wang, Geng, and Guoqiang Chen, "Identification of piezoelectric hysteresis by a novel Duhem model based neural
network," Sensors and Actuators A: Physical, vol. 264, pp. 282-288, 2017.
[26] Mao, Xuefei, et al., "A Hybrid Feedforward-Feedback Hysteresis Compensator in Piezoelectric Actuators Based on
Least-Squares Support Vector Machine," IEEE Transactions on Industrial Electronics, vol.65(7), pp. 5704-5711,
2018.
[27] Krasnosel'skii, Mark A., and Aleksei V. Pokrovskii, "Systems with hysteresis," Springer Science & Business
Media, 2012.
[28] Bououden S., Mohammed Chadli, and Hamid Reza Karimi, "An ant colony optimization-based fuzzy predictive
control approach for nonlinear processes," Information Sciences, vol. 299, pp. 143-158, 2015.
[29] Wang, Tong, Huijun Gao, and Jianbin Qiu, "A combined adaptive neural network and nonlinear model predictive
control for multirate networked industrial process control," IEEE Transactions on Neural Networks and Learning
Systems, vol. 27(2), pp. 416-425, 2016.
[30] Iplikci, Serdar, "A support vector machine-based control application to the experimental three-tank system," ISA
transactions, vol. 49(3), pp. 376-386, 2010.
[31] Johansson, Karl Henrik, "The quadruple-tank process: A multivariable laboratory process with an adjustable
zero," IEEE Transactions on control systems technology, vol. 8(3), pp. 456-465, 2000.
 ISSN: 2088-8708
Int J Elec & Comp Eng, Vol. 9, No. 3, June 2019 : 1861 - 1870
1870
BIOGRAPHIES OF AUTHORS
Son Nguyen received his M.Sc. and Ph.D. degrees in the Faculty of Electrical and Electronics
Engineering (FEEE) from Ho Chi Minh City University of Technology in 2012 and 2017,
respectively. He is currently a Vice-Dean of the Faculty of Electronics Technology, Industrial
University of Ho Chi Minh City, Viet Nam. His current research interests include intelligent control,
robotics, identification of nonlinear systems, and the internet of things.
Khanh Nguyen Duy received his M.Sc degree in the Faculty of Telecommunications from Posts
and Telecommunications Institute of Technology in 2014. He is currently a Chairman of Student
Science Research Club of Faculty of Electronics Technology, Industrial University of Ho Chi Minh
City, Viet Nam. His research interests include intelligent systems, machine learning, identification
systems, and the internet of thing.
Tran Minh Chinh graduated in 2011 and received Ph.D. degrees in 2016 from Tambov Stade
Technical University, Russia. From 9/2016, he works as a teacher in the Faculty of Electronics
Technology, Industrial University of Ho Chi Minh City, Viet Nam. His research interests are modern
control, intelligent systems, artificially intelligence, machine learning.

More Related Content

What's hot

11.digital image processing for camera application in mobile devices using ar...
11.digital image processing for camera application in mobile devices using ar...11.digital image processing for camera application in mobile devices using ar...
11.digital image processing for camera application in mobile devices using ar...Alexander Decker
 
Disease Classification using ECG Signal Based on PCA Feature along with GA & ...
Disease Classification using ECG Signal Based on PCA Feature along with GA & ...Disease Classification using ECG Signal Based on PCA Feature along with GA & ...
Disease Classification using ECG Signal Based on PCA Feature along with GA & ...IRJET Journal
 
Electricity Demand Forecasting Using Fuzzy-Neural Network
Electricity Demand Forecasting Using Fuzzy-Neural NetworkElectricity Demand Forecasting Using Fuzzy-Neural Network
Electricity Demand Forecasting Using Fuzzy-Neural NetworkNaren Chandra Kattla
 
Electricity Demand Forecasting Using ANN
Electricity Demand Forecasting Using ANNElectricity Demand Forecasting Using ANN
Electricity Demand Forecasting Using ANNNaren Chandra Kattla
 
Feedforward neural network
Feedforward neural networkFeedforward neural network
Feedforward neural networkSopheaktra YONG
 
Incorporating Kalman Filter in the Optimization of Quantum Neural Network Par...
Incorporating Kalman Filter in the Optimization of Quantum Neural Network Par...Incorporating Kalman Filter in the Optimization of Quantum Neural Network Par...
Incorporating Kalman Filter in the Optimization of Quantum Neural Network Par...Waqas Tariq
 
A comparison-of-first-and-second-order-training-algorithms-for-artificial-neu...
A comparison-of-first-and-second-order-training-algorithms-for-artificial-neu...A comparison-of-first-and-second-order-training-algorithms-for-artificial-neu...
A comparison-of-first-and-second-order-training-algorithms-for-artificial-neu...Cemal Ardil
 
Objective Evaluation of a Deep Neural Network Approach for Single-Channel Spe...
Objective Evaluation of a Deep Neural Network Approach for Single-Channel Spe...Objective Evaluation of a Deep Neural Network Approach for Single-Channel Spe...
Objective Evaluation of a Deep Neural Network Approach for Single-Channel Spe...csandit
 
Meta-GMVAE: Mixture of Gaussian VAE for Unsupervised Meta-Learning
Meta-GMVAE: Mixture of Gaussian VAE for Unsupervised Meta-LearningMeta-GMVAE: Mixture of Gaussian VAE for Unsupervised Meta-Learning
Meta-GMVAE: Mixture of Gaussian VAE for Unsupervised Meta-LearningMLAI2
 
International Journal of Engineering Research and Development (IJERD)
International Journal of Engineering Research and Development (IJERD)International Journal of Engineering Research and Development (IJERD)
International Journal of Engineering Research and Development (IJERD)IJERD Editor
 
Survey on Artificial Neural Network Learning Technique Algorithms
Survey on Artificial Neural Network Learning Technique AlgorithmsSurvey on Artificial Neural Network Learning Technique Algorithms
Survey on Artificial Neural Network Learning Technique AlgorithmsIRJET Journal
 
Improving Performance of Back propagation Learning Algorithm
Improving Performance of Back propagation Learning AlgorithmImproving Performance of Back propagation Learning Algorithm
Improving Performance of Back propagation Learning Algorithmijsrd.com
 
Image Recognition With the Help of Auto-Associative Neural Network
Image Recognition With the Help of Auto-Associative Neural NetworkImage Recognition With the Help of Auto-Associative Neural Network
Image Recognition With the Help of Auto-Associative Neural NetworkCSCJournals
 

What's hot (19)

G013124354
G013124354G013124354
G013124354
 
11.digital image processing for camera application in mobile devices using ar...
11.digital image processing for camera application in mobile devices using ar...11.digital image processing for camera application in mobile devices using ar...
11.digital image processing for camera application in mobile devices using ar...
 
Disease Classification using ECG Signal Based on PCA Feature along with GA & ...
Disease Classification using ECG Signal Based on PCA Feature along with GA & ...Disease Classification using ECG Signal Based on PCA Feature along with GA & ...
Disease Classification using ECG Signal Based on PCA Feature along with GA & ...
 
Electricity Demand Forecasting Using Fuzzy-Neural Network
Electricity Demand Forecasting Using Fuzzy-Neural NetworkElectricity Demand Forecasting Using Fuzzy-Neural Network
Electricity Demand Forecasting Using Fuzzy-Neural Network
 
Electricity Demand Forecasting Using ANN
Electricity Demand Forecasting Using ANNElectricity Demand Forecasting Using ANN
Electricity Demand Forecasting Using ANN
 
Feedforward neural network
Feedforward neural networkFeedforward neural network
Feedforward neural network
 
Incorporating Kalman Filter in the Optimization of Quantum Neural Network Par...
Incorporating Kalman Filter in the Optimization of Quantum Neural Network Par...Incorporating Kalman Filter in the Optimization of Quantum Neural Network Par...
Incorporating Kalman Filter in the Optimization of Quantum Neural Network Par...
 
A comparison-of-first-and-second-order-training-algorithms-for-artificial-neu...
A comparison-of-first-and-second-order-training-algorithms-for-artificial-neu...A comparison-of-first-and-second-order-training-algorithms-for-artificial-neu...
A comparison-of-first-and-second-order-training-algorithms-for-artificial-neu...
 
Unit ii supervised ii
Unit ii supervised iiUnit ii supervised ii
Unit ii supervised ii
 
Objective Evaluation of a Deep Neural Network Approach for Single-Channel Spe...
Objective Evaluation of a Deep Neural Network Approach for Single-Channel Spe...Objective Evaluation of a Deep Neural Network Approach for Single-Channel Spe...
Objective Evaluation of a Deep Neural Network Approach for Single-Channel Spe...
 
Meta-GMVAE: Mixture of Gaussian VAE for Unsupervised Meta-Learning
Meta-GMVAE: Mixture of Gaussian VAE for Unsupervised Meta-LearningMeta-GMVAE: Mixture of Gaussian VAE for Unsupervised Meta-Learning
Meta-GMVAE: Mixture of Gaussian VAE for Unsupervised Meta-Learning
 
International Journal of Engineering Research and Development (IJERD)
International Journal of Engineering Research and Development (IJERD)International Journal of Engineering Research and Development (IJERD)
International Journal of Engineering Research and Development (IJERD)
 
Survey on Artificial Neural Network Learning Technique Algorithms
Survey on Artificial Neural Network Learning Technique AlgorithmsSurvey on Artificial Neural Network Learning Technique Algorithms
Survey on Artificial Neural Network Learning Technique Algorithms
 
J04401066071
J04401066071J04401066071
J04401066071
 
Iv3515241527
Iv3515241527Iv3515241527
Iv3515241527
 
Improving Performance of Back propagation Learning Algorithm
Improving Performance of Back propagation Learning AlgorithmImproving Performance of Back propagation Learning Algorithm
Improving Performance of Back propagation Learning Algorithm
 
Image Recognition With the Help of Auto-Associative Neural Network
Image Recognition With the Help of Auto-Associative Neural NetworkImage Recognition With the Help of Auto-Associative Neural Network
Image Recognition With the Help of Auto-Associative Neural Network
 
A040101001006
A040101001006A040101001006
A040101001006
 
F017533540
F017533540F017533540
F017533540
 

Similar to Black-box modeling of nonlinear system using evolutionary neural NARX model

AN IMPROVED METHOD FOR IDENTIFYING WELL-TEST INTERPRETATION MODEL BASED ON AG...
AN IMPROVED METHOD FOR IDENTIFYING WELL-TEST INTERPRETATION MODEL BASED ON AG...AN IMPROVED METHOD FOR IDENTIFYING WELL-TEST INTERPRETATION MODEL BASED ON AG...
AN IMPROVED METHOD FOR IDENTIFYING WELL-TEST INTERPRETATION MODEL BASED ON AG...IAEME Publication
 
Optimal neural network models for wind speed prediction
Optimal neural network models for wind speed predictionOptimal neural network models for wind speed prediction
Optimal neural network models for wind speed predictionIAEME Publication
 
Optimal neural network models for wind speed prediction
Optimal neural network models for wind speed predictionOptimal neural network models for wind speed prediction
Optimal neural network models for wind speed predictionIAEME Publication
 
Power system transient stability margin estimation using artificial neural ne...
Power system transient stability margin estimation using artificial neural ne...Power system transient stability margin estimation using artificial neural ne...
Power system transient stability margin estimation using artificial neural ne...elelijjournal
 
Poster_Reseau_Neurones_Journees_2013
Poster_Reseau_Neurones_Journees_2013Poster_Reseau_Neurones_Journees_2013
Poster_Reseau_Neurones_Journees_2013Pedro Lopes
 
Hierarchical algorithms of quasi linear ARX Neural Networks for Identificatio...
Hierarchical algorithms of quasi linear ARX Neural Networks for Identificatio...Hierarchical algorithms of quasi linear ARX Neural Networks for Identificatio...
Hierarchical algorithms of quasi linear ARX Neural Networks for Identificatio...Yuyun Wabula
 
A Novel Neuroglial Architecture for Modelling Singular Perturbation System
A Novel Neuroglial Architecture for Modelling Singular Perturbation System  A Novel Neuroglial Architecture for Modelling Singular Perturbation System
A Novel Neuroglial Architecture for Modelling Singular Perturbation System IJECEIAES
 
Feed forward neural network for sine
Feed forward neural network for sineFeed forward neural network for sine
Feed forward neural network for sineijcsa
 
Multimode system condition monitoring using sparsity reconstruction for quali...
Multimode system condition monitoring using sparsity reconstruction for quali...Multimode system condition monitoring using sparsity reconstruction for quali...
Multimode system condition monitoring using sparsity reconstruction for quali...IJECEIAES
 
Comparison Between Levenberg-Marquardt And Scaled Conjugate Gradient Training...
Comparison Between Levenberg-Marquardt And Scaled Conjugate Gradient Training...Comparison Between Levenberg-Marquardt And Scaled Conjugate Gradient Training...
Comparison Between Levenberg-Marquardt And Scaled Conjugate Gradient Training...CSCJournals
 
Machine Learning Algorithms for Image Classification of Hand Digits and Face ...
Machine Learning Algorithms for Image Classification of Hand Digits and Face ...Machine Learning Algorithms for Image Classification of Hand Digits and Face ...
Machine Learning Algorithms for Image Classification of Hand Digits and Face ...IRJET Journal
 
A Learning Linguistic Teaching Control for a Multi-Area Electric Power System
A Learning Linguistic Teaching Control for a Multi-Area Electric Power SystemA Learning Linguistic Teaching Control for a Multi-Area Electric Power System
A Learning Linguistic Teaching Control for a Multi-Area Electric Power SystemCSCJournals
 
Short Term Electrical Load Forecasting by Artificial Neural Network
Short Term Electrical Load Forecasting by Artificial Neural NetworkShort Term Electrical Load Forecasting by Artificial Neural Network
Short Term Electrical Load Forecasting by Artificial Neural NetworkIJERA Editor
 
Development of deep reinforcement learning for inverted pendulum
Development of deep reinforcement learning for inverted  pendulumDevelopment of deep reinforcement learning for inverted  pendulum
Development of deep reinforcement learning for inverted pendulumIJECEIAES
 
Architecture neural network deep optimizing based on self organizing feature ...
Architecture neural network deep optimizing based on self organizing feature ...Architecture neural network deep optimizing based on self organizing feature ...
Architecture neural network deep optimizing based on self organizing feature ...journalBEEI
 

Similar to Black-box modeling of nonlinear system using evolutionary neural NARX model (20)

AN IMPROVED METHOD FOR IDENTIFYING WELL-TEST INTERPRETATION MODEL BASED ON AG...
AN IMPROVED METHOD FOR IDENTIFYING WELL-TEST INTERPRETATION MODEL BASED ON AG...AN IMPROVED METHOD FOR IDENTIFYING WELL-TEST INTERPRETATION MODEL BASED ON AG...
AN IMPROVED METHOD FOR IDENTIFYING WELL-TEST INTERPRETATION MODEL BASED ON AG...
 
Optimal neural network models for wind speed prediction
Optimal neural network models for wind speed predictionOptimal neural network models for wind speed prediction
Optimal neural network models for wind speed prediction
 
Optimal neural network models for wind speed prediction
Optimal neural network models for wind speed predictionOptimal neural network models for wind speed prediction
Optimal neural network models for wind speed prediction
 
Power system transient stability margin estimation using artificial neural ne...
Power system transient stability margin estimation using artificial neural ne...Power system transient stability margin estimation using artificial neural ne...
Power system transient stability margin estimation using artificial neural ne...
 
Poster_Reseau_Neurones_Journees_2013
Poster_Reseau_Neurones_Journees_2013Poster_Reseau_Neurones_Journees_2013
Poster_Reseau_Neurones_Journees_2013
 
D028018022
D028018022D028018022
D028018022
 
A0270107
A0270107A0270107
A0270107
 
Hierarchical algorithms of quasi linear ARX Neural Networks for Identificatio...
Hierarchical algorithms of quasi linear ARX Neural Networks for Identificatio...Hierarchical algorithms of quasi linear ARX Neural Networks for Identificatio...
Hierarchical algorithms of quasi linear ARX Neural Networks for Identificatio...
 
A Novel Neuroglial Architecture for Modelling Singular Perturbation System
A Novel Neuroglial Architecture for Modelling Singular Perturbation System  A Novel Neuroglial Architecture for Modelling Singular Perturbation System
A Novel Neuroglial Architecture for Modelling Singular Perturbation System
 
Feed forward neural network for sine
Feed forward neural network for sineFeed forward neural network for sine
Feed forward neural network for sine
 
Multimode system condition monitoring using sparsity reconstruction for quali...
Multimode system condition monitoring using sparsity reconstruction for quali...Multimode system condition monitoring using sparsity reconstruction for quali...
Multimode system condition monitoring using sparsity reconstruction for quali...
 
Hs3613611366
Hs3613611366Hs3613611366
Hs3613611366
 
Hs3613611366
Hs3613611366Hs3613611366
Hs3613611366
 
Comparison Between Levenberg-Marquardt And Scaled Conjugate Gradient Training...
Comparison Between Levenberg-Marquardt And Scaled Conjugate Gradient Training...Comparison Between Levenberg-Marquardt And Scaled Conjugate Gradient Training...
Comparison Between Levenberg-Marquardt And Scaled Conjugate Gradient Training...
 
Path loss prediction
Path loss predictionPath loss prediction
Path loss prediction
 
Machine Learning Algorithms for Image Classification of Hand Digits and Face ...
Machine Learning Algorithms for Image Classification of Hand Digits and Face ...Machine Learning Algorithms for Image Classification of Hand Digits and Face ...
Machine Learning Algorithms for Image Classification of Hand Digits and Face ...
 
A Learning Linguistic Teaching Control for a Multi-Area Electric Power System
A Learning Linguistic Teaching Control for a Multi-Area Electric Power SystemA Learning Linguistic Teaching Control for a Multi-Area Electric Power System
A Learning Linguistic Teaching Control for a Multi-Area Electric Power System
 
Short Term Electrical Load Forecasting by Artificial Neural Network
Short Term Electrical Load Forecasting by Artificial Neural NetworkShort Term Electrical Load Forecasting by Artificial Neural Network
Short Term Electrical Load Forecasting by Artificial Neural Network
 
Development of deep reinforcement learning for inverted pendulum
Development of deep reinforcement learning for inverted  pendulumDevelopment of deep reinforcement learning for inverted  pendulum
Development of deep reinforcement learning for inverted pendulum
 
Architecture neural network deep optimizing based on self organizing feature ...
Architecture neural network deep optimizing based on self organizing feature ...Architecture neural network deep optimizing based on self organizing feature ...
Architecture neural network deep optimizing based on self organizing feature ...
 

More from IJECEIAES

Cloud service ranking with an integration of k-means algorithm and decision-m...
Cloud service ranking with an integration of k-means algorithm and decision-m...Cloud service ranking with an integration of k-means algorithm and decision-m...
Cloud service ranking with an integration of k-means algorithm and decision-m...IJECEIAES
 
Prediction of the risk of developing heart disease using logistic regression
Prediction of the risk of developing heart disease using logistic regressionPrediction of the risk of developing heart disease using logistic regression
Prediction of the risk of developing heart disease using logistic regressionIJECEIAES
 
Predictive analysis of terrorist activities in Thailand's Southern provinces:...
Predictive analysis of terrorist activities in Thailand's Southern provinces:...Predictive analysis of terrorist activities in Thailand's Southern provinces:...
Predictive analysis of terrorist activities in Thailand's Southern provinces:...IJECEIAES
 
Optimal model of vehicular ad-hoc network assisted by unmanned aerial vehicl...
Optimal model of vehicular ad-hoc network assisted by  unmanned aerial vehicl...Optimal model of vehicular ad-hoc network assisted by  unmanned aerial vehicl...
Optimal model of vehicular ad-hoc network assisted by unmanned aerial vehicl...IJECEIAES
 
Improving cyberbullying detection through multi-level machine learning
Improving cyberbullying detection through multi-level machine learningImproving cyberbullying detection through multi-level machine learning
Improving cyberbullying detection through multi-level machine learningIJECEIAES
 
Comparison of time series temperature prediction with autoregressive integrat...
Comparison of time series temperature prediction with autoregressive integrat...Comparison of time series temperature prediction with autoregressive integrat...
Comparison of time series temperature prediction with autoregressive integrat...IJECEIAES
 
Strengthening data integrity in academic document recording with blockchain a...
Strengthening data integrity in academic document recording with blockchain a...Strengthening data integrity in academic document recording with blockchain a...
Strengthening data integrity in academic document recording with blockchain a...IJECEIAES
 
Design of storage benchmark kit framework for supporting the file storage ret...
Design of storage benchmark kit framework for supporting the file storage ret...Design of storage benchmark kit framework for supporting the file storage ret...
Design of storage benchmark kit framework for supporting the file storage ret...IJECEIAES
 
Detection of diseases in rice leaf using convolutional neural network with tr...
Detection of diseases in rice leaf using convolutional neural network with tr...Detection of diseases in rice leaf using convolutional neural network with tr...
Detection of diseases in rice leaf using convolutional neural network with tr...IJECEIAES
 
A systematic review of in-memory database over multi-tenancy
A systematic review of in-memory database over multi-tenancyA systematic review of in-memory database over multi-tenancy
A systematic review of in-memory database over multi-tenancyIJECEIAES
 
Agriculture crop yield prediction using inertia based cat swarm optimization
Agriculture crop yield prediction using inertia based cat swarm optimizationAgriculture crop yield prediction using inertia based cat swarm optimization
Agriculture crop yield prediction using inertia based cat swarm optimizationIJECEIAES
 
Three layer hybrid learning to improve intrusion detection system performance
Three layer hybrid learning to improve intrusion detection system performanceThree layer hybrid learning to improve intrusion detection system performance
Three layer hybrid learning to improve intrusion detection system performanceIJECEIAES
 
Non-binary codes approach on the performance of short-packet full-duplex tran...
Non-binary codes approach on the performance of short-packet full-duplex tran...Non-binary codes approach on the performance of short-packet full-duplex tran...
Non-binary codes approach on the performance of short-packet full-duplex tran...IJECEIAES
 
Improved design and performance of the global rectenna system for wireless po...
Improved design and performance of the global rectenna system for wireless po...Improved design and performance of the global rectenna system for wireless po...
Improved design and performance of the global rectenna system for wireless po...IJECEIAES
 
Advanced hybrid algorithms for precise multipath channel estimation in next-g...
Advanced hybrid algorithms for precise multipath channel estimation in next-g...Advanced hybrid algorithms for precise multipath channel estimation in next-g...
Advanced hybrid algorithms for precise multipath channel estimation in next-g...IJECEIAES
 
Performance analysis of 2D optical code division multiple access through unde...
Performance analysis of 2D optical code division multiple access through unde...Performance analysis of 2D optical code division multiple access through unde...
Performance analysis of 2D optical code division multiple access through unde...IJECEIAES
 
On performance analysis of non-orthogonal multiple access downlink for cellul...
On performance analysis of non-orthogonal multiple access downlink for cellul...On performance analysis of non-orthogonal multiple access downlink for cellul...
On performance analysis of non-orthogonal multiple access downlink for cellul...IJECEIAES
 
Phase delay through slot-line beam switching microstrip patch array antenna d...
Phase delay through slot-line beam switching microstrip patch array antenna d...Phase delay through slot-line beam switching microstrip patch array antenna d...
Phase delay through slot-line beam switching microstrip patch array antenna d...IJECEIAES
 
A simple feed orthogonal excitation X-band dual circular polarized microstrip...
A simple feed orthogonal excitation X-band dual circular polarized microstrip...A simple feed orthogonal excitation X-band dual circular polarized microstrip...
A simple feed orthogonal excitation X-band dual circular polarized microstrip...IJECEIAES
 
A taxonomy on power optimization techniques for fifthgeneration heterogenous ...
A taxonomy on power optimization techniques for fifthgeneration heterogenous ...A taxonomy on power optimization techniques for fifthgeneration heterogenous ...
A taxonomy on power optimization techniques for fifthgeneration heterogenous ...IJECEIAES
 

More from IJECEIAES (20)

Cloud service ranking with an integration of k-means algorithm and decision-m...
Cloud service ranking with an integration of k-means algorithm and decision-m...Cloud service ranking with an integration of k-means algorithm and decision-m...
Cloud service ranking with an integration of k-means algorithm and decision-m...
 
Prediction of the risk of developing heart disease using logistic regression
Prediction of the risk of developing heart disease using logistic regressionPrediction of the risk of developing heart disease using logistic regression
Prediction of the risk of developing heart disease using logistic regression
 
Predictive analysis of terrorist activities in Thailand's Southern provinces:...
Predictive analysis of terrorist activities in Thailand's Southern provinces:...Predictive analysis of terrorist activities in Thailand's Southern provinces:...
Predictive analysis of terrorist activities in Thailand's Southern provinces:...
 
Optimal model of vehicular ad-hoc network assisted by unmanned aerial vehicl...
Optimal model of vehicular ad-hoc network assisted by  unmanned aerial vehicl...Optimal model of vehicular ad-hoc network assisted by  unmanned aerial vehicl...
Optimal model of vehicular ad-hoc network assisted by unmanned aerial vehicl...
 
Improving cyberbullying detection through multi-level machine learning
Improving cyberbullying detection through multi-level machine learningImproving cyberbullying detection through multi-level machine learning
Improving cyberbullying detection through multi-level machine learning
 
Comparison of time series temperature prediction with autoregressive integrat...
Comparison of time series temperature prediction with autoregressive integrat...Comparison of time series temperature prediction with autoregressive integrat...
Comparison of time series temperature prediction with autoregressive integrat...
 
Strengthening data integrity in academic document recording with blockchain a...
Strengthening data integrity in academic document recording with blockchain a...Strengthening data integrity in academic document recording with blockchain a...
Strengthening data integrity in academic document recording with blockchain a...
 
Design of storage benchmark kit framework for supporting the file storage ret...
Design of storage benchmark kit framework for supporting the file storage ret...Design of storage benchmark kit framework for supporting the file storage ret...
Design of storage benchmark kit framework for supporting the file storage ret...
 
Detection of diseases in rice leaf using convolutional neural network with tr...
Detection of diseases in rice leaf using convolutional neural network with tr...Detection of diseases in rice leaf using convolutional neural network with tr...
Detection of diseases in rice leaf using convolutional neural network with tr...
 
A systematic review of in-memory database over multi-tenancy
A systematic review of in-memory database over multi-tenancyA systematic review of in-memory database over multi-tenancy
A systematic review of in-memory database over multi-tenancy
 
Agriculture crop yield prediction using inertia based cat swarm optimization
Agriculture crop yield prediction using inertia based cat swarm optimizationAgriculture crop yield prediction using inertia based cat swarm optimization
Agriculture crop yield prediction using inertia based cat swarm optimization
 
Three layer hybrid learning to improve intrusion detection system performance
Three layer hybrid learning to improve intrusion detection system performanceThree layer hybrid learning to improve intrusion detection system performance
Three layer hybrid learning to improve intrusion detection system performance
 
Non-binary codes approach on the performance of short-packet full-duplex tran...
Non-binary codes approach on the performance of short-packet full-duplex tran...Non-binary codes approach on the performance of short-packet full-duplex tran...
Non-binary codes approach on the performance of short-packet full-duplex tran...
 
Improved design and performance of the global rectenna system for wireless po...
Improved design and performance of the global rectenna system for wireless po...Improved design and performance of the global rectenna system for wireless po...
Improved design and performance of the global rectenna system for wireless po...
 
Advanced hybrid algorithms for precise multipath channel estimation in next-g...
Advanced hybrid algorithms for precise multipath channel estimation in next-g...Advanced hybrid algorithms for precise multipath channel estimation in next-g...
Advanced hybrid algorithms for precise multipath channel estimation in next-g...
 
Performance analysis of 2D optical code division multiple access through unde...
Performance analysis of 2D optical code division multiple access through unde...Performance analysis of 2D optical code division multiple access through unde...
Performance analysis of 2D optical code division multiple access through unde...
 
On performance analysis of non-orthogonal multiple access downlink for cellul...
On performance analysis of non-orthogonal multiple access downlink for cellul...On performance analysis of non-orthogonal multiple access downlink for cellul...
On performance analysis of non-orthogonal multiple access downlink for cellul...
 
Phase delay through slot-line beam switching microstrip patch array antenna d...
Phase delay through slot-line beam switching microstrip patch array antenna d...Phase delay through slot-line beam switching microstrip patch array antenna d...
Phase delay through slot-line beam switching microstrip patch array antenna d...
 
A simple feed orthogonal excitation X-band dual circular polarized microstrip...
A simple feed orthogonal excitation X-band dual circular polarized microstrip...A simple feed orthogonal excitation X-band dual circular polarized microstrip...
A simple feed orthogonal excitation X-band dual circular polarized microstrip...
 
A taxonomy on power optimization techniques for fifthgeneration heterogenous ...
A taxonomy on power optimization techniques for fifthgeneration heterogenous ...A taxonomy on power optimization techniques for fifthgeneration heterogenous ...
A taxonomy on power optimization techniques for fifthgeneration heterogenous ...
 

Recently uploaded

main PPT.pptx of girls hostel security using rfid
main PPT.pptx of girls hostel security using rfidmain PPT.pptx of girls hostel security using rfid
main PPT.pptx of girls hostel security using rfidNikhilNagaraju
 
Study on Air-Water & Water-Water Heat Exchange in a Finned Tube Exchanger
Study on Air-Water & Water-Water Heat Exchange in a Finned Tube ExchangerStudy on Air-Water & Water-Water Heat Exchange in a Finned Tube Exchanger
Study on Air-Water & Water-Water Heat Exchange in a Finned Tube ExchangerAnamika Sarkar
 
Biology for Computer Engineers Course Handout.pptx
Biology for Computer Engineers Course Handout.pptxBiology for Computer Engineers Course Handout.pptx
Biology for Computer Engineers Course Handout.pptxDeepakSakkari2
 
Concrete Mix Design - IS 10262-2019 - .pptx
Concrete Mix Design - IS 10262-2019 - .pptxConcrete Mix Design - IS 10262-2019 - .pptx
Concrete Mix Design - IS 10262-2019 - .pptxKartikeyaDwivedi3
 
Gurgaon ✡️9711147426✨Call In girls Gurgaon Sector 51 escort service
Gurgaon ✡️9711147426✨Call In girls Gurgaon Sector 51 escort serviceGurgaon ✡️9711147426✨Call In girls Gurgaon Sector 51 escort service
Gurgaon ✡️9711147426✨Call In girls Gurgaon Sector 51 escort servicejennyeacort
 
CCS355 Neural Network & Deep Learning Unit II Notes with Question bank .pdf
CCS355 Neural Network & Deep Learning Unit II Notes with Question bank .pdfCCS355 Neural Network & Deep Learning Unit II Notes with Question bank .pdf
CCS355 Neural Network & Deep Learning Unit II Notes with Question bank .pdfAsst.prof M.Gokilavani
 
VICTOR MAESTRE RAMIREZ - Planetary Defender on NASA's Double Asteroid Redirec...
VICTOR MAESTRE RAMIREZ - Planetary Defender on NASA's Double Asteroid Redirec...VICTOR MAESTRE RAMIREZ - Planetary Defender on NASA's Double Asteroid Redirec...
VICTOR MAESTRE RAMIREZ - Planetary Defender on NASA's Double Asteroid Redirec...VICTOR MAESTRE RAMIREZ
 
Oxy acetylene welding presentation note.
Oxy acetylene welding presentation note.Oxy acetylene welding presentation note.
Oxy acetylene welding presentation note.eptoze12
 
DATA ANALYTICS PPT definition usage example
DATA ANALYTICS PPT definition usage exampleDATA ANALYTICS PPT definition usage example
DATA ANALYTICS PPT definition usage examplePragyanshuParadkar1
 
Heart Disease Prediction using machine learning.pptx
Heart Disease Prediction using machine learning.pptxHeart Disease Prediction using machine learning.pptx
Heart Disease Prediction using machine learning.pptxPoojaBan
 
IVE Industry Focused Event - Defence Sector 2024
IVE Industry Focused Event - Defence Sector 2024IVE Industry Focused Event - Defence Sector 2024
IVE Industry Focused Event - Defence Sector 2024Mark Billinghurst
 
Electronically Controlled suspensions system .pdf
Electronically Controlled suspensions system .pdfElectronically Controlled suspensions system .pdf
Electronically Controlled suspensions system .pdfme23b1001
 
Work Experience-Dalton Park.pptxfvvvvvvv
Work Experience-Dalton Park.pptxfvvvvvvvWork Experience-Dalton Park.pptxfvvvvvvv
Work Experience-Dalton Park.pptxfvvvvvvvLewisJB
 
HARMONY IN THE NATURE AND EXISTENCE - Unit-IV
HARMONY IN THE NATURE AND EXISTENCE - Unit-IVHARMONY IN THE NATURE AND EXISTENCE - Unit-IV
HARMONY IN THE NATURE AND EXISTENCE - Unit-IVRajaP95
 
An experimental study in using natural admixture as an alternative for chemic...
An experimental study in using natural admixture as an alternative for chemic...An experimental study in using natural admixture as an alternative for chemic...
An experimental study in using natural admixture as an alternative for chemic...Chandu841456
 
CCS355 Neural Networks & Deep Learning Unit 1 PDF notes with Question bank .pdf
CCS355 Neural Networks & Deep Learning Unit 1 PDF notes with Question bank .pdfCCS355 Neural Networks & Deep Learning Unit 1 PDF notes with Question bank .pdf
CCS355 Neural Networks & Deep Learning Unit 1 PDF notes with Question bank .pdfAsst.prof M.Gokilavani
 
Decoding Kotlin - Your guide to solving the mysterious in Kotlin.pptx
Decoding Kotlin - Your guide to solving the mysterious in Kotlin.pptxDecoding Kotlin - Your guide to solving the mysterious in Kotlin.pptx
Decoding Kotlin - Your guide to solving the mysterious in Kotlin.pptxJoão Esperancinha
 
Artificial-Intelligence-in-Electronics (K).pptx
Artificial-Intelligence-in-Electronics (K).pptxArtificial-Intelligence-in-Electronics (K).pptx
Artificial-Intelligence-in-Electronics (K).pptxbritheesh05
 

Recently uploaded (20)

main PPT.pptx of girls hostel security using rfid
main PPT.pptx of girls hostel security using rfidmain PPT.pptx of girls hostel security using rfid
main PPT.pptx of girls hostel security using rfid
 
Study on Air-Water & Water-Water Heat Exchange in a Finned Tube Exchanger
Study on Air-Water & Water-Water Heat Exchange in a Finned Tube ExchangerStudy on Air-Water & Water-Water Heat Exchange in a Finned Tube Exchanger
Study on Air-Water & Water-Water Heat Exchange in a Finned Tube Exchanger
 
Biology for Computer Engineers Course Handout.pptx
Biology for Computer Engineers Course Handout.pptxBiology for Computer Engineers Course Handout.pptx
Biology for Computer Engineers Course Handout.pptx
 
Concrete Mix Design - IS 10262-2019 - .pptx
Concrete Mix Design - IS 10262-2019 - .pptxConcrete Mix Design - IS 10262-2019 - .pptx
Concrete Mix Design - IS 10262-2019 - .pptx
 
Gurgaon ✡️9711147426✨Call In girls Gurgaon Sector 51 escort service
Gurgaon ✡️9711147426✨Call In girls Gurgaon Sector 51 escort serviceGurgaon ✡️9711147426✨Call In girls Gurgaon Sector 51 escort service
Gurgaon ✡️9711147426✨Call In girls Gurgaon Sector 51 escort service
 
CCS355 Neural Network & Deep Learning Unit II Notes with Question bank .pdf
CCS355 Neural Network & Deep Learning Unit II Notes with Question bank .pdfCCS355 Neural Network & Deep Learning Unit II Notes with Question bank .pdf
CCS355 Neural Network & Deep Learning Unit II Notes with Question bank .pdf
 
VICTOR MAESTRE RAMIREZ - Planetary Defender on NASA's Double Asteroid Redirec...
VICTOR MAESTRE RAMIREZ - Planetary Defender on NASA's Double Asteroid Redirec...VICTOR MAESTRE RAMIREZ - Planetary Defender on NASA's Double Asteroid Redirec...
VICTOR MAESTRE RAMIREZ - Planetary Defender on NASA's Double Asteroid Redirec...
 
Oxy acetylene welding presentation note.
Oxy acetylene welding presentation note.Oxy acetylene welding presentation note.
Oxy acetylene welding presentation note.
 
DATA ANALYTICS PPT definition usage example
DATA ANALYTICS PPT definition usage exampleDATA ANALYTICS PPT definition usage example
DATA ANALYTICS PPT definition usage example
 
Heart Disease Prediction using machine learning.pptx
Heart Disease Prediction using machine learning.pptxHeart Disease Prediction using machine learning.pptx
Heart Disease Prediction using machine learning.pptx
 
IVE Industry Focused Event - Defence Sector 2024
IVE Industry Focused Event - Defence Sector 2024IVE Industry Focused Event - Defence Sector 2024
IVE Industry Focused Event - Defence Sector 2024
 
Electronically Controlled suspensions system .pdf
Electronically Controlled suspensions system .pdfElectronically Controlled suspensions system .pdf
Electronically Controlled suspensions system .pdf
 
Work Experience-Dalton Park.pptxfvvvvvvv
Work Experience-Dalton Park.pptxfvvvvvvvWork Experience-Dalton Park.pptxfvvvvvvv
Work Experience-Dalton Park.pptxfvvvvvvv
 
HARMONY IN THE NATURE AND EXISTENCE - Unit-IV
HARMONY IN THE NATURE AND EXISTENCE - Unit-IVHARMONY IN THE NATURE AND EXISTENCE - Unit-IV
HARMONY IN THE NATURE AND EXISTENCE - Unit-IV
 
An experimental study in using natural admixture as an alternative for chemic...
An experimental study in using natural admixture as an alternative for chemic...An experimental study in using natural admixture as an alternative for chemic...
An experimental study in using natural admixture as an alternative for chemic...
 
POWER SYSTEMS-1 Complete notes examples
POWER SYSTEMS-1 Complete notes  examplesPOWER SYSTEMS-1 Complete notes  examples
POWER SYSTEMS-1 Complete notes examples
 
CCS355 Neural Networks & Deep Learning Unit 1 PDF notes with Question bank .pdf
CCS355 Neural Networks & Deep Learning Unit 1 PDF notes with Question bank .pdfCCS355 Neural Networks & Deep Learning Unit 1 PDF notes with Question bank .pdf
CCS355 Neural Networks & Deep Learning Unit 1 PDF notes with Question bank .pdf
 
Decoding Kotlin - Your guide to solving the mysterious in Kotlin.pptx
Decoding Kotlin - Your guide to solving the mysterious in Kotlin.pptxDecoding Kotlin - Your guide to solving the mysterious in Kotlin.pptx
Decoding Kotlin - Your guide to solving the mysterious in Kotlin.pptx
 
young call girls in Green Park🔝 9953056974 🔝 escort Service
young call girls in Green Park🔝 9953056974 🔝 escort Serviceyoung call girls in Green Park🔝 9953056974 🔝 escort Service
young call girls in Green Park🔝 9953056974 🔝 escort Service
 
Artificial-Intelligence-in-Electronics (K).pptx
Artificial-Intelligence-in-Electronics (K).pptxArtificial-Intelligence-in-Electronics (K).pptx
Artificial-Intelligence-in-Electronics (K).pptx
 

Black-box modeling of nonlinear system using evolutionary neural NARX model

  • 1. International Journal of Electrical and Computer Engineering (IJECE) Vol. 9, No. 3, June 2019, pp. 1861~1870 ISSN: 2088-8708, DOI: 10.11591/ijece.v9i3.pp1861-1870  1861 Journal homepage: http://iaescore.com/journals/index.php/IJECE Black-box modeling of nonlinear system using evolutionary neural NARX model Nguyen Ngoc Son, Nguyen Duy Khanh, Tran Minh Chinh Faculty of Electronics Technology, Industrial University of Ho Chi Minh City, Viet Nam Article Info ABSTRACT Article history: Received May 12, 2018 Revised Dec 18, 2018 Accepted Dec 29, 2018 Nonlinear systems with uncertainty and disturbance are very difficult to model using mathematic approach. Therefore, a black-box modeling approach without any prior knowledge is necessary. There are some modeling approaches have been used to develop a black box model such as fuzzy logic, neural network, and evolution algorithms. In this paper, an evolutionary neural network by combining a neural network and a modified differential evolution algorithm is applied to model a nonlinear system. The feasibility and effectiveness of the proposed modeling are tested on a piezoelectric actuator SISO system and an experimental quadruple tank MIMO system. Keywords: Differential evolution Evolutionary neural networks Nonlinear system identification Piezoelectric actuator Quadruple tank system Copyright © 2019 Institute of Advanced Engineering and Science. All rights reserved. Corresponding Author: Nguyen Ngoc Son, Faculty of Electronics Technology, Industrial University of Ho Chi Minh City, 12 Nguyen Van Bao Street, 4 Ward, Go Vap District, Ho Chi Minh City, Viet Nam. Email: nguyenngocson@iuh.edu.vn 1. INTRODUCTION Mathematical modeling of systems is a very common methodology in engineering. It is used both as a means for achieving deeper knowledge about a system and as a basis for simulations or for the design of controllers. However, in practice, it is not easy to obtain an accurate mathematical model of a nonlinear system because of a lack of knowledge of the system and disturbance impact to system maybe still unknown. In these cases, system identification can be a way of solving the modeling problem. System identification deals with the problem of how to estimate a model of a system from measured input and output signals. Black-Box nonlinear modeling approaches include non-parametric methods, such as neural networks, fuzzy logic, genetic algorithm etc., [1] which do not require a priori knowledge. Recently, the multilayer feed-forward neural network (MLP) has been widely used in nonlinear system identification. As we know, the performance of a neural network is dependent on the training process. A popular training algorithm is the back-propagation. However, the back-propagation (BP) algorithm only perform a local search around the initial values and provide local optimizations [2], [3]. Therefore the meta- heuristic algorithms based training procedures are considered as promising alternatives. The meta-heuristic algorithms generate global optimum because of their ability to search the global solution space and avoiding falling into a locally optimal solution. For example, a genetic algorithm [4]-[6] is used for turning the structure and parameters of neural networks. Papers [7]-[9] introduced the particle swarm optimization (PSO) to train the neural network model. Valian et al. [10] proposed the improved cuckoo search algorithm for training feed-forward neural network for two benchmark classification problems. Although these proposed methods obtained good results, two challenges that need to be further improved in training neural network are how to find the global optimal solution and how to achieve a fast convergence speed.
  • 2.  ISSN: 2088-8708 Int J Elec & Comp Eng, Vol. 9, No. 3, June 2019 : 1861 - 1870 1862 Among meta-heuristic algorithms, the differential evolution (DE) technique was regarded as a promising stochastic global optimization algorithm. The DE algorithm was first studied and published by Storn R. and Price K.V. [11]. Its advantages are as follows: the simple and straightforward features in installation, better performance, fewer parameters involved, and low complexity. Over recent years, the DE technique had been applied to learn a neural model via optimizing real and constrained integer weighting values [12]-[15]. Nonetheless, DE technique gets the slow convergence speed for high-sized optimization tasks. Furthermore, DE technique often seems easy to fall into a stagnant situation that is a state that the optimum searching procedure stagnates before obtaining a global optimum solution. Some suggestions on how to improve the DE performance on the training neural network have been studied [16]-[20]. Paper [21] proposed the hybrid modified differential evolution plus back-propagation algorithm (MDE-BP) for training neural network model. The performance and efficiency of the proposed MDE-BP training method are tested on identifying some benchmark nonlinear systems. However, paper [21] only perform for SISO nonlinear identification system. Therefore, this paper continuously studies the proposed MDE-BP training algorithm in [21] to train a neural network for a general nonlinear identification and its approach to model a piezoelectric actuator SISO system and an experimental quadruple tank MIMO system. These systems are suitable to test the effectiveness of the proposed method because of its hysteresis behavior and highly nonlinearity characteristic. The rest of this paper is organized as follows. Section 2 introduces the proposed MDE-BP training neural NARX model for MIMO nonlinear system identification. Section 3 presents the results and discussion. Where Section 3.1 introduces to model a piezoelectric actuator SISO system. Section 3.2 introduces an experimental quadruple tank setup and the identification results. Finally, Section 4 contains some conclusions. 2. RESEARCH METHOD Evolutionary neural NARX (ENN) model is proposed in [21] by connecting the Multi-Layer Perceptron Neural Networks (MLP) model and NARX structure. The weight value of ENN model is optimized by a hybridizing modified differential evolution and backpropagation training (MDE-BP) algorithms. Based on this combination, the ENN model obtains a strongly approximating feature of the MLP scheme and a powerful predictive feature of the NARX structure. The ENN model structure, which is used for nonlinear MIMO system identification, is illustrated in Figure 1. 1 z 1 (k 1)u  nb z MDE-BP algorithm Nonlinear MIMO system1u nu 1y my 1 ˆy ˆmy MLP - NARX error error 1 (k )u nb 1 z (k 1)nu  nb z (k )nu nb 1 z (k 1)my  na z (k )my na 1 z 1 (k 1)y  na z 1 (k )y na Figure 1. The ENN model for a nonlinear system identification Where, u(k) and y(k) represent the input and output signals of nonlinear MIMO system; na and nb are order of output y(k) and input u(k), respectively; q is the backward time shift operator defined as q-1 u (k) = u (k-1). vjn is the weight of input layer, vj0 is the weight of bias input layer, w1j is the weight of hidden layer, w10 is the weight of bias hidden layer; fj(:) is sigmoid function at hidden layer, F(:) is linear activation function at output layer; the dimension number D is the sum of the number of weights and thresholds of the
  • 3. Int J Elec & Comp Eng ISSN: 2088-8708  Black-box modeling of nonlinear system using evolutionary neural NARX model (Nguyen Ngoc Son) 1863 neural NARX model;      1 2(k) ,u ,...,unu u k k k    is the input signal vector and      1 2(k) ,y ,...,ymy y k k k    is the output signal vector of nonlinear MIMO system. We determine the prediction output as follows: ̂( ) (∑ (∑ ( ) ) ) (1) Where, ( )kj is the regression vector and q is the weight vector, defined by                      1 1 ,..., , 1 ,..., , ,..., 1 ,..., , 1 ,..., T T m m n n n y k y k na y k y k na k k k u k u k nb u k u k nb                     (2) [ ] , - (3) The modified differential evolution training algorithm is used to optimally generate the value of the weight of the neural NARX model. The output of the neural NARX model is a prediction function ( )ˆy k q of the synaptic weight vector  and regression vector  k . Algorithm 1. The proposed MDE-BP training algorithm 1. Begin 2. Generate randomly initialized a population ⃗⃗⃗⃗⃗⃗ [ ] 3. Evaluate the fitness of each individual in the population 4. For G=1 to GEN do 5. For i =1 to NP do 6. jrand= randint(1,D) 7. F = rand[0:4; 1:0], CR = rand[0:7; 1:0] 8. For j =1 to D do 9. If rand[0,1] < CR or j == jrand then 10. If rand[0,1] > threshold then 11. Select randomly * + 12. ( ) 13. Else 14. Select randomly * + 15. ( ) 16. End if 17. Else 18. 19. End if 20. End for 21. If (⃗⃗ ) (⃗⃗ ) then 22. ⃗⃗ ⃗⃗ 23. Else 24. ⃗⃗ ⃗⃗ 25. End if 26. End for 27. Use ⃗⃗ as an initial point for BP algorithm 28. Replace ⃗⃗ by bp obtaining from BP algorithm 29. End for 30. End In the training process, both the input signal u(k) and the output signal y(k) of nonlinear MIMO system are known and the synaptic weight vector  is adapted to obtain appropriate functional mappings from the input u(k) to the output y(k). Generally, the adaptation process can be carried out by minimizing the network error function EN which is based on the introduction of a measure of closeness in terms of a mean square error (MSE) criterion. ( ) ∑ , ( ) ̂( )- , ( ) ̂( )- (4)
  • 4.  ISSN: 2088-8708 Int J Elec & Comp Eng, Vol. 9, No. 3, June 2019 : 1861 - 1870 1864 Where the training data N Z is specified by *, ( ) ( )- +. The optimization goal is to minimize the objective function EN by optimizing the values of the network weights [ ]1 2, ,...., T Dw w wq = by using the MDE-BP algorithm which is described in details at paper [21]. The working steps involved in employing MDE-BP training algorithm as Algorithm 1. 3. RESULTS AND ANALYSIS All of the modelings is performed by Matlab version 2013b on an Intel Core i3 computer with a clock rate of 2.53GHz and 2.00GB of RAM. 3.1. Modeling the hysteresis behavior of the piezoelectric actuator Micropositioning stages using piezoelectric actuator are widely used in a variety of applications such as microgripper robot [22], energy harvesting [23], MEMs [24] and so on. The piezoelectric actuator possesses a higher displacement accuracy, larger generation force and higher response speed than other types of actuators. However, the nonlinearities hysteresis of the piezoelectric actuator can greatly degrade the positioning accuracy of micropositioning systems [25], [26]. Therefore, modeling precisely and identifying parameter effectively for piezoelectric actuator still remain a challenging problem nowadays. To describe the hysteresis behavior of the piezoelectric actuator, many mathematical models have been proposed such as Prandtl-Ishlinskii, Preisach model, Bouc-Wen model, KP model, Duhem model and so on [27]. However, the difficulties in determining the parameters of the hysteresis model limit its application in practice. Figure 2. Selection of training data for estimating and validating purposes To overcome this problem, paper [25] proposed a parameter identification method based on artificial neural networks for the Duhem hysteresis model. The mathematical model of the piezoelectric actuator based Duhem model in [25] can be described as                       my t ny t ky t k du t w t w t u t cu t w t bu t          (5) where m is the equivalent mass; n is the equivalent damping; k is the equivalent stiffness; u(t) is the input voltage; y(t) is the output displacement; w(t) is the hysteretic state variable; parameters α, b, c controls the shapes and amplitudes of the hysteresis loop; and d is the effective piezoelectric coefficient of the actuator. In this paper, the ENN model trained MDE-BP algorithm is proposed to identify the nonlinearities Duhem hysteresis of the piezoelectric actuator. Firstly, the above system (5) is implemented in MATLAB. The training data set and validating data set are collected form system (5) and shown in Figure 2. Secondly, the ENN structure is selected by linking the 3-layer MLP with S1 hidden nodes and the 2nd order NARX structure, is presented with the regression and prediction functions, respectively. Selecting parameter S1 = 5, NP = 62 and GEN = 10000. 0 1 2 3 4 5 -5 0 5 Dataset for training inputdata 0 1 2 3 4 5 -5 0 5 time (sec) outputdata 0 1 2 3 4 5 -4 -2 0 2 4 Dataset for validation 0 1 2 3 4 5 -4 -2 0 2 4 time (sec)
  • 5. Int J Elec & Comp Eng ISSN: 2088-8708  Black-box modeling of nonlinear system using evolutionary neural NARX model (Nguyen Ngoc Son) 1865 Figure 3. Convergence rate in training Figure 4. Identification performance Finally, the performance identification using the proposed ENN model is conducted. Figure 3 shows the convergence rates of MDE-BP-ENN in the training process. Figure 4 demonstrates the errors between the predicted output of the neural network and the formula output of Duhem model. The results indicate the proposed method can be used to identify and predict the hysteresis behavior of the piezoelectric actuator. 3.2. Modeling a quadruple tank system In practice, a common tank system consists of tanks, pumps, piping, valves, liquid level sensors. During operation, depending on the technology requirements and load requirements, the valves can change the aperture, or the liquid type in the tanks can change. This leads to a nonlinear characteristic of the system that can vary. Moreover, the parameters of the liquid tank system such as the size and discharge coefficient of the valves, the power factor of the pump in some cases may be still unknown. Therefore, it is not easy to obtain an accurate theoretical model of a quadrature tank system. To overcome the disadvantages of the theoretical modeling method, some identification approaches have been investigated. Paper [28] proposed an adaptive fuzzy model predictive control based on the ant colony optimization (ACO) for nonlinear process system. Paper [29] used a radial basis function neural network as the prediction function due to its approximation ability. Then, a nonlinear model predictive control method was proposed to guarantee the system stability and compensate the network-induced delays and packet dropouts. Iplikci [30] proposed a support vector machine (SVM) approach to the generalized predictive control (GPC) of an experimental three-tank system. One advantage of the black-box modeling approach is that it is unnecessary to precisely analyze its internal mechanism or the relationship among physical variables. In this paper, the ENN model trained MDE-BP algorithm is proposed to identify the black-box modeling of a quadruple tank system. 3.2.1. Physical model The quadruple tank system which is described in Figure 5 is a nonlinear plant with strong coupling and large time delay. The quadruple tank plant can be seen as a system with two inputs, the voltages of the pumps, and two outputs, the water levels of the lower tanks. Where Li is the liquid level in tank i; Dti is the outlet cross-sectional area of tank i; Doi is the cross- sectional area of tank i; i  is the portion of the flow into the upper tank from pump i; uj is the speed setting of pump j, with the corresponding gain kj. A mathematical model based on physical data together with its linearization around an operating point is derived in Johansson [31]. 0 2000 4000 6000 8000 10000 10 -3 10 -2 10 -1 10 0 10 1 Generation MSEfortraining 0 1 2 3 4 5 -4 -2 0 2 4 output 0 1 2 3 4 5 -0.4 -0.2 0 0.2 time (sec) error actual predicted
  • 6.  ISSN: 2088-8708 Int J Elec & Comp Eng, Vol. 9, No. 3, June 2019 : 1861 - 1870 1866 1 2 3 4 Pump 2 Pump 1 Figure 5. Schematic of the quadruple-tank system 3.2.2. Experimental quadruple tank setup In this part, the experimental quadruple tank system has been studied. Figure 6 describes the diagram block of the experimental quadruple tank system. Table 1 describes in detail the physical parameters of the tank model system. Table 1. The Parameters of the Quadruple-tank System Parameters Value Unit The outlet cross-sectional area of the tank ( 1 2 3 4, , ,t t t tD D D D ) 4.6 cm The cross-sectional area of tank 1 and 3 ( 1 o3,oD D ) 0.8 cm The cross-sectional area of tank 2 and 4 ( 2 o4,oD D ) 0.65 cm The portion of the flow into the upper tank from pump 1, 1 0.7 ------ The portion of the flow into the upper tank from pump 2, 2 0.65 ------ The corresponding gain of Pump, pk 6.9 3 cm /s/V The speed setting of the pump, ( 1 2,u u ) ------ V The pump used in the quadruple-tank system is an Ogihara engine with a 24 V supply and a pump flow rate of 10 liters per minute. In fact, the motors pump water into the tank in the operating range of 30% - 70% (Vmax). The Freescale Semiconductor's Strain Gauge MPX10 is used to measure water levels in tanks. Details of the equipment parameters of the quadruple-tank system are described in Table 2. Amplifier NI-PCI 6221 Pressure sensor DAC Matlab/Simulink ADC Figure 6. Diagram of the experimental quadruple tank system Table 2. The parameters of Pump and MPX10 Equipment Parameters Pump - Supply voltage: 24 VDC - Flow rate: 10 liters/minute - Power consumption: 26 W MPX10 sensor - Type of MPX10DP CASE 344C. - Supply voltage: 3-6 VDC - Sensity ∆V/∆P: 3.5 mV/kPa - Range: 0-10 kPa
  • 7. Int J Elec & Comp Eng ISSN: 2088-8708  Black-box modeling of nonlinear system using evolutionary neural NARX model (Nguyen Ngoc Son) 1867 3.2.3. Identification inverse model results In fact, the inverse predictive model plays an important role in the design of model-based control. In this article, the inverse model of the quadruple-tank system is identified by using the ENN model. The procedure consists of four basic steps as follows: Firstly, the experimental input-output data set, applied for training and validating purposes of the ENN based MDE-BP training algorithm, is collected from the quadruple-tank system. The input data set consists of the input signal as the voltage for the pump motor and the output signal of tank water level 2 and tank 4 collected from the experimental model described in Figure 7. Which, 1( )u k and 2 ( )u k are the voltage signal for the pump 1 and pump 2. 2 ( )L k and 4 ( )L k is the water level in tank 2 and tank 4. The dataset with the input voltage ratio has a change in amplitude from 0 to 1 and the change frequency described in Figure 7 will be used to estimate and evaluate the MDE-ENN prediction model. Where, Figure 7(a) is used to estimate the model, Figure 7(b) is used to evaluate the model. Figure 7. Experimental dataset for training and validation of the ENN model Secondly, the ENN structure is selected by linking the 3-layered MLP model with the 1st order NARX structure and described in Figure 8. In this case, the number of hidden neurons is S1 = 12, population size NP = 120, number of generations of trained GEN = 700, the coefficient of learning BP 0.000001  and number of iterations for BP iter3 = 5. e  1 ˆu k 2 (k 1)L 1( )u k Inverse NNARX model MDE-BP 1 z e 1 z 1 z 1 z  2 ˆu k 2 ( )u k 4 (k 1)L  Quadruple tank system Figure 8. The inverse model of the quadruple-tank system 0 500 1000 1500 2000 0 0.5 1 (a) u1e 0 500 1000 1500 2000 0 10 20 L2e 0 500 1000 1500 2000 0 0.5 1 u2e 0 500 1000 1500 2000 0 10 time (samples) L4e 0 500 1000 1500 2000 0 0.5 1 (b) u1v 0 500 1000 1500 2000 15 20L2v 0 500 1000 1500 2000 0 0.5 1 u2v 0 500 1000 1500 2000 10 15 time (samples) L4v
  • 8.  ISSN: 2088-8708 Int J Elec & Comp Eng, Vol. 9, No. 3, June 2019 : 1861 - 1870 1868 Finally, the estimation and validation process are conducted to identify the ENN model. Figure 9 shows the performance of MDE-BP-ENN based on the values of MSE in the training process. Figure 10 shows the performance of MDE-BP-ENN based on the average values of MSE on the validation process. Based on the above results, we see that the ENN prediction model with weightings optimized by the MDE- BP algorithm has been identified and predicted fairly accurately the inverse dynamic properties of the quadruple-tank system. Figure 9. The MSE value on the training process Figure 10. The MSE value on the validation process 4. CONCLUSION This paper introduces how to modeling a nonlinear SISO and MIMO system based on input-output data using the proposed Evolutionary Neural NARX (ENN) model. The ENN scheme is used by connecting the Multi-Layer Perceptron Neural Networks (MLP) model and NARX structure. The weight value of ENN model is optimized by hybridizing a modified differential evolution and backpropagation training (MDE-BP) algorithms. The effectiveness of ENN model is tested on modeling a piezoelectric actuator and a quadruple tank system. The results prove that the ENN model has the ability to learn the dynamics model to reduce the tracking error to nearly zero. The results will be used to initialize the design of the model-based controller for nonlinear systems in the future research. ACKNOWLEDGEMENTS The study was supported by Science and Technology Incubator Youth Program, managed by the Center for Science and Technology Development, Ho Chi Minh Communist Youth Union, the contract number is "13/2018/HĐ-KHCN-VƯ ". 0 500 1000 1500 2000 0 0.5 1 L2 (solid) and L2_hat (dashed) output 0 500 1000 1500 2000 -0.5 0 0.5 time (samples) predictionerror 0 500 1000 1500 2000 0 0.5 1 L4 (solid) and L4_hat (dashed) 0 500 1000 1500 2000 -0.5 0 0.5 time (samples) 0 500 1000 1500 2000 0 0.5 1 L2 (solid) and L2_hat (dashed) output 0 500 1000 1500 2000 -0.5 0 0.5 time (samples) predictionerror 0 500 1000 1500 2000 0 0.5 1 L4 (solid) and L4_hat (dashed) 0 500 1000 1500 2000 -0.5 0 0.5 time (samples)
  • 9. Int J Elec & Comp Eng ISSN: 2088-8708  Black-box modeling of nonlinear system using evolutionary neural NARX model (Nguyen Ngoc Son) 1869 REFERENCES [1] Ljung, Lennart, "System identification," Signal analysis and prediction, pp. 163-173, 1998. [2] Wang, Lin, Yi Zeng, and Tao Chen, "Back propagation neural network with adaptive differential evolution algorithm for time series forecasting." Expert Systems with Applications, vol 42(2), pp. 855-863, 2015. [3] Piotrowski, Adam P., "Differential evolution algorithms applied to neural network training suffer from stagnation." Applied Soft Computing, vol. 21, pp. 382-406, 2014. [4] Yu, Feng, and Xiaozhong Xu, "A short-term load forecasting model of natural gas based on optimized genetic algorithm and improved BP neural network," Applied Energy, vol. 134, pp. 102-113, 2014. [5] Leung, Frank Hung-Fat, et al., "Tuning of the structure and parameters of a neural network using an improved genetic algorithm," IEEE Transactions on Neural networks, vol. 14(1), pp. 79-88, 2003. [6] Asadi, Ehsan, et al. "Multi-objective optimization for building retrofit: A model using genetic algorithm and artificial neural network and an application," Energy and Buildings, vol. 81, pp. 444-456, 2014. [7] Song, Ying, Zengqiang Chen, and Zhuzhi Yuan, "New chaotic PSO-based neural network predictive control for nonlinear process," IEEE transactions on neural networks, vol. 18(2), pp. 595-601, 2007. [8] Bashir Z. A., and M. E. El-Hawary, "Applying wavelets to short-term load forecasting using PSO-based neural networks," IEEE transactions on power systems, vol. 24(1), pp. 20-27, 2009. [9] Gordan, Behrouz, et al, "Prediction of seismic slope stability through combination of particle swarm optimization and neural network," Engineering with Computers, 32(1), pp. 85-97, 2016. [10] Valian, Ehsan, Shahram Mohanna, and Saeed Tavakoli, "Improved cuckoo search algorithm for feedforward neural network training," International Journal of Artificial Intelligence & Applications, vol. 2(3), pp. 36-43, 2011. [11] Storn, Rainer, and Kenneth Price, "Differential evolution–a simple and efficient heuristic for global optimization over continuous spaces," Journal of global optimization, vol. 11(4), pp. 341-359, 1997. [12] Ilonen, Jarmo, Joni-Kristian Kamarainen, and Jouni Lampinen, "Differential evolution training algorithm for feed- forward neural networks," Neural Processing Letters, vol. 17(1), pp. 93-105, 2003. [13] Baştürk, Alper, and Enis Günay, "Efficient edge detection in digital images using a cellular neural network optimized by differential evolution algorithm," Expert Systems with Applications, vol. 36(2), pp. 2645-2650, 2009. [14] Subudhi, Bidyadhar, and Debashisha Jena, "A differential evolution based neural network approach to nonlinear system identification," Applied Soft Computing, vol. 11(1), pp. 861-871, 2011. [15] Chauhan, Nikunj, Vadlamani Ravi, and D. Karthik Chandra, "Differential evolution trained wavelet neural networks: Application to bankruptcy prediction in banks," Expert Systems with Applications, vol. 36(4), pp.7659-7665, 2009. [16] Wang, Lin, Yi Zeng, and Tao Chen, "Back propagation neural network with adaptive differential evolution algorithm for time series forecasting," Expert Systems with Applications vol. 42(2), pp. 855-863, 2015. [17] Liu, Wei, et al., "Neural network based on self-adaptive differential evolution for ultra-short-term power load forecasting," International conference on intelligent computing. Springer, Cham, 2014. [18] Chen, Cheng-Hung, Cheng-Jian Lin, and Chin-Teng Lin, "Nonlinear system control using adaptive neural fuzzy networks based on a modified differential evolution." IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews), vol. 39(4), pp. 459-473, 2009, [19] Slowik, Adam, "Application of an adaptive differential evolution algorithm with multiple trial vectors to artificial neural network training," IEEE Transactions on Industrial Electronics, 58(8), pp. 3160-3167, 2011. [20] Kumar, Jitendra, and Ashutosh Kumar Singh, "Workload prediction in cloud using artificial neural network and adaptive differential evolution," Future Generation Computer Systems, vol. 81, pp. 41-52, 2018. [21] Nguyen, Son Ngoc, Vinh Ho‐ Huu, and Anh Pham Huy Ho, "A neural differential evolution identification approach to nonlinear systems and modelling of shape memory alloy actuator," Asian Journal of Control, 2018. [22] Nah, S. K., and Z. W. Zhong, "A microgripper using piezoelectric actuation for micro-object manipulation," Sensors and Actuators A: Physical, vol. 133(1), pp. 218-224, 2007. [23] Bowen, C. R., et al., "Piezoelectric and ferroelectric materials and structures for energy harvesting applications," Energy & Environmental Science, vol. 7(1), pp. 25-44, 2014. [24] Nguyen, Cuong H., Ulrik Hanke, and Einar Halvorsen, "Actuation of Piezoelectric Layered Beams with d31 and d33 Coupling," IEEE Transactions on Ultrasonics, Ferroelectrics, and Frequency Control, 2018. [25] Wang, Geng, and Guoqiang Chen, "Identification of piezoelectric hysteresis by a novel Duhem model based neural network," Sensors and Actuators A: Physical, vol. 264, pp. 282-288, 2017. [26] Mao, Xuefei, et al., "A Hybrid Feedforward-Feedback Hysteresis Compensator in Piezoelectric Actuators Based on Least-Squares Support Vector Machine," IEEE Transactions on Industrial Electronics, vol.65(7), pp. 5704-5711, 2018. [27] Krasnosel'skii, Mark A., and Aleksei V. Pokrovskii, "Systems with hysteresis," Springer Science & Business Media, 2012. [28] Bououden S., Mohammed Chadli, and Hamid Reza Karimi, "An ant colony optimization-based fuzzy predictive control approach for nonlinear processes," Information Sciences, vol. 299, pp. 143-158, 2015. [29] Wang, Tong, Huijun Gao, and Jianbin Qiu, "A combined adaptive neural network and nonlinear model predictive control for multirate networked industrial process control," IEEE Transactions on Neural Networks and Learning Systems, vol. 27(2), pp. 416-425, 2016. [30] Iplikci, Serdar, "A support vector machine-based control application to the experimental three-tank system," ISA transactions, vol. 49(3), pp. 376-386, 2010. [31] Johansson, Karl Henrik, "The quadruple-tank process: A multivariable laboratory process with an adjustable zero," IEEE Transactions on control systems technology, vol. 8(3), pp. 456-465, 2000.
  • 10.  ISSN: 2088-8708 Int J Elec & Comp Eng, Vol. 9, No. 3, June 2019 : 1861 - 1870 1870 BIOGRAPHIES OF AUTHORS Son Nguyen received his M.Sc. and Ph.D. degrees in the Faculty of Electrical and Electronics Engineering (FEEE) from Ho Chi Minh City University of Technology in 2012 and 2017, respectively. He is currently a Vice-Dean of the Faculty of Electronics Technology, Industrial University of Ho Chi Minh City, Viet Nam. His current research interests include intelligent control, robotics, identification of nonlinear systems, and the internet of things. Khanh Nguyen Duy received his M.Sc degree in the Faculty of Telecommunications from Posts and Telecommunications Institute of Technology in 2014. He is currently a Chairman of Student Science Research Club of Faculty of Electronics Technology, Industrial University of Ho Chi Minh City, Viet Nam. His research interests include intelligent systems, machine learning, identification systems, and the internet of thing. Tran Minh Chinh graduated in 2011 and received Ph.D. degrees in 2016 from Tambov Stade Technical University, Russia. From 9/2016, he works as a teacher in the Faculty of Electronics Technology, Industrial University of Ho Chi Minh City, Viet Nam. His research interests are modern control, intelligent systems, artificially intelligence, machine learning.