SlideShare a Scribd company logo
International Journal of Electrical and Computer Engineering (IJECE)
Vol. 10, No. 3, June 2020, pp. 2383∼2391
ISSN: 2088-8708, DOI: 10.11591/ijece.v10i3.pp2383-2391 Ì 2383
Discrete wavelet transform-based RI adaptive algorithm
for system identification
Mohammad Shukri Salman1
, Alaa Eleyan2
, Bahaa Al-Sheikh3
1,3
College of Engineering and Technology, American University of the Middle East, Kuwait
2
Electrical and Electronic Engineering, Avrasya University, Trabzon, Turkey
3
Biomedical Systems and Medical Informatics Engineering Department, Yarmouk University, Jordan
Article Info
Article history:
Received Mar 20, 2019
Revised Nov 5, 2019
Accepted Nov 25, 2019
Keywords:
Adaptive filters
Discrete wavelet transform
LMS algorithm
Recursive inverse algorithm
System identification
ABSTRACT
In this paper, we propose a new adaptive filtering algorithm for system identifica-
tion. The algorithm is based on the recursive inverse (RI) adaptive algorithm which
suffers from low convergence rates in some applications; i.e., the eigenvalue spread
of the autocorrelation matrix is relatively high. The proposed algorithm applies
discrete-wavelet transform (DWT) to the input signal which, in turn, helps to over-
come the low convergence rate of the RI algorithm with relatively small step-size(s).
Different scenarios has been investigated in different noise environments in system
identification setting. Experiments demonstrate the advantages of the proposed DWT
recursive inverse (DWT-RI) filter in terms of convergence rate and mean-square-error
(MSE) compared to the RI, discrete cosine transform LMS (DCT-LMS), discrete-
wavelet transform LMS (DWT-LMS) and recursive-least-squares (RLS) algorithms
under same conditions.
Copyright c 2020 Insitute of Advanced Engineeering and Science.
All rights reserved.
Corresponding Author:
Mohammad Shukri Salman,
College of Engineering and Technology,
American University of the Middle East,
Kuwait.
Tel: +965 2225 1400, ext: 1765
Email: mohammad.salman@aum.edu.kw
1. INTRODUCTION
Adaptive filtering plays an essential role in many signal processing applications. The least-mean-
square (LMS) algorithm’s simplicity made it very commonly used in adaptive signal processing applications
such as system identification [1], echo cancelation [2], channel equalization [3, 4], and interference cancela-
tion [3, 5]. The main drawback of the LMS algorithm is that it suffers from low convergence rate when the
input signal is highly correlated. Many LMS variants [6-10] had been introduced to overcome the limitations
of the original LMS algorithm and to achieve better performance in terms of mean-square-error (MSE) and
convergence rate. Transform domain variable step-size algorithms are effective and performing well in highly
correlated noise environment [7, 11]. It has been shown in [12] that transforming the input signal into another
domain can reduce the eigenvalue spread of input signal autocorrelation matrix which, in turn, accelerates
the convergence rate of the adaptive filters. The discrete-wavelet-transform LMS (DWT-LMS) [10] and the
discrete-cosine transform LMS (DCT-LMS) [13] algorithms were proposed to decrease the eigenvalue spread
of the autocorrelation matrix of the input signal. However, due to the fixed step-size of the LMS algorithm,
these algorithms provide poor performance in terms of the convergence rate.
The recursive-least-square (RLS) algorithm was proposed to offer faster convergence rate, especially,
for highly correlated input signals [6, 14, 15]. However, it has a disadvantage of being highly computation-
Journal homepage: http://ijece.iaescore.com/index.php/IJECE
2384 Ì ISSN: 2088-8708
ally complex. The performance of RLS algorithm and its variants depends on the forgetting factor (β) in
terms of convergence rate, misadjustment, tracking capability and stability [16]. The forgetting factor can take
values between zero and unity and needs to compromise between the above mentioned performance criteria.
When the forgetting factor is close to unity, the algorithm achieves low misadjustment and high stability, but
it compromises its tracking capabilities. A smaller value of (β) would improve the tracking capability of the
RLS algorithm [16], but it would increase the misadjustment and might affect the stability of the algorithm.
In [17] the authors investigated the influence of the forgetting factor of the RLS adaptive filter in system
identification. A possible solution to overcome this problem is to use a variable forgetting factor (VFF-RLS)
algorithm [18, 19].
Recursive inverse (RI) algorithm [20, 21] had been proposed to overcome the drawbacks and limita-
tions of the above mentioned adaptive filters. It had been shown that the RI algorithm performs considerably
better than the LMS algorithm and its variants. It was also shown that its performance, in terms of conver-
gence rate and excess MSE, is comparable to that of the RLS under different settings, with less computational
complexity. However, still the RI algorithm requires a very small initial value for its step-size if the eigenvalue
spread of input signal autocorrelation matrix is relatively high.
In this paper, we introduce a solution for the aforementioned problems by proposing a new DWT-
based RI (DWT-RI) algorithm. Applying DWT on the input signal [22, 23] will reduce the eigenvalue spread
of the autocorrelation matrix [24, 25] and gives the user the freedom to initiate the RI algorithm with relatively
high initial values for the step-size. This process guarantees a very high performance, of the algorithm, in terms
of both MSE and convergence rate.
The paper is organized as follows: In Section 2., a brief explanation of discrete wavelet transform is
covered. Section 3. presents the derivation of proposed DWT-RI algorithm. In Section 4., simulation results
that compare the performance of the proposed algorithm to those of the RI, DCT-LMS, DWT-LMS and RLS
algorithms, in different noise environments for system identification setting, are given. Finally, the conclusions
are drawn in the last section.
2. DISCRETE WAVELET TRANSFORM
The theory of multiresolution analysis was firstly developed by Mallat [26], to represent functions
defined over N dimensional space. Wavelet transform is a multiresolution technique for analyzing signals.
It was developed, as an alternative to short time Fourier transform (STFT), to overcome the time-frequency
resolution problems. The DWT uses filter banks to perform the wavelet analysis by the construction of the
multiresolution time-frequency plane. DWT decomposes the signal into wavelet coefficients from which the
original signal can be reconstructed again. The wavelet coefficients represent the signal in various frequency
bands [27, 28]. Figure 1 shows the structure of discrete wavelet transform adaptive filter (DWTAF).
Figure 1. Structure of discrete wavelet transform transversal adaptive filter.
Int J Elec & Comp Eng, Vol. 10, No. 3, June 2020 : 2383 – 2391
Int J Elec & Comp Eng ISSN: 2088-8708 Ì 2385
According to DWT theory, reconstruction of the original signal x(k) can be performed using the
following finite sum:
x(k) =
J−1
j=0 n∈Z
θj,nψj,n(k), (1)
where θj,n are the wavelet coefficients and ψj,n(k) are the wavelet functions that form an orthogonal basis.
The purpose of DWT adaptive filter is to generate the discrete reconstruction of xj(k) which is the projective
discrete form of x(k) in wavelet subspace. xj(k) is given by:
xj(k) =
n∈Z
θj,nψj,n(k). (2)
If vj(k) is the approximation of projective xj(k), then
vj(k) =
n∈Z
ˆθj,nψj,n(k), (3)
where ˆθj,n is the discrete approximation of the wavelet coefficients θj,n,
ˆθj,n =
l
x(l) ¯ψj,n(l). (4)
Given that,
hj(l, k) =
n∈Z
¯ψj,n(l)ψj,n(k). (5)
Now, substituting (4) and (5) in (3) results in
vj(k) =
l
x(l)hj(l, k). (6)
Equation (6) is simply the discrete convolution of the input signal x(k) and the filter coefficients hj(l, k).
Using Orthogonality and time-steadiness, filter indices can be rewritten as:
hj(l, k) = hj(l − k). (7)
Therefore,
vj(k) =
l
x(l)hj(l − k). (8)
3. DISCRETE WAVELET TRANSFORM RECURSIVE INVERSE ALGORITHM
3.1. Recursive inverse (RI) algorithm
The optimum solution for the FIR filter coefficients can be obtained using the Wiener-Hopf
equation [6]:
C(k) = R−1
(k)p(k), (9)
where k is the time parameter (k = 1, 2, . . .), C(k) is the filter weight vector calculated at time k, R(k) is the
estimate of the tap-input vector’s autocorrelation matrix, and p(k) is the estimate of the cross-correlation vector
between the desired output signal and the tap-input vector.
Recursive estimation of R(k) and p(k) in (9) can be obtained as follows;
R(k) = βR(k − 1) + x(k)xT
(k), (10)
p(k) = βp(k − 1) + d(k)x(k), (11)
where β is the forgetting factor which is usually very close to unity and x(k) is the tap-input vector.
Discrete wavelet transform-based RI adaptive... (Mohammad Shukri Salman)
2386 Ì ISSN: 2088-8708
Using the recursive solution of the Wiener-Hopf equation for one iteration with variable step size gives
the weight update equation of the RI algorithm [20]:
C(k) = [I − µ(k)R(k)]C(k − 1) + µ(k)p(k). (12)
Where µ(k) is the variable step-size [20] which satisfies the convergence criterion [6]:
µ(k) <
2
λmax(R(k))
=
1 − β
1 − βk
2
λmax(Rxx)
=
µmax
1 − βk
, (13)
where λmax is the maximum eigenvalue of R(k) and Rxx = E x(k)xT
(k) . For more details about derivation
and convergence analysis of the RI algorithm, the reader may refer to [20].
The RI algorithm has a major advantage compared to the RLS algorithm in that it does not require the update
of the inverse autocorrelation matrix. Also, its computational complexity is much less than that of the RLS
algorithm. Due to the update of inverse autocorrelation matrix, RLS type algorithms may face numerical
stability problems [29], which is not the case for the RI algorithm.
3.2. The proposed algorithm
The performance of the RI algorithm can be improved further by applying the DWT to the input signal.
In this case, the weights update equation in (12) will become as:
C(k + 1) = [I − µ(k)Rvv(k)]C(k) + µ(k)pvd(k). (14)
where
Rvv(k) = βRvv(k − 1) + v(k)vT
(k), (15)
and
pvd(k) = βpvd(k − 1) + d(k)v(k). (16)
Where v(k) = Wx(k) is the transformed input signal and W is the wavelet transform matrix of size J × N.
µ(k) =
µ0
1 − βk
, (17)
where µ0 is a constant selected as:
µ0 < µmax =
2(1 − β)
λmax (Rvv)
and Rvv = E v(k)vT
(k) .
The adaptive estimation error is given as:
e(k) = d(k) − y(k), (18)
where
y(k) = vT
(k)C(k) =
J−1
j=0
vj(k)cj(k) =
J−1
j=0 l
cj(k)hj(l − k)x(l), (19)
where y(k) is the transformed version of y(k) shown in Figure 2
Int J Elec & Comp Eng, Vol. 10, No. 3, June 2020 : 2383 – 2391
Int J Elec & Comp Eng ISSN: 2088-8708 Ì 2387
Figure 2. Block diagram of an adaptive system identification setting
0 0.5 1 1.5 2 2.5 3 3.5
0
0.2
0.4
0.6
0.8
1
1.2
1.4
Frequency
Magnitude
Figure 3. Unknown system transfer function
4. SIMULATION RESULTS
In the simulations, the performance of the proposed DWT-RI algorithm is compared to those of the
RI [20], DCT-LMS [9], DWT-LMS [10] and RLS [6] algorithms in the system identification setting described
in Figure 2. The filter length for all algorithms is J = 16 taps and the signal-to-noise ratio (SNR) was selected
to be 30dB for all the experiments. The received signal x(k) was generated using the DWT on the signal xi(k)
given by [7]:
xi(k) = 1.79xi(k − 1) − 1.85xi(k − 2) + 1.27xi(k − 3) − 0.41xi(k − 4) + v0(k). (20)
where v0(k) is a Gaussian process with zero mean and variance σ2
= 0.3849. The unknown system is the
bandpass filter shown in Figure 3. The simulation results for Gaussian and impulsive noise were obtained by
averaging 100 and 300 Monte-Carlo independent runs, respectively.
4.1. Additive white gaussian noise
In order to test the performance of the proposed algorithm, the signal is assumed to be corrupted with
an additive white Gaussian noise (AWGN) process. Simulations were carried out with the following parame-
ters: For the DWT-RI and RI algorithms: β = 0.99 and µ0 = 0.0013. For DCT-LMS algorithm: β = 0.9985,
= 8 × 10−4
, µ = 0.02, γ = 2 × 10−3
and M = 10. For DWT-LMS algorithm: µ = 0.02. For the
RLS algorithm: β = 0.99. Figure 4 shows that the RI, RLS and DWT-RI algorithms converge to the same
Discrete wavelet transform-based RI adaptive... (Mohammad Shukri Salman)
2388 Ì ISSN: 2088-8708
MSE. However, the DWT-RI and RLS converge much faster than the RI algorithm (950 iterations faster).
On the other hand, the DCT-LMS and DWT-LMS algorithms converge to a higher MSE (mse=5dB worse) than
the other algorithms with low rate of convergence.
200 400 600 800 1000 1200 1400
10
−6
10
−5
10
−4
10
−3
10
−2
10
−1
10
0
Iteration
MSE
DWT−RI
RLS RI
DCT−LMS
DWT−LMS
Figure 4. The ensemble MSE for RI, RLS,
DCT-LMS, DWT-LMS and DWT-RI in AWGN
200 400 600 800 1000 1200 1400
10
−7
10
−6
10
−5
10
−4
10
−3
10
−2
10
−1
10
0
Iteration
MSE
RI
DWT−LMS
DWT−RI
RLS DCT−LMS
Figure 5. The ensemble MSE for RI, RLS,
DCT-LMS, DWT-LMS and DWT-RI in AWIN
( = 0.2, κ = 100)
4.2. Additive white impulsive noise
Due to man-made noise, underwater acoustic noise, atmospheric noise, etc, the noise added to
the received signal may not be modeled as Gaussian. This type of noise which has a heavy-tailed distribution
is characterized by outliers and may be better modeled using a Gaussian mixture model. In order to test the
robustness of the proposed algorithm, and to study the effects of the impulsive components (outliers) of the
noise process in the system identification setting, an impulsive noise process is generated by the probability
density function [30]: f = (1 − ) G 0, σ2
n + G 0, κσ2
n with variance σ2
f given as: σ2
f = (1 − ) σ2
n+ κσ2
n,
where G 0, σ2
n is a Gaussian probability density function with zero mean and variance σ2
n that represents
the nominal background noise. G 0, κσ2
n represents the impulsive component of the noise model, where is
the probability and κ ≥ 1 is the strength of the impulsive components.
(a) Firstly, the signal is assumed to be corrupted with an additive white impulsive noise (AWIN) process.
The white impulsive noise process is generated with the parameters: = 0.2 and κ = 100. Simulations
were carried out with the following parameters: For the DWT-RI and RI algorithms: β = 0.99 and
µ0 = 0.001. For DCT-LMS algorithm: β = 0.9985, = 8 × 10−4
, µ = 0.02, γ = 2 × 10−3
and
M = 10. For DWT-LMS algorithm: µ = 0.018. For the RLS algorithm: β = 0.99. Figure 5 shows that
the DWT-RI and RLS algorithms converge to the same MSE at the same time, The RI and DCT-LMS
algorithms still converge to the same MSE but with much low rate of convergence than those of the
DWT-RI and RLS algorithms. The DWT-LMS algorithm converges to much higher MSE with almost
the same rate of convergence of those of RLS and DWT-RI algorithms.
(b) Secondly, in order to emphasize on the capability of the proposed DWT-RI algorithm in suppressing
impulsive noise, even, with high impulsivity strength, an AWIN process is generated with the parame-
ters: = 0.2 and κ = 100000. Simulations were carried out with the following parameters: For the
DWT-RI and RI algorithms: β = 0.99 and µ0 = 0.0001. For DCT-LMS algorithm: β = 0.9985,
= 8 × 10−4
, µ = 0.02, γ = 2 × 10−3
and M = 10. For DWT-LMS algorithm: µ = 0.018.
For the RLS algorithm: β = 0.99. The RI algorithm fails to converge under these settings. Figure 6
shows that the RLS algorithm converges to the steady-state MSE (MSE= −10dB) after 400 time itera-
tions, while the DWT-RI algorithm converges to a lower MSE (MSE= −14dB) than the RLS at the same
time. The DCT-LMS algorithm converges to a lower MSE than that of the DWT-RI algorithm but with
very low convergence rate, whereas the DWT-LMS algorithm converges to a very high MSE. This shows
the advantage of domain transform in reducing the self-correlation of the input signal and converging to
a lower MSE values with higher convergence rates.
Int J Elec & Comp Eng, Vol. 10, No. 3, June 2020 : 2383 – 2391
Int J Elec & Comp Eng ISSN: 2088-8708 Ì 2389
500 1000 1500 2000 2500 3000
10
−3
10
−2
10
−1
10
0
10
1
Iteration
MSE
DWT−RI RLS
DCT−LMS
DWT−LMS
Figure 6. The ensemble MSE for RI, RLS, DCT-LMS, DWT-LMS and DWT-RI in AWIN
( = 0.2, κ = 100000)
5. CONCLUSION
A new discrete wavelet transform based RI adaptive filtering algorithm is proposed. The performances
of the DWT-RI, DCT-LMS, DWT,LMS, RI and RLS algorithms are compared in AWGN and AWIN environ-
ments in system identification setting. Under the same conditions, the DWT-RI algorithm outperforms the
aforementioned algorithms in terms of MSE and/or convergence rate.
REFERENCES
[1] M. S. Ahmad, O. Kukrer and A. Hocanin, “The effect of the forgetting factor on the RI adaptive algorithm
in system identification,” 10th International Symposium on Signals, Circuits and Systems (ISSCS), pp. 1-
4, 2011.
[2] C. Paleologu, J. Benesty, S. L. Grant, and C. Osterwise, “Variable step-size NLMS algorithms for echo
cancellation,” 43rd Asilomar Conference on Signals, Systems and Computers, pp. 633-637, 2009.
[3] C. V. Sinn, and J. Gotze, “Comparative study of techniques to compute FIR filter weights in adap-
tive channel equalization,” IEEE International Conference on Acoustics, Speech and Signal Processing
(ICASSP03), vol. 6, pp. 217-220, 2003.
[4] M. S. Ahmad, O. Kukrer and A. Hocanin, “An efficient Recursive Inverse adaptive filtering algorithm for
channel equalization,” European Wireless Conference (EW 2010), pp. 88-92, 2010.
[5] S. Dixit and D. Nagaria, “LMS adaptive filters for noise cancellation: A review,” International Journal of
Electrical and Computer Engineering (IJECE), vol. 7, no. 5, pp. 2520-2529, 2017.
[6] S. Haykin, Adaptive Filter Theory, Prentice Hall, Upper Saddle River, NJ, 4th
edn., 2002.
[7] R. C. Bilcu, P. Kuosmanen and K. Egiazarian, “A transform domain LMS adaptive filter with variable
step-size,” IEEE Signal Processing Letters, vol. 9, no. 2, pp. 51-53, 2002.
[8] C. P. Kwong and E. W. Jonston, “A variable step-size LMS algorithm,” IEEE Transactions on Signal
Processing, vol. 40, pp. 1633–1642, 1992.
[9] D. I. Kim and P. De Wilde, “Performance analysis of the DCT-LMS adaptive filtering algorithm,” Signal
Process, vol. 80, no. 8, pp. 1629-1654, 2000.
[10] S. Hosur and A. H. Tewfik, “Wavelet transform domain adaptive FIR filtering,” IEEE Transactions on
Signal Processing, vol. 45, no. 3, pp. 617–629, 1997.
[11] T. Gowri, R. Kumar P., D.V.R. Koti Reddy, “Efficient reduction of PLI in ECG signal using new vari-
able step size least mean fourth adaptive algorithm,” International Journal of Electrical and Computer
Engineering (IJECE), vol. 9, no. 1, pp. 307-313, 2019.
[12] S. S. Narayan, A. M. Peterson and M. J. Narasimha, “Transform domain LMS algorithm,” IEEE Trans-
actions on ASSP, ASSP-31, no. 3, pp. 609-615, 1983.
[13] J. C. Lee and C. K. Un, “Performance of transform domain LMS adaptive digital filters,” IEEE Transac-
tions of Acoustic, Speech, Signal Processing, ASSP-34, no. 3, pp. 499-510, 1986.
Discrete wavelet transform-based RI adaptive... (Mohammad Shukri Salman)
2390 Ì ISSN: 2088-8708
[14] S. Qiao, “Fast adaptive RLS algorithms: a generalized inverse approach and analysis,” IEEE Transactions
on Signal Processing, vol. 39, no. 6, pp. 1455-1459, 1991.
[15] A. H. Sayed, Adaptive Filters, John Wily & Sons, NJ, 2008.
[16] S. Haykin, A. H. Sayed, J. R. Zeidler, P. Yee and P. C. Wei, “Adaptive tracking of linear time-variant
systems by extended RLS algorithms,” IEEE Transactions on Signal Processing, vol. 45, no. 5, pp. 1118-
1128, 1997.
[17] S. Ciochina, C. Paleologu, J. Benesty and A. A. Enescu, “On the influence of the forgetting factor of the
RLS adaptive filter in system identification,” International Symposium on Signals, Circuits and Systems
(ISSCS 2009), pp. 1-4, 2009.
[18] S. H. Leung, and C. F. So, “Gradient-based variable forgetting factor RLS algorithm in time-varying
environments,” IEEE Transactions on Signal Processing, vol. 53, no. 8, pp. 3141–3150, 2005.
[19] C. Paleologu, J. Benesty and S. Ciochina, “A robust variable forgetting factor recursive least-squares
algorithm for system identification,” IEEE Signal Processing Letters, vol. 15, pp. 597–600, 2008.
[20] M. S. Ahmad, O. Kukrer and A. Hocanin, “Recursive inverse adaptive filtering algorithm,” Digital Signal
Processing (Elsevier), vol. 21, no. 4, pp. 491-496, 2011.
[21] M. S. Salman, O. Kukrer and A. Hocanin, “Recursive inverse algorithm: Mean-square-error analysis,”
Digital Signal Processing (Elsevier), vol. 66, pp. 10-17, 2017.
[22] S. Saxena, R. Jais and M. K. Hota, “Removal of powerline interference from ECG signal using FIR,
IIR, DWT and NLMS adaptive filter,” 2019 International Conference on Communication and Signal
Processing (ICCSP), pp. 12-16, 2019.
[23] A. Mannan and A. Habib, “Adaptive processing of image using DWT and FFT OFDM in AWGN and
Rayleigh channel,” 2017 International Conference on Communication, Computing and Digital Systems
(C-CODE), pp. 346-350, 2017.
[24] T. Yang, Y. Chiang and F. Chang, “Further discussions on adaptive filters to improve the wavelet shrinkage
method,” 2016 International Conference on System Science and Engineering (ICSSE), pp. 1-4, 2016.
[25] A. N. S. Belgurzi and I. Elshafiey, “A power line interference canceler using wavelet transform and adap-
tive filter for ECG signal,” 2017 International Conference on Computer and Applications (ICCA), pp.
206-210, 2017.
[26] S. Mallat, “Wavelet for a vision,” Proceedings of the IEEE, vol. 84, no. 4, pp. 604-914, 1996.
[27] A. N. S. Belgurzi and I. Elshafiey, “A power line interference canceler using wavelet transform and adap-
tive filter for ECG signal,” 2017 International Conference on Computer and Applications (ICCA), pp.
206-210, 2017.
[28] A. Mannan and A. Habib, “Adaptive processing of image using DWT and FFT OFDM in AWGN and
Rayleigh channel,” 2017 International Conference on Communication, Computing and Digital Systems
(C-CODE), pp. 346-350, 2017.
[29] G. O. Glentis, K. Berberidis and S. Theodoridis, “Efficient least squares adaptive algorithms for FIR
transversal filtering,” IEEE Signal Processing Magazine, pp. 13-41, 1999.
[30] H. Delic and A. Hocanin, “Robust detection in DS/CDMA,” IEEE Transactions on Vehicular Technology,
vol. 51, no. 1, pp. 155-170, 2002.
BIOGRAPHIES OF AUTHORS
Mohammad Shukri Salman received the B.Sc., M.Sc. and Ph.D. Degrees in Electrical and
Electronics Engineering from Eastern Mediterranean University (EMU), in 2006, 2007 and 2011,
respectively. From 2006 to 2010, he was a teaching assistant of Electrical and Electronics Engi-
neering department at EMU. In 2010, he has joined the Department of Electrical and Electronic
Engineering at European University of Lefke (EUL) as a senior lecturer. For the period 2011-2015,
he has worked as an Assist. Prof. in the Department of Electrical and Electronics Engineering,
Mevlana (Rumi) University, Turkey. Currently, he is with Electrical Engineering Department at
the American University of Middle East in Kuwait. He has served as a general chair, program
chair and a TPC member for many international conferences. His research interests include signal
processing, adaptive filters, image processing, sparse representation of signals, control systems and
communications systems.
Int J Elec & Comp Eng, Vol. 10, No. 3, June 2020 : 2383 – 2391
Int J Elec & Comp Eng ISSN: 2088-8708 Ì 2391
Alaa Eleyan received the B.Sc. and M.Sc. degrees in Electrical Electronics Engineering from Near
East University, Northern Cyprus, in 2002 and 2004, respectively. In 2009, He finished his PhD
degree in Electrical and Electronics Engineering from Eastern Mediterranean University, Northern
Cyprus. Currently, he is working as an associate professor at Avrasya University, Turkey. His current
research interests are computer vision, signal image processing, machine learning and robotics.
He has more than 60 published journal articles and conference papers in these research fields.
Bahaa Al-Sheikh received the B.Sc. degree in Electronics Engineering from Yarmouk University,
Jordan, MSc in Electrical Engineering from Colorado State University, Colorado, USA, and PhD
in Biomedical Engineering degree from the University of Denver, Colorado, USA, in 2000, 2005
and 2009, respectively. Between 2009 and 2015, he worked for Yarmouk University as an assis-
tant professor in the department of Biomedical Systems and Medical Informatics Engineering and
served as the department chairman between 2010 and 2012. He served as a part-time consultant for
Sandhill Scientific Inc., Highlands Ranch, Colorado, USA in Biomedical Signal Processing field
between 2009 and 2014. Currently, he is an Assistant Professor at the Electrical Engineering
Department at the American University of the Middle East in Kuwait. His research interests
include digital signal and image processing, biomedical systems modeling, medical instrumentation
and sound source localization systems.
Discrete wavelet transform-based RI adaptive... (Mohammad Shukri Salman)

More Related Content

What's hot

Singular Value Decomposition: Principles and Applications in Multiple Input M...
Singular Value Decomposition: Principles and Applications in Multiple Input M...Singular Value Decomposition: Principles and Applications in Multiple Input M...
Singular Value Decomposition: Principles and Applications in Multiple Input M...IJCNCJournal
 
Memory Polynomial Based Adaptive Digital Predistorter
Memory Polynomial Based Adaptive Digital PredistorterMemory Polynomial Based Adaptive Digital Predistorter
Memory Polynomial Based Adaptive Digital PredistorterIJERA Editor
 
Multi carrier equalization by restoration of redundanc y (merry) for adaptive...
Multi carrier equalization by restoration of redundanc y (merry) for adaptive...Multi carrier equalization by restoration of redundanc y (merry) for adaptive...
Multi carrier equalization by restoration of redundanc y (merry) for adaptive...IJNSA Journal
 
A Study of Training and Blind Equalization Algorithms for Quadrature Amplitud...
A Study of Training and Blind Equalization Algorithms for Quadrature Amplitud...A Study of Training and Blind Equalization Algorithms for Quadrature Amplitud...
A Study of Training and Blind Equalization Algorithms for Quadrature Amplitud...IRJET Journal
 
Low power tool paper
Low power tool paperLow power tool paper
Low power tool paperM Madan Gopal
 
Mitigating Interference to GPS Operation Using Variable Forgetting Factor Bas...
Mitigating Interference to GPS Operation Using Variable Forgetting Factor Bas...Mitigating Interference to GPS Operation Using Variable Forgetting Factor Bas...
Mitigating Interference to GPS Operation Using Variable Forgetting Factor Bas...IJCNCJournal
 
Localized Algorithm for Channel Assignment in Cognitive Radio Networks
Localized Algorithm for Channel Assignment in Cognitive Radio NetworksLocalized Algorithm for Channel Assignment in Cognitive Radio Networks
Localized Algorithm for Channel Assignment in Cognitive Radio NetworksIJERA Editor
 
EGRE 310 RAMEYJM Final Project Writeup
EGRE 310 RAMEYJM Final Project WriteupEGRE 310 RAMEYJM Final Project Writeup
EGRE 310 RAMEYJM Final Project WriteupJacob Ramey
 
Local Vibrational Modes
Local Vibrational ModesLocal Vibrational Modes
Local Vibrational ModesDani Setiawan
 
MODIFIED LLL ALGORITHM WITH SHIFTED START COLUMN FOR COMPLEXITY REDUCTION
MODIFIED LLL ALGORITHM WITH SHIFTED START COLUMN FOR COMPLEXITY REDUCTIONMODIFIED LLL ALGORITHM WITH SHIFTED START COLUMN FOR COMPLEXITY REDUCTION
MODIFIED LLL ALGORITHM WITH SHIFTED START COLUMN FOR COMPLEXITY REDUCTIONijwmn
 
Energy efficient resources allocations for wireless communication systems
Energy efficient resources allocations for wireless communication systemsEnergy efficient resources allocations for wireless communication systems
Energy efficient resources allocations for wireless communication systemsTELKOMNIKA JOURNAL
 
An improved dft based channel estimation
An improved dft based channel estimationAn improved dft based channel estimation
An improved dft based channel estimationsakru naik
 
Performance Analysis of Ultra Wideband Receivers for High Data Rate Wireless ...
Performance Analysis of Ultra Wideband Receivers for High Data Rate Wireless ...Performance Analysis of Ultra Wideband Receivers for High Data Rate Wireless ...
Performance Analysis of Ultra Wideband Receivers for High Data Rate Wireless ...graphhoc
 
A SEMI BLIND CHANNEL ESTIMATION METHOD BASED ON HYBRID NEURAL NETWORKS FOR UP...
A SEMI BLIND CHANNEL ESTIMATION METHOD BASED ON HYBRID NEURAL NETWORKS FOR UP...A SEMI BLIND CHANNEL ESTIMATION METHOD BASED ON HYBRID NEURAL NETWORKS FOR UP...
A SEMI BLIND CHANNEL ESTIMATION METHOD BASED ON HYBRID NEURAL NETWORKS FOR UP...ijwmn
 
circuit_modes_v5
circuit_modes_v5circuit_modes_v5
circuit_modes_v5Olivier Buu
 
Heuristic based adaptive step size clms algorithms for smart antennas
Heuristic based adaptive step size clms algorithms for smart antennasHeuristic based adaptive step size clms algorithms for smart antennas
Heuristic based adaptive step size clms algorithms for smart antennascsandit
 

What's hot (19)

Singular Value Decomposition: Principles and Applications in Multiple Input M...
Singular Value Decomposition: Principles and Applications in Multiple Input M...Singular Value Decomposition: Principles and Applications in Multiple Input M...
Singular Value Decomposition: Principles and Applications in Multiple Input M...
 
Memory Polynomial Based Adaptive Digital Predistorter
Memory Polynomial Based Adaptive Digital PredistorterMemory Polynomial Based Adaptive Digital Predistorter
Memory Polynomial Based Adaptive Digital Predistorter
 
Multi carrier equalization by restoration of redundanc y (merry) for adaptive...
Multi carrier equalization by restoration of redundanc y (merry) for adaptive...Multi carrier equalization by restoration of redundanc y (merry) for adaptive...
Multi carrier equalization by restoration of redundanc y (merry) for adaptive...
 
A Study of Training and Blind Equalization Algorithms for Quadrature Amplitud...
A Study of Training and Blind Equalization Algorithms for Quadrature Amplitud...A Study of Training and Blind Equalization Algorithms for Quadrature Amplitud...
A Study of Training and Blind Equalization Algorithms for Quadrature Amplitud...
 
Low power tool paper
Low power tool paperLow power tool paper
Low power tool paper
 
Dr35672675
Dr35672675Dr35672675
Dr35672675
 
Mitigating Interference to GPS Operation Using Variable Forgetting Factor Bas...
Mitigating Interference to GPS Operation Using Variable Forgetting Factor Bas...Mitigating Interference to GPS Operation Using Variable Forgetting Factor Bas...
Mitigating Interference to GPS Operation Using Variable Forgetting Factor Bas...
 
Localized Algorithm for Channel Assignment in Cognitive Radio Networks
Localized Algorithm for Channel Assignment in Cognitive Radio NetworksLocalized Algorithm for Channel Assignment in Cognitive Radio Networks
Localized Algorithm for Channel Assignment in Cognitive Radio Networks
 
Dynamic simulation of three-phase nine-level multilevel inverter with switchi...
Dynamic simulation of three-phase nine-level multilevel inverter with switchi...Dynamic simulation of three-phase nine-level multilevel inverter with switchi...
Dynamic simulation of three-phase nine-level multilevel inverter with switchi...
 
EGRE 310 RAMEYJM Final Project Writeup
EGRE 310 RAMEYJM Final Project WriteupEGRE 310 RAMEYJM Final Project Writeup
EGRE 310 RAMEYJM Final Project Writeup
 
Local Vibrational Modes
Local Vibrational ModesLocal Vibrational Modes
Local Vibrational Modes
 
MODIFIED LLL ALGORITHM WITH SHIFTED START COLUMN FOR COMPLEXITY REDUCTION
MODIFIED LLL ALGORITHM WITH SHIFTED START COLUMN FOR COMPLEXITY REDUCTIONMODIFIED LLL ALGORITHM WITH SHIFTED START COLUMN FOR COMPLEXITY REDUCTION
MODIFIED LLL ALGORITHM WITH SHIFTED START COLUMN FOR COMPLEXITY REDUCTION
 
Energy efficient resources allocations for wireless communication systems
Energy efficient resources allocations for wireless communication systemsEnergy efficient resources allocations for wireless communication systems
Energy efficient resources allocations for wireless communication systems
 
An improved dft based channel estimation
An improved dft based channel estimationAn improved dft based channel estimation
An improved dft based channel estimation
 
Project doc
Project docProject doc
Project doc
 
Performance Analysis of Ultra Wideband Receivers for High Data Rate Wireless ...
Performance Analysis of Ultra Wideband Receivers for High Data Rate Wireless ...Performance Analysis of Ultra Wideband Receivers for High Data Rate Wireless ...
Performance Analysis of Ultra Wideband Receivers for High Data Rate Wireless ...
 
A SEMI BLIND CHANNEL ESTIMATION METHOD BASED ON HYBRID NEURAL NETWORKS FOR UP...
A SEMI BLIND CHANNEL ESTIMATION METHOD BASED ON HYBRID NEURAL NETWORKS FOR UP...A SEMI BLIND CHANNEL ESTIMATION METHOD BASED ON HYBRID NEURAL NETWORKS FOR UP...
A SEMI BLIND CHANNEL ESTIMATION METHOD BASED ON HYBRID NEURAL NETWORKS FOR UP...
 
circuit_modes_v5
circuit_modes_v5circuit_modes_v5
circuit_modes_v5
 
Heuristic based adaptive step size clms algorithms for smart antennas
Heuristic based adaptive step size clms algorithms for smart antennasHeuristic based adaptive step size clms algorithms for smart antennas
Heuristic based adaptive step size clms algorithms for smart antennas
 

Similar to Discrete wavelet transform-based RI adaptive algorithm for system identification

Area efficient parallel LFSR for cyclic redundancy check
Area efficient parallel LFSR for cyclic redundancy check  Area efficient parallel LFSR for cyclic redundancy check
Area efficient parallel LFSR for cyclic redundancy check IJECEIAES
 
PERFORMANCE AND COMPLEXITY ANALYSIS OF A REDUCED ITERATIONS LLL ALGORITHM
PERFORMANCE AND COMPLEXITY ANALYSIS OF A REDUCED ITERATIONS LLL ALGORITHMPERFORMANCE AND COMPLEXITY ANALYSIS OF A REDUCED ITERATIONS LLL ALGORITHM
PERFORMANCE AND COMPLEXITY ANALYSIS OF A REDUCED ITERATIONS LLL ALGORITHMIJCNCJournal
 
Efficient realization-of-an-adfe-with-a-new-adaptive-algorithm
Efficient realization-of-an-adfe-with-a-new-adaptive-algorithmEfficient realization-of-an-adfe-with-a-new-adaptive-algorithm
Efficient realization-of-an-adfe-with-a-new-adaptive-algorithmCemal Ardil
 
Low-complexity robust adaptive generalized sidelobe canceller detector for DS...
Low-complexity robust adaptive generalized sidelobe canceller detector for DS...Low-complexity robust adaptive generalized sidelobe canceller detector for DS...
Low-complexity robust adaptive generalized sidelobe canceller detector for DS...Dr. Ayman Elnashar, PhD
 
BER Analysis ofImpulse Noise inOFDM System Using LMS,NLMS&RLS
BER Analysis ofImpulse Noise inOFDM System Using LMS,NLMS&RLSBER Analysis ofImpulse Noise inOFDM System Using LMS,NLMS&RLS
BER Analysis ofImpulse Noise inOFDM System Using LMS,NLMS&RLSiosrjce
 
Fixed Point Realization of Iterative LR-Aided Soft MIMO Decoding Algorithm
Fixed Point Realization of Iterative LR-Aided Soft MIMO Decoding AlgorithmFixed Point Realization of Iterative LR-Aided Soft MIMO Decoding Algorithm
Fixed Point Realization of Iterative LR-Aided Soft MIMO Decoding AlgorithmCSCJournals
 
Performance Evaluation of Adaptive Continuous Wavelet Transform based Rake Re...
Performance Evaluation of Adaptive Continuous Wavelet Transform based Rake Re...Performance Evaluation of Adaptive Continuous Wavelet Transform based Rake Re...
Performance Evaluation of Adaptive Continuous Wavelet Transform based Rake Re...IJECEIAES
 
15.sp.dictionary_draft.pdf
15.sp.dictionary_draft.pdf15.sp.dictionary_draft.pdf
15.sp.dictionary_draft.pdfAllanKelvinSales
 
ICI and PAPR enhancement in MIMO-OFDM system using RNS coding
ICI and PAPR enhancement in MIMO-OFDM system using RNS codingICI and PAPR enhancement in MIMO-OFDM system using RNS coding
ICI and PAPR enhancement in MIMO-OFDM system using RNS codingIJECEIAES
 
An Algorithm For Vector Quantizer Design
An Algorithm For Vector Quantizer DesignAn Algorithm For Vector Quantizer Design
An Algorithm For Vector Quantizer DesignAngie Miller
 
A Review: Compensation of Mismatches in Time Interleaved Analog to Digital Co...
A Review: Compensation of Mismatches in Time Interleaved Analog to Digital Co...A Review: Compensation of Mismatches in Time Interleaved Analog to Digital Co...
A Review: Compensation of Mismatches in Time Interleaved Analog to Digital Co...IJERA Editor
 
Iterative Soft Decision Based Complex K-best MIMO Decoder
Iterative Soft Decision Based Complex K-best MIMO DecoderIterative Soft Decision Based Complex K-best MIMO Decoder
Iterative Soft Decision Based Complex K-best MIMO DecoderCSCJournals
 
Iterative Soft Decision Based Complex K-best MIMO Decoder
Iterative Soft Decision Based Complex K-best MIMO DecoderIterative Soft Decision Based Complex K-best MIMO Decoder
Iterative Soft Decision Based Complex K-best MIMO DecoderCSCJournals
 
A Performance Analysis of CLMS and Augmented CLMS Algorithms for Smart Antennas
A Performance Analysis of CLMS and Augmented CLMS Algorithms for Smart Antennas A Performance Analysis of CLMS and Augmented CLMS Algorithms for Smart Antennas
A Performance Analysis of CLMS and Augmented CLMS Algorithms for Smart Antennas cscpconf
 
Performance of Matching Algorithmsfor Signal Approximation
Performance of Matching Algorithmsfor Signal ApproximationPerformance of Matching Algorithmsfor Signal Approximation
Performance of Matching Algorithmsfor Signal Approximationiosrjce
 

Similar to Discrete wavelet transform-based RI adaptive algorithm for system identification (20)

Area efficient parallel LFSR for cyclic redundancy check
Area efficient parallel LFSR for cyclic redundancy check  Area efficient parallel LFSR for cyclic redundancy check
Area efficient parallel LFSR for cyclic redundancy check
 
wcnc05
wcnc05wcnc05
wcnc05
 
E0812730
E0812730E0812730
E0812730
 
PERFORMANCE AND COMPLEXITY ANALYSIS OF A REDUCED ITERATIONS LLL ALGORITHM
PERFORMANCE AND COMPLEXITY ANALYSIS OF A REDUCED ITERATIONS LLL ALGORITHMPERFORMANCE AND COMPLEXITY ANALYSIS OF A REDUCED ITERATIONS LLL ALGORITHM
PERFORMANCE AND COMPLEXITY ANALYSIS OF A REDUCED ITERATIONS LLL ALGORITHM
 
Efficient realization-of-an-adfe-with-a-new-adaptive-algorithm
Efficient realization-of-an-adfe-with-a-new-adaptive-algorithmEfficient realization-of-an-adfe-with-a-new-adaptive-algorithm
Efficient realization-of-an-adfe-with-a-new-adaptive-algorithm
 
Low-complexity robust adaptive generalized sidelobe canceller detector for DS...
Low-complexity robust adaptive generalized sidelobe canceller detector for DS...Low-complexity robust adaptive generalized sidelobe canceller detector for DS...
Low-complexity robust adaptive generalized sidelobe canceller detector for DS...
 
I017325055
I017325055I017325055
I017325055
 
BER Analysis ofImpulse Noise inOFDM System Using LMS,NLMS&RLS
BER Analysis ofImpulse Noise inOFDM System Using LMS,NLMS&RLSBER Analysis ofImpulse Noise inOFDM System Using LMS,NLMS&RLS
BER Analysis ofImpulse Noise inOFDM System Using LMS,NLMS&RLS
 
iscas07
iscas07iscas07
iscas07
 
Fixed Point Realization of Iterative LR-Aided Soft MIMO Decoding Algorithm
Fixed Point Realization of Iterative LR-Aided Soft MIMO Decoding AlgorithmFixed Point Realization of Iterative LR-Aided Soft MIMO Decoding Algorithm
Fixed Point Realization of Iterative LR-Aided Soft MIMO Decoding Algorithm
 
Performance Evaluation of Adaptive Continuous Wavelet Transform based Rake Re...
Performance Evaluation of Adaptive Continuous Wavelet Transform based Rake Re...Performance Evaluation of Adaptive Continuous Wavelet Transform based Rake Re...
Performance Evaluation of Adaptive Continuous Wavelet Transform based Rake Re...
 
15.sp.dictionary_draft.pdf
15.sp.dictionary_draft.pdf15.sp.dictionary_draft.pdf
15.sp.dictionary_draft.pdf
 
L010628894
L010628894L010628894
L010628894
 
ICI and PAPR enhancement in MIMO-OFDM system using RNS coding
ICI and PAPR enhancement in MIMO-OFDM system using RNS codingICI and PAPR enhancement in MIMO-OFDM system using RNS coding
ICI and PAPR enhancement in MIMO-OFDM system using RNS coding
 
An Algorithm For Vector Quantizer Design
An Algorithm For Vector Quantizer DesignAn Algorithm For Vector Quantizer Design
An Algorithm For Vector Quantizer Design
 
A Review: Compensation of Mismatches in Time Interleaved Analog to Digital Co...
A Review: Compensation of Mismatches in Time Interleaved Analog to Digital Co...A Review: Compensation of Mismatches in Time Interleaved Analog to Digital Co...
A Review: Compensation of Mismatches in Time Interleaved Analog to Digital Co...
 
Iterative Soft Decision Based Complex K-best MIMO Decoder
Iterative Soft Decision Based Complex K-best MIMO DecoderIterative Soft Decision Based Complex K-best MIMO Decoder
Iterative Soft Decision Based Complex K-best MIMO Decoder
 
Iterative Soft Decision Based Complex K-best MIMO Decoder
Iterative Soft Decision Based Complex K-best MIMO DecoderIterative Soft Decision Based Complex K-best MIMO Decoder
Iterative Soft Decision Based Complex K-best MIMO Decoder
 
A Performance Analysis of CLMS and Augmented CLMS Algorithms for Smart Antennas
A Performance Analysis of CLMS and Augmented CLMS Algorithms for Smart Antennas A Performance Analysis of CLMS and Augmented CLMS Algorithms for Smart Antennas
A Performance Analysis of CLMS and Augmented CLMS Algorithms for Smart Antennas
 
Performance of Matching Algorithmsfor Signal Approximation
Performance of Matching Algorithmsfor Signal ApproximationPerformance of Matching Algorithmsfor Signal Approximation
Performance of Matching Algorithmsfor Signal Approximation
 

More from IJECEIAES

Remote field-programmable gate array laboratory for signal acquisition and de...
Remote field-programmable gate array laboratory for signal acquisition and de...Remote field-programmable gate array laboratory for signal acquisition and de...
Remote field-programmable gate array laboratory for signal acquisition and de...IJECEIAES
 
Detecting and resolving feature envy through automated machine learning and m...
Detecting and resolving feature envy through automated machine learning and m...Detecting and resolving feature envy through automated machine learning and m...
Detecting and resolving feature envy through automated machine learning and m...IJECEIAES
 
Smart monitoring technique for solar cell systems using internet of things ba...
Smart monitoring technique for solar cell systems using internet of things ba...Smart monitoring technique for solar cell systems using internet of things ba...
Smart monitoring technique for solar cell systems using internet of things ba...IJECEIAES
 
An efficient security framework for intrusion detection and prevention in int...
An efficient security framework for intrusion detection and prevention in int...An efficient security framework for intrusion detection and prevention in int...
An efficient security framework for intrusion detection and prevention in int...IJECEIAES
 
Developing a smart system for infant incubators using the internet of things ...
Developing a smart system for infant incubators using the internet of things ...Developing a smart system for infant incubators using the internet of things ...
Developing a smart system for infant incubators using the internet of things ...IJECEIAES
 
A review on internet of things-based stingless bee's honey production with im...
A review on internet of things-based stingless bee's honey production with im...A review on internet of things-based stingless bee's honey production with im...
A review on internet of things-based stingless bee's honey production with im...IJECEIAES
 
A trust based secure access control using authentication mechanism for intero...
A trust based secure access control using authentication mechanism for intero...A trust based secure access control using authentication mechanism for intero...
A trust based secure access control using authentication mechanism for intero...IJECEIAES
 
Fuzzy linear programming with the intuitionistic polygonal fuzzy numbers
Fuzzy linear programming with the intuitionistic polygonal fuzzy numbersFuzzy linear programming with the intuitionistic polygonal fuzzy numbers
Fuzzy linear programming with the intuitionistic polygonal fuzzy numbersIJECEIAES
 
The performance of artificial intelligence in prostate magnetic resonance im...
The performance of artificial intelligence in prostate  magnetic resonance im...The performance of artificial intelligence in prostate  magnetic resonance im...
The performance of artificial intelligence in prostate magnetic resonance im...IJECEIAES
 
Seizure stage detection of epileptic seizure using convolutional neural networks
Seizure stage detection of epileptic seizure using convolutional neural networksSeizure stage detection of epileptic seizure using convolutional neural networks
Seizure stage detection of epileptic seizure using convolutional neural networksIJECEIAES
 
Analysis of driving style using self-organizing maps to analyze driver behavior
Analysis of driving style using self-organizing maps to analyze driver behaviorAnalysis of driving style using self-organizing maps to analyze driver behavior
Analysis of driving style using self-organizing maps to analyze driver behaviorIJECEIAES
 
Hyperspectral object classification using hybrid spectral-spatial fusion and ...
Hyperspectral object classification using hybrid spectral-spatial fusion and ...Hyperspectral object classification using hybrid spectral-spatial fusion and ...
Hyperspectral object classification using hybrid spectral-spatial fusion and ...IJECEIAES
 
Fuzzy logic method-based stress detector with blood pressure and body tempera...
Fuzzy logic method-based stress detector with blood pressure and body tempera...Fuzzy logic method-based stress detector with blood pressure and body tempera...
Fuzzy logic method-based stress detector with blood pressure and body tempera...IJECEIAES
 
SADCNN-ORBM: a hybrid deep learning model based citrus disease detection and ...
SADCNN-ORBM: a hybrid deep learning model based citrus disease detection and ...SADCNN-ORBM: a hybrid deep learning model based citrus disease detection and ...
SADCNN-ORBM: a hybrid deep learning model based citrus disease detection and ...IJECEIAES
 
Performance enhancement of machine learning algorithm for breast cancer diagn...
Performance enhancement of machine learning algorithm for breast cancer diagn...Performance enhancement of machine learning algorithm for breast cancer diagn...
Performance enhancement of machine learning algorithm for breast cancer diagn...IJECEIAES
 
A deep learning framework for accurate diagnosis of colorectal cancer using h...
A deep learning framework for accurate diagnosis of colorectal cancer using h...A deep learning framework for accurate diagnosis of colorectal cancer using h...
A deep learning framework for accurate diagnosis of colorectal cancer using h...IJECEIAES
 
Swarm flip-crossover algorithm: a new swarm-based metaheuristic enriched with...
Swarm flip-crossover algorithm: a new swarm-based metaheuristic enriched with...Swarm flip-crossover algorithm: a new swarm-based metaheuristic enriched with...
Swarm flip-crossover algorithm: a new swarm-based metaheuristic enriched with...IJECEIAES
 
Predicting churn with filter-based techniques and deep learning
Predicting churn with filter-based techniques and deep learningPredicting churn with filter-based techniques and deep learning
Predicting churn with filter-based techniques and deep learningIJECEIAES
 
Taxi-out time prediction at Mohammed V Casablanca Airport
Taxi-out time prediction at Mohammed V Casablanca AirportTaxi-out time prediction at Mohammed V Casablanca Airport
Taxi-out time prediction at Mohammed V Casablanca AirportIJECEIAES
 
Automatic customer review summarization using deep learningbased hybrid senti...
Automatic customer review summarization using deep learningbased hybrid senti...Automatic customer review summarization using deep learningbased hybrid senti...
Automatic customer review summarization using deep learningbased hybrid senti...IJECEIAES
 

More from IJECEIAES (20)

Remote field-programmable gate array laboratory for signal acquisition and de...
Remote field-programmable gate array laboratory for signal acquisition and de...Remote field-programmable gate array laboratory for signal acquisition and de...
Remote field-programmable gate array laboratory for signal acquisition and de...
 
Detecting and resolving feature envy through automated machine learning and m...
Detecting and resolving feature envy through automated machine learning and m...Detecting and resolving feature envy through automated machine learning and m...
Detecting and resolving feature envy through automated machine learning and m...
 
Smart monitoring technique for solar cell systems using internet of things ba...
Smart monitoring technique for solar cell systems using internet of things ba...Smart monitoring technique for solar cell systems using internet of things ba...
Smart monitoring technique for solar cell systems using internet of things ba...
 
An efficient security framework for intrusion detection and prevention in int...
An efficient security framework for intrusion detection and prevention in int...An efficient security framework for intrusion detection and prevention in int...
An efficient security framework for intrusion detection and prevention in int...
 
Developing a smart system for infant incubators using the internet of things ...
Developing a smart system for infant incubators using the internet of things ...Developing a smart system for infant incubators using the internet of things ...
Developing a smart system for infant incubators using the internet of things ...
 
A review on internet of things-based stingless bee's honey production with im...
A review on internet of things-based stingless bee's honey production with im...A review on internet of things-based stingless bee's honey production with im...
A review on internet of things-based stingless bee's honey production with im...
 
A trust based secure access control using authentication mechanism for intero...
A trust based secure access control using authentication mechanism for intero...A trust based secure access control using authentication mechanism for intero...
A trust based secure access control using authentication mechanism for intero...
 
Fuzzy linear programming with the intuitionistic polygonal fuzzy numbers
Fuzzy linear programming with the intuitionistic polygonal fuzzy numbersFuzzy linear programming with the intuitionistic polygonal fuzzy numbers
Fuzzy linear programming with the intuitionistic polygonal fuzzy numbers
 
The performance of artificial intelligence in prostate magnetic resonance im...
The performance of artificial intelligence in prostate  magnetic resonance im...The performance of artificial intelligence in prostate  magnetic resonance im...
The performance of artificial intelligence in prostate magnetic resonance im...
 
Seizure stage detection of epileptic seizure using convolutional neural networks
Seizure stage detection of epileptic seizure using convolutional neural networksSeizure stage detection of epileptic seizure using convolutional neural networks
Seizure stage detection of epileptic seizure using convolutional neural networks
 
Analysis of driving style using self-organizing maps to analyze driver behavior
Analysis of driving style using self-organizing maps to analyze driver behaviorAnalysis of driving style using self-organizing maps to analyze driver behavior
Analysis of driving style using self-organizing maps to analyze driver behavior
 
Hyperspectral object classification using hybrid spectral-spatial fusion and ...
Hyperspectral object classification using hybrid spectral-spatial fusion and ...Hyperspectral object classification using hybrid spectral-spatial fusion and ...
Hyperspectral object classification using hybrid spectral-spatial fusion and ...
 
Fuzzy logic method-based stress detector with blood pressure and body tempera...
Fuzzy logic method-based stress detector with blood pressure and body tempera...Fuzzy logic method-based stress detector with blood pressure and body tempera...
Fuzzy logic method-based stress detector with blood pressure and body tempera...
 
SADCNN-ORBM: a hybrid deep learning model based citrus disease detection and ...
SADCNN-ORBM: a hybrid deep learning model based citrus disease detection and ...SADCNN-ORBM: a hybrid deep learning model based citrus disease detection and ...
SADCNN-ORBM: a hybrid deep learning model based citrus disease detection and ...
 
Performance enhancement of machine learning algorithm for breast cancer diagn...
Performance enhancement of machine learning algorithm for breast cancer diagn...Performance enhancement of machine learning algorithm for breast cancer diagn...
Performance enhancement of machine learning algorithm for breast cancer diagn...
 
A deep learning framework for accurate diagnosis of colorectal cancer using h...
A deep learning framework for accurate diagnosis of colorectal cancer using h...A deep learning framework for accurate diagnosis of colorectal cancer using h...
A deep learning framework for accurate diagnosis of colorectal cancer using h...
 
Swarm flip-crossover algorithm: a new swarm-based metaheuristic enriched with...
Swarm flip-crossover algorithm: a new swarm-based metaheuristic enriched with...Swarm flip-crossover algorithm: a new swarm-based metaheuristic enriched with...
Swarm flip-crossover algorithm: a new swarm-based metaheuristic enriched with...
 
Predicting churn with filter-based techniques and deep learning
Predicting churn with filter-based techniques and deep learningPredicting churn with filter-based techniques and deep learning
Predicting churn with filter-based techniques and deep learning
 
Taxi-out time prediction at Mohammed V Casablanca Airport
Taxi-out time prediction at Mohammed V Casablanca AirportTaxi-out time prediction at Mohammed V Casablanca Airport
Taxi-out time prediction at Mohammed V Casablanca Airport
 
Automatic customer review summarization using deep learningbased hybrid senti...
Automatic customer review summarization using deep learningbased hybrid senti...Automatic customer review summarization using deep learningbased hybrid senti...
Automatic customer review summarization using deep learningbased hybrid senti...
 

Recently uploaded

Peek implant persentation - Copy (1).pdf
Peek implant persentation - Copy (1).pdfPeek implant persentation - Copy (1).pdf
Peek implant persentation - Copy (1).pdfAyahmorsy
 
KIT-601 Lecture Notes-UNIT-3.pdf Mining Data Stream
KIT-601 Lecture Notes-UNIT-3.pdf Mining Data StreamKIT-601 Lecture Notes-UNIT-3.pdf Mining Data Stream
KIT-601 Lecture Notes-UNIT-3.pdf Mining Data StreamDr. Radhey Shyam
 
Arduino based vehicle speed tracker project
Arduino based vehicle speed tracker projectArduino based vehicle speed tracker project
Arduino based vehicle speed tracker projectRased Khan
 
Event Management System Vb Net Project Report.pdf
Event Management System Vb Net  Project Report.pdfEvent Management System Vb Net  Project Report.pdf
Event Management System Vb Net Project Report.pdfKamal Acharya
 
KIT-601 Lecture Notes-UNIT-5.pdf Frame Works and Visualization
KIT-601 Lecture Notes-UNIT-5.pdf Frame Works and VisualizationKIT-601 Lecture Notes-UNIT-5.pdf Frame Works and Visualization
KIT-601 Lecture Notes-UNIT-5.pdf Frame Works and VisualizationDr. Radhey Shyam
 
CFD Simulation of By-pass Flow in a HRSG module by R&R Consult.pptx
CFD Simulation of By-pass Flow in a HRSG module by R&R Consult.pptxCFD Simulation of By-pass Flow in a HRSG module by R&R Consult.pptx
CFD Simulation of By-pass Flow in a HRSG module by R&R Consult.pptxR&R Consult
 
Introduction to Casting Processes in Manufacturing
Introduction to Casting Processes in ManufacturingIntroduction to Casting Processes in Manufacturing
Introduction to Casting Processes in Manufacturingssuser0811ec
 
Halogenation process of chemical process industries
Halogenation process of chemical process industriesHalogenation process of chemical process industries
Halogenation process of chemical process industriesMuhammadTufail242431
 
Introduction to Machine Learning Unit-4 Notes for II-II Mechanical Engineering
Introduction to Machine Learning Unit-4 Notes for II-II Mechanical EngineeringIntroduction to Machine Learning Unit-4 Notes for II-II Mechanical Engineering
Introduction to Machine Learning Unit-4 Notes for II-II Mechanical EngineeringC Sai Kiran
 
HYDROPOWER - Hydroelectric power generation
HYDROPOWER - Hydroelectric power generationHYDROPOWER - Hydroelectric power generation
HYDROPOWER - Hydroelectric power generationRobbie Edward Sayers
 
A case study of cinema management system project report..pdf
A case study of cinema management system project report..pdfA case study of cinema management system project report..pdf
A case study of cinema management system project report..pdfKamal Acharya
 
Fruit shop management system project report.pdf
Fruit shop management system project report.pdfFruit shop management system project report.pdf
Fruit shop management system project report.pdfKamal Acharya
 
Democratizing Fuzzing at Scale by Abhishek Arya
Democratizing Fuzzing at Scale by Abhishek AryaDemocratizing Fuzzing at Scale by Abhishek Arya
Democratizing Fuzzing at Scale by Abhishek Aryaabh.arya
 
Explosives Industry manufacturing process.pdf
Explosives Industry manufacturing process.pdfExplosives Industry manufacturing process.pdf
Explosives Industry manufacturing process.pdf884710SadaqatAli
 
Natalia Rutkowska - BIM School Course in Kraków
Natalia Rutkowska - BIM School Course in KrakówNatalia Rutkowska - BIM School Course in Kraków
Natalia Rutkowska - BIM School Course in Krakówbim.edu.pl
 
Top 13 Famous Civil Engineering Scientist
Top 13 Famous Civil Engineering ScientistTop 13 Famous Civil Engineering Scientist
Top 13 Famous Civil Engineering Scientistgettygaming1
 
İTÜ CAD and Reverse Engineering Workshop
İTÜ CAD and Reverse Engineering WorkshopİTÜ CAD and Reverse Engineering Workshop
İTÜ CAD and Reverse Engineering WorkshopEmre Günaydın
 
AI for workflow automation Use cases applications benefits and development.pdf
AI for workflow automation Use cases applications benefits and development.pdfAI for workflow automation Use cases applications benefits and development.pdf
AI for workflow automation Use cases applications benefits and development.pdfmahaffeycheryld
 
retail automation billing system ppt.pptx
retail automation billing system ppt.pptxretail automation billing system ppt.pptx
retail automation billing system ppt.pptxfaamieahmd
 
Pharmacy management system project report..pdf
Pharmacy management system project report..pdfPharmacy management system project report..pdf
Pharmacy management system project report..pdfKamal Acharya
 

Recently uploaded (20)

Peek implant persentation - Copy (1).pdf
Peek implant persentation - Copy (1).pdfPeek implant persentation - Copy (1).pdf
Peek implant persentation - Copy (1).pdf
 
KIT-601 Lecture Notes-UNIT-3.pdf Mining Data Stream
KIT-601 Lecture Notes-UNIT-3.pdf Mining Data StreamKIT-601 Lecture Notes-UNIT-3.pdf Mining Data Stream
KIT-601 Lecture Notes-UNIT-3.pdf Mining Data Stream
 
Arduino based vehicle speed tracker project
Arduino based vehicle speed tracker projectArduino based vehicle speed tracker project
Arduino based vehicle speed tracker project
 
Event Management System Vb Net Project Report.pdf
Event Management System Vb Net  Project Report.pdfEvent Management System Vb Net  Project Report.pdf
Event Management System Vb Net Project Report.pdf
 
KIT-601 Lecture Notes-UNIT-5.pdf Frame Works and Visualization
KIT-601 Lecture Notes-UNIT-5.pdf Frame Works and VisualizationKIT-601 Lecture Notes-UNIT-5.pdf Frame Works and Visualization
KIT-601 Lecture Notes-UNIT-5.pdf Frame Works and Visualization
 
CFD Simulation of By-pass Flow in a HRSG module by R&R Consult.pptx
CFD Simulation of By-pass Flow in a HRSG module by R&R Consult.pptxCFD Simulation of By-pass Flow in a HRSG module by R&R Consult.pptx
CFD Simulation of By-pass Flow in a HRSG module by R&R Consult.pptx
 
Introduction to Casting Processes in Manufacturing
Introduction to Casting Processes in ManufacturingIntroduction to Casting Processes in Manufacturing
Introduction to Casting Processes in Manufacturing
 
Halogenation process of chemical process industries
Halogenation process of chemical process industriesHalogenation process of chemical process industries
Halogenation process of chemical process industries
 
Introduction to Machine Learning Unit-4 Notes for II-II Mechanical Engineering
Introduction to Machine Learning Unit-4 Notes for II-II Mechanical EngineeringIntroduction to Machine Learning Unit-4 Notes for II-II Mechanical Engineering
Introduction to Machine Learning Unit-4 Notes for II-II Mechanical Engineering
 
HYDROPOWER - Hydroelectric power generation
HYDROPOWER - Hydroelectric power generationHYDROPOWER - Hydroelectric power generation
HYDROPOWER - Hydroelectric power generation
 
A case study of cinema management system project report..pdf
A case study of cinema management system project report..pdfA case study of cinema management system project report..pdf
A case study of cinema management system project report..pdf
 
Fruit shop management system project report.pdf
Fruit shop management system project report.pdfFruit shop management system project report.pdf
Fruit shop management system project report.pdf
 
Democratizing Fuzzing at Scale by Abhishek Arya
Democratizing Fuzzing at Scale by Abhishek AryaDemocratizing Fuzzing at Scale by Abhishek Arya
Democratizing Fuzzing at Scale by Abhishek Arya
 
Explosives Industry manufacturing process.pdf
Explosives Industry manufacturing process.pdfExplosives Industry manufacturing process.pdf
Explosives Industry manufacturing process.pdf
 
Natalia Rutkowska - BIM School Course in Kraków
Natalia Rutkowska - BIM School Course in KrakówNatalia Rutkowska - BIM School Course in Kraków
Natalia Rutkowska - BIM School Course in Kraków
 
Top 13 Famous Civil Engineering Scientist
Top 13 Famous Civil Engineering ScientistTop 13 Famous Civil Engineering Scientist
Top 13 Famous Civil Engineering Scientist
 
İTÜ CAD and Reverse Engineering Workshop
İTÜ CAD and Reverse Engineering WorkshopİTÜ CAD and Reverse Engineering Workshop
İTÜ CAD and Reverse Engineering Workshop
 
AI for workflow automation Use cases applications benefits and development.pdf
AI for workflow automation Use cases applications benefits and development.pdfAI for workflow automation Use cases applications benefits and development.pdf
AI for workflow automation Use cases applications benefits and development.pdf
 
retail automation billing system ppt.pptx
retail automation billing system ppt.pptxretail automation billing system ppt.pptx
retail automation billing system ppt.pptx
 
Pharmacy management system project report..pdf
Pharmacy management system project report..pdfPharmacy management system project report..pdf
Pharmacy management system project report..pdf
 

Discrete wavelet transform-based RI adaptive algorithm for system identification

  • 1. International Journal of Electrical and Computer Engineering (IJECE) Vol. 10, No. 3, June 2020, pp. 2383∼2391 ISSN: 2088-8708, DOI: 10.11591/ijece.v10i3.pp2383-2391 Ì 2383 Discrete wavelet transform-based RI adaptive algorithm for system identification Mohammad Shukri Salman1 , Alaa Eleyan2 , Bahaa Al-Sheikh3 1,3 College of Engineering and Technology, American University of the Middle East, Kuwait 2 Electrical and Electronic Engineering, Avrasya University, Trabzon, Turkey 3 Biomedical Systems and Medical Informatics Engineering Department, Yarmouk University, Jordan Article Info Article history: Received Mar 20, 2019 Revised Nov 5, 2019 Accepted Nov 25, 2019 Keywords: Adaptive filters Discrete wavelet transform LMS algorithm Recursive inverse algorithm System identification ABSTRACT In this paper, we propose a new adaptive filtering algorithm for system identifica- tion. The algorithm is based on the recursive inverse (RI) adaptive algorithm which suffers from low convergence rates in some applications; i.e., the eigenvalue spread of the autocorrelation matrix is relatively high. The proposed algorithm applies discrete-wavelet transform (DWT) to the input signal which, in turn, helps to over- come the low convergence rate of the RI algorithm with relatively small step-size(s). Different scenarios has been investigated in different noise environments in system identification setting. Experiments demonstrate the advantages of the proposed DWT recursive inverse (DWT-RI) filter in terms of convergence rate and mean-square-error (MSE) compared to the RI, discrete cosine transform LMS (DCT-LMS), discrete- wavelet transform LMS (DWT-LMS) and recursive-least-squares (RLS) algorithms under same conditions. Copyright c 2020 Insitute of Advanced Engineeering and Science. All rights reserved. Corresponding Author: Mohammad Shukri Salman, College of Engineering and Technology, American University of the Middle East, Kuwait. Tel: +965 2225 1400, ext: 1765 Email: mohammad.salman@aum.edu.kw 1. INTRODUCTION Adaptive filtering plays an essential role in many signal processing applications. The least-mean- square (LMS) algorithm’s simplicity made it very commonly used in adaptive signal processing applications such as system identification [1], echo cancelation [2], channel equalization [3, 4], and interference cancela- tion [3, 5]. The main drawback of the LMS algorithm is that it suffers from low convergence rate when the input signal is highly correlated. Many LMS variants [6-10] had been introduced to overcome the limitations of the original LMS algorithm and to achieve better performance in terms of mean-square-error (MSE) and convergence rate. Transform domain variable step-size algorithms are effective and performing well in highly correlated noise environment [7, 11]. It has been shown in [12] that transforming the input signal into another domain can reduce the eigenvalue spread of input signal autocorrelation matrix which, in turn, accelerates the convergence rate of the adaptive filters. The discrete-wavelet-transform LMS (DWT-LMS) [10] and the discrete-cosine transform LMS (DCT-LMS) [13] algorithms were proposed to decrease the eigenvalue spread of the autocorrelation matrix of the input signal. However, due to the fixed step-size of the LMS algorithm, these algorithms provide poor performance in terms of the convergence rate. The recursive-least-square (RLS) algorithm was proposed to offer faster convergence rate, especially, for highly correlated input signals [6, 14, 15]. However, it has a disadvantage of being highly computation- Journal homepage: http://ijece.iaescore.com/index.php/IJECE
  • 2. 2384 Ì ISSN: 2088-8708 ally complex. The performance of RLS algorithm and its variants depends on the forgetting factor (β) in terms of convergence rate, misadjustment, tracking capability and stability [16]. The forgetting factor can take values between zero and unity and needs to compromise between the above mentioned performance criteria. When the forgetting factor is close to unity, the algorithm achieves low misadjustment and high stability, but it compromises its tracking capabilities. A smaller value of (β) would improve the tracking capability of the RLS algorithm [16], but it would increase the misadjustment and might affect the stability of the algorithm. In [17] the authors investigated the influence of the forgetting factor of the RLS adaptive filter in system identification. A possible solution to overcome this problem is to use a variable forgetting factor (VFF-RLS) algorithm [18, 19]. Recursive inverse (RI) algorithm [20, 21] had been proposed to overcome the drawbacks and limita- tions of the above mentioned adaptive filters. It had been shown that the RI algorithm performs considerably better than the LMS algorithm and its variants. It was also shown that its performance, in terms of conver- gence rate and excess MSE, is comparable to that of the RLS under different settings, with less computational complexity. However, still the RI algorithm requires a very small initial value for its step-size if the eigenvalue spread of input signal autocorrelation matrix is relatively high. In this paper, we introduce a solution for the aforementioned problems by proposing a new DWT- based RI (DWT-RI) algorithm. Applying DWT on the input signal [22, 23] will reduce the eigenvalue spread of the autocorrelation matrix [24, 25] and gives the user the freedom to initiate the RI algorithm with relatively high initial values for the step-size. This process guarantees a very high performance, of the algorithm, in terms of both MSE and convergence rate. The paper is organized as follows: In Section 2., a brief explanation of discrete wavelet transform is covered. Section 3. presents the derivation of proposed DWT-RI algorithm. In Section 4., simulation results that compare the performance of the proposed algorithm to those of the RI, DCT-LMS, DWT-LMS and RLS algorithms, in different noise environments for system identification setting, are given. Finally, the conclusions are drawn in the last section. 2. DISCRETE WAVELET TRANSFORM The theory of multiresolution analysis was firstly developed by Mallat [26], to represent functions defined over N dimensional space. Wavelet transform is a multiresolution technique for analyzing signals. It was developed, as an alternative to short time Fourier transform (STFT), to overcome the time-frequency resolution problems. The DWT uses filter banks to perform the wavelet analysis by the construction of the multiresolution time-frequency plane. DWT decomposes the signal into wavelet coefficients from which the original signal can be reconstructed again. The wavelet coefficients represent the signal in various frequency bands [27, 28]. Figure 1 shows the structure of discrete wavelet transform adaptive filter (DWTAF). Figure 1. Structure of discrete wavelet transform transversal adaptive filter. Int J Elec & Comp Eng, Vol. 10, No. 3, June 2020 : 2383 – 2391
  • 3. Int J Elec & Comp Eng ISSN: 2088-8708 Ì 2385 According to DWT theory, reconstruction of the original signal x(k) can be performed using the following finite sum: x(k) = J−1 j=0 n∈Z θj,nψj,n(k), (1) where θj,n are the wavelet coefficients and ψj,n(k) are the wavelet functions that form an orthogonal basis. The purpose of DWT adaptive filter is to generate the discrete reconstruction of xj(k) which is the projective discrete form of x(k) in wavelet subspace. xj(k) is given by: xj(k) = n∈Z θj,nψj,n(k). (2) If vj(k) is the approximation of projective xj(k), then vj(k) = n∈Z ˆθj,nψj,n(k), (3) where ˆθj,n is the discrete approximation of the wavelet coefficients θj,n, ˆθj,n = l x(l) ¯ψj,n(l). (4) Given that, hj(l, k) = n∈Z ¯ψj,n(l)ψj,n(k). (5) Now, substituting (4) and (5) in (3) results in vj(k) = l x(l)hj(l, k). (6) Equation (6) is simply the discrete convolution of the input signal x(k) and the filter coefficients hj(l, k). Using Orthogonality and time-steadiness, filter indices can be rewritten as: hj(l, k) = hj(l − k). (7) Therefore, vj(k) = l x(l)hj(l − k). (8) 3. DISCRETE WAVELET TRANSFORM RECURSIVE INVERSE ALGORITHM 3.1. Recursive inverse (RI) algorithm The optimum solution for the FIR filter coefficients can be obtained using the Wiener-Hopf equation [6]: C(k) = R−1 (k)p(k), (9) where k is the time parameter (k = 1, 2, . . .), C(k) is the filter weight vector calculated at time k, R(k) is the estimate of the tap-input vector’s autocorrelation matrix, and p(k) is the estimate of the cross-correlation vector between the desired output signal and the tap-input vector. Recursive estimation of R(k) and p(k) in (9) can be obtained as follows; R(k) = βR(k − 1) + x(k)xT (k), (10) p(k) = βp(k − 1) + d(k)x(k), (11) where β is the forgetting factor which is usually very close to unity and x(k) is the tap-input vector. Discrete wavelet transform-based RI adaptive... (Mohammad Shukri Salman)
  • 4. 2386 Ì ISSN: 2088-8708 Using the recursive solution of the Wiener-Hopf equation for one iteration with variable step size gives the weight update equation of the RI algorithm [20]: C(k) = [I − µ(k)R(k)]C(k − 1) + µ(k)p(k). (12) Where µ(k) is the variable step-size [20] which satisfies the convergence criterion [6]: µ(k) < 2 λmax(R(k)) = 1 − β 1 − βk 2 λmax(Rxx) = µmax 1 − βk , (13) where λmax is the maximum eigenvalue of R(k) and Rxx = E x(k)xT (k) . For more details about derivation and convergence analysis of the RI algorithm, the reader may refer to [20]. The RI algorithm has a major advantage compared to the RLS algorithm in that it does not require the update of the inverse autocorrelation matrix. Also, its computational complexity is much less than that of the RLS algorithm. Due to the update of inverse autocorrelation matrix, RLS type algorithms may face numerical stability problems [29], which is not the case for the RI algorithm. 3.2. The proposed algorithm The performance of the RI algorithm can be improved further by applying the DWT to the input signal. In this case, the weights update equation in (12) will become as: C(k + 1) = [I − µ(k)Rvv(k)]C(k) + µ(k)pvd(k). (14) where Rvv(k) = βRvv(k − 1) + v(k)vT (k), (15) and pvd(k) = βpvd(k − 1) + d(k)v(k). (16) Where v(k) = Wx(k) is the transformed input signal and W is the wavelet transform matrix of size J × N. µ(k) = µ0 1 − βk , (17) where µ0 is a constant selected as: µ0 < µmax = 2(1 − β) λmax (Rvv) and Rvv = E v(k)vT (k) . The adaptive estimation error is given as: e(k) = d(k) − y(k), (18) where y(k) = vT (k)C(k) = J−1 j=0 vj(k)cj(k) = J−1 j=0 l cj(k)hj(l − k)x(l), (19) where y(k) is the transformed version of y(k) shown in Figure 2 Int J Elec & Comp Eng, Vol. 10, No. 3, June 2020 : 2383 – 2391
  • 5. Int J Elec & Comp Eng ISSN: 2088-8708 Ì 2387 Figure 2. Block diagram of an adaptive system identification setting 0 0.5 1 1.5 2 2.5 3 3.5 0 0.2 0.4 0.6 0.8 1 1.2 1.4 Frequency Magnitude Figure 3. Unknown system transfer function 4. SIMULATION RESULTS In the simulations, the performance of the proposed DWT-RI algorithm is compared to those of the RI [20], DCT-LMS [9], DWT-LMS [10] and RLS [6] algorithms in the system identification setting described in Figure 2. The filter length for all algorithms is J = 16 taps and the signal-to-noise ratio (SNR) was selected to be 30dB for all the experiments. The received signal x(k) was generated using the DWT on the signal xi(k) given by [7]: xi(k) = 1.79xi(k − 1) − 1.85xi(k − 2) + 1.27xi(k − 3) − 0.41xi(k − 4) + v0(k). (20) where v0(k) is a Gaussian process with zero mean and variance σ2 = 0.3849. The unknown system is the bandpass filter shown in Figure 3. The simulation results for Gaussian and impulsive noise were obtained by averaging 100 and 300 Monte-Carlo independent runs, respectively. 4.1. Additive white gaussian noise In order to test the performance of the proposed algorithm, the signal is assumed to be corrupted with an additive white Gaussian noise (AWGN) process. Simulations were carried out with the following parame- ters: For the DWT-RI and RI algorithms: β = 0.99 and µ0 = 0.0013. For DCT-LMS algorithm: β = 0.9985, = 8 × 10−4 , µ = 0.02, γ = 2 × 10−3 and M = 10. For DWT-LMS algorithm: µ = 0.02. For the RLS algorithm: β = 0.99. Figure 4 shows that the RI, RLS and DWT-RI algorithms converge to the same Discrete wavelet transform-based RI adaptive... (Mohammad Shukri Salman)
  • 6. 2388 Ì ISSN: 2088-8708 MSE. However, the DWT-RI and RLS converge much faster than the RI algorithm (950 iterations faster). On the other hand, the DCT-LMS and DWT-LMS algorithms converge to a higher MSE (mse=5dB worse) than the other algorithms with low rate of convergence. 200 400 600 800 1000 1200 1400 10 −6 10 −5 10 −4 10 −3 10 −2 10 −1 10 0 Iteration MSE DWT−RI RLS RI DCT−LMS DWT−LMS Figure 4. The ensemble MSE for RI, RLS, DCT-LMS, DWT-LMS and DWT-RI in AWGN 200 400 600 800 1000 1200 1400 10 −7 10 −6 10 −5 10 −4 10 −3 10 −2 10 −1 10 0 Iteration MSE RI DWT−LMS DWT−RI RLS DCT−LMS Figure 5. The ensemble MSE for RI, RLS, DCT-LMS, DWT-LMS and DWT-RI in AWIN ( = 0.2, κ = 100) 4.2. Additive white impulsive noise Due to man-made noise, underwater acoustic noise, atmospheric noise, etc, the noise added to the received signal may not be modeled as Gaussian. This type of noise which has a heavy-tailed distribution is characterized by outliers and may be better modeled using a Gaussian mixture model. In order to test the robustness of the proposed algorithm, and to study the effects of the impulsive components (outliers) of the noise process in the system identification setting, an impulsive noise process is generated by the probability density function [30]: f = (1 − ) G 0, σ2 n + G 0, κσ2 n with variance σ2 f given as: σ2 f = (1 − ) σ2 n+ κσ2 n, where G 0, σ2 n is a Gaussian probability density function with zero mean and variance σ2 n that represents the nominal background noise. G 0, κσ2 n represents the impulsive component of the noise model, where is the probability and κ ≥ 1 is the strength of the impulsive components. (a) Firstly, the signal is assumed to be corrupted with an additive white impulsive noise (AWIN) process. The white impulsive noise process is generated with the parameters: = 0.2 and κ = 100. Simulations were carried out with the following parameters: For the DWT-RI and RI algorithms: β = 0.99 and µ0 = 0.001. For DCT-LMS algorithm: β = 0.9985, = 8 × 10−4 , µ = 0.02, γ = 2 × 10−3 and M = 10. For DWT-LMS algorithm: µ = 0.018. For the RLS algorithm: β = 0.99. Figure 5 shows that the DWT-RI and RLS algorithms converge to the same MSE at the same time, The RI and DCT-LMS algorithms still converge to the same MSE but with much low rate of convergence than those of the DWT-RI and RLS algorithms. The DWT-LMS algorithm converges to much higher MSE with almost the same rate of convergence of those of RLS and DWT-RI algorithms. (b) Secondly, in order to emphasize on the capability of the proposed DWT-RI algorithm in suppressing impulsive noise, even, with high impulsivity strength, an AWIN process is generated with the parame- ters: = 0.2 and κ = 100000. Simulations were carried out with the following parameters: For the DWT-RI and RI algorithms: β = 0.99 and µ0 = 0.0001. For DCT-LMS algorithm: β = 0.9985, = 8 × 10−4 , µ = 0.02, γ = 2 × 10−3 and M = 10. For DWT-LMS algorithm: µ = 0.018. For the RLS algorithm: β = 0.99. The RI algorithm fails to converge under these settings. Figure 6 shows that the RLS algorithm converges to the steady-state MSE (MSE= −10dB) after 400 time itera- tions, while the DWT-RI algorithm converges to a lower MSE (MSE= −14dB) than the RLS at the same time. The DCT-LMS algorithm converges to a lower MSE than that of the DWT-RI algorithm but with very low convergence rate, whereas the DWT-LMS algorithm converges to a very high MSE. This shows the advantage of domain transform in reducing the self-correlation of the input signal and converging to a lower MSE values with higher convergence rates. Int J Elec & Comp Eng, Vol. 10, No. 3, June 2020 : 2383 – 2391
  • 7. Int J Elec & Comp Eng ISSN: 2088-8708 Ì 2389 500 1000 1500 2000 2500 3000 10 −3 10 −2 10 −1 10 0 10 1 Iteration MSE DWT−RI RLS DCT−LMS DWT−LMS Figure 6. The ensemble MSE for RI, RLS, DCT-LMS, DWT-LMS and DWT-RI in AWIN ( = 0.2, κ = 100000) 5. CONCLUSION A new discrete wavelet transform based RI adaptive filtering algorithm is proposed. The performances of the DWT-RI, DCT-LMS, DWT,LMS, RI and RLS algorithms are compared in AWGN and AWIN environ- ments in system identification setting. Under the same conditions, the DWT-RI algorithm outperforms the aforementioned algorithms in terms of MSE and/or convergence rate. REFERENCES [1] M. S. Ahmad, O. Kukrer and A. Hocanin, “The effect of the forgetting factor on the RI adaptive algorithm in system identification,” 10th International Symposium on Signals, Circuits and Systems (ISSCS), pp. 1- 4, 2011. [2] C. Paleologu, J. Benesty, S. L. Grant, and C. Osterwise, “Variable step-size NLMS algorithms for echo cancellation,” 43rd Asilomar Conference on Signals, Systems and Computers, pp. 633-637, 2009. [3] C. V. Sinn, and J. Gotze, “Comparative study of techniques to compute FIR filter weights in adap- tive channel equalization,” IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP03), vol. 6, pp. 217-220, 2003. [4] M. S. Ahmad, O. Kukrer and A. Hocanin, “An efficient Recursive Inverse adaptive filtering algorithm for channel equalization,” European Wireless Conference (EW 2010), pp. 88-92, 2010. [5] S. Dixit and D. Nagaria, “LMS adaptive filters for noise cancellation: A review,” International Journal of Electrical and Computer Engineering (IJECE), vol. 7, no. 5, pp. 2520-2529, 2017. [6] S. Haykin, Adaptive Filter Theory, Prentice Hall, Upper Saddle River, NJ, 4th edn., 2002. [7] R. C. Bilcu, P. Kuosmanen and K. Egiazarian, “A transform domain LMS adaptive filter with variable step-size,” IEEE Signal Processing Letters, vol. 9, no. 2, pp. 51-53, 2002. [8] C. P. Kwong and E. W. Jonston, “A variable step-size LMS algorithm,” IEEE Transactions on Signal Processing, vol. 40, pp. 1633–1642, 1992. [9] D. I. Kim and P. De Wilde, “Performance analysis of the DCT-LMS adaptive filtering algorithm,” Signal Process, vol. 80, no. 8, pp. 1629-1654, 2000. [10] S. Hosur and A. H. Tewfik, “Wavelet transform domain adaptive FIR filtering,” IEEE Transactions on Signal Processing, vol. 45, no. 3, pp. 617–629, 1997. [11] T. Gowri, R. Kumar P., D.V.R. Koti Reddy, “Efficient reduction of PLI in ECG signal using new vari- able step size least mean fourth adaptive algorithm,” International Journal of Electrical and Computer Engineering (IJECE), vol. 9, no. 1, pp. 307-313, 2019. [12] S. S. Narayan, A. M. Peterson and M. J. Narasimha, “Transform domain LMS algorithm,” IEEE Trans- actions on ASSP, ASSP-31, no. 3, pp. 609-615, 1983. [13] J. C. Lee and C. K. Un, “Performance of transform domain LMS adaptive digital filters,” IEEE Transac- tions of Acoustic, Speech, Signal Processing, ASSP-34, no. 3, pp. 499-510, 1986. Discrete wavelet transform-based RI adaptive... (Mohammad Shukri Salman)
  • 8. 2390 Ì ISSN: 2088-8708 [14] S. Qiao, “Fast adaptive RLS algorithms: a generalized inverse approach and analysis,” IEEE Transactions on Signal Processing, vol. 39, no. 6, pp. 1455-1459, 1991. [15] A. H. Sayed, Adaptive Filters, John Wily & Sons, NJ, 2008. [16] S. Haykin, A. H. Sayed, J. R. Zeidler, P. Yee and P. C. Wei, “Adaptive tracking of linear time-variant systems by extended RLS algorithms,” IEEE Transactions on Signal Processing, vol. 45, no. 5, pp. 1118- 1128, 1997. [17] S. Ciochina, C. Paleologu, J. Benesty and A. A. Enescu, “On the influence of the forgetting factor of the RLS adaptive filter in system identification,” International Symposium on Signals, Circuits and Systems (ISSCS 2009), pp. 1-4, 2009. [18] S. H. Leung, and C. F. So, “Gradient-based variable forgetting factor RLS algorithm in time-varying environments,” IEEE Transactions on Signal Processing, vol. 53, no. 8, pp. 3141–3150, 2005. [19] C. Paleologu, J. Benesty and S. Ciochina, “A robust variable forgetting factor recursive least-squares algorithm for system identification,” IEEE Signal Processing Letters, vol. 15, pp. 597–600, 2008. [20] M. S. Ahmad, O. Kukrer and A. Hocanin, “Recursive inverse adaptive filtering algorithm,” Digital Signal Processing (Elsevier), vol. 21, no. 4, pp. 491-496, 2011. [21] M. S. Salman, O. Kukrer and A. Hocanin, “Recursive inverse algorithm: Mean-square-error analysis,” Digital Signal Processing (Elsevier), vol. 66, pp. 10-17, 2017. [22] S. Saxena, R. Jais and M. K. Hota, “Removal of powerline interference from ECG signal using FIR, IIR, DWT and NLMS adaptive filter,” 2019 International Conference on Communication and Signal Processing (ICCSP), pp. 12-16, 2019. [23] A. Mannan and A. Habib, “Adaptive processing of image using DWT and FFT OFDM in AWGN and Rayleigh channel,” 2017 International Conference on Communication, Computing and Digital Systems (C-CODE), pp. 346-350, 2017. [24] T. Yang, Y. Chiang and F. Chang, “Further discussions on adaptive filters to improve the wavelet shrinkage method,” 2016 International Conference on System Science and Engineering (ICSSE), pp. 1-4, 2016. [25] A. N. S. Belgurzi and I. Elshafiey, “A power line interference canceler using wavelet transform and adap- tive filter for ECG signal,” 2017 International Conference on Computer and Applications (ICCA), pp. 206-210, 2017. [26] S. Mallat, “Wavelet for a vision,” Proceedings of the IEEE, vol. 84, no. 4, pp. 604-914, 1996. [27] A. N. S. Belgurzi and I. Elshafiey, “A power line interference canceler using wavelet transform and adap- tive filter for ECG signal,” 2017 International Conference on Computer and Applications (ICCA), pp. 206-210, 2017. [28] A. Mannan and A. Habib, “Adaptive processing of image using DWT and FFT OFDM in AWGN and Rayleigh channel,” 2017 International Conference on Communication, Computing and Digital Systems (C-CODE), pp. 346-350, 2017. [29] G. O. Glentis, K. Berberidis and S. Theodoridis, “Efficient least squares adaptive algorithms for FIR transversal filtering,” IEEE Signal Processing Magazine, pp. 13-41, 1999. [30] H. Delic and A. Hocanin, “Robust detection in DS/CDMA,” IEEE Transactions on Vehicular Technology, vol. 51, no. 1, pp. 155-170, 2002. BIOGRAPHIES OF AUTHORS Mohammad Shukri Salman received the B.Sc., M.Sc. and Ph.D. Degrees in Electrical and Electronics Engineering from Eastern Mediterranean University (EMU), in 2006, 2007 and 2011, respectively. From 2006 to 2010, he was a teaching assistant of Electrical and Electronics Engi- neering department at EMU. In 2010, he has joined the Department of Electrical and Electronic Engineering at European University of Lefke (EUL) as a senior lecturer. For the period 2011-2015, he has worked as an Assist. Prof. in the Department of Electrical and Electronics Engineering, Mevlana (Rumi) University, Turkey. Currently, he is with Electrical Engineering Department at the American University of Middle East in Kuwait. He has served as a general chair, program chair and a TPC member for many international conferences. His research interests include signal processing, adaptive filters, image processing, sparse representation of signals, control systems and communications systems. Int J Elec & Comp Eng, Vol. 10, No. 3, June 2020 : 2383 – 2391
  • 9. Int J Elec & Comp Eng ISSN: 2088-8708 Ì 2391 Alaa Eleyan received the B.Sc. and M.Sc. degrees in Electrical Electronics Engineering from Near East University, Northern Cyprus, in 2002 and 2004, respectively. In 2009, He finished his PhD degree in Electrical and Electronics Engineering from Eastern Mediterranean University, Northern Cyprus. Currently, he is working as an associate professor at Avrasya University, Turkey. His current research interests are computer vision, signal image processing, machine learning and robotics. He has more than 60 published journal articles and conference papers in these research fields. Bahaa Al-Sheikh received the B.Sc. degree in Electronics Engineering from Yarmouk University, Jordan, MSc in Electrical Engineering from Colorado State University, Colorado, USA, and PhD in Biomedical Engineering degree from the University of Denver, Colorado, USA, in 2000, 2005 and 2009, respectively. Between 2009 and 2015, he worked for Yarmouk University as an assis- tant professor in the department of Biomedical Systems and Medical Informatics Engineering and served as the department chairman between 2010 and 2012. He served as a part-time consultant for Sandhill Scientific Inc., Highlands Ranch, Colorado, USA in Biomedical Signal Processing field between 2009 and 2014. Currently, he is an Assistant Professor at the Electrical Engineering Department at the American University of the Middle East in Kuwait. His research interests include digital signal and image processing, biomedical systems modeling, medical instrumentation and sound source localization systems. Discrete wavelet transform-based RI adaptive... (Mohammad Shukri Salman)