SlideShare a Scribd company logo
1 of 9
Download to read offline
International Journal of Electrical and Computer Engineering (IJECE)
Vol. 10, No. 4, August 2020, pp. 3528~3536
ISSN: 2088-8708, DOI: 10.11591/ijece.v10i4.pp3528-3536 ๏ฒ 3528
Journal homepage: http://ijece.iaescore.com/index.php/IJECE
ELM and K-nn machine learning in classification
of Breath sounds signals
Z. Neili, M. Fezari, A. Redjati
Department of Electronic, LASA Laboratory, Badji Mokhtar University Annaba, Algeria
Article Info ABSTRACT
Article history:
Received Apr 7, 2019
Revised Jan 6, 2020
Accepted Jan 29, 2020
The acquisition of Breath sounds (BS) signals from a human respiratory
system with an electronic stethoscope, provide and offer prominent
information which helps the doctors to diagnosis and classification of
pulmonary diseases. Unfortunately, this BS signals with other biological
signals have a non-stationary nature according to the variation of the lung
volume, and this nature makes it difficult to analyze and classify between
several diseases. In this study, we were focused on comparing the ability
of the extreme learning machine (ELM) and k-nearest neighbour (K-nn)
machine learning algorithms in the classification of adventitious and normal
breath sounds. To do so, the empirical mode decomposition (EMD) was used
in this work to analyze BS, this method is rarely used in the breath sounds
analysis. After the EMD decomposition of the signals into Intrinsic Mode
Functions (IMFs), the Hjorth descriptors (Activity) and Permutation Entropy
(PE) features were extracted from each IMFs and combined for classification
stage. The study has found that the combination of features (activity and PE)
yielded an accuracy of 90.71%, 95% using ELM and K-nn respectively in
binary classification (normal and abnormal breath sounds), and 83.57%,
86.42% in multiclass classification (five classes).
Keywords:
Empirical mode decomposition
Extreme learning machine
Hjorth descriptors
K-nearest neighbour
Permutation entropy
Copyright ยฉ 2020 Institute of Advanced Engineering and Science.
All rights reserved.
Corresponding Author:
N. Zakaria,
Department of Electronic,
Faculty of Sciences,
Laboratoire dโ€™Automatique et Signaux de Annaba (LASA),
Badji Mokhtar University Annaba,
P.O. Box 12, 23000 Annaba, Algeria.
Email: zaki.neli@yahoo.fr
1. INTRODUCTION
Recently many researches in the Breath Sounds (BS) areas is conducted by applying many
techniques for analyzing and classify a respiratory signal in order to diagnosis the pulmonary pathology,
such as (Asthma, COPD, Pneumoniaโ€ฆ). However, the acquisition of lung sounds plays an important role to
detect and identification of pulmonary diseases. The doctors listening to the lung sounds through
the stethoscope placed on the chest or posterior to the patient which is suffering from a type of lung disease,
but the problem is sometimes the decision of the doctors concerning types of pathology is not accurate, this is
due to many reasons such as a few experiences concerning auscultation and diagnosis. To address this
problem a research study has been widely conducted in this area focus on three principal domains
(time domain, frequency domain and time-frequency domain).
Breath sound is a complex signal [1] such other biological signals, have a non-linear and
non-stationary nature, these properties of the signal lead it to assessed by different techniques in signal
processing have the same property of the breath signals. However, these techniques used for three
transformation domains which are mentioned previously. In [2] Islam, A et al the artificial neural network
Int J Elec & Comp Eng ISSN: 2088-8708 ๏ฒ
ELM and K-nn machine learning in classification of Breath sounds signals (Z. Neili)
3529
(ANN) and support vector machine (SVM) classifiers have been used for classifying normal and asthmatic
subjects with, spectral subband was extracted from the lung sound cycle, with a maximum classification
accuracy of 89.2% and 93.3% by the ANN and SVM classifiers, respectively, Mondal, A [3] et al apply
the empirical mode decomposition to lung sounds focused on pattern recognition algorithms for classifying
into pulmonary dysfunction with an accuracy of 94.16 %, in [4] A. Rizal et al classify the lung sounds using
Tsallis Entropy and using MLP classifier with an accuracy 95.35%, Pancaldi, F et al [5] diagnosis the lung
diseases (interstitial lung diseases) by using empirical observation as proposed solution with an overall
accuracy of 90.0%, A.Cheema, M.Singh [6] use an EMD method for detect Psychological stress from
phonocardiography signal the average accuracy of 93.14% to classifying stressed and non-stressed,
in [7] R. Palaniappan classify a pulmonary signal using Autoregressive Coefficients and k-Nearest Neighbor
as a classifier with an accuracy of 95.18%. In this work we analyzed a breath sounds signals using empirical
mode decomposition with Hjorth descriptors (Activity) and Permutation entropy as features, were extracted
from each IMFs produced by EMD, finally,a comparative study has been assessed between an extreme
learning machine (ELM) and K-nearest neighbor (K-NN) for distinguishing between normal, and
adventitious respiratory sounds.
2. RESEARCH METHOD
Our work was divided into two principal stages namely (Multiclass classification stage, Binary
classification stage). The four steps proposed for both stage study namely (database, pre-processing, feature
extraction and classification) are presented in Figure 1(a) for multiclass classification, and the second stage is
represented in Figure 1(b) for binary classification.
(a)
(b)
Figure 1. Two principal stage of the breath sounds signal classification
(a) multiclass classification (b) binary classification
2.1. Database
In this paper the database of breath sounds signals used for analysis are the R.A.L.E (Respiration
Acoustic Laboratory Environment) Lung Sounds, is the only commercially available database, is an
educational program to help doctors and researchers in respiratory signals processing area offer more than 50
breath sounds were recorded using a contact accelerometer (Siemens-EMT25C) covering normal and
abnormal respiratory sounds [8] are sampled at 10,240Hz. As this database (R.A.L.E) has a few data,
therefore to ensure the credibility of this comparative study we used another data were collected from
the internet:
- The Auscultation Assistant, 2015 [9, 10]
- Arnall, 2015 [11]
- The CD of the book [12]
In all a 75 breath sounds divided into five classes (Normal bronchial, Wheeze, Crackle, Pleural rub,
Stridor) were used in our study, each sound is an effect of particular disease such as Wheeze indicate that
the patient suffering from asthma and COPD (Chronic Obstructive Pulmonary diseases), crackle indicate
pneumonia or lung cancer.
๏ฒ ISSN: 2088-8708
Int J Elec & Comp Eng, Vol. 10, No. 4, August 2020 : 3528 - 3536
3530
2.2. Breath sounds pre-processing
Breath sounds signals are subject to several artefacts such as heart sounds and noise which simulate
real-life conditions. The breath sounds signals (R.A.L.E) that have been filtered by a high-pass filter
with 7.5 Hz by 1st order Butterworth to remove DC offset, and a low-pass filter at 2.5 Hz by 8th
order
Butterworth [13, 14] , and concerning the data were collected we apply a mean and amplitude normalization
to reduce the effect of heart sounds. Finally, all samples are downsampled to 8000 Hz sampling frequency
according to CORSA (computerized respiratory sound analysis) [15], in this study, the 16-bit resolution and
one respiratory cycle are used.
2.3. Empirical mode decomposition
The Empirical Mode Decomposition (EMD) method is a new adaptive signal time-frequency
processing method proposed by NE Huang in 1998 by NASA and others [16]. It is especially suitable for
nonlinearity, analysis and processing of non-stationary signals. The Hilbert transform transforms the well-
known Hilbert-Huang Transform (HHT).
EMD is actually a method of decomposing signals. It is consistent with the core idea of Fourier
transform and wavelet transform. Everyone wants to decompose the signal into a superposition of
independent components, only the Fourier transform and the wavelet transform it is required to have a basic
function, but EMD completely abandons the constraint of the basis function, and only performs signal
decomposition based on the time scale feature of the data itself, and has adaptability. Since no basis function
is required, EMD can be used for almost any type of signal decomposition, especially for the decomposition
of nonlinear, non-stationary signals [17, 18]. The purpose of EMD is to decompose the signal into
a superposition of multiple intrinsic mode functions (IMFs). In addition, the IMF must satisfy the following
two conditions( the function must have the same number of local extreme points and zero crossings within
the entire time range, and at any point in time, the envelope of the local maximum the envelope of
the (upper envelope) and the local minimum (lower envelope) must be zero on average.
The EMD method is based on the:
๏€ญ The signal has at least two extreme points, one maximum and one minimum.
๏€ญ The characteristic time scale is defined by the time between the two extreme points.
๏€ญ If the data lacks extreme points but has deformation points, the extreme points can be obtained by data
differentiation once or several times, and then the decomposition results are obtained by integration.
The algorithm flow is as follows:
- Identify all extrema of x(t)
- Interpolate between minima (resp. maxima), ending up with some envelope emin(t) (resp. emax(t))
- Compute the mean m(t) = (emin(t)+emax(t))/2
- Extract the detail d(t) = x(t) โˆ’ m(t)
- Iterate on the residual m(t)
2.4. Features extraction
A helpful feature for express a biomedical signal namely Hjorth descriptors (HD) divided into three
main parameters as follows:
- Activity: is the most useful parameters in biological signals, simply its variance of the signal represents
the energy:
๐ด๐‘๐‘ก๐‘ฃ = ๐œŽ0
2
(1)
- Mobility: Mobility is given by:
๐‘€๐‘œ๐‘ = ๐œŽ1
2
/ ๐œŽ0
2
(2)
- Complexity: gives a computational value for the shape of the signal:
๐ถ๐‘œ๐‘š๐‘ = โˆš(
( ๐œŽ ๐‘š+1)2
( ๐œŽ ๐‘š)2 โˆ’
(๐œŽ ๐‘š)2
(๐œŽ ๐‘šโˆ’1)2)
2
(3)
- Permutation Entropy: Bandt and Pompe are investigated the (PE) Permutation entropy to measure
the complexity of the non-linearity and non-stationary nature in time series signals [19]. the Shannon
entropy is calculated in PE for the different symbol in the signal and can be calculated as follows:
๐‘ƒ๐ธ๐‘› = โˆ‘ ๐‘๐‘–
๐‘š
๐‘–=1 โˆ— ๐‘™๐‘œ๐‘”(๐‘๐‘–)/๐‘™๐‘›(๐‘š) (4)
Int J Elec & Comp Eng ISSN: 2088-8708 ๏ฒ
ELM and K-nn machine learning in classification of Breath sounds signals (Z. Neili)
3531
2.4.1. Statistical analysis
In this study, a statistical analysis of mean and standard deviation was used to test the significance
of the activity and PE features. SD and Mean are expressed respectively as follows:
๐œŽ = โˆš
1
๐‘€
โˆ‘ (๐‘ฅ๐‘— โˆ’ ๐œ‡)
2๐‘€
๐‘—=1 (5)
๐‘ฅฬ… = (โˆ‘ ๐‘ฅ๐‘—)/๐‘€ (6)
where:
๐‘ฅ๐‘— each value of the dataset.
M the total number of data points.
2.5. Classification
In this study, two classifiers were used for two classification types (multiclass classification, binary
classification), one is the extreme learning machine (ELM) and the other is a k-nearest neighbour (K-NN).
detailed of these classifiers are presented in this section:
2.5.1. Extreme learning machine
Huang et al. [20] propose an algorithm for solving a single hidden layer neural network which is an
extreme learning machine (ELM). The biggest feature of ELM is that traditional neural networks, especially
concerning a single hidden layer feedforward neural networks (SLFNs), are faster than traditional learning
algorithms while guaranteeing learning accuracy [21].
For a single hidden layer neural network shown in Figure 2, assume that there is ๐‘ต an arbitrary
sample (๐‘ฟ๐’Š, ๐’•๐’Š) of which [22]:
๐‘ฟ๐’Š = [๐’™๐’Š๐Ÿ, ๐’™๐’Š๐Ÿ, โ€ฆ , ๐’™๐’Š๐’] ๐‘ป
ฯต ๐‘… ๐‘›
, ๐’•๐’Š = [๐’•๐’Š๐Ÿ, ๐’•๐’Š๐Ÿ, โ€ฆ , ๐’•๐’Š๐’] ๐‘ป
ฯต ๐‘… ๐‘š
(7)
For a ๐‘ณ single hidden layer neural network with a hidden layer node, it can be expressed as:
โˆ‘ ๐›ฝ๐‘–
๐‘”(๐‘Š๐‘–
๐ฟ
๐‘–=1 . ๐‘‹๐‘— + ๐‘๐‘–) = ๐‘œ๐‘—, ๐‘— = 1, โ€ฆ , ๐‘ (8)
Among them ๐‘”(๐‘ฅ), the activation function, which:
๐‘Š๐‘– = [๐‘ค๐‘–,1, ๐‘ค๐‘–,2, โ€ฆ , ๐‘ค๐‘–,๐‘›] ๐‘‡
is the input weight and ๐›ฝ๐‘– the output weight, ๐‘๐‘– is the offset of the first hidden
layer unit. ๐‘Š๐‘– . ๐‘‹๐‘— Representation ๐‘Š๐‘– and ๐‘‹๐‘— inner product..
The goal of a single hidden layer neural network learning is to minimize the error of the output,
which can be expressed as:
โˆ‘ โ€– ๐‘œ๐‘— โˆ’ ๐‘ก๐‘—โ€– = 0๐‘
๐‘—=1 (9)
That exists ๐›ฝ๐‘– , ๐‘Š๐‘– and ๐‘๐‘– so that
โˆ‘ ๐›ฝ๐‘–
๐‘”(๐‘Š๐‘–
๐ฟ
๐‘–=1 . ๐‘‹๐‘— + ๐‘๐‘–) = ๐‘ก๐‘—, ๐‘— = 1, โ€ฆ , ๐‘ (10)
Can be expressed as a matrix
๐ป๐›ฝ = ๐‘‡ (11)
Among them it ๐‘ฏ is the output of the hidden layer node, which ๐œท is the output weight and ๐‘ป is
the expected output.
๐ป = (๐‘Š1, โ€ฆ , ๐‘Š๐ฟ, ๐‘1, โ€ฆ , ๐‘๐‘™, ๐‘‹1, โ€ฆ , ๐‘‹ ๐ฟ) (12)
= [
๐‘”(๐‘Š1. ๐‘‹1 + ๐‘1) โ€ฆ ๐‘”(๐‘Š๐ฟ . ๐‘‹1 + ๐‘ ๐ฟ)
โ‹ฎ โ€ฆ โ‹ฎ
๐‘”(๐‘Š1. ๐‘‹ ๐‘ + ๐‘1) โ€ฆ ๐‘”(๐‘Š๐ฟ . ๐‘‹ ๐‘ + ๐‘ ๐ฟ)
]
๐‘ร—๐ฟ
๏ฒ ISSN: 2088-8708
Int J Elec & Comp Eng, Vol. 10, No. 4, August 2020 : 3528 - 3536
3532
๐›ฝ = [
๐›ฝ1
๐‘‡
โ‹ฎ
๐›ฝ ๐ฟ
๐‘‡
]
๐ฟร—๐‘š,
๐‘‡ = [
๐‘‡1
๐‘‡
โ‹ฎ
๐‘‡ ๐‘
๐‘‡
]
๐‘ร—๐‘š,
(13)
In order to be able to train a single hidden layer neural network, we hope to get ๐‘Š1, ๐‘๐‘– and ๐›ฝ๐‘– to make:
โ€– ๐ป ( ๐‘Šฬ‚ ๐‘–, ๐‘ฬ‚๐‘–) ๐›ฝฬ‚๐‘–
โˆ’ ๐‘‡โ€– = min
๐‘ค,๐‘,๐›ฝ
โ€– ๐ป ( ๐‘Š๐‘–, ๐‘๐‘–) ๐›ฝ๐‘–
โˆ’ ๐‘‡โ€– (14)
where ๐’Š = ๐Ÿ, โ€ฆ , ๐‘ณ this is equivalent to minimizing the loss function
๐ธ = โˆ‘ (โˆ‘ ๐›ฝ๐‘– ๐‘”(๐‘Š๐‘–
๐ฟ
๐‘–=1 . ๐‘‹๐‘— + ๐‘๐‘–) โˆ’ ๐‘ก๐‘—)๐‘
๐‘—=1
2
(15)
Some traditional algorithms based on the gradient descent method can be used to solve such
problems, but the basic gradient-based learning algorithm needs to adjust all parameters during the iterative
process. In the ELM algorithm, once the input weight ๐‘พ๐’Š and the bias of the hidden layer ๐’ƒ๐’Š are randomly
determined, the output matrix of the hidden layer ๐‘ฏ is uniquely determined. The training single hidden layer
neural network can be transformed into a linear system ๐‘ฏ๐œท = ๐‘ป and the output weight ๐œท can be determined
๐›ฝฬ‚ = ๐ปฯฏ
๐‘‡ (16)
Among them ๐‘ฏฯฏ
is ๐‘ฏ the Moore-Penrose generalized inverse of the matrix. And it can be proved that ๐œทฬ‚
the norm of the solution obtained is minimal and unique [22].
Figure 2. SLFN: additive hidden nodes
2.5.2. K-nearest neighbour
The K-Nearest Neighbors (K-NN) algorithm is a classification algorithm and one of the easiest to
understand machine learning algorithms. In 1968, it was proposed by Cover and Hart [23]. The simplest and
mundane classifier may be the kind of memorable classifier, remember all the training data, for the new data,
it matches the training data directly, if there is training data of the same attribute, use it directly, come as
a classification of new data.The k-NN algorithm finds the k records closest to the new data from the training
set and then determines the category of the new data based on their primary classification.
The algorithm involves three main factors:
- The training set
- The distance or similar measure. In this study a Euclidian distance has been used:
๐‘‘(๐‘ฅ, ๐‘ฆ) = โˆ‘ โˆš๐‘ฅ๐‘–
2
โˆ’ ๐‘ฆ๐‘–
2๐‘
๐‘–=1 (17)
- The size of k
Int J Elec & Comp Eng ISSN: 2088-8708 ๏ฒ
ELM and K-nn machine learning in classification of Breath sounds signals (Z. Neili)
3533
In the validation stage, the dataset X is divided into a training set Y (training set) and a test set Z
(test set), for the case that the sample size is insufficient such as in our study, and in order to full use of all
data set to test the algorithms effect, database X is randomly divided into k packets, one of which is used as
a test set each time, and the remaining k-1 packets are trained as a training set, by using k-fold cross-
validation method [24].
3. RESULTS AND DISCUSSION
In this work the all experiments were performed by using MATLAB R2013b and on a pc with
a configuration of Intel CPU Core i5, 4 GB RAM, and Windows 10 operating system. In [25] the authors
apply Hjorth descriptors as features and find that the activity feature is the best feature compared with
mobility and complexity as shown in (1),(2) and (3). Therefore, in our work, the activity feature was
exploited for enhanced this study with combined it with the permutation entropy feature shown in (4),
and formed a features vectors to fed into two machine learning algorithms namely ELM and K-NN,
to compare them in the classification of breath sounds signals. The EMD decomposes BS signals into a set of
IMFs, Figure 3 shows some IMFs of the normal subject. The features (Activity and Permutation Entropy)
were extracted from each IMF and tested using a statistical measure of (mean and standard deviation SD
described in (1) and (2)) as tabulated in Table 1.
(a)
IMF1
โ‹ฎ
IMF10
(b)
Figure 3. (a) Normal breath sounds and (b) their IMF (1-10)
๏ฒ ISSN: 2088-8708
Int J Elec & Comp Eng, Vol. 10, No. 4, August 2020 : 3528 - 3536
3534
Table 1 Statistical analysis of features extracted from breath sounds
Breath sounds Activity Mean ยฑ standard deviation Permutation entropy Mean ยฑ standard deviation
Normal bronchial 0.001387 ยฑ 0.004387 0.56497 ยฑ 0.202819
Wheeze
Crackle
0.005829 ยฑ 0.000468
0.000645 ยฑ 0.000765
0.56792 ยฑ 0.209888
0.586679 ยฑ 0.216714
Pleural rub 0.002608 ยฑ 0.000513 0.56675 ยฑ 0.223923
Stridor 0.001594 ยฑ 0.001472 0.563352ยฑ0.215641
From Table 1 we inferred that there is significant discrimination in the activity and PE features
of different classes. Can be observed a mean and SD are different from each class in activity features, but in
PE features a little different between classes. From this, we can combine theme to test and compare
the classification accuracy of both K-nn and ELM classifiers. These features have been formed as follows:
Features = [Activity, PE].
In order to verify the reliability of the outcome of the classifiers, the k-fold cross-validation was
used. Figure 4 shows how the ten-fold works. After several tests to choose the k value, we found that k=10
is promised value, therefore it has been used in this study.
Figure 4. K-fold cross-validation methods
In the literature review many researchers based on activity or entropy features extraction,
nevertheless, this study has combined both activities and PE features for observed the ability of both ELM
and K-nn to classify different BS signals. In Table 2 the classification stage is described, and give
the classification performance of features (Activity, PE) extracted from IMFs using ELM with RBF Kernel,
Polynomial Kernel and K-nn with distance euclidian which is described in equation (17), and 1 to 10
number of neighbours.
Table 2. Classification performance of (Activity, PE) from IMFs of BS signals
in multiclass classification stage
Classifier K-Fold K neighbours Kernel Average accuracy(%)
ELM (Activity, PE)
ELM (Activity, PE)
10
10
/
/
RBF
Polynomial
83.57
77.86
K-nn (Activity, PE) 10 1 / 86.42
K-nn (Activity, PE) 10 2 / 80.71
K-nn (Activity, PE)
K-nn (Activity, PE)
K-nn (Activity, PE)
K-nn (Activity, PE)
K-nn (Activity, PE)
K-nn (Activity, PE)
K-nn (Activity, PE)
K-nn (Activity, PE)
10
10
10
10
10
10
10
10
3
4
5
6
7
8
9
10
/
/
/
/
/
/
/
/
82.14
80.00
82.14
80.00
81.42
82.14
81.00
77.14
As shown in Tables 2, The ELM with RBF Kernel and K-nn with 1 neighbour gave the higher
classification accuracy of 83.57% and 86.42% respectively. The ELM by RBF kernel is better than ELM
with Polynomial kernel in multiclass classification case, and k-nn by 1 neighbour is better than rest
Int J Elec & Comp Eng ISSN: 2088-8708 ๏ฒ
ELM and K-nn machine learning in classification of Breath sounds signals (Z. Neili)
3535
neighbours. We can say that the ability of the K-nn is higher than ELM in the classification of the Breath
sounds signals into several classes (Normal bronchial, Wheeze, Crackle, Pleural rub, Stridor). We can be
seen in Table 3, the accuracy found from k-nn is 95% by 6-8-10 neighbours and from ELM with Polynomial
Kernel is 90.71% better than RBF kernel in binary classification case. However, according to these results,
we can say that, this comparative study shows that the capability of the k-nn classifier is higher compared
with that of the ELM classifier in the classification of breath sounds signals from our test conditions.
The ability of the k-nn is higher than ELM in the classification of the breath sounds signals into binary and
multiclass classification cases.
Table 3. Classification performance of (Activity, PE) from IMFs of BS signals in binary classification stage
Classifier K-Fold K neighbours Kernel Average accuracy (%)
ELM (Activity, PE)
ELM (Activity, PE)
10
10
/
/
RBF
Polynomial
89.29
90.71
K-nn (Activity, PE)
K-nn (Activity, PE)
K-nn (Activity, PE)
K-nn (Activity, PE)
K-nn (Activity, PE)
K-nn (Activity, PE)
K-nn (Activity, PE)
K-nn (Activity, PE)
K-nn (Activity, PE)
K-nn (Activity, PE)
10
10
10
10
10
10
10
10
10
10
1
2
3
4
5
6
7
8
9
10
/
/
/
/
/
/
/
/
/
/
93.57
92.14
94.29
92.86
94.28
95.00
94.29
95.00
93.00
95.00
4. CONCLUSION
In this study, the performance of the ELM and K-nn classifiers were compared using the Hjorth
descriptors (Activity) and Permutation Entropy (PE) features in distinguishing between breath sounds signals
with combination these features (Activity, PE). The features extracted were analyzed statistically
by calculating a mean and standard deviation to observe the difference between them for each class
(Normal bronchial, Wheeze, Crackle, Pleural rub, Stridor). The classification accuracy in multiclass
classification case of the ELM and k-nn classifiers is 83.57% and 86.42% respectively, and in binary
classification case, the accuracy is 90.71% , 95% respectively. These show that the ability of k-nn in our test
conditions (database, methods of analyses the breath signals, and features used) is higher than the ELM
classifier in multiclass and binary classification. In future work, the EMD methods will be compared with
another method for further analysis of breath sounds signals using a large database.
REFERENCES
[1] H. Kitaoka, and R. Takaki, B. Suki, โ€œA three-dimensional model of the human airway tree,โ€ Journal of Applied
Physiology, Dec. 1999.
[2] Md.A. Islam, et al., โ€œMultichannel lung sound analysis for asthma detection,โ€ Computer Methods and Programs in
Biomedicine, vol. 159, pp. 111โ€“123, Jun. 2018.
[3] A. Mondal, et al., โ€œA Novel Feature Extraction Technique for Pulmonary Sound Analysis Based on EMD,โ€
Computer Methods and Programs in Biomedicine, vol. 159, pp. 199-209, Jun. 2018.
[4] A. Rizal, R. Hidayat and H.A. Nugroho, โ€œPulmonary crackle feature extraction using tsallis entropy for automatic
lung sound classification,โ€ 2016 1st International Conference on Biomedical Engineering (IBIOMED), Yogyakarta,
pp. 1-4, 2016.
[5] F. Pancaldi, et al., โ€œAnalysis of pulmonary sounds for the diagnosis of interstitial lung diseases secondary to
rheumatoid arthritis,โ€ Computers in Biology and Medicine, vol. 96, pp. 91-97, May 2018.
[6] A. Cheema, et al., โ€œAn application of phonocardiography signals for psychological stress detection using non-linear
entropy-based features in empirical mode decomposition domain,โ€ In Applied Soft Computing Journal, vol. 77,
pp. 24-33, Apr. 2019.
[7] R. Palaniappan, et al., โ€œPulmonary Acoustic Signal Classification using Autoregressive Coefficients and k-Nearest
Neighbor,โ€ Advanced Manufacturing Research and Intelligent Applications, vol. 591, pp. 211-214, Jul. 2014.
[8] H. Pasterkamp, et al., โ€œState of the art advances beyond the stethoscope,โ€ American Journal Respiratory Critical
Care Medicine, vol. 156, pp. 974-987, 1997.
[9] The Auscultation Assistant, โ€œBreath Sounds,โ€ 2015.
[10] A. Rizal, R. Hidayat and H. A. Nugroho, โ€œEntropy measurement as features extraction in automatic lung sound
classification,โ€ International Conference on Control, Electronics, Renewable Energy and Communications
(ICCREC), Yogyakarta, pp. 93-97, 2017.
[11] D. Arnall, โ€œPulmonary breath sounds,โ€ 2015.
[12] R. Wilkins, et al., โ€œLung Sounds: A Practical Guide with Audio CD .2nd Ed,โ€ Mosby, Feb. 1996.
๏ฒ ISSN: 2088-8708
Int J Elec & Comp Eng, Vol. 10, No. 4, August 2020 : 3528 - 3536
3536
[13] D. Bardou, et al., โ€œLung sounds classification using convolutional neural networks,โ€ Artificial intelligence in
medicine, vol. 88, pp. 58-69, 2018.
[14] R. Palaniappan, et al., โ€œA comparative study of the svm and k-nn machine learning algorithms for the diagnosis of
respiratory pathologies using pulmonary acoustic signals,โ€ BMC bioinformatics, vol. 15, pp. 223, 2014.
[15] A. Sovijรคrvi, et al., โ€œStandardization of computerized respiratory sound analysis,โ€ Crit Care Med., vol. 156,
pp. 974-987, 1997.
[16] I. Branch, et al., โ€œThe empirical mode decomposition and the Hilbert spectrum for nonlinear and non-stationary
time series analysis,โ€ Proceeding of the Royal Society Mathematical, Physical and Engineering Sciences, 1998.
[17] G. Rilling, et al., โ€œOn Empirical Mode Decomposition and its Algorithms,โ€ 2003.
[18] A, Mondal, et al., โ€œA Enhancement of lung sounds based on empirical mode decomposition and Fourier transform
algorithm,โ€ Computer methods and programs in biomedicine, vol. 139, pp. 119-136, 2017.
[19] C. Bandt, and B. Pompe, โ€œPermutation Entropy: A Natural Complexity Measure for Time Series,โ€ Physical Review
Letters, vol. 88, pp. 17-29, Apr. 2002.
[20] G. Bin-Huang, et al., โ€œExtrem Learning Machine: Theory and applications,โ€ Neurocomputing, vol. 70, pp. 489-501,
Dec. 2006.
[21] G. Bin-Huang, et al., โ€œExtreme learning machinesโ€ฏ: a survey,โ€ International Journal of Machine Learning and
Cybernetics, vol. 2, pp. 107โ€“122, Jun. 2011.
[22] S. Liao and C. Feng, โ€œMeta-ELM: ELM with ELM hidden nodes,โ€ Neurocomputing, vol. 128, pp. 81-87,
Mar. 2014.
[23] Cover, T. M, et al., โ€œNearest neighbor pattern classification,โ€ IEEE transactions on information theory, vol. 13,
no. 1, pp. 21-27, 1967.
[24] T. Andersen and T. Martinez, โ€œCross validation and MLP architecture selection,โ€ In IJCNN'99. International Joint
Conference on Neural Networks. Proceedings, vol. 3, pp. 1614-1619, 1999,
[25] A. Rizal, et al., โ€œLung Sound Classification Using Empirical Mode Decomposition and the Hjorth Descriptor,โ€
American Journal of Applied Sciences, vol. 14, pp. 166-173, Jan. 2017.
BIOGRAPHIES OF AUTHORS
Neili Zakaria received his master degree in multimedia and digital communications from Badji
Mokhtar Annaba University in 2017. Since 2018 he has joined the Automatic and Signals
Laboratory of Annaba University, His research interests are in biomedical signal processing and
biomedical applications.
Mohamed Fezari is a professor in electronics and computer architecture at the University of
Badji Mokhtar Annaba, Algeria. He got a Bachelor degree in electrical engineering from the
University of Oran, 1983. He got an MSc degree in computer science from the University of
California Riverside, 1987. He holds a PhD degree in electronics from the University of Badji
Mokhtar Annaba, 2006. His research interests include speech processing, DSP, microcontroller,
microprocessor, robotics and human-machine interaction, and rehabilitation.
Abdelghani Redjati was born in Annaba, Algeria, in 1966. He received M.Sc. degree in
Electronic (State Engineer in Electronics (June 1995 โ€“ Badji Mokhtar Annaba University),
Algeria, Magister degree in Industrial Control in 2005 and PhD degrees in Signal Processing
from Badji-Mokhtar University, Annaba Algeria, in 2009. Currently, he is Assistant Professor
and Head of Electronic Department at Badji- Mokhtar University, Annaba Algeria. His current
research interests include Speech processing and embedded systems, Information and
Communication Technology, electronic design circuits.

More Related Content

Similar to ELM and K-nn machine learning in classification of Breath sounds signals

Classification of Normal and Crackles Respiratory Sounds into Healthy and Lun...
Classification of Normal and Crackles Respiratory Sounds into Healthy and Lun...Classification of Normal and Crackles Respiratory Sounds into Healthy and Lun...
Classification of Normal and Crackles Respiratory Sounds into Healthy and Lun...IJECEIAES
ย 
New Method of R-Wave Detection by Continuous Wavelet Transform
New Method of R-Wave Detection by Continuous Wavelet TransformNew Method of R-Wave Detection by Continuous Wavelet Transform
New Method of R-Wave Detection by Continuous Wavelet TransformCSCJournals
ย 
De-Noising Corrupted ECG Signals By Empirical Mode Decomposition (EMD) With A...
De-Noising Corrupted ECG Signals By Empirical Mode Decomposition (EMD) With A...De-Noising Corrupted ECG Signals By Empirical Mode Decomposition (EMD) With A...
De-Noising Corrupted ECG Signals By Empirical Mode Decomposition (EMD) With A...IOSR Journals
ย 
Phonocardiogram Based Diagnosis Using Machine Learning : Parametric Estimatio...
Phonocardiogram Based Diagnosis Using Machine Learning : Parametric Estimatio...Phonocardiogram Based Diagnosis Using Machine Learning : Parametric Estimatio...
Phonocardiogram Based Diagnosis Using Machine Learning : Parametric Estimatio...bioejjournal
ย 
Phonocardiogram Based Diagnosis Using Machine Learning : Parametric Estimatio...
Phonocardiogram Based Diagnosis Using Machine Learning : Parametric Estimatio...Phonocardiogram Based Diagnosis Using Machine Learning : Parametric Estimatio...
Phonocardiogram Based Diagnosis Using Machine Learning : Parametric Estimatio...bioejjournal
ย 
PHONOCARDIOGRAM-BASED DIAGNOSIS USING MACHINE LEARNING: PARAMETRIC ESTIMATION...
PHONOCARDIOGRAM-BASED DIAGNOSIS USING MACHINE LEARNING: PARAMETRIC ESTIMATION...PHONOCARDIOGRAM-BASED DIAGNOSIS USING MACHINE LEARNING: PARAMETRIC ESTIMATION...
PHONOCARDIOGRAM-BASED DIAGNOSIS USING MACHINE LEARNING: PARAMETRIC ESTIMATION...bioejjournal
ย 
PHONOCARDIOGRAM-BASED DIAGNOSIS USING MACHINE LEARNING: PARAMETRIC ESTIMATION...
PHONOCARDIOGRAM-BASED DIAGNOSIS USING MACHINE LEARNING: PARAMETRIC ESTIMATION...PHONOCARDIOGRAM-BASED DIAGNOSIS USING MACHINE LEARNING: PARAMETRIC ESTIMATION...
PHONOCARDIOGRAM-BASED DIAGNOSIS USING MACHINE LEARNING: PARAMETRIC ESTIMATION...bioejjournal
ย 
Analysis electrocardiogram signal using ensemble empirical mode decomposition...
Analysis electrocardiogram signal using ensemble empirical mode decomposition...Analysis electrocardiogram signal using ensemble empirical mode decomposition...
Analysis electrocardiogram signal using ensemble empirical mode decomposition...IAEME Publication
ย 
Performance Study of Various Adaptive filter algorithms for Noise Cancellatio...
Performance Study of Various Adaptive filter algorithms for Noise Cancellatio...Performance Study of Various Adaptive filter algorithms for Noise Cancellatio...
Performance Study of Various Adaptive filter algorithms for Noise Cancellatio...CSCJournals
ย 
Fpga based arrhythmia detection resume
Fpga based arrhythmia detection resumeFpga based arrhythmia detection resume
Fpga based arrhythmia detection resumeAlvi Milanisti
ย 
Revealing and evaluating the influence of filters position in cascaded filter...
Revealing and evaluating the influence of filters position in cascaded filter...Revealing and evaluating the influence of filters position in cascaded filter...
Revealing and evaluating the influence of filters position in cascaded filter...nooriasukmaningtyas
ย 
CLASSIFICATION OF ECG ARRHYTHMIAS USING /DISCRETE WAVELET TRANSFORM AND NEURA...
CLASSIFICATION OF ECG ARRHYTHMIAS USING /DISCRETE WAVELET TRANSFORM AND NEURA...CLASSIFICATION OF ECG ARRHYTHMIAS USING /DISCRETE WAVELET TRANSFORM AND NEURA...
CLASSIFICATION OF ECG ARRHYTHMIAS USING /DISCRETE WAVELET TRANSFORM AND NEURA...IJCSEA Journal
ย 
Ijetcas14 577
Ijetcas14 577Ijetcas14 577
Ijetcas14 577Iasir Journals
ย 
Separation of heart murmur aortic regurgitation sound from sound mixture usin...
Separation of heart murmur aortic regurgitation sound from sound mixture usin...Separation of heart murmur aortic regurgitation sound from sound mixture usin...
Separation of heart murmur aortic regurgitation sound from sound mixture usin...IAEME Publication
ย 
A comparative study of wavelet families for electromyography signal classific...
A comparative study of wavelet families for electromyography signal classific...A comparative study of wavelet families for electromyography signal classific...
A comparative study of wavelet families for electromyography signal classific...journalBEEI
ย 
Neuro identification of some commonly used volatile organic compounds using e...
Neuro identification of some commonly used volatile organic compounds using e...Neuro identification of some commonly used volatile organic compounds using e...
Neuro identification of some commonly used volatile organic compounds using e...Alexander Decker
ย 
Artifact elimination in ECG signal using wavelet transform
Artifact elimination in ECG signal using wavelet transformArtifact elimination in ECG signal using wavelet transform
Artifact elimination in ECG signal using wavelet transformTELKOMNIKA JOURNAL
ย 

Similar to ELM and K-nn machine learning in classification of Breath sounds signals (20)

Classification of Normal and Crackles Respiratory Sounds into Healthy and Lun...
Classification of Normal and Crackles Respiratory Sounds into Healthy and Lun...Classification of Normal and Crackles Respiratory Sounds into Healthy and Lun...
Classification of Normal and Crackles Respiratory Sounds into Healthy and Lun...
ย 
New Method of R-Wave Detection by Continuous Wavelet Transform
New Method of R-Wave Detection by Continuous Wavelet TransformNew Method of R-Wave Detection by Continuous Wavelet Transform
New Method of R-Wave Detection by Continuous Wavelet Transform
ย 
I0414752
I0414752I0414752
I0414752
ย 
De-Noising Corrupted ECG Signals By Empirical Mode Decomposition (EMD) With A...
De-Noising Corrupted ECG Signals By Empirical Mode Decomposition (EMD) With A...De-Noising Corrupted ECG Signals By Empirical Mode Decomposition (EMD) With A...
De-Noising Corrupted ECG Signals By Empirical Mode Decomposition (EMD) With A...
ย 
Phonocardiogram Based Diagnosis Using Machine Learning : Parametric Estimatio...
Phonocardiogram Based Diagnosis Using Machine Learning : Parametric Estimatio...Phonocardiogram Based Diagnosis Using Machine Learning : Parametric Estimatio...
Phonocardiogram Based Diagnosis Using Machine Learning : Parametric Estimatio...
ย 
Phonocardiogram Based Diagnosis Using Machine Learning : Parametric Estimatio...
Phonocardiogram Based Diagnosis Using Machine Learning : Parametric Estimatio...Phonocardiogram Based Diagnosis Using Machine Learning : Parametric Estimatio...
Phonocardiogram Based Diagnosis Using Machine Learning : Parametric Estimatio...
ย 
PHONOCARDIOGRAM-BASED DIAGNOSIS USING MACHINE LEARNING: PARAMETRIC ESTIMATION...
PHONOCARDIOGRAM-BASED DIAGNOSIS USING MACHINE LEARNING: PARAMETRIC ESTIMATION...PHONOCARDIOGRAM-BASED DIAGNOSIS USING MACHINE LEARNING: PARAMETRIC ESTIMATION...
PHONOCARDIOGRAM-BASED DIAGNOSIS USING MACHINE LEARNING: PARAMETRIC ESTIMATION...
ย 
PHONOCARDIOGRAM-BASED DIAGNOSIS USING MACHINE LEARNING: PARAMETRIC ESTIMATION...
PHONOCARDIOGRAM-BASED DIAGNOSIS USING MACHINE LEARNING: PARAMETRIC ESTIMATION...PHONOCARDIOGRAM-BASED DIAGNOSIS USING MACHINE LEARNING: PARAMETRIC ESTIMATION...
PHONOCARDIOGRAM-BASED DIAGNOSIS USING MACHINE LEARNING: PARAMETRIC ESTIMATION...
ย 
Analysis electrocardiogram signal using ensemble empirical mode decomposition...
Analysis electrocardiogram signal using ensemble empirical mode decomposition...Analysis electrocardiogram signal using ensemble empirical mode decomposition...
Analysis electrocardiogram signal using ensemble empirical mode decomposition...
ย 
Performance Study of Various Adaptive filter algorithms for Noise Cancellatio...
Performance Study of Various Adaptive filter algorithms for Noise Cancellatio...Performance Study of Various Adaptive filter algorithms for Noise Cancellatio...
Performance Study of Various Adaptive filter algorithms for Noise Cancellatio...
ย 
Fpga based arrhythmia detection resume
Fpga based arrhythmia detection resumeFpga based arrhythmia detection resume
Fpga based arrhythmia detection resume
ย 
Revealing and evaluating the influence of filters position in cascaded filter...
Revealing and evaluating the influence of filters position in cascaded filter...Revealing and evaluating the influence of filters position in cascaded filter...
Revealing and evaluating the influence of filters position in cascaded filter...
ย 
CLASSIFICATION OF ECG ARRHYTHMIAS USING /DISCRETE WAVELET TRANSFORM AND NEURA...
CLASSIFICATION OF ECG ARRHYTHMIAS USING /DISCRETE WAVELET TRANSFORM AND NEURA...CLASSIFICATION OF ECG ARRHYTHMIAS USING /DISCRETE WAVELET TRANSFORM AND NEURA...
CLASSIFICATION OF ECG ARRHYTHMIAS USING /DISCRETE WAVELET TRANSFORM AND NEURA...
ย 
Ijetcas14 577
Ijetcas14 577Ijetcas14 577
Ijetcas14 577
ย 
Separation of heart murmur aortic regurgitation sound from sound mixture usin...
Separation of heart murmur aortic regurgitation sound from sound mixture usin...Separation of heart murmur aortic regurgitation sound from sound mixture usin...
Separation of heart murmur aortic regurgitation sound from sound mixture usin...
ย 
40120130405007
4012013040500740120130405007
40120130405007
ย 
A comparative study of wavelet families for electromyography signal classific...
A comparative study of wavelet families for electromyography signal classific...A comparative study of wavelet families for electromyography signal classific...
A comparative study of wavelet families for electromyography signal classific...
ย 
Neuro identification of some commonly used volatile organic compounds using e...
Neuro identification of some commonly used volatile organic compounds using e...Neuro identification of some commonly used volatile organic compounds using e...
Neuro identification of some commonly used volatile organic compounds using e...
ย 
Artifact elimination in ECG signal using wavelet transform
Artifact elimination in ECG signal using wavelet transformArtifact elimination in ECG signal using wavelet transform
Artifact elimination in ECG signal using wavelet transform
ย 
Real Time Acquisition and Analysis of PCG and PPG Signals
Real Time Acquisition and Analysis of PCG and PPG SignalsReal Time Acquisition and Analysis of PCG and PPG Signals
Real Time Acquisition and Analysis of PCG and PPG Signals
ย 

More from IJECEIAES

Cloud service ranking with an integration of k-means algorithm and decision-m...
Cloud service ranking with an integration of k-means algorithm and decision-m...Cloud service ranking with an integration of k-means algorithm and decision-m...
Cloud service ranking with an integration of k-means algorithm and decision-m...IJECEIAES
ย 
Prediction of the risk of developing heart disease using logistic regression
Prediction of the risk of developing heart disease using logistic regressionPrediction of the risk of developing heart disease using logistic regression
Prediction of the risk of developing heart disease using logistic regressionIJECEIAES
ย 
Predictive analysis of terrorist activities in Thailand's Southern provinces:...
Predictive analysis of terrorist activities in Thailand's Southern provinces:...Predictive analysis of terrorist activities in Thailand's Southern provinces:...
Predictive analysis of terrorist activities in Thailand's Southern provinces:...IJECEIAES
ย 
Optimal model of vehicular ad-hoc network assisted by unmanned aerial vehicl...
Optimal model of vehicular ad-hoc network assisted by  unmanned aerial vehicl...Optimal model of vehicular ad-hoc network assisted by  unmanned aerial vehicl...
Optimal model of vehicular ad-hoc network assisted by unmanned aerial vehicl...IJECEIAES
ย 
Improving cyberbullying detection through multi-level machine learning
Improving cyberbullying detection through multi-level machine learningImproving cyberbullying detection through multi-level machine learning
Improving cyberbullying detection through multi-level machine learningIJECEIAES
ย 
Comparison of time series temperature prediction with autoregressive integrat...
Comparison of time series temperature prediction with autoregressive integrat...Comparison of time series temperature prediction with autoregressive integrat...
Comparison of time series temperature prediction with autoregressive integrat...IJECEIAES
ย 
Strengthening data integrity in academic document recording with blockchain a...
Strengthening data integrity in academic document recording with blockchain a...Strengthening data integrity in academic document recording with blockchain a...
Strengthening data integrity in academic document recording with blockchain a...IJECEIAES
ย 
Design of storage benchmark kit framework for supporting the file storage ret...
Design of storage benchmark kit framework for supporting the file storage ret...Design of storage benchmark kit framework for supporting the file storage ret...
Design of storage benchmark kit framework for supporting the file storage ret...IJECEIAES
ย 
Detection of diseases in rice leaf using convolutional neural network with tr...
Detection of diseases in rice leaf using convolutional neural network with tr...Detection of diseases in rice leaf using convolutional neural network with tr...
Detection of diseases in rice leaf using convolutional neural network with tr...IJECEIAES
ย 
A systematic review of in-memory database over multi-tenancy
A systematic review of in-memory database over multi-tenancyA systematic review of in-memory database over multi-tenancy
A systematic review of in-memory database over multi-tenancyIJECEIAES
ย 
Agriculture crop yield prediction using inertia based cat swarm optimization
Agriculture crop yield prediction using inertia based cat swarm optimizationAgriculture crop yield prediction using inertia based cat swarm optimization
Agriculture crop yield prediction using inertia based cat swarm optimizationIJECEIAES
ย 
Three layer hybrid learning to improve intrusion detection system performance
Three layer hybrid learning to improve intrusion detection system performanceThree layer hybrid learning to improve intrusion detection system performance
Three layer hybrid learning to improve intrusion detection system performanceIJECEIAES
ย 
Non-binary codes approach on the performance of short-packet full-duplex tran...
Non-binary codes approach on the performance of short-packet full-duplex tran...Non-binary codes approach on the performance of short-packet full-duplex tran...
Non-binary codes approach on the performance of short-packet full-duplex tran...IJECEIAES
ย 
Improved design and performance of the global rectenna system for wireless po...
Improved design and performance of the global rectenna system for wireless po...Improved design and performance of the global rectenna system for wireless po...
Improved design and performance of the global rectenna system for wireless po...IJECEIAES
ย 
Advanced hybrid algorithms for precise multipath channel estimation in next-g...
Advanced hybrid algorithms for precise multipath channel estimation in next-g...Advanced hybrid algorithms for precise multipath channel estimation in next-g...
Advanced hybrid algorithms for precise multipath channel estimation in next-g...IJECEIAES
ย 
Performance analysis of 2D optical code division multiple access through unde...
Performance analysis of 2D optical code division multiple access through unde...Performance analysis of 2D optical code division multiple access through unde...
Performance analysis of 2D optical code division multiple access through unde...IJECEIAES
ย 
On performance analysis of non-orthogonal multiple access downlink for cellul...
On performance analysis of non-orthogonal multiple access downlink for cellul...On performance analysis of non-orthogonal multiple access downlink for cellul...
On performance analysis of non-orthogonal multiple access downlink for cellul...IJECEIAES
ย 
Phase delay through slot-line beam switching microstrip patch array antenna d...
Phase delay through slot-line beam switching microstrip patch array antenna d...Phase delay through slot-line beam switching microstrip patch array antenna d...
Phase delay through slot-line beam switching microstrip patch array antenna d...IJECEIAES
ย 
A simple feed orthogonal excitation X-band dual circular polarized microstrip...
A simple feed orthogonal excitation X-band dual circular polarized microstrip...A simple feed orthogonal excitation X-band dual circular polarized microstrip...
A simple feed orthogonal excitation X-band dual circular polarized microstrip...IJECEIAES
ย 
A taxonomy on power optimization techniques for fifthgeneration heterogenous ...
A taxonomy on power optimization techniques for fifthgeneration heterogenous ...A taxonomy on power optimization techniques for fifthgeneration heterogenous ...
A taxonomy on power optimization techniques for fifthgeneration heterogenous ...IJECEIAES
ย 

More from IJECEIAES (20)

Cloud service ranking with an integration of k-means algorithm and decision-m...
Cloud service ranking with an integration of k-means algorithm and decision-m...Cloud service ranking with an integration of k-means algorithm and decision-m...
Cloud service ranking with an integration of k-means algorithm and decision-m...
ย 
Prediction of the risk of developing heart disease using logistic regression
Prediction of the risk of developing heart disease using logistic regressionPrediction of the risk of developing heart disease using logistic regression
Prediction of the risk of developing heart disease using logistic regression
ย 
Predictive analysis of terrorist activities in Thailand's Southern provinces:...
Predictive analysis of terrorist activities in Thailand's Southern provinces:...Predictive analysis of terrorist activities in Thailand's Southern provinces:...
Predictive analysis of terrorist activities in Thailand's Southern provinces:...
ย 
Optimal model of vehicular ad-hoc network assisted by unmanned aerial vehicl...
Optimal model of vehicular ad-hoc network assisted by  unmanned aerial vehicl...Optimal model of vehicular ad-hoc network assisted by  unmanned aerial vehicl...
Optimal model of vehicular ad-hoc network assisted by unmanned aerial vehicl...
ย 
Improving cyberbullying detection through multi-level machine learning
Improving cyberbullying detection through multi-level machine learningImproving cyberbullying detection through multi-level machine learning
Improving cyberbullying detection through multi-level machine learning
ย 
Comparison of time series temperature prediction with autoregressive integrat...
Comparison of time series temperature prediction with autoregressive integrat...Comparison of time series temperature prediction with autoregressive integrat...
Comparison of time series temperature prediction with autoregressive integrat...
ย 
Strengthening data integrity in academic document recording with blockchain a...
Strengthening data integrity in academic document recording with blockchain a...Strengthening data integrity in academic document recording with blockchain a...
Strengthening data integrity in academic document recording with blockchain a...
ย 
Design of storage benchmark kit framework for supporting the file storage ret...
Design of storage benchmark kit framework for supporting the file storage ret...Design of storage benchmark kit framework for supporting the file storage ret...
Design of storage benchmark kit framework for supporting the file storage ret...
ย 
Detection of diseases in rice leaf using convolutional neural network with tr...
Detection of diseases in rice leaf using convolutional neural network with tr...Detection of diseases in rice leaf using convolutional neural network with tr...
Detection of diseases in rice leaf using convolutional neural network with tr...
ย 
A systematic review of in-memory database over multi-tenancy
A systematic review of in-memory database over multi-tenancyA systematic review of in-memory database over multi-tenancy
A systematic review of in-memory database over multi-tenancy
ย 
Agriculture crop yield prediction using inertia based cat swarm optimization
Agriculture crop yield prediction using inertia based cat swarm optimizationAgriculture crop yield prediction using inertia based cat swarm optimization
Agriculture crop yield prediction using inertia based cat swarm optimization
ย 
Three layer hybrid learning to improve intrusion detection system performance
Three layer hybrid learning to improve intrusion detection system performanceThree layer hybrid learning to improve intrusion detection system performance
Three layer hybrid learning to improve intrusion detection system performance
ย 
Non-binary codes approach on the performance of short-packet full-duplex tran...
Non-binary codes approach on the performance of short-packet full-duplex tran...Non-binary codes approach on the performance of short-packet full-duplex tran...
Non-binary codes approach on the performance of short-packet full-duplex tran...
ย 
Improved design and performance of the global rectenna system for wireless po...
Improved design and performance of the global rectenna system for wireless po...Improved design and performance of the global rectenna system for wireless po...
Improved design and performance of the global rectenna system for wireless po...
ย 
Advanced hybrid algorithms for precise multipath channel estimation in next-g...
Advanced hybrid algorithms for precise multipath channel estimation in next-g...Advanced hybrid algorithms for precise multipath channel estimation in next-g...
Advanced hybrid algorithms for precise multipath channel estimation in next-g...
ย 
Performance analysis of 2D optical code division multiple access through unde...
Performance analysis of 2D optical code division multiple access through unde...Performance analysis of 2D optical code division multiple access through unde...
Performance analysis of 2D optical code division multiple access through unde...
ย 
On performance analysis of non-orthogonal multiple access downlink for cellul...
On performance analysis of non-orthogonal multiple access downlink for cellul...On performance analysis of non-orthogonal multiple access downlink for cellul...
On performance analysis of non-orthogonal multiple access downlink for cellul...
ย 
Phase delay through slot-line beam switching microstrip patch array antenna d...
Phase delay through slot-line beam switching microstrip patch array antenna d...Phase delay through slot-line beam switching microstrip patch array antenna d...
Phase delay through slot-line beam switching microstrip patch array antenna d...
ย 
A simple feed orthogonal excitation X-band dual circular polarized microstrip...
A simple feed orthogonal excitation X-band dual circular polarized microstrip...A simple feed orthogonal excitation X-band dual circular polarized microstrip...
A simple feed orthogonal excitation X-band dual circular polarized microstrip...
ย 
A taxonomy on power optimization techniques for fifthgeneration heterogenous ...
A taxonomy on power optimization techniques for fifthgeneration heterogenous ...A taxonomy on power optimization techniques for fifthgeneration heterogenous ...
A taxonomy on power optimization techniques for fifthgeneration heterogenous ...
ย 

Recently uploaded

Gfe Mayur Vihar Call Girls Service WhatsApp -> 9999965857 Available 24x7 ^ De...
Gfe Mayur Vihar Call Girls Service WhatsApp -> 9999965857 Available 24x7 ^ De...Gfe Mayur Vihar Call Girls Service WhatsApp -> 9999965857 Available 24x7 ^ De...
Gfe Mayur Vihar Call Girls Service WhatsApp -> 9999965857 Available 24x7 ^ De...srsj9000
ย 
Model Call Girl in Narela Delhi reach out to us at ๐Ÿ”8264348440๐Ÿ”
Model Call Girl in Narela Delhi reach out to us at ๐Ÿ”8264348440๐Ÿ”Model Call Girl in Narela Delhi reach out to us at ๐Ÿ”8264348440๐Ÿ”
Model Call Girl in Narela Delhi reach out to us at ๐Ÿ”8264348440๐Ÿ”soniya singh
ย 
High Profile Call Girls Nagpur Isha Call 7001035870 Meet With Nagpur Escorts
High Profile Call Girls Nagpur Isha Call 7001035870 Meet With Nagpur EscortsHigh Profile Call Girls Nagpur Isha Call 7001035870 Meet With Nagpur Escorts
High Profile Call Girls Nagpur Isha Call 7001035870 Meet With Nagpur Escortsranjana rawat
ย 
Microscopic Analysis of Ceramic Materials.pptx
Microscopic Analysis of Ceramic Materials.pptxMicroscopic Analysis of Ceramic Materials.pptx
Microscopic Analysis of Ceramic Materials.pptxpurnimasatapathy1234
ย 
chaitra-1.pptx fake news detection using machine learning
chaitra-1.pptx  fake news detection using machine learningchaitra-1.pptx  fake news detection using machine learning
chaitra-1.pptx fake news detection using machine learningmisbanausheenparvam
ย 
OSVC_Meta-Data based Simulation Automation to overcome Verification Challenge...
OSVC_Meta-Data based Simulation Automation to overcome Verification Challenge...OSVC_Meta-Data based Simulation Automation to overcome Verification Challenge...
OSVC_Meta-Data based Simulation Automation to overcome Verification Challenge...Soham Mondal
ย 
Heart Disease Prediction using machine learning.pptx
Heart Disease Prediction using machine learning.pptxHeart Disease Prediction using machine learning.pptx
Heart Disease Prediction using machine learning.pptxPoojaBan
ย 
Call Girls Delhi {Jodhpur} 9711199012 high profile service
Call Girls Delhi {Jodhpur} 9711199012 high profile serviceCall Girls Delhi {Jodhpur} 9711199012 high profile service
Call Girls Delhi {Jodhpur} 9711199012 high profile servicerehmti665
ย 
Internship report on mechanical engineering
Internship report on mechanical engineeringInternship report on mechanical engineering
Internship report on mechanical engineeringmalavadedarshan25
ย 
College Call Girls Nashik Nehal 7001305949 Independent Escort Service Nashik
College Call Girls Nashik Nehal 7001305949 Independent Escort Service NashikCollege Call Girls Nashik Nehal 7001305949 Independent Escort Service Nashik
College Call Girls Nashik Nehal 7001305949 Independent Escort Service NashikCall Girls in Nagpur High Profile
ย 
GDSC ASEB Gen AI study jams presentation
GDSC ASEB Gen AI study jams presentationGDSC ASEB Gen AI study jams presentation
GDSC ASEB Gen AI study jams presentationGDSCAESB
ย 
main PPT.pptx of girls hostel security using rfid
main PPT.pptx of girls hostel security using rfidmain PPT.pptx of girls hostel security using rfid
main PPT.pptx of girls hostel security using rfidNikhilNagaraju
ย 
SPICE PARK APR2024 ( 6,793 SPICE Models )
SPICE PARK APR2024 ( 6,793 SPICE Models )SPICE PARK APR2024 ( 6,793 SPICE Models )
SPICE PARK APR2024 ( 6,793 SPICE Models )Tsuyoshi Horigome
ย 
Current Transformer Drawing and GTP for MSETCL
Current Transformer Drawing and GTP for MSETCLCurrent Transformer Drawing and GTP for MSETCL
Current Transformer Drawing and GTP for MSETCLDeelipZope
ย 
Sachpazis Costas: Geotechnical Engineering: A student's Perspective Introduction
Sachpazis Costas: Geotechnical Engineering: A student's Perspective IntroductionSachpazis Costas: Geotechnical Engineering: A student's Perspective Introduction
Sachpazis Costas: Geotechnical Engineering: A student's Perspective IntroductionDr.Costas Sachpazis
ย 
VIP Call Girls Service Hitech City Hyderabad Call +91-8250192130
VIP Call Girls Service Hitech City Hyderabad Call +91-8250192130VIP Call Girls Service Hitech City Hyderabad Call +91-8250192130
VIP Call Girls Service Hitech City Hyderabad Call +91-8250192130Suhani Kapoor
ย 
VIP Call Girls Service Kondapur Hyderabad Call +91-8250192130
VIP Call Girls Service Kondapur Hyderabad Call +91-8250192130VIP Call Girls Service Kondapur Hyderabad Call +91-8250192130
VIP Call Girls Service Kondapur Hyderabad Call +91-8250192130Suhani Kapoor
ย 
HARMONY IN THE NATURE AND EXISTENCE - Unit-IV
HARMONY IN THE NATURE AND EXISTENCE - Unit-IVHARMONY IN THE NATURE AND EXISTENCE - Unit-IV
HARMONY IN THE NATURE AND EXISTENCE - Unit-IVRajaP95
ย 
Exploring_Network_Security_with_JA3_by_Rakesh Seal.pptx
Exploring_Network_Security_with_JA3_by_Rakesh Seal.pptxExploring_Network_Security_with_JA3_by_Rakesh Seal.pptx
Exploring_Network_Security_with_JA3_by_Rakesh Seal.pptxnull - The Open Security Community
ย 

Recently uploaded (20)

Gfe Mayur Vihar Call Girls Service WhatsApp -> 9999965857 Available 24x7 ^ De...
Gfe Mayur Vihar Call Girls Service WhatsApp -> 9999965857 Available 24x7 ^ De...Gfe Mayur Vihar Call Girls Service WhatsApp -> 9999965857 Available 24x7 ^ De...
Gfe Mayur Vihar Call Girls Service WhatsApp -> 9999965857 Available 24x7 ^ De...
ย 
Model Call Girl in Narela Delhi reach out to us at ๐Ÿ”8264348440๐Ÿ”
Model Call Girl in Narela Delhi reach out to us at ๐Ÿ”8264348440๐Ÿ”Model Call Girl in Narela Delhi reach out to us at ๐Ÿ”8264348440๐Ÿ”
Model Call Girl in Narela Delhi reach out to us at ๐Ÿ”8264348440๐Ÿ”
ย 
High Profile Call Girls Nagpur Isha Call 7001035870 Meet With Nagpur Escorts
High Profile Call Girls Nagpur Isha Call 7001035870 Meet With Nagpur EscortsHigh Profile Call Girls Nagpur Isha Call 7001035870 Meet With Nagpur Escorts
High Profile Call Girls Nagpur Isha Call 7001035870 Meet With Nagpur Escorts
ย 
Microscopic Analysis of Ceramic Materials.pptx
Microscopic Analysis of Ceramic Materials.pptxMicroscopic Analysis of Ceramic Materials.pptx
Microscopic Analysis of Ceramic Materials.pptx
ย 
โ˜… CALL US 9953330565 ( HOT Young Call Girls In Badarpur delhi NCR
โ˜… CALL US 9953330565 ( HOT Young Call Girls In Badarpur delhi NCRโ˜… CALL US 9953330565 ( HOT Young Call Girls In Badarpur delhi NCR
โ˜… CALL US 9953330565 ( HOT Young Call Girls In Badarpur delhi NCR
ย 
chaitra-1.pptx fake news detection using machine learning
chaitra-1.pptx  fake news detection using machine learningchaitra-1.pptx  fake news detection using machine learning
chaitra-1.pptx fake news detection using machine learning
ย 
OSVC_Meta-Data based Simulation Automation to overcome Verification Challenge...
OSVC_Meta-Data based Simulation Automation to overcome Verification Challenge...OSVC_Meta-Data based Simulation Automation to overcome Verification Challenge...
OSVC_Meta-Data based Simulation Automation to overcome Verification Challenge...
ย 
Heart Disease Prediction using machine learning.pptx
Heart Disease Prediction using machine learning.pptxHeart Disease Prediction using machine learning.pptx
Heart Disease Prediction using machine learning.pptx
ย 
Call Girls Delhi {Jodhpur} 9711199012 high profile service
Call Girls Delhi {Jodhpur} 9711199012 high profile serviceCall Girls Delhi {Jodhpur} 9711199012 high profile service
Call Girls Delhi {Jodhpur} 9711199012 high profile service
ย 
Internship report on mechanical engineering
Internship report on mechanical engineeringInternship report on mechanical engineering
Internship report on mechanical engineering
ย 
College Call Girls Nashik Nehal 7001305949 Independent Escort Service Nashik
College Call Girls Nashik Nehal 7001305949 Independent Escort Service NashikCollege Call Girls Nashik Nehal 7001305949 Independent Escort Service Nashik
College Call Girls Nashik Nehal 7001305949 Independent Escort Service Nashik
ย 
GDSC ASEB Gen AI study jams presentation
GDSC ASEB Gen AI study jams presentationGDSC ASEB Gen AI study jams presentation
GDSC ASEB Gen AI study jams presentation
ย 
main PPT.pptx of girls hostel security using rfid
main PPT.pptx of girls hostel security using rfidmain PPT.pptx of girls hostel security using rfid
main PPT.pptx of girls hostel security using rfid
ย 
SPICE PARK APR2024 ( 6,793 SPICE Models )
SPICE PARK APR2024 ( 6,793 SPICE Models )SPICE PARK APR2024 ( 6,793 SPICE Models )
SPICE PARK APR2024 ( 6,793 SPICE Models )
ย 
Current Transformer Drawing and GTP for MSETCL
Current Transformer Drawing and GTP for MSETCLCurrent Transformer Drawing and GTP for MSETCL
Current Transformer Drawing and GTP for MSETCL
ย 
Sachpazis Costas: Geotechnical Engineering: A student's Perspective Introduction
Sachpazis Costas: Geotechnical Engineering: A student's Perspective IntroductionSachpazis Costas: Geotechnical Engineering: A student's Perspective Introduction
Sachpazis Costas: Geotechnical Engineering: A student's Perspective Introduction
ย 
VIP Call Girls Service Hitech City Hyderabad Call +91-8250192130
VIP Call Girls Service Hitech City Hyderabad Call +91-8250192130VIP Call Girls Service Hitech City Hyderabad Call +91-8250192130
VIP Call Girls Service Hitech City Hyderabad Call +91-8250192130
ย 
VIP Call Girls Service Kondapur Hyderabad Call +91-8250192130
VIP Call Girls Service Kondapur Hyderabad Call +91-8250192130VIP Call Girls Service Kondapur Hyderabad Call +91-8250192130
VIP Call Girls Service Kondapur Hyderabad Call +91-8250192130
ย 
HARMONY IN THE NATURE AND EXISTENCE - Unit-IV
HARMONY IN THE NATURE AND EXISTENCE - Unit-IVHARMONY IN THE NATURE AND EXISTENCE - Unit-IV
HARMONY IN THE NATURE AND EXISTENCE - Unit-IV
ย 
Exploring_Network_Security_with_JA3_by_Rakesh Seal.pptx
Exploring_Network_Security_with_JA3_by_Rakesh Seal.pptxExploring_Network_Security_with_JA3_by_Rakesh Seal.pptx
Exploring_Network_Security_with_JA3_by_Rakesh Seal.pptx
ย 

ELM and K-nn machine learning in classification of Breath sounds signals

  • 1. International Journal of Electrical and Computer Engineering (IJECE) Vol. 10, No. 4, August 2020, pp. 3528~3536 ISSN: 2088-8708, DOI: 10.11591/ijece.v10i4.pp3528-3536 ๏ฒ 3528 Journal homepage: http://ijece.iaescore.com/index.php/IJECE ELM and K-nn machine learning in classification of Breath sounds signals Z. Neili, M. Fezari, A. Redjati Department of Electronic, LASA Laboratory, Badji Mokhtar University Annaba, Algeria Article Info ABSTRACT Article history: Received Apr 7, 2019 Revised Jan 6, 2020 Accepted Jan 29, 2020 The acquisition of Breath sounds (BS) signals from a human respiratory system with an electronic stethoscope, provide and offer prominent information which helps the doctors to diagnosis and classification of pulmonary diseases. Unfortunately, this BS signals with other biological signals have a non-stationary nature according to the variation of the lung volume, and this nature makes it difficult to analyze and classify between several diseases. In this study, we were focused on comparing the ability of the extreme learning machine (ELM) and k-nearest neighbour (K-nn) machine learning algorithms in the classification of adventitious and normal breath sounds. To do so, the empirical mode decomposition (EMD) was used in this work to analyze BS, this method is rarely used in the breath sounds analysis. After the EMD decomposition of the signals into Intrinsic Mode Functions (IMFs), the Hjorth descriptors (Activity) and Permutation Entropy (PE) features were extracted from each IMFs and combined for classification stage. The study has found that the combination of features (activity and PE) yielded an accuracy of 90.71%, 95% using ELM and K-nn respectively in binary classification (normal and abnormal breath sounds), and 83.57%, 86.42% in multiclass classification (five classes). Keywords: Empirical mode decomposition Extreme learning machine Hjorth descriptors K-nearest neighbour Permutation entropy Copyright ยฉ 2020 Institute of Advanced Engineering and Science. All rights reserved. Corresponding Author: N. Zakaria, Department of Electronic, Faculty of Sciences, Laboratoire dโ€™Automatique et Signaux de Annaba (LASA), Badji Mokhtar University Annaba, P.O. Box 12, 23000 Annaba, Algeria. Email: zaki.neli@yahoo.fr 1. INTRODUCTION Recently many researches in the Breath Sounds (BS) areas is conducted by applying many techniques for analyzing and classify a respiratory signal in order to diagnosis the pulmonary pathology, such as (Asthma, COPD, Pneumoniaโ€ฆ). However, the acquisition of lung sounds plays an important role to detect and identification of pulmonary diseases. The doctors listening to the lung sounds through the stethoscope placed on the chest or posterior to the patient which is suffering from a type of lung disease, but the problem is sometimes the decision of the doctors concerning types of pathology is not accurate, this is due to many reasons such as a few experiences concerning auscultation and diagnosis. To address this problem a research study has been widely conducted in this area focus on three principal domains (time domain, frequency domain and time-frequency domain). Breath sound is a complex signal [1] such other biological signals, have a non-linear and non-stationary nature, these properties of the signal lead it to assessed by different techniques in signal processing have the same property of the breath signals. However, these techniques used for three transformation domains which are mentioned previously. In [2] Islam, A et al the artificial neural network
  • 2. Int J Elec & Comp Eng ISSN: 2088-8708 ๏ฒ ELM and K-nn machine learning in classification of Breath sounds signals (Z. Neili) 3529 (ANN) and support vector machine (SVM) classifiers have been used for classifying normal and asthmatic subjects with, spectral subband was extracted from the lung sound cycle, with a maximum classification accuracy of 89.2% and 93.3% by the ANN and SVM classifiers, respectively, Mondal, A [3] et al apply the empirical mode decomposition to lung sounds focused on pattern recognition algorithms for classifying into pulmonary dysfunction with an accuracy of 94.16 %, in [4] A. Rizal et al classify the lung sounds using Tsallis Entropy and using MLP classifier with an accuracy 95.35%, Pancaldi, F et al [5] diagnosis the lung diseases (interstitial lung diseases) by using empirical observation as proposed solution with an overall accuracy of 90.0%, A.Cheema, M.Singh [6] use an EMD method for detect Psychological stress from phonocardiography signal the average accuracy of 93.14% to classifying stressed and non-stressed, in [7] R. Palaniappan classify a pulmonary signal using Autoregressive Coefficients and k-Nearest Neighbor as a classifier with an accuracy of 95.18%. In this work we analyzed a breath sounds signals using empirical mode decomposition with Hjorth descriptors (Activity) and Permutation entropy as features, were extracted from each IMFs produced by EMD, finally,a comparative study has been assessed between an extreme learning machine (ELM) and K-nearest neighbor (K-NN) for distinguishing between normal, and adventitious respiratory sounds. 2. RESEARCH METHOD Our work was divided into two principal stages namely (Multiclass classification stage, Binary classification stage). The four steps proposed for both stage study namely (database, pre-processing, feature extraction and classification) are presented in Figure 1(a) for multiclass classification, and the second stage is represented in Figure 1(b) for binary classification. (a) (b) Figure 1. Two principal stage of the breath sounds signal classification (a) multiclass classification (b) binary classification 2.1. Database In this paper the database of breath sounds signals used for analysis are the R.A.L.E (Respiration Acoustic Laboratory Environment) Lung Sounds, is the only commercially available database, is an educational program to help doctors and researchers in respiratory signals processing area offer more than 50 breath sounds were recorded using a contact accelerometer (Siemens-EMT25C) covering normal and abnormal respiratory sounds [8] are sampled at 10,240Hz. As this database (R.A.L.E) has a few data, therefore to ensure the credibility of this comparative study we used another data were collected from the internet: - The Auscultation Assistant, 2015 [9, 10] - Arnall, 2015 [11] - The CD of the book [12] In all a 75 breath sounds divided into five classes (Normal bronchial, Wheeze, Crackle, Pleural rub, Stridor) were used in our study, each sound is an effect of particular disease such as Wheeze indicate that the patient suffering from asthma and COPD (Chronic Obstructive Pulmonary diseases), crackle indicate pneumonia or lung cancer.
  • 3. ๏ฒ ISSN: 2088-8708 Int J Elec & Comp Eng, Vol. 10, No. 4, August 2020 : 3528 - 3536 3530 2.2. Breath sounds pre-processing Breath sounds signals are subject to several artefacts such as heart sounds and noise which simulate real-life conditions. The breath sounds signals (R.A.L.E) that have been filtered by a high-pass filter with 7.5 Hz by 1st order Butterworth to remove DC offset, and a low-pass filter at 2.5 Hz by 8th order Butterworth [13, 14] , and concerning the data were collected we apply a mean and amplitude normalization to reduce the effect of heart sounds. Finally, all samples are downsampled to 8000 Hz sampling frequency according to CORSA (computerized respiratory sound analysis) [15], in this study, the 16-bit resolution and one respiratory cycle are used. 2.3. Empirical mode decomposition The Empirical Mode Decomposition (EMD) method is a new adaptive signal time-frequency processing method proposed by NE Huang in 1998 by NASA and others [16]. It is especially suitable for nonlinearity, analysis and processing of non-stationary signals. The Hilbert transform transforms the well- known Hilbert-Huang Transform (HHT). EMD is actually a method of decomposing signals. It is consistent with the core idea of Fourier transform and wavelet transform. Everyone wants to decompose the signal into a superposition of independent components, only the Fourier transform and the wavelet transform it is required to have a basic function, but EMD completely abandons the constraint of the basis function, and only performs signal decomposition based on the time scale feature of the data itself, and has adaptability. Since no basis function is required, EMD can be used for almost any type of signal decomposition, especially for the decomposition of nonlinear, non-stationary signals [17, 18]. The purpose of EMD is to decompose the signal into a superposition of multiple intrinsic mode functions (IMFs). In addition, the IMF must satisfy the following two conditions( the function must have the same number of local extreme points and zero crossings within the entire time range, and at any point in time, the envelope of the local maximum the envelope of the (upper envelope) and the local minimum (lower envelope) must be zero on average. The EMD method is based on the: ๏€ญ The signal has at least two extreme points, one maximum and one minimum. ๏€ญ The characteristic time scale is defined by the time between the two extreme points. ๏€ญ If the data lacks extreme points but has deformation points, the extreme points can be obtained by data differentiation once or several times, and then the decomposition results are obtained by integration. The algorithm flow is as follows: - Identify all extrema of x(t) - Interpolate between minima (resp. maxima), ending up with some envelope emin(t) (resp. emax(t)) - Compute the mean m(t) = (emin(t)+emax(t))/2 - Extract the detail d(t) = x(t) โˆ’ m(t) - Iterate on the residual m(t) 2.4. Features extraction A helpful feature for express a biomedical signal namely Hjorth descriptors (HD) divided into three main parameters as follows: - Activity: is the most useful parameters in biological signals, simply its variance of the signal represents the energy: ๐ด๐‘๐‘ก๐‘ฃ = ๐œŽ0 2 (1) - Mobility: Mobility is given by: ๐‘€๐‘œ๐‘ = ๐œŽ1 2 / ๐œŽ0 2 (2) - Complexity: gives a computational value for the shape of the signal: ๐ถ๐‘œ๐‘š๐‘ = โˆš( ( ๐œŽ ๐‘š+1)2 ( ๐œŽ ๐‘š)2 โˆ’ (๐œŽ ๐‘š)2 (๐œŽ ๐‘šโˆ’1)2) 2 (3) - Permutation Entropy: Bandt and Pompe are investigated the (PE) Permutation entropy to measure the complexity of the non-linearity and non-stationary nature in time series signals [19]. the Shannon entropy is calculated in PE for the different symbol in the signal and can be calculated as follows: ๐‘ƒ๐ธ๐‘› = โˆ‘ ๐‘๐‘– ๐‘š ๐‘–=1 โˆ— ๐‘™๐‘œ๐‘”(๐‘๐‘–)/๐‘™๐‘›(๐‘š) (4)
  • 4. Int J Elec & Comp Eng ISSN: 2088-8708 ๏ฒ ELM and K-nn machine learning in classification of Breath sounds signals (Z. Neili) 3531 2.4.1. Statistical analysis In this study, a statistical analysis of mean and standard deviation was used to test the significance of the activity and PE features. SD and Mean are expressed respectively as follows: ๐œŽ = โˆš 1 ๐‘€ โˆ‘ (๐‘ฅ๐‘— โˆ’ ๐œ‡) 2๐‘€ ๐‘—=1 (5) ๐‘ฅฬ… = (โˆ‘ ๐‘ฅ๐‘—)/๐‘€ (6) where: ๐‘ฅ๐‘— each value of the dataset. M the total number of data points. 2.5. Classification In this study, two classifiers were used for two classification types (multiclass classification, binary classification), one is the extreme learning machine (ELM) and the other is a k-nearest neighbour (K-NN). detailed of these classifiers are presented in this section: 2.5.1. Extreme learning machine Huang et al. [20] propose an algorithm for solving a single hidden layer neural network which is an extreme learning machine (ELM). The biggest feature of ELM is that traditional neural networks, especially concerning a single hidden layer feedforward neural networks (SLFNs), are faster than traditional learning algorithms while guaranteeing learning accuracy [21]. For a single hidden layer neural network shown in Figure 2, assume that there is ๐‘ต an arbitrary sample (๐‘ฟ๐’Š, ๐’•๐’Š) of which [22]: ๐‘ฟ๐’Š = [๐’™๐’Š๐Ÿ, ๐’™๐’Š๐Ÿ, โ€ฆ , ๐’™๐’Š๐’] ๐‘ป ฯต ๐‘… ๐‘› , ๐’•๐’Š = [๐’•๐’Š๐Ÿ, ๐’•๐’Š๐Ÿ, โ€ฆ , ๐’•๐’Š๐’] ๐‘ป ฯต ๐‘… ๐‘š (7) For a ๐‘ณ single hidden layer neural network with a hidden layer node, it can be expressed as: โˆ‘ ๐›ฝ๐‘– ๐‘”(๐‘Š๐‘– ๐ฟ ๐‘–=1 . ๐‘‹๐‘— + ๐‘๐‘–) = ๐‘œ๐‘—, ๐‘— = 1, โ€ฆ , ๐‘ (8) Among them ๐‘”(๐‘ฅ), the activation function, which: ๐‘Š๐‘– = [๐‘ค๐‘–,1, ๐‘ค๐‘–,2, โ€ฆ , ๐‘ค๐‘–,๐‘›] ๐‘‡ is the input weight and ๐›ฝ๐‘– the output weight, ๐‘๐‘– is the offset of the first hidden layer unit. ๐‘Š๐‘– . ๐‘‹๐‘— Representation ๐‘Š๐‘– and ๐‘‹๐‘— inner product.. The goal of a single hidden layer neural network learning is to minimize the error of the output, which can be expressed as: โˆ‘ โ€– ๐‘œ๐‘— โˆ’ ๐‘ก๐‘—โ€– = 0๐‘ ๐‘—=1 (9) That exists ๐›ฝ๐‘– , ๐‘Š๐‘– and ๐‘๐‘– so that โˆ‘ ๐›ฝ๐‘– ๐‘”(๐‘Š๐‘– ๐ฟ ๐‘–=1 . ๐‘‹๐‘— + ๐‘๐‘–) = ๐‘ก๐‘—, ๐‘— = 1, โ€ฆ , ๐‘ (10) Can be expressed as a matrix ๐ป๐›ฝ = ๐‘‡ (11) Among them it ๐‘ฏ is the output of the hidden layer node, which ๐œท is the output weight and ๐‘ป is the expected output. ๐ป = (๐‘Š1, โ€ฆ , ๐‘Š๐ฟ, ๐‘1, โ€ฆ , ๐‘๐‘™, ๐‘‹1, โ€ฆ , ๐‘‹ ๐ฟ) (12) = [ ๐‘”(๐‘Š1. ๐‘‹1 + ๐‘1) โ€ฆ ๐‘”(๐‘Š๐ฟ . ๐‘‹1 + ๐‘ ๐ฟ) โ‹ฎ โ€ฆ โ‹ฎ ๐‘”(๐‘Š1. ๐‘‹ ๐‘ + ๐‘1) โ€ฆ ๐‘”(๐‘Š๐ฟ . ๐‘‹ ๐‘ + ๐‘ ๐ฟ) ] ๐‘ร—๐ฟ
  • 5. ๏ฒ ISSN: 2088-8708 Int J Elec & Comp Eng, Vol. 10, No. 4, August 2020 : 3528 - 3536 3532 ๐›ฝ = [ ๐›ฝ1 ๐‘‡ โ‹ฎ ๐›ฝ ๐ฟ ๐‘‡ ] ๐ฟร—๐‘š, ๐‘‡ = [ ๐‘‡1 ๐‘‡ โ‹ฎ ๐‘‡ ๐‘ ๐‘‡ ] ๐‘ร—๐‘š, (13) In order to be able to train a single hidden layer neural network, we hope to get ๐‘Š1, ๐‘๐‘– and ๐›ฝ๐‘– to make: โ€– ๐ป ( ๐‘Šฬ‚ ๐‘–, ๐‘ฬ‚๐‘–) ๐›ฝฬ‚๐‘– โˆ’ ๐‘‡โ€– = min ๐‘ค,๐‘,๐›ฝ โ€– ๐ป ( ๐‘Š๐‘–, ๐‘๐‘–) ๐›ฝ๐‘– โˆ’ ๐‘‡โ€– (14) where ๐’Š = ๐Ÿ, โ€ฆ , ๐‘ณ this is equivalent to minimizing the loss function ๐ธ = โˆ‘ (โˆ‘ ๐›ฝ๐‘– ๐‘”(๐‘Š๐‘– ๐ฟ ๐‘–=1 . ๐‘‹๐‘— + ๐‘๐‘–) โˆ’ ๐‘ก๐‘—)๐‘ ๐‘—=1 2 (15) Some traditional algorithms based on the gradient descent method can be used to solve such problems, but the basic gradient-based learning algorithm needs to adjust all parameters during the iterative process. In the ELM algorithm, once the input weight ๐‘พ๐’Š and the bias of the hidden layer ๐’ƒ๐’Š are randomly determined, the output matrix of the hidden layer ๐‘ฏ is uniquely determined. The training single hidden layer neural network can be transformed into a linear system ๐‘ฏ๐œท = ๐‘ป and the output weight ๐œท can be determined ๐›ฝฬ‚ = ๐ปฯฏ ๐‘‡ (16) Among them ๐‘ฏฯฏ is ๐‘ฏ the Moore-Penrose generalized inverse of the matrix. And it can be proved that ๐œทฬ‚ the norm of the solution obtained is minimal and unique [22]. Figure 2. SLFN: additive hidden nodes 2.5.2. K-nearest neighbour The K-Nearest Neighbors (K-NN) algorithm is a classification algorithm and one of the easiest to understand machine learning algorithms. In 1968, it was proposed by Cover and Hart [23]. The simplest and mundane classifier may be the kind of memorable classifier, remember all the training data, for the new data, it matches the training data directly, if there is training data of the same attribute, use it directly, come as a classification of new data.The k-NN algorithm finds the k records closest to the new data from the training set and then determines the category of the new data based on their primary classification. The algorithm involves three main factors: - The training set - The distance or similar measure. In this study a Euclidian distance has been used: ๐‘‘(๐‘ฅ, ๐‘ฆ) = โˆ‘ โˆš๐‘ฅ๐‘– 2 โˆ’ ๐‘ฆ๐‘– 2๐‘ ๐‘–=1 (17) - The size of k
  • 6. Int J Elec & Comp Eng ISSN: 2088-8708 ๏ฒ ELM and K-nn machine learning in classification of Breath sounds signals (Z. Neili) 3533 In the validation stage, the dataset X is divided into a training set Y (training set) and a test set Z (test set), for the case that the sample size is insufficient such as in our study, and in order to full use of all data set to test the algorithms effect, database X is randomly divided into k packets, one of which is used as a test set each time, and the remaining k-1 packets are trained as a training set, by using k-fold cross- validation method [24]. 3. RESULTS AND DISCUSSION In this work the all experiments were performed by using MATLAB R2013b and on a pc with a configuration of Intel CPU Core i5, 4 GB RAM, and Windows 10 operating system. In [25] the authors apply Hjorth descriptors as features and find that the activity feature is the best feature compared with mobility and complexity as shown in (1),(2) and (3). Therefore, in our work, the activity feature was exploited for enhanced this study with combined it with the permutation entropy feature shown in (4), and formed a features vectors to fed into two machine learning algorithms namely ELM and K-NN, to compare them in the classification of breath sounds signals. The EMD decomposes BS signals into a set of IMFs, Figure 3 shows some IMFs of the normal subject. The features (Activity and Permutation Entropy) were extracted from each IMF and tested using a statistical measure of (mean and standard deviation SD described in (1) and (2)) as tabulated in Table 1. (a) IMF1 โ‹ฎ IMF10 (b) Figure 3. (a) Normal breath sounds and (b) their IMF (1-10)
  • 7. ๏ฒ ISSN: 2088-8708 Int J Elec & Comp Eng, Vol. 10, No. 4, August 2020 : 3528 - 3536 3534 Table 1 Statistical analysis of features extracted from breath sounds Breath sounds Activity Mean ยฑ standard deviation Permutation entropy Mean ยฑ standard deviation Normal bronchial 0.001387 ยฑ 0.004387 0.56497 ยฑ 0.202819 Wheeze Crackle 0.005829 ยฑ 0.000468 0.000645 ยฑ 0.000765 0.56792 ยฑ 0.209888 0.586679 ยฑ 0.216714 Pleural rub 0.002608 ยฑ 0.000513 0.56675 ยฑ 0.223923 Stridor 0.001594 ยฑ 0.001472 0.563352ยฑ0.215641 From Table 1 we inferred that there is significant discrimination in the activity and PE features of different classes. Can be observed a mean and SD are different from each class in activity features, but in PE features a little different between classes. From this, we can combine theme to test and compare the classification accuracy of both K-nn and ELM classifiers. These features have been formed as follows: Features = [Activity, PE]. In order to verify the reliability of the outcome of the classifiers, the k-fold cross-validation was used. Figure 4 shows how the ten-fold works. After several tests to choose the k value, we found that k=10 is promised value, therefore it has been used in this study. Figure 4. K-fold cross-validation methods In the literature review many researchers based on activity or entropy features extraction, nevertheless, this study has combined both activities and PE features for observed the ability of both ELM and K-nn to classify different BS signals. In Table 2 the classification stage is described, and give the classification performance of features (Activity, PE) extracted from IMFs using ELM with RBF Kernel, Polynomial Kernel and K-nn with distance euclidian which is described in equation (17), and 1 to 10 number of neighbours. Table 2. Classification performance of (Activity, PE) from IMFs of BS signals in multiclass classification stage Classifier K-Fold K neighbours Kernel Average accuracy(%) ELM (Activity, PE) ELM (Activity, PE) 10 10 / / RBF Polynomial 83.57 77.86 K-nn (Activity, PE) 10 1 / 86.42 K-nn (Activity, PE) 10 2 / 80.71 K-nn (Activity, PE) K-nn (Activity, PE) K-nn (Activity, PE) K-nn (Activity, PE) K-nn (Activity, PE) K-nn (Activity, PE) K-nn (Activity, PE) K-nn (Activity, PE) 10 10 10 10 10 10 10 10 3 4 5 6 7 8 9 10 / / / / / / / / 82.14 80.00 82.14 80.00 81.42 82.14 81.00 77.14 As shown in Tables 2, The ELM with RBF Kernel and K-nn with 1 neighbour gave the higher classification accuracy of 83.57% and 86.42% respectively. The ELM by RBF kernel is better than ELM with Polynomial kernel in multiclass classification case, and k-nn by 1 neighbour is better than rest
  • 8. Int J Elec & Comp Eng ISSN: 2088-8708 ๏ฒ ELM and K-nn machine learning in classification of Breath sounds signals (Z. Neili) 3535 neighbours. We can say that the ability of the K-nn is higher than ELM in the classification of the Breath sounds signals into several classes (Normal bronchial, Wheeze, Crackle, Pleural rub, Stridor). We can be seen in Table 3, the accuracy found from k-nn is 95% by 6-8-10 neighbours and from ELM with Polynomial Kernel is 90.71% better than RBF kernel in binary classification case. However, according to these results, we can say that, this comparative study shows that the capability of the k-nn classifier is higher compared with that of the ELM classifier in the classification of breath sounds signals from our test conditions. The ability of the k-nn is higher than ELM in the classification of the breath sounds signals into binary and multiclass classification cases. Table 3. Classification performance of (Activity, PE) from IMFs of BS signals in binary classification stage Classifier K-Fold K neighbours Kernel Average accuracy (%) ELM (Activity, PE) ELM (Activity, PE) 10 10 / / RBF Polynomial 89.29 90.71 K-nn (Activity, PE) K-nn (Activity, PE) K-nn (Activity, PE) K-nn (Activity, PE) K-nn (Activity, PE) K-nn (Activity, PE) K-nn (Activity, PE) K-nn (Activity, PE) K-nn (Activity, PE) K-nn (Activity, PE) 10 10 10 10 10 10 10 10 10 10 1 2 3 4 5 6 7 8 9 10 / / / / / / / / / / 93.57 92.14 94.29 92.86 94.28 95.00 94.29 95.00 93.00 95.00 4. CONCLUSION In this study, the performance of the ELM and K-nn classifiers were compared using the Hjorth descriptors (Activity) and Permutation Entropy (PE) features in distinguishing between breath sounds signals with combination these features (Activity, PE). The features extracted were analyzed statistically by calculating a mean and standard deviation to observe the difference between them for each class (Normal bronchial, Wheeze, Crackle, Pleural rub, Stridor). The classification accuracy in multiclass classification case of the ELM and k-nn classifiers is 83.57% and 86.42% respectively, and in binary classification case, the accuracy is 90.71% , 95% respectively. These show that the ability of k-nn in our test conditions (database, methods of analyses the breath signals, and features used) is higher than the ELM classifier in multiclass and binary classification. In future work, the EMD methods will be compared with another method for further analysis of breath sounds signals using a large database. REFERENCES [1] H. Kitaoka, and R. Takaki, B. Suki, โ€œA three-dimensional model of the human airway tree,โ€ Journal of Applied Physiology, Dec. 1999. [2] Md.A. Islam, et al., โ€œMultichannel lung sound analysis for asthma detection,โ€ Computer Methods and Programs in Biomedicine, vol. 159, pp. 111โ€“123, Jun. 2018. [3] A. Mondal, et al., โ€œA Novel Feature Extraction Technique for Pulmonary Sound Analysis Based on EMD,โ€ Computer Methods and Programs in Biomedicine, vol. 159, pp. 199-209, Jun. 2018. [4] A. Rizal, R. Hidayat and H.A. Nugroho, โ€œPulmonary crackle feature extraction using tsallis entropy for automatic lung sound classification,โ€ 2016 1st International Conference on Biomedical Engineering (IBIOMED), Yogyakarta, pp. 1-4, 2016. [5] F. Pancaldi, et al., โ€œAnalysis of pulmonary sounds for the diagnosis of interstitial lung diseases secondary to rheumatoid arthritis,โ€ Computers in Biology and Medicine, vol. 96, pp. 91-97, May 2018. [6] A. Cheema, et al., โ€œAn application of phonocardiography signals for psychological stress detection using non-linear entropy-based features in empirical mode decomposition domain,โ€ In Applied Soft Computing Journal, vol. 77, pp. 24-33, Apr. 2019. [7] R. Palaniappan, et al., โ€œPulmonary Acoustic Signal Classification using Autoregressive Coefficients and k-Nearest Neighbor,โ€ Advanced Manufacturing Research and Intelligent Applications, vol. 591, pp. 211-214, Jul. 2014. [8] H. Pasterkamp, et al., โ€œState of the art advances beyond the stethoscope,โ€ American Journal Respiratory Critical Care Medicine, vol. 156, pp. 974-987, 1997. [9] The Auscultation Assistant, โ€œBreath Sounds,โ€ 2015. [10] A. Rizal, R. Hidayat and H. A. Nugroho, โ€œEntropy measurement as features extraction in automatic lung sound classification,โ€ International Conference on Control, Electronics, Renewable Energy and Communications (ICCREC), Yogyakarta, pp. 93-97, 2017. [11] D. Arnall, โ€œPulmonary breath sounds,โ€ 2015. [12] R. Wilkins, et al., โ€œLung Sounds: A Practical Guide with Audio CD .2nd Ed,โ€ Mosby, Feb. 1996.
  • 9. ๏ฒ ISSN: 2088-8708 Int J Elec & Comp Eng, Vol. 10, No. 4, August 2020 : 3528 - 3536 3536 [13] D. Bardou, et al., โ€œLung sounds classification using convolutional neural networks,โ€ Artificial intelligence in medicine, vol. 88, pp. 58-69, 2018. [14] R. Palaniappan, et al., โ€œA comparative study of the svm and k-nn machine learning algorithms for the diagnosis of respiratory pathologies using pulmonary acoustic signals,โ€ BMC bioinformatics, vol. 15, pp. 223, 2014. [15] A. Sovijรคrvi, et al., โ€œStandardization of computerized respiratory sound analysis,โ€ Crit Care Med., vol. 156, pp. 974-987, 1997. [16] I. Branch, et al., โ€œThe empirical mode decomposition and the Hilbert spectrum for nonlinear and non-stationary time series analysis,โ€ Proceeding of the Royal Society Mathematical, Physical and Engineering Sciences, 1998. [17] G. Rilling, et al., โ€œOn Empirical Mode Decomposition and its Algorithms,โ€ 2003. [18] A, Mondal, et al., โ€œA Enhancement of lung sounds based on empirical mode decomposition and Fourier transform algorithm,โ€ Computer methods and programs in biomedicine, vol. 139, pp. 119-136, 2017. [19] C. Bandt, and B. Pompe, โ€œPermutation Entropy: A Natural Complexity Measure for Time Series,โ€ Physical Review Letters, vol. 88, pp. 17-29, Apr. 2002. [20] G. Bin-Huang, et al., โ€œExtrem Learning Machine: Theory and applications,โ€ Neurocomputing, vol. 70, pp. 489-501, Dec. 2006. [21] G. Bin-Huang, et al., โ€œExtreme learning machinesโ€ฏ: a survey,โ€ International Journal of Machine Learning and Cybernetics, vol. 2, pp. 107โ€“122, Jun. 2011. [22] S. Liao and C. Feng, โ€œMeta-ELM: ELM with ELM hidden nodes,โ€ Neurocomputing, vol. 128, pp. 81-87, Mar. 2014. [23] Cover, T. M, et al., โ€œNearest neighbor pattern classification,โ€ IEEE transactions on information theory, vol. 13, no. 1, pp. 21-27, 1967. [24] T. Andersen and T. Martinez, โ€œCross validation and MLP architecture selection,โ€ In IJCNN'99. International Joint Conference on Neural Networks. Proceedings, vol. 3, pp. 1614-1619, 1999, [25] A. Rizal, et al., โ€œLung Sound Classification Using Empirical Mode Decomposition and the Hjorth Descriptor,โ€ American Journal of Applied Sciences, vol. 14, pp. 166-173, Jan. 2017. BIOGRAPHIES OF AUTHORS Neili Zakaria received his master degree in multimedia and digital communications from Badji Mokhtar Annaba University in 2017. Since 2018 he has joined the Automatic and Signals Laboratory of Annaba University, His research interests are in biomedical signal processing and biomedical applications. Mohamed Fezari is a professor in electronics and computer architecture at the University of Badji Mokhtar Annaba, Algeria. He got a Bachelor degree in electrical engineering from the University of Oran, 1983. He got an MSc degree in computer science from the University of California Riverside, 1987. He holds a PhD degree in electronics from the University of Badji Mokhtar Annaba, 2006. His research interests include speech processing, DSP, microcontroller, microprocessor, robotics and human-machine interaction, and rehabilitation. Abdelghani Redjati was born in Annaba, Algeria, in 1966. He received M.Sc. degree in Electronic (State Engineer in Electronics (June 1995 โ€“ Badji Mokhtar Annaba University), Algeria, Magister degree in Industrial Control in 2005 and PhD degrees in Signal Processing from Badji-Mokhtar University, Annaba Algeria, in 2009. Currently, he is Assistant Professor and Head of Electronic Department at Badji- Mokhtar University, Annaba Algeria. His current research interests include Speech processing and embedded systems, Information and Communication Technology, electronic design circuits.