SlideShare a Scribd company logo
1 of 9
Download to read offline
Computer Science and Information Technologies
Vol. 4, No. 1, March 2023, pp. 24~32
ISSN: 2722-3221, DOI: 10.11591/csit.v4i1.pp24-32 ๏ฒ 24
Journal homepage: http://iaesprime.com/index.php/csit
Comparative study of ensemble deep learning models to
determine the classification of turtle species
Ruvita Faurina1
, Andang Wijanarko2
, Aknia Faza Heryuanti1
, Sahrial Ihsani Ishak3
, Indra Agustian4
1
Informatics Study Program, Faculty of Engineering, Bengkulu University, Bengkulu, Indonesia
2
Information System Study Program, Faculty of Engineering, Bengkulu University, Bengkulu, Indonesia
3
Department of Computer Science, Faculty of Mathematics and Natural Sciences, IPB University, Bogor, Indonesia
4
Department of Electrical Engineering, Bengkulu University, Bengkulu, Indonesia
Article Info ABSTRACT
Article history:
Received Aug 23, 2022
Revised Dec 26, 2022
Accepted Jan 4, 2022
Sea turtles are reptiles listed on the international union for conservation of
nature (IUCN) red list of threatened species and the convention on
international trade in endangered species of wild fauna and flora (CITES)
Appendix I as species threatened with extinction. Sea turtles are nearly
extinct due to natural predators and people who are frequently incorrect or
even ignorant in determining which turtles should not be caught. The aim of
this study was to develop a classification system to help classify sea turtle
species. Therefore, the ensemble deep learning of convolutional neural
network (CNN) method based on transfer learning is proposed for the
classification of turtle species found in coastal communities. In this case,
there are five well-known CNN models (VGG-16, ResNet-50, ResNet-152,
Inception-V3, and DenseNet201). Among the five different models, the three
most successful were selected for the ensemble method. The final result is
obtained by combining the predictions of the CNN model with the ensemble
method during the test. The evaluation result shows that the VGG16 -
DenseNet201 ensemble is the best ensemble model, with accuracy,
precision, recall, and F1-Score values of 0.74, 0.75, 0.74, and 0.76,
respectively. This result also shows that this ensemble model outperforms
the original model.
Keywords:
Classification
Ensemble deep learning
Sea turtle
Transfer learning
This is an open access article under the CC BY-SA license.
Corresponding Author:
Ruvita Faurina
Informatics Study Program, Faculty of Engineering, University of Bengkulu
Jl. W.R Supratman, Kandang Limun, Bengkulu 38371, Indonesia
Email: ruvita.faurina@unib.ac.id
1. INTRODUCTION
Turtles are reptiles that can be easily recognized by their distinctive body shape from the head and
carapace or dorsal (back) [1]. There are three main groups of turtles: land turtles, aquatic turtles, and marine
turtles. Marine turtles are also known as sea turtles. There are seven species of sea turtles in the world
[2]โ€“[5], six of which can be found in Indonesia: green turtles (Chelonia Mydas), hawksbill turtles
(Eretmochelys Imbricata), tortoiseshell turtles (Lepidochelys Olivacea), flat turtles (Natator Depressus),
leatherback turtles (Dermochelys Coriacea), and loggerhead turtles (Caretta Caretta) [6]. Based on data from
the Bengkulu Province Marine and Fisheries Service, it was stated that there were only 4 species that visited
the Bengkulu coast, namely green turtles, hawksbill turtles, loggerhead turtles, and olive ridley turtles.
Sea turtles are currently threatened with extinction and were added to the list of endangered reptiles
on the international union for conservation of nature (IUCN) red list and convention on international trade in
endangered species (CITES) Appendix I of species threatened with extinction [7]โ€“[9]. The condition of
Comput Sci Inf Technol ISSN: 2722-3221 ๏ฒ
Comparative study of ensemble deep learning models to โ€ฆ (Ruvita Faurina)
25
endangered sea turtles is caused by threats from human and animal predators. Humans and predators take
turtle eggs as a source of protein, and in traditional rituals, turtle backs are used as accessories [10]. Coastal
communities and other communities, in general, are often mistaken and cannot distinguish the types of turtles
they find on the coast. This problem is caused by the high similarity between each type of turtle. This high
level of similarity is also an obstacle when reporting turtle findings to conservation authorities. Reports of
finding turtles that are still handled manually also cause the process of handling and saving turtles to take a
long time. This problem hinders conservationists from making semi-natural nests for sea turtles, which
results in increased mortality and eggs failing to hatch. Therefore, to reduce illegal fishing and assist in the
conservation of sea turtles, technology is needed to classify turtle species.
Deep learning is a new and popular classifier technology. Deep learning can manage vast volumes
of data. One of the benefits of deep learning is transfer learning, in which the model learnt for one task can be
applied to other tasks with limited data [11]โ€“[13]. Deep learning, particularly convolutional neural networks
(CNN) inspired by the mammalian visual brain, has the capacity to evaluate and research a huge number of
features on its own, including some not previously addressed by experts [14]. Not many studies on the turtle
classification system that have been carried out by previous researchers can be found. Several related studies
were found: Liu et al. [15] in his research conducted a classification of turtles using deep learning with
transfer learning: LeNet, AlexNet, VGG16, VGG16-TL, InceptionV3 and Inception v3-TL based on CNN
resulting in an average accuracy of 65.2%, 80.6%, 84.4%, 91.4%, 87.2% and 96.4%. Paixao et al. [16]
developed a texture-based classification system for five species of sea turtles found on the coast of Brazil.
The method used is k-nearest neighbors (KNN) and support vector machine (SVM) with color histograms
and chromaticity moments features. The KNN method is claimed to be better than SVM, with a global
accuracy of 0.74. Yussof et al. [17], developed a sea turtle identification system using transfer learning, CNN
AlexNet, and SVM. The dataset is sourced from the Biodiversity Research Center, Academia Sinica, Taiwan.
The highest level of accuracy of the classification system is 62.9%. Dunbar et al. [18] conducted a study on
the practical use of photographic identification (PID) methods to identify sea turtles. PID case studies were
conducted to identify sea turtles in Reunion Island (France), Roatan (Honduras), and the Republic of
Maldives. The study results show that PID can be an effective and efficient method for gathering information
about animals.
Different from the studies mentioned above, the learning method used in this study is based on the
concept of deep learning training via the well-known and successful use of transfer learning with appropriate
pre-trained models [19]. Then combine the power of transfer learning models known as "deep learning
ensembles" [20]. In this case, VGG-16 , ResNet-50, InceptionV3, DenseNet201, and Resnet152 [21]. From
the training results, it is known that each CNN model has different generalization abilities on the dataset.
Based on these observations, the three most successful CNN models, ResNet-50, InceptionV3, and
DenseNet201, were selected for the ensemble method. The classification results obtained from the selected
CNN model are combined using the ensemble average voting method to reach the final output of the
classification. As a result of this ensemble method, satisfactory classification results were obtained.
Therefore, this study proposes an ensemble method using three transfer learning models to strengthen the
final decision and observes the use of original and augmented data in the model.
2. METHOD
This study will be built using the cross-industry standard process for data mining (CRISP-DM)
method. Cross-industry standard process for data mining (CRISP-DM) was developed in 1996 by the
analysis of several industries such as standardization Daimler Chrysler (Daimler-Benz), statistical package
for the social sciences (SPSS), and non-conformance report (NCR). CRISP-DM can be used as a general
problem-solving strategy for a business or research unit [22]โ€“[24]. The flow of this method can be seen in
Figure 1.
The CRISP-DM method begins with the Business Understanding Phase, which is the business
understanding phase to determine the direction of research to be carried out. Then proceed with the data
understanding phase, which is the data understanding phase for dealing with data needs related to business
goals. Furthermore, the data preparation phase is carried out, which is a phase to improve data quality so that
the data is in accordance with the modeling process to be carried out. This modeling phase involves the
creation of a model, after which the data is ready for the model-based training process. Next is the Evaluation
phase, in this phase an evaluation will be carried out on the model in which the iteration is made. The last
phase is the deployment phase, in which the model will be implemented on the desired platform.
๏ฒ ISSN: 2722-3221
Comput Sci Inf Technol, Vol. 4, No. 1, March 2023: 24-32
26
Figure 1. CRISP-DM method [24]
2.1. Business understanding
Coastal communities and other communities, in general, are often mistaken and cannot distinguish
the types of turtles they find on the coast. Reports of turtle weaving that is still manual also cause the process
of handling and saving turtles to take a long time. This problem hinders conservation parties from making
semi-natural nests, which results in increased mortality and eggs that fail to hatch. To reduce threats and aid
conservation, a technology capable of classifying turtle species is required. One of the emerging and popular
technologies for classifying is deep learning. Deep learning can perform classification through images or
videos. The advantage of deep learning is the ability to transfer learning, which means that the model learned
from one task can be reapplied to another task that may have limited data. Transfer learning performance can
be improved by combining transfer learning, also known as the "ensemble deep learning model. The deep
learning ensemble model generated in this study can be implemented into a web- or mobile-based system to
assist the classification and reporting process when the community finds turtles. As a result, this system is
expected to help the community and conservation organizations protect turtles by providing access to a
system for the classification and reporting of turtle findings that can be accessed via cellphones or personal
computers.
2.2. Data understanding
This study requires analysis of data needs and data collection carried out in three ways: literature
study, observation, and interviews. The dataset used is a turtle image consisting of 4 classes according to the
types of turtles that have been validated by experts: green turtles, hawksbill turtles, olive ridley turtles, and
loggerhead turtles. Figure 2 depicts an example sea turtle images from the dataset. Figures 2(a) to 2(d) show
green turtle (Chelonia mydas), olive ridley (Lepidochelys olivacea), hawksbill turtle (Eretmochelys
imbricata), and Loggerhead turtle (Lepidochelys olivacea), in that order. Before data augmentation, the data
was generated with different positions of the turtles, specifically when they were on the coast and when they
were at sea.
(a) (b) (c) (d)
Figure 2. Sample image of sea turtles in the dataset: (a) green turtle (Chelonia mydas), (b) olive ridley
(Lepidochelys olivacea), (c) hawksbill turtle (Eretmochelys imbricata), (d) Loggerhead turtle
(Lepidochelys olivacea)
Comput Sci Inf Technol ISSN: 2722-3221 ๏ฒ
Comparative study of ensemble deep learning models to โ€ฆ (Ruvita Faurina)
27
The image dataset used in this study consists of a primary dataset and a secondary dataset of images
taken from public datasets. The primary dataset of 654 images was collected by the research team at the
โ€œKonservasi Penyu Alun Utaraโ€ located in Pekik Nyaring Village, Central Bengkulu Regency, Bengkulu
Province, Indonesia. While the secondary dataset of 850 images was taken from Smaranjit Ghose's public
dataset on Kaggle [25]. The composition of the dataset is shown in Table 1.
Table 1. Dataset composition
No Name of Data Number Image Original
1 Green Turtles 376
2 Olive Ridley Turtles 376
3 Loggerhead Turtles 376
4 Hawksbill Turtles 376
Total 1504
2.3. Data preparation
At the data preparation stage, the research team resizes, augments and separates the dataset from the
data that has been obtained. The image size is resized to 224ร—224 px, then augmented with rotation, noise,
brightness, and blur augmentation techniques, and then the dataset is divided into three parts, namely training
data, validation data, and test data. Before being divided, the data, especially the distribution of the dataset
after processing, are shown in Table 2. The augmentation technique is performed with random values in a
range, each of which is rotation: -40 to 40, noise: 1 to 5%, brightness: -25% to +25. %, blur: 1 to 5 px. The
distribution of the dataset after the process is shown in Table 2.
Table 2. Split dataset
No Name of Data Number Image Original
1 Training 70% of the total = 4228
2 Validation 20% of the total = 1208
3 Test 10% of the total = 580
Total 6016
2.4. Modeling
The ensemble deep learning that will be carried out in this study will use the average voting
strategy. The average vote will take the probabilities made for each data point in the average. In this method,
the ensemble classifier system takes the average of the predictions from all the models and uses it to make
the final prediction. At this stage, we will simulate the ensemble deep learning by adjusting the parameters to
produce the best model. The parameters needed to be set in the model training process are input, batch size,
epoch, sea turtle dataset, hyperparameter, and weight evaluation. The same parameter properties are applied
to five types of transfer learning: InceptionV3, DenseNet, VGG16, ResNet50, and ResNet152. Three of the
five models will be selected, which are good for an ensemble model. Details of the design stages of the sea
turtleโ€™s classification model are shown in Figure 3.
From the detailed steps in Figure 3, it can be seen that the training dataset is trained and validated
using transfer learning with the InceptionV3, DenseNet, VGG16, ResNet50, and ResNet152 architectures. A
test dataset is used to evaluate the performance of each architecture's output model. The average vote of the
three best models was taken based on the performance of the validation and evaluation of the test dataset to
be used as the final ensemble model for the classification system of the turtle. In the training process, the
initial weights of the pre-trained model used have been trained with the ImageNet dataset; the only layer
taken is the feature extraction layer, while the last dense layer is replaced with a fully connected layer for the
sea turtle classifier. The training process is evaluated based on data loss and accuracy in the training and
validation datasets, as well as the values of precision, recall, and TF1 score.
Five well-known CNN architectures (InceptionV3, DenseNet, VGG16, ResNet50, and ResNet152)
were trained in the study with a batch size of 16 and a learning rate of 0.0001. We trained models with the
same epoch size (300 epoch). The callbacks list method will save accuracy for the training model. Adam was
used as the optimization function to minimize the categorical cross-entropy loss function. The softmax
activation function was used in the last layer for classification. Early stopping was utilized to overcome
overfitting in models. All experiments were carried out on a Windows-based PC with 4 GB of RAM, a 4 GB
hard drive, and a 256-bit Nvidia Core i5 graphics card. The computer languages Python and the keras module
๏ฒ ISSN: 2722-3221
Comput Sci Inf Technol, Vol. 4, No. 1, March 2023: 24-32
28
are utilized in the software development process. The three most successful CNN models were chosen for the
ensemble approach from among the five.
Figure 3. Model deep learning
2.5. Evaluation
The performance of the classification model is evaluated based on precision, recall, accuracy, and
F1 Score. These metrics are calculated based on true positive (TP), true negative (TN), false positive (FP),
and false negative (FN) data from the confusion matrix based on (1)-(4). TP is the number of true positive
predictions, TN is the number of true negative predictions, FP is the number of false positive predictions, and
FN is the number of false negative predictions [26]โ€“[28].
๐‘ƒ๐‘Ÿ๐‘’๐‘๐‘–๐‘ ๐‘–๐‘œ๐‘› =
๐‘‡๐‘ƒ
๐‘‡๐‘ƒ+๐น๐‘ƒ
(1)
๐‘…๐‘’๐‘๐‘Ž๐‘™๐‘™ =
๐‘‡๐‘ƒ
๐‘‡๐‘ƒ+๐น๐‘
(2)
๐ด๐‘๐‘๐‘ข๐‘Ÿ๐‘Ž๐‘๐‘ฆ =
๐‘‡๐‘ƒ+๐‘‡๐‘
๐‘‡๐‘ƒ+๐น๐‘+๐‘‡๐‘+๐น๐‘ƒ
(3)
๐น1 ๐‘†๐‘๐‘œ๐‘Ÿ๐‘’ = 2 ร—
๐‘Ÿ๐‘’๐‘๐‘Ž๐‘™๐‘™ร—๐‘๐‘Ÿ๐‘’๐‘๐‘–๐‘ ๐‘–๐‘œ๐‘›
๐‘Ÿ๐‘’๐‘๐‘Ž๐‘™๐‘™+๐‘๐‘Ÿ๐‘’๐‘๐‘–๐‘ ๐‘–๐‘œ๐‘›
(4)
3. RESULTS AND DISCUSSION
The evaluation metrics results for the trained models of InceptionV3, DenseNet, VGG16, ResNet50,
and ResNet152 in this study are shown in Table 3. It can be seen that the three best models are InceptionV3,
DenseNet201, and VGG16. Example of train-validation loss and accuracy graphs of the DenseNet201 are
shown in Figure 4 and Figure 5. In the figure, it can be seen that the loss and accuracy of the DenseNet201
Comput Sci Inf Technol ISSN: 2722-3221 ๏ฒ
Comparative study of ensemble deep learning models to โ€ฆ (Ruvita Faurina)
29
model in the training process are approaching convergence above 25 epochs. The other models also started to
converge around 25 epochs.
Table 3. Evaluation metrics for the trained models of the sea turtle classifier
No Models Accuracy Precison Recall F1-Score
1 InceptionV3 0.60 0.58 0.60 0.56
2 DenseNet201 0.70 0.76 0.70 0.70
3 VGG16 0.69 0.71 0.69 0.68
4 Resnet50 0.29 0.14 0.29 0.19
5 Resnet152 0.40 0.44 0.40 0.39
Figure 4. InceptionV3 train and validation loss
Figure 5. InceptionV3 train and validation accuracy
The ensemble model is composed of the three best models: Ensemble InceptionV3 - VGG16,
Ensemble InceptionV3 - DenseNet201, VGG16 - DenseNet201, and Ensemble InceptionV3 - DenseNet201 -
VGG16. The evaluation metrics for the ensemble models are shown in Table 4. It shows that the best
ensemble model is VGG16 - DenseNet201 with accuracy, precision, recall, and F1-Score of 0.74, 0.75, 0.74,
and 0.76, respectively. The ensemble model shows a significant performance improvement over the original
models.
๏ฒ ISSN: 2722-3221
Comput Sci Inf Technol, Vol. 4, No. 1, March 2023: 24-32
30
Table 4. Evaluation metrics for the ensemble trained models of the sea turtle classifier
No Ensemble Models Accuracy Precision Recall F1-Score
1 InceptionV3 - VGG16 0.70 0.71 0.70 0.69
2 InceptionV3 - DenseNet201 0.72 0.75 0.72 0.72
3 VGG16 - DenseNet201 0.74 0.75 0.74 0.76
4 InceptionV3 - DenseNet201 - VGG16 0.70 0.72 0.70 0.70
Table 5 shows the comparison of the performance of the VGG16 - DenseNet201 ensemble model
with the original model (VGG16 and DenseNet201) for each class; in this case, only precision, recall and F1-
Score were observed. It can be seen that the model ensemble shows better performance. Evaluation metrics
increased for all classes except for the green turtles class, the ensemble model experienced a decrease in
precision compared to the VGG16 model and a decrease in recall compared to the DenseNet201 model. It
can be said that the ensemble model as a whole has a better classification performance for all performance
classes compared to the original model.
Table 5. Comparison transfer learning VGG16, DenseNet201 (D201), and ensemble model (EM)
Sea Turtles Precision Recall F1-Score
D201 VGG16 EM D201 VGG EM D201 VGG EM
Green Turtles 0.54 0.71 0.65 0.83 0.37 0.76 0.65 0.48 0.70
Olive Ridley Turtles 0.81 0.79 0.84 0.84 0.86 0.86 0.84 0.83 0.85
Loggerhead Turtles 0.50 0.71 0.81 0.47 0.67 0.57 0.62 0.69 0.67
Hawksbill Turtles 0.52 0.58 0.71 0.56 0.88 0.74 0.60 0.70 0.72
4. CONCLUSION
In this study, a deep learning ensemble CNN-based marine turtle classification model was
developed. The ensemble model was selected from the InceptionV3, DenseNet, VGG16, ResNet50, and
ResNet152 architectures. Based on individual model evaluation, it was found that the three best models are
InceptionV3, DenseNet201, and VGG16. The ensemble model is composed of the three best models from
individual evaluation: InceptionV3 - VGG16, InceptionV3 - DenseNet201, VGG16 - DenseNet201, and
InceptionV3 - DenseNet201 - VGG16. VGG16 - DenseNet201 is the best ensemble model obtained, with
accuracy, precision, recall, and F1-Score values of 0.74, 0.75, 0.74, and 0.76, respectively. The result shows
that the ensemble model outperforms the original models. Based on the performance of the classifier for each
class prediction, all evaluation metrics show an improvement except for the green turtles class. The VGG16
precision for the green turtles class decreased to 0.65 from 0.71 and the DenseNet201 recall decreased to 0.76
from 0.83, but there was still some improvement at F1-Score from 0.65 to 0.70. Overall, this study shows that
the ensemble method can improve classification performance better than the individual model.
ACKNOWLEDGEMENTS
This research was funded by the University of Bengkulu through a fundamental research scheme
with contract No. 2015/UN30.15/PP/2022. This research also received non-financial support from Alun
Utara Turtle Conservation, Central Bengkulu Regency, Bengkulu Province, Indonesia.
REFERENCES
[1] R. W. Ibrahim, โ€œConformal geometry of the turtle shell,โ€ Journal of King Saud University - Science, vol. 32, no. 3, pp. 2202โ€“
2206, 2020, doi: 10.1016/j.jksus.2020.02.024.
[2] J. U. Van Dyke, R. J. Spencer, M. B. Thompson, B. Chessman, K. Howard, and A. Georges, โ€œConservation implications of turtle
declines in Australiaโ€™s Murray River system,โ€ Scientific Reports, vol. 9, no. 1, 2019, doi: 10.1038/s41598-019-39096-3.
[3] H. Barrios-Garrido, T. Shimada, A. Diedrich, and M. Hamann, โ€œConservation and enforcement capacity index (CECi): Integrating
human development, economy, and marine turtle status,โ€ Journal of Environmental Management, vol. 262, 2020, doi:
10.1016/j.jenvman.2020.110311.
[4] M. Matiddi et al., โ€œLoggerhead sea turtles (Caretta caretta): A target species for monitoring litter ingested by marine organisms in
the Mediterranean Sea,โ€ Environmental Pollution, vol. 230, pp. 199โ€“209, 2017, doi: 10.1016/j.envpol.2017.06.054.
[5] J. E. Moore et al., โ€œAn interview-based approach to assess marine mammal and sea turtle captures in artisanal fisheries,โ€
Biological Conservation, vol. 143, no. 3, pp. 795โ€“805, 2010, doi: 10.1016/j.biocon.2009.12.023.
[6] R. F. Tapilatu, H. Wona, and R. H. S. Siburian, โ€œData on environmental contaminants in sea turtle eggs at Venu Island, Kaimana
โ€“ West Papua, Indonesia,โ€ Data in Brief, vol. 31, 2020, doi: 10.1016/j.dib.2020.105778.
[7] M. H. Mohd Salleh, Y. Esa, S. M. Salleh, and S. A. Mohd Sah, โ€œTurtles in Malaysia: A review of conservation status and a call
for research,โ€ Animals, vol. 12, no. 17, 2022, doi: 10.3390/ani12172184.
[8] Sunarto et al., โ€œA geomorphological evaluation of sea turtles nesting in the southern sea of West Java,โ€ IOP Conference Series:
Comput Sci Inf Technol ISSN: 2722-3221 ๏ฒ
Comparative study of ensemble deep learning models to โ€ฆ (Ruvita Faurina)
31
Earth and Environmental Science, vol. 256, no. 1, 2019, doi: 10.1088/1755-1315/256/1/012028.
[9] B. Nahill, โ€œSea turtle research and conservation. lesson from working in the field,โ€ Academic Press, p. 244/207, 2020.
[10] L. Cรกceres-Farias, E. Resรฉndiz, J. Espinoza, H. Fernรกndez-Sanz, and A. Alfaro-Nรบรฑez, โ€œThreats and vulnerabilities for the
globally distributed Olive Ridley (Lepidochelys olivacea) sea turtle: A historical and current status evaluation,โ€ Animals, vol. 12,
no. 14, 2022, doi: 10.3390/ani12141837.
[11] A. Gulli and S. Pal, โ€œDeep learning with Keras: Beginners guide to deep learning with Keras,โ€ Packt Publishing Ltd, p. 318, 2017,
[Online]. Available: https://www.packtpub.com/big-data-and-business-intelligence/deep-learning-keras.
[12] J. Heaton, โ€œIan Goodfellow, Yoshua Bengio, and Aaron Courville: Deep learning,โ€ Genetic Programming and Evolvable
Machines, vol. 19, no. 1โ€“2, pp. 305โ€“307, 2018, doi: 10.1007/s10710-017-9314-z.
[13] Y. Bengio, Y. Lecun, and G. Hinton, โ€œDeep learning for AI,โ€ Communications of the ACM, vol. 64, no. 7, pp. 58โ€“65, 2021, doi:
10.1145/3448250.
[14] A. Bakhshi, S. Chalup, and N. Noman, โ€œFast evolution of CNN architecture for image classification,โ€ Natural Computing Series,
pp. 209โ€“229, 2020, doi: 10.1007/978-981-15-3685-4_8.
[15] J. Liu, M. Wang, L. Bao, X. Li, J. Sun, and Y. Ming, โ€œClassification and recognition of turtle images based on convolutional
neural network,โ€ IOP Conference Series: Materials Science and Engineering, vol. 782, no. 5, 2020, doi: 10.1088/1757-
899X/782/5/052044.
[16] W. R. da Paixao, T. M. Paixao, M. C. B. da Costa, J. O. Andrade, F. G. Pereira, and K. S. Komati, โ€œTexture classification of sea
turtle shell based on color features: Color histograms and chromaticity moments,โ€ International Journal of Artificial Intelligence
& Applications, vol. 9, no. 2, pp. 55โ€“67, 2018, doi: 10.5121/ijaia.2018.9205.
[17] W. N. J. Hj Wan Yussof, N. Shaharudin, M. S. Hitam, E. A. Awalludin, M. U. Rusli, and D. Z. Hoh, โ€œPhoto identification of sea
turtles using alexnet and multi-class SVM,โ€ Frontiers in Artificial Intelligence and Applications, vol. 327, pp. 23โ€“31, 2020, doi:
10.3233/FAIA200549.
[18] S. G. Dunbar, J. Hudgins, and C. Jean, โ€œApplications of photo identification in sea turtle studies,โ€ Sea Turtle Research and
Conservation: Lessons From Working In The Field, pp. 45โ€“55, 2020, doi: 10.1016/B978-0-12-821029-1.00005-2.
[19] M. Hussain, J. J. Bird, and D. R. Faria, โ€œA study on CNN transfer learning for image classification,โ€ Advances in Intelligent
Systems and Computing, vol. 840, pp. 191โ€“202, 2019, doi: 10.1007/978-3-319-97982-3_16.
[20] Y. Cao, T. A. Geddes, J. Y. H. Yang, and P. Yang, โ€œEnsemble deep learning in bioinformatics,โ€ Nature Machine Intelligence, vol.
2, no. 9, pp. 500โ€“508, 2020, doi: 10.1038/s42256-020-0217-y.
[21] L. Alzubaidi et al., โ€œReview of deep learning: concepts, CNN architectures, challenges, applications, future directions,โ€ Journal of
Big Data, vol. 8, no. 1, 2021, doi: 10.1186/s40537-021-00444-8.
[22] C. Schrรถer, F. Kruse, and J. M. Gรณmez, โ€œA systematic literature review on applying CRISP-DM process model,โ€ Procedia
Computer Science, vol. 181, pp. 526โ€“534, 2021, doi: 10.1016/j.procs.2021.01.199.
[23] F. Martinez-Plumed et al., โ€œCRISP-DM twenty years later: From data mining processes to data science trajectories,โ€ IEEE
Transactions on Knowledge and Data Engineering, vol. 33, no. 8, pp. 3048โ€“3061, 2021, doi: 10.1109/TKDE.2019.2962680.
[24] IBM, โ€œIBM documentation,โ€ 2021, [Online]. Available: https://www.ibm.com/docs/en/spss-modeler/saas?topic=dm-crisp-help-
overview.
[25] S. Ghose, โ€œSea turtle face detection,โ€ 2022, [Online]. Available: https://www.kaggle.com/datasets/smaranjitghose/sea-turtle-face-
detection.
[26] C. Goutte and E. Gaussier, โ€œA probabilistic interpretation of precision, recall and f-score, with implication for evaluation,โ€
Lecture Notes in Computer Science, vol. 3408, pp. 345โ€“359, 2005, doi: 10.1007/978-3-540-31865-1_25.
[27] C. Ferri, J. Hernรกndez-Orallo, and R. Modroiu, โ€œAn experimental comparison of performance measures for classification,โ€
Pattern Recognition Letters, vol. 30, no. 1, pp. 27โ€“38, 2009, doi: 10.1016/j.patrec.2008.08.010.
[28] ลฝ. Vujoviฤ‡, โ€œClassification model evaluation metrics,โ€ International Journal of Advanced Computer Science and Applications,
vol. 12, no. 6, pp. 599โ€“606, 2021, doi: 10.14569/IJACSA.2021.0120670.
BIOGRAPHIES OF AUTHORS
Ruvita Faurina received the S.T. degree in informatics from University of
Bengkulu, Indonesia and the M.Eng. degree in electrical engineering and information
technology from University of Gadjah Mada, Indonesia, respectively. Currently, she is an
Assistant Professor at the Department of Informatics, University of Bengkulu. Her research
interests include artificial intelligence, natural language processing, image captioning and
attention mechanism. She can be contacted at email: ruvita.faurina@unib.ac.id
Andang Wijanarko received the S.Kom. degree in information system and the
M.Kom. degree in informatics from Universitas Amikom Yogyakarta. Currently, he is an
Assistant Professor at the Department of information system, University of Bengkulu. His
research interests include artificial intelligence, multimeda, UI/UX design, mobile and website
development. He can be contacted at email: andang@unib.ac.id
๏ฒ ISSN: 2722-3221
Comput Sci Inf Technol, Vol. 4, No. 1, March 2023: 24-32
32
Aknia Faza Heryuanti currently is an undergraduate student in department of
Informatics, University of Bengkulu. Her research includes Artificial intelligence. She can be
contacted at email: akniaheryuanti@gmail.com
Sahrial Ihsani Ishak received the S.Kom. degree in informatics from the
department of informatics at the University of Bengkulu, Indonesia. Currently, he is a graduate
student in the Department of Computer Science, Faculty of Mathematics and Natural Sciences,
IPB University, Indonesia. His research interests include artificial intelligence. He can be
contacted at email: sahrialishak@gmail.com
Indra Agustian received the S.T. and M.Eng. degrees in electrical engineering
from University of Gadjah Mada, Indonesia. Currently, he is an Assistant Professor at the
Department of Electrical Engineering, University of Bengkulu, Indonesia. His research
interests include control engineering, robotics and artificial intelligence, He can be contacted at
email: indraagustian@unib.ac.id

More Related Content

Similar to Comparative study of ensemble deep learning models to determine the classification of turtle species

Animal Breed Classification And Prediction Using Convolutional Neural Network...
Animal Breed Classification And Prediction Using Convolutional Neural Network...Animal Breed Classification And Prediction Using Convolutional Neural Network...
Animal Breed Classification And Prediction Using Convolutional Neural Network...Allison Thompson
ย 
Decision Support System for Bat Identification using Random Forest and C5.0
Decision Support System for Bat Identification using Random Forest and C5.0Decision Support System for Bat Identification using Random Forest and C5.0
Decision Support System for Bat Identification using Random Forest and C5.0TELKOMNIKA JOURNAL
ย 
IRJET - Classification of Cancer Images using Deep Learning
IRJET -  	  Classification of Cancer Images using Deep LearningIRJET -  	  Classification of Cancer Images using Deep Learning
IRJET - Classification of Cancer Images using Deep LearningIRJET Journal
ย 
Plant leaf identification system using convolutional neural network
Plant leaf identification system using convolutional neural networkPlant leaf identification system using convolutional neural network
Plant leaf identification system using convolutional neural networkjournalBEEI
ย 
Generalized deep learning model for Classification of Gastric, Colon and Rena...
Generalized deep learning model for Classification of Gastric, Colon and Rena...Generalized deep learning model for Classification of Gastric, Colon and Rena...
Generalized deep learning model for Classification of Gastric, Colon and Rena...IRJET Journal
ย 
Deep Learning-based Diagnosis of Pneumonia using X-Ray Scans
Deep Learning-based Diagnosis of Pneumonia using X-Ray ScansDeep Learning-based Diagnosis of Pneumonia using X-Ray Scans
Deep Learning-based Diagnosis of Pneumonia using X-Ray ScansIRJET Journal
ย 
Deep Learning for Denoising Bioluminescent Interference and Electronic Artifa...
Deep Learning for Denoising Bioluminescent Interference and Electronic Artifa...Deep Learning for Denoising Bioluminescent Interference and Electronic Artifa...
Deep Learning for Denoising Bioluminescent Interference and Electronic Artifa...IRJET Journal
ย 
Peanut leaf spot disease identification using pre-trained deep convolutional...
Peanut leaf spot disease identification using pre-trained deep  convolutional...Peanut leaf spot disease identification using pre-trained deep  convolutional...
Peanut leaf spot disease identification using pre-trained deep convolutional...IJECEIAES
ย 
USING E-INFRASTRUCTURES FOR BIODIVERSITY CONSERVATION - Module 5
USING E-INFRASTRUCTURES FOR BIODIVERSITY CONSERVATION - Module 5USING E-INFRASTRUCTURES FOR BIODIVERSITY CONSERVATION - Module 5
USING E-INFRASTRUCTURES FOR BIODIVERSITY CONSERVATION - Module 5Gianpaolo Coro
ย 
Building on iMarine for fostering Innovation, Decision making, Governance and...
Building on iMarine for fostering Innovation, Decision making, Governance and...Building on iMarine for fostering Innovation, Decision making, Governance and...
Building on iMarine for fostering Innovation, Decision making, Governance and...Blue BRIDGE
ย 
G44083642
G44083642G44083642
G44083642IJERA Editor
ย 
Blue Skills
Blue SkillsBlue Skills
Blue SkillsBlue BRIDGE
ย 
Detection of Aedes aegypti larvae using single shot multibox detector with tr...
Detection of Aedes aegypti larvae using single shot multibox detector with tr...Detection of Aedes aegypti larvae using single shot multibox detector with tr...
Detection of Aedes aegypti larvae using single shot multibox detector with tr...journalBEEI
ย 
Modified Child Rescue System against Open Borewell
Modified Child Rescue System against Open BorewellModified Child Rescue System against Open Borewell
Modified Child Rescue System against Open Borewellijtsrd
ย 
Classification of neovascularization using convolutional neural network model
Classification of neovascularization using convolutional neural network modelClassification of neovascularization using convolutional neural network model
Classification of neovascularization using convolutional neural network modelTELKOMNIKA JOURNAL
ย 
Intelligent aquaculture system for pisciculture simulation using deep learnin...
Intelligent aquaculture system for pisciculture simulation using deep learnin...Intelligent aquaculture system for pisciculture simulation using deep learnin...
Intelligent aquaculture system for pisciculture simulation using deep learnin...nooriasukmaningtyas
ย 
Detection of diseases in rice leaf using convolutional neural network with tr...
Detection of diseases in rice leaf using convolutional neural network with tr...Detection of diseases in rice leaf using convolutional neural network with tr...
Detection of diseases in rice leaf using convolutional neural network with tr...IJECEIAES
ย 
PLANT LEAF DISEASE CLASSIFICATION USING CNN
PLANT LEAF DISEASE CLASSIFICATION USING CNNPLANT LEAF DISEASE CLASSIFICATION USING CNN
PLANT LEAF DISEASE CLASSIFICATION USING CNNIRJET Journal
ย 

Similar to Comparative study of ensemble deep learning models to determine the classification of turtle species (20)

Animal Breed Classification And Prediction Using Convolutional Neural Network...
Animal Breed Classification And Prediction Using Convolutional Neural Network...Animal Breed Classification And Prediction Using Convolutional Neural Network...
Animal Breed Classification And Prediction Using Convolutional Neural Network...
ย 
Decision Support System for Bat Identification using Random Forest and C5.0
Decision Support System for Bat Identification using Random Forest and C5.0Decision Support System for Bat Identification using Random Forest and C5.0
Decision Support System for Bat Identification using Random Forest and C5.0
ย 
IRJET - Classification of Cancer Images using Deep Learning
IRJET -  	  Classification of Cancer Images using Deep LearningIRJET -  	  Classification of Cancer Images using Deep Learning
IRJET - Classification of Cancer Images using Deep Learning
ย 
Plant leaf identification system using convolutional neural network
Plant leaf identification system using convolutional neural networkPlant leaf identification system using convolutional neural network
Plant leaf identification system using convolutional neural network
ย 
Generalized deep learning model for Classification of Gastric, Colon and Rena...
Generalized deep learning model for Classification of Gastric, Colon and Rena...Generalized deep learning model for Classification of Gastric, Colon and Rena...
Generalized deep learning model for Classification of Gastric, Colon and Rena...
ย 
Deep Learning-based Diagnosis of Pneumonia using X-Ray Scans
Deep Learning-based Diagnosis of Pneumonia using X-Ray ScansDeep Learning-based Diagnosis of Pneumonia using X-Ray Scans
Deep Learning-based Diagnosis of Pneumonia using X-Ray Scans
ย 
Deep Learning for Denoising Bioluminescent Interference and Electronic Artifa...
Deep Learning for Denoising Bioluminescent Interference and Electronic Artifa...Deep Learning for Denoising Bioluminescent Interference and Electronic Artifa...
Deep Learning for Denoising Bioluminescent Interference and Electronic Artifa...
ย 
Peanut leaf spot disease identification using pre-trained deep convolutional...
Peanut leaf spot disease identification using pre-trained deep  convolutional...Peanut leaf spot disease identification using pre-trained deep  convolutional...
Peanut leaf spot disease identification using pre-trained deep convolutional...
ย 
USING E-INFRASTRUCTURES FOR BIODIVERSITY CONSERVATION - Module 5
USING E-INFRASTRUCTURES FOR BIODIVERSITY CONSERVATION - Module 5USING E-INFRASTRUCTURES FOR BIODIVERSITY CONSERVATION - Module 5
USING E-INFRASTRUCTURES FOR BIODIVERSITY CONSERVATION - Module 5
ย 
Building on iMarine for fostering Innovation, Decision making, Governance and...
Building on iMarine for fostering Innovation, Decision making, Governance and...Building on iMarine for fostering Innovation, Decision making, Governance and...
Building on iMarine for fostering Innovation, Decision making, Governance and...
ย 
IFPRI - NAIP - Experiences about the Training Programs - Nachiket Kotwaliwale
IFPRI - NAIP  - Experiences about the Training Programs - Nachiket KotwaliwaleIFPRI - NAIP  - Experiences about the Training Programs - Nachiket Kotwaliwale
IFPRI - NAIP - Experiences about the Training Programs - Nachiket Kotwaliwale
ย 
G44083642
G44083642G44083642
G44083642
ย 
Blue Skills
Blue SkillsBlue Skills
Blue Skills
ย 
Detection of Aedes aegypti larvae using single shot multibox detector with tr...
Detection of Aedes aegypti larvae using single shot multibox detector with tr...Detection of Aedes aegypti larvae using single shot multibox detector with tr...
Detection of Aedes aegypti larvae using single shot multibox detector with tr...
ย 
Modified Child Rescue System against Open Borewell
Modified Child Rescue System against Open BorewellModified Child Rescue System against Open Borewell
Modified Child Rescue System against Open Borewell
ย 
Classification of neovascularization using convolutional neural network model
Classification of neovascularization using convolutional neural network modelClassification of neovascularization using convolutional neural network model
Classification of neovascularization using convolutional neural network model
ย 
Intelligent aquaculture system for pisciculture simulation using deep learnin...
Intelligent aquaculture system for pisciculture simulation using deep learnin...Intelligent aquaculture system for pisciculture simulation using deep learnin...
Intelligent aquaculture system for pisciculture simulation using deep learnin...
ย 
Quarantine and surveillance modelling for horticulture biosecurity threats
Quarantine and surveillance modelling for horticulture biosecurity threatsQuarantine and surveillance modelling for horticulture biosecurity threats
Quarantine and surveillance modelling for horticulture biosecurity threats
ย 
Detection of diseases in rice leaf using convolutional neural network with tr...
Detection of diseases in rice leaf using convolutional neural network with tr...Detection of diseases in rice leaf using convolutional neural network with tr...
Detection of diseases in rice leaf using convolutional neural network with tr...
ย 
PLANT LEAF DISEASE CLASSIFICATION USING CNN
PLANT LEAF DISEASE CLASSIFICATION USING CNNPLANT LEAF DISEASE CLASSIFICATION USING CNN
PLANT LEAF DISEASE CLASSIFICATION USING CNN
ย 

More from CSITiaesprime

Hybrid model for detection of brain tumor using convolution neural networks
Hybrid model for detection of brain tumor using convolution neural networksHybrid model for detection of brain tumor using convolution neural networks
Hybrid model for detection of brain tumor using convolution neural networksCSITiaesprime
ย 
Implementing lee's model to apply fuzzy time series in forecasting bitcoin price
Implementing lee's model to apply fuzzy time series in forecasting bitcoin priceImplementing lee's model to apply fuzzy time series in forecasting bitcoin price
Implementing lee's model to apply fuzzy time series in forecasting bitcoin priceCSITiaesprime
ย 
Sentiment analysis of online licensing service quality in the energy and mine...
Sentiment analysis of online licensing service quality in the energy and mine...Sentiment analysis of online licensing service quality in the energy and mine...
Sentiment analysis of online licensing service quality in the energy and mine...CSITiaesprime
ย 
Trends in sentiment of Twitter users towards Indonesian tourism: analysis wit...
Trends in sentiment of Twitter users towards Indonesian tourism: analysis wit...Trends in sentiment of Twitter users towards Indonesian tourism: analysis wit...
Trends in sentiment of Twitter users towards Indonesian tourism: analysis wit...CSITiaesprime
ย 
The impact of usability in information technology projects
The impact of usability in information technology projectsThe impact of usability in information technology projects
The impact of usability in information technology projectsCSITiaesprime
ย 
Collecting and analyzing network-based evidence
Collecting and analyzing network-based evidenceCollecting and analyzing network-based evidence
Collecting and analyzing network-based evidenceCSITiaesprime
ย 
Agile adoption challenges in insurance: a systematic literature and expert re...
Agile adoption challenges in insurance: a systematic literature and expert re...Agile adoption challenges in insurance: a systematic literature and expert re...
Agile adoption challenges in insurance: a systematic literature and expert re...CSITiaesprime
ย 
Exploring network security threats through text mining techniques: a comprehe...
Exploring network security threats through text mining techniques: a comprehe...Exploring network security threats through text mining techniques: a comprehe...
Exploring network security threats through text mining techniques: a comprehe...CSITiaesprime
ย 
An LSTM-based prediction model for gradient-descending optimization in virtua...
An LSTM-based prediction model for gradient-descending optimization in virtua...An LSTM-based prediction model for gradient-descending optimization in virtua...
An LSTM-based prediction model for gradient-descending optimization in virtua...CSITiaesprime
ย 
Generalization of linear and non-linear support vector machine in multiple fi...
Generalization of linear and non-linear support vector machine in multiple fi...Generalization of linear and non-linear support vector machine in multiple fi...
Generalization of linear and non-linear support vector machine in multiple fi...CSITiaesprime
ย 
Designing a framework for blockchain-based e-voting system for Libya
Designing a framework for blockchain-based e-voting system for LibyaDesigning a framework for blockchain-based e-voting system for Libya
Designing a framework for blockchain-based e-voting system for LibyaCSITiaesprime
ย 
Development reference model to build management reporter using dynamics great...
Development reference model to build management reporter using dynamics great...Development reference model to build management reporter using dynamics great...
Development reference model to build management reporter using dynamics great...CSITiaesprime
ย 
Social media and optimization of the promotion of Lake Toba tourism destinati...
Social media and optimization of the promotion of Lake Toba tourism destinati...Social media and optimization of the promotion of Lake Toba tourism destinati...
Social media and optimization of the promotion of Lake Toba tourism destinati...CSITiaesprime
ย 
Caring jacket: health monitoring jacket integrated with the internet of thing...
Caring jacket: health monitoring jacket integrated with the internet of thing...Caring jacket: health monitoring jacket integrated with the internet of thing...
Caring jacket: health monitoring jacket integrated with the internet of thing...CSITiaesprime
ย 
Net impact implementation application development life-cycle management in ba...
Net impact implementation application development life-cycle management in ba...Net impact implementation application development life-cycle management in ba...
Net impact implementation application development life-cycle management in ba...CSITiaesprime
ย 
Circularly polarized metamaterial Antenna in energy harvesting wearable commu...
Circularly polarized metamaterial Antenna in energy harvesting wearable commu...Circularly polarized metamaterial Antenna in energy harvesting wearable commu...
Circularly polarized metamaterial Antenna in energy harvesting wearable commu...CSITiaesprime
ย 
An ensemble approach for the identification and classification of crime tweet...
An ensemble approach for the identification and classification of crime tweet...An ensemble approach for the identification and classification of crime tweet...
An ensemble approach for the identification and classification of crime tweet...CSITiaesprime
ย 
National archival platform system design using the microservice-based service...
National archival platform system design using the microservice-based service...National archival platform system design using the microservice-based service...
National archival platform system design using the microservice-based service...CSITiaesprime
ย 
Antispoofing in face biometrics: A comprehensive study on software-based tech...
Antispoofing in face biometrics: A comprehensive study on software-based tech...Antispoofing in face biometrics: A comprehensive study on software-based tech...
Antispoofing in face biometrics: A comprehensive study on software-based tech...CSITiaesprime
ย 
The antecedent e-government quality for public behaviour intention, and exten...
The antecedent e-government quality for public behaviour intention, and exten...The antecedent e-government quality for public behaviour intention, and exten...
The antecedent e-government quality for public behaviour intention, and exten...CSITiaesprime
ย 

More from CSITiaesprime (20)

Hybrid model for detection of brain tumor using convolution neural networks
Hybrid model for detection of brain tumor using convolution neural networksHybrid model for detection of brain tumor using convolution neural networks
Hybrid model for detection of brain tumor using convolution neural networks
ย 
Implementing lee's model to apply fuzzy time series in forecasting bitcoin price
Implementing lee's model to apply fuzzy time series in forecasting bitcoin priceImplementing lee's model to apply fuzzy time series in forecasting bitcoin price
Implementing lee's model to apply fuzzy time series in forecasting bitcoin price
ย 
Sentiment analysis of online licensing service quality in the energy and mine...
Sentiment analysis of online licensing service quality in the energy and mine...Sentiment analysis of online licensing service quality in the energy and mine...
Sentiment analysis of online licensing service quality in the energy and mine...
ย 
Trends in sentiment of Twitter users towards Indonesian tourism: analysis wit...
Trends in sentiment of Twitter users towards Indonesian tourism: analysis wit...Trends in sentiment of Twitter users towards Indonesian tourism: analysis wit...
Trends in sentiment of Twitter users towards Indonesian tourism: analysis wit...
ย 
The impact of usability in information technology projects
The impact of usability in information technology projectsThe impact of usability in information technology projects
The impact of usability in information technology projects
ย 
Collecting and analyzing network-based evidence
Collecting and analyzing network-based evidenceCollecting and analyzing network-based evidence
Collecting and analyzing network-based evidence
ย 
Agile adoption challenges in insurance: a systematic literature and expert re...
Agile adoption challenges in insurance: a systematic literature and expert re...Agile adoption challenges in insurance: a systematic literature and expert re...
Agile adoption challenges in insurance: a systematic literature and expert re...
ย 
Exploring network security threats through text mining techniques: a comprehe...
Exploring network security threats through text mining techniques: a comprehe...Exploring network security threats through text mining techniques: a comprehe...
Exploring network security threats through text mining techniques: a comprehe...
ย 
An LSTM-based prediction model for gradient-descending optimization in virtua...
An LSTM-based prediction model for gradient-descending optimization in virtua...An LSTM-based prediction model for gradient-descending optimization in virtua...
An LSTM-based prediction model for gradient-descending optimization in virtua...
ย 
Generalization of linear and non-linear support vector machine in multiple fi...
Generalization of linear and non-linear support vector machine in multiple fi...Generalization of linear and non-linear support vector machine in multiple fi...
Generalization of linear and non-linear support vector machine in multiple fi...
ย 
Designing a framework for blockchain-based e-voting system for Libya
Designing a framework for blockchain-based e-voting system for LibyaDesigning a framework for blockchain-based e-voting system for Libya
Designing a framework for blockchain-based e-voting system for Libya
ย 
Development reference model to build management reporter using dynamics great...
Development reference model to build management reporter using dynamics great...Development reference model to build management reporter using dynamics great...
Development reference model to build management reporter using dynamics great...
ย 
Social media and optimization of the promotion of Lake Toba tourism destinati...
Social media and optimization of the promotion of Lake Toba tourism destinati...Social media and optimization of the promotion of Lake Toba tourism destinati...
Social media and optimization of the promotion of Lake Toba tourism destinati...
ย 
Caring jacket: health monitoring jacket integrated with the internet of thing...
Caring jacket: health monitoring jacket integrated with the internet of thing...Caring jacket: health monitoring jacket integrated with the internet of thing...
Caring jacket: health monitoring jacket integrated with the internet of thing...
ย 
Net impact implementation application development life-cycle management in ba...
Net impact implementation application development life-cycle management in ba...Net impact implementation application development life-cycle management in ba...
Net impact implementation application development life-cycle management in ba...
ย 
Circularly polarized metamaterial Antenna in energy harvesting wearable commu...
Circularly polarized metamaterial Antenna in energy harvesting wearable commu...Circularly polarized metamaterial Antenna in energy harvesting wearable commu...
Circularly polarized metamaterial Antenna in energy harvesting wearable commu...
ย 
An ensemble approach for the identification and classification of crime tweet...
An ensemble approach for the identification and classification of crime tweet...An ensemble approach for the identification and classification of crime tweet...
An ensemble approach for the identification and classification of crime tweet...
ย 
National archival platform system design using the microservice-based service...
National archival platform system design using the microservice-based service...National archival platform system design using the microservice-based service...
National archival platform system design using the microservice-based service...
ย 
Antispoofing in face biometrics: A comprehensive study on software-based tech...
Antispoofing in face biometrics: A comprehensive study on software-based tech...Antispoofing in face biometrics: A comprehensive study on software-based tech...
Antispoofing in face biometrics: A comprehensive study on software-based tech...
ย 
The antecedent e-government quality for public behaviour intention, and exten...
The antecedent e-government quality for public behaviour intention, and exten...The antecedent e-government quality for public behaviour intention, and exten...
The antecedent e-government quality for public behaviour intention, and exten...
ย 

Recently uploaded

08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking MenDelhi Call girls
ย 
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptxHampshireHUG
ย 
08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking MenDelhi Call girls
ย 
Understanding the Laravel MVC Architecture
Understanding the Laravel MVC ArchitectureUnderstanding the Laravel MVC Architecture
Understanding the Laravel MVC ArchitecturePixlogix Infotech
ย 
Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...
Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...
Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...HostedbyConfluent
ย 
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...Igalia
ย 
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...Neo4j
ย 
Transcript: #StandardsGoals for 2024: Whatโ€™s new for BISAC - Tech Forum 2024
Transcript: #StandardsGoals for 2024: Whatโ€™s new for BISAC - Tech Forum 2024Transcript: #StandardsGoals for 2024: Whatโ€™s new for BISAC - Tech Forum 2024
Transcript: #StandardsGoals for 2024: Whatโ€™s new for BISAC - Tech Forum 2024BookNet Canada
ย 
Kalyanpur ) Call Girls in Lucknow Finest Escorts Service ๐Ÿธ 8923113531 ๐ŸŽฐ Avail...
Kalyanpur ) Call Girls in Lucknow Finest Escorts Service ๐Ÿธ 8923113531 ๐ŸŽฐ Avail...Kalyanpur ) Call Girls in Lucknow Finest Escorts Service ๐Ÿธ 8923113531 ๐ŸŽฐ Avail...
Kalyanpur ) Call Girls in Lucknow Finest Escorts Service ๐Ÿธ 8923113531 ๐ŸŽฐ Avail...gurkirankumar98700
ย 
How to convert PDF to text with Nanonets
How to convert PDF to text with NanonetsHow to convert PDF to text with Nanonets
How to convert PDF to text with Nanonetsnaman860154
ย 
Swan(sea) Song โ€“ personal research during my six years at Swansea ... and bey...
Swan(sea) Song โ€“ personal research during my six years at Swansea ... and bey...Swan(sea) Song โ€“ personal research during my six years at Swansea ... and bey...
Swan(sea) Song โ€“ personal research during my six years at Swansea ... and bey...Alan Dix
ย 
Scaling API-first โ€“ The story of a global engineering organization
Scaling API-first โ€“ The story of a global engineering organizationScaling API-first โ€“ The story of a global engineering organization
Scaling API-first โ€“ The story of a global engineering organizationRadu Cotescu
ย 
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Miguel Araรบjo
ย 
FULL ENJOY ๐Ÿ” 8264348440 ๐Ÿ” Call Girls in Diplomatic Enclave | Delhi
FULL ENJOY ๐Ÿ” 8264348440 ๐Ÿ” Call Girls in Diplomatic Enclave | DelhiFULL ENJOY ๐Ÿ” 8264348440 ๐Ÿ” Call Girls in Diplomatic Enclave | Delhi
FULL ENJOY ๐Ÿ” 8264348440 ๐Ÿ” Call Girls in Diplomatic Enclave | Delhisoniya singh
ย 
GenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationGenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationMichael W. Hawkins
ย 
Google AI Hackathon: LLM based Evaluator for RAG
Google AI Hackathon: LLM based Evaluator for RAGGoogle AI Hackathon: LLM based Evaluator for RAG
Google AI Hackathon: LLM based Evaluator for RAGSujit Pal
ย 
A Call to Action for Generative AI in 2024
A Call to Action for Generative AI in 2024A Call to Action for Generative AI in 2024
A Call to Action for Generative AI in 2024Results
ย 
Finology Group โ€“ Insurtech Innovation Award 2024
Finology Group โ€“ Insurtech Innovation Award 2024Finology Group โ€“ Insurtech Innovation Award 2024
Finology Group โ€“ Insurtech Innovation Award 2024The Digital Insurer
ย 
Injustice - Developers Among Us (SciFiDevCon 2024)
Injustice - Developers Among Us (SciFiDevCon 2024)Injustice - Developers Among Us (SciFiDevCon 2024)
Injustice - Developers Among Us (SciFiDevCon 2024)Allon Mureinik
ย 
Slack Application Development 101 Slides
Slack Application Development 101 SlidesSlack Application Development 101 Slides
Slack Application Development 101 Slidespraypatel2
ย 

Recently uploaded (20)

08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men
ย 
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
ย 
08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men08448380779 Call Girls In Civil Lines Women Seeking Men
08448380779 Call Girls In Civil Lines Women Seeking Men
ย 
Understanding the Laravel MVC Architecture
Understanding the Laravel MVC ArchitectureUnderstanding the Laravel MVC Architecture
Understanding the Laravel MVC Architecture
ย 
Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...
Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...
Transforming Data Streams with Kafka Connect: An Introduction to Single Messa...
ย 
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
ย 
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...
ย 
Transcript: #StandardsGoals for 2024: Whatโ€™s new for BISAC - Tech Forum 2024
Transcript: #StandardsGoals for 2024: Whatโ€™s new for BISAC - Tech Forum 2024Transcript: #StandardsGoals for 2024: Whatโ€™s new for BISAC - Tech Forum 2024
Transcript: #StandardsGoals for 2024: Whatโ€™s new for BISAC - Tech Forum 2024
ย 
Kalyanpur ) Call Girls in Lucknow Finest Escorts Service ๐Ÿธ 8923113531 ๐ŸŽฐ Avail...
Kalyanpur ) Call Girls in Lucknow Finest Escorts Service ๐Ÿธ 8923113531 ๐ŸŽฐ Avail...Kalyanpur ) Call Girls in Lucknow Finest Escorts Service ๐Ÿธ 8923113531 ๐ŸŽฐ Avail...
Kalyanpur ) Call Girls in Lucknow Finest Escorts Service ๐Ÿธ 8923113531 ๐ŸŽฐ Avail...
ย 
How to convert PDF to text with Nanonets
How to convert PDF to text with NanonetsHow to convert PDF to text with Nanonets
How to convert PDF to text with Nanonets
ย 
Swan(sea) Song โ€“ personal research during my six years at Swansea ... and bey...
Swan(sea) Song โ€“ personal research during my six years at Swansea ... and bey...Swan(sea) Song โ€“ personal research during my six years at Swansea ... and bey...
Swan(sea) Song โ€“ personal research during my six years at Swansea ... and bey...
ย 
Scaling API-first โ€“ The story of a global engineering organization
Scaling API-first โ€“ The story of a global engineering organizationScaling API-first โ€“ The story of a global engineering organization
Scaling API-first โ€“ The story of a global engineering organization
ย 
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
ย 
FULL ENJOY ๐Ÿ” 8264348440 ๐Ÿ” Call Girls in Diplomatic Enclave | Delhi
FULL ENJOY ๐Ÿ” 8264348440 ๐Ÿ” Call Girls in Diplomatic Enclave | DelhiFULL ENJOY ๐Ÿ” 8264348440 ๐Ÿ” Call Girls in Diplomatic Enclave | Delhi
FULL ENJOY ๐Ÿ” 8264348440 ๐Ÿ” Call Girls in Diplomatic Enclave | Delhi
ย 
GenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationGenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day Presentation
ย 
Google AI Hackathon: LLM based Evaluator for RAG
Google AI Hackathon: LLM based Evaluator for RAGGoogle AI Hackathon: LLM based Evaluator for RAG
Google AI Hackathon: LLM based Evaluator for RAG
ย 
A Call to Action for Generative AI in 2024
A Call to Action for Generative AI in 2024A Call to Action for Generative AI in 2024
A Call to Action for Generative AI in 2024
ย 
Finology Group โ€“ Insurtech Innovation Award 2024
Finology Group โ€“ Insurtech Innovation Award 2024Finology Group โ€“ Insurtech Innovation Award 2024
Finology Group โ€“ Insurtech Innovation Award 2024
ย 
Injustice - Developers Among Us (SciFiDevCon 2024)
Injustice - Developers Among Us (SciFiDevCon 2024)Injustice - Developers Among Us (SciFiDevCon 2024)
Injustice - Developers Among Us (SciFiDevCon 2024)
ย 
Slack Application Development 101 Slides
Slack Application Development 101 SlidesSlack Application Development 101 Slides
Slack Application Development 101 Slides
ย 

Comparative study of ensemble deep learning models to determine the classification of turtle species

  • 1. Computer Science and Information Technologies Vol. 4, No. 1, March 2023, pp. 24~32 ISSN: 2722-3221, DOI: 10.11591/csit.v4i1.pp24-32 ๏ฒ 24 Journal homepage: http://iaesprime.com/index.php/csit Comparative study of ensemble deep learning models to determine the classification of turtle species Ruvita Faurina1 , Andang Wijanarko2 , Aknia Faza Heryuanti1 , Sahrial Ihsani Ishak3 , Indra Agustian4 1 Informatics Study Program, Faculty of Engineering, Bengkulu University, Bengkulu, Indonesia 2 Information System Study Program, Faculty of Engineering, Bengkulu University, Bengkulu, Indonesia 3 Department of Computer Science, Faculty of Mathematics and Natural Sciences, IPB University, Bogor, Indonesia 4 Department of Electrical Engineering, Bengkulu University, Bengkulu, Indonesia Article Info ABSTRACT Article history: Received Aug 23, 2022 Revised Dec 26, 2022 Accepted Jan 4, 2022 Sea turtles are reptiles listed on the international union for conservation of nature (IUCN) red list of threatened species and the convention on international trade in endangered species of wild fauna and flora (CITES) Appendix I as species threatened with extinction. Sea turtles are nearly extinct due to natural predators and people who are frequently incorrect or even ignorant in determining which turtles should not be caught. The aim of this study was to develop a classification system to help classify sea turtle species. Therefore, the ensemble deep learning of convolutional neural network (CNN) method based on transfer learning is proposed for the classification of turtle species found in coastal communities. In this case, there are five well-known CNN models (VGG-16, ResNet-50, ResNet-152, Inception-V3, and DenseNet201). Among the five different models, the three most successful were selected for the ensemble method. The final result is obtained by combining the predictions of the CNN model with the ensemble method during the test. The evaluation result shows that the VGG16 - DenseNet201 ensemble is the best ensemble model, with accuracy, precision, recall, and F1-Score values of 0.74, 0.75, 0.74, and 0.76, respectively. This result also shows that this ensemble model outperforms the original model. Keywords: Classification Ensemble deep learning Sea turtle Transfer learning This is an open access article under the CC BY-SA license. Corresponding Author: Ruvita Faurina Informatics Study Program, Faculty of Engineering, University of Bengkulu Jl. W.R Supratman, Kandang Limun, Bengkulu 38371, Indonesia Email: ruvita.faurina@unib.ac.id 1. INTRODUCTION Turtles are reptiles that can be easily recognized by their distinctive body shape from the head and carapace or dorsal (back) [1]. There are three main groups of turtles: land turtles, aquatic turtles, and marine turtles. Marine turtles are also known as sea turtles. There are seven species of sea turtles in the world [2]โ€“[5], six of which can be found in Indonesia: green turtles (Chelonia Mydas), hawksbill turtles (Eretmochelys Imbricata), tortoiseshell turtles (Lepidochelys Olivacea), flat turtles (Natator Depressus), leatherback turtles (Dermochelys Coriacea), and loggerhead turtles (Caretta Caretta) [6]. Based on data from the Bengkulu Province Marine and Fisheries Service, it was stated that there were only 4 species that visited the Bengkulu coast, namely green turtles, hawksbill turtles, loggerhead turtles, and olive ridley turtles. Sea turtles are currently threatened with extinction and were added to the list of endangered reptiles on the international union for conservation of nature (IUCN) red list and convention on international trade in endangered species (CITES) Appendix I of species threatened with extinction [7]โ€“[9]. The condition of
  • 2. Comput Sci Inf Technol ISSN: 2722-3221 ๏ฒ Comparative study of ensemble deep learning models to โ€ฆ (Ruvita Faurina) 25 endangered sea turtles is caused by threats from human and animal predators. Humans and predators take turtle eggs as a source of protein, and in traditional rituals, turtle backs are used as accessories [10]. Coastal communities and other communities, in general, are often mistaken and cannot distinguish the types of turtles they find on the coast. This problem is caused by the high similarity between each type of turtle. This high level of similarity is also an obstacle when reporting turtle findings to conservation authorities. Reports of finding turtles that are still handled manually also cause the process of handling and saving turtles to take a long time. This problem hinders conservationists from making semi-natural nests for sea turtles, which results in increased mortality and eggs failing to hatch. Therefore, to reduce illegal fishing and assist in the conservation of sea turtles, technology is needed to classify turtle species. Deep learning is a new and popular classifier technology. Deep learning can manage vast volumes of data. One of the benefits of deep learning is transfer learning, in which the model learnt for one task can be applied to other tasks with limited data [11]โ€“[13]. Deep learning, particularly convolutional neural networks (CNN) inspired by the mammalian visual brain, has the capacity to evaluate and research a huge number of features on its own, including some not previously addressed by experts [14]. Not many studies on the turtle classification system that have been carried out by previous researchers can be found. Several related studies were found: Liu et al. [15] in his research conducted a classification of turtles using deep learning with transfer learning: LeNet, AlexNet, VGG16, VGG16-TL, InceptionV3 and Inception v3-TL based on CNN resulting in an average accuracy of 65.2%, 80.6%, 84.4%, 91.4%, 87.2% and 96.4%. Paixao et al. [16] developed a texture-based classification system for five species of sea turtles found on the coast of Brazil. The method used is k-nearest neighbors (KNN) and support vector machine (SVM) with color histograms and chromaticity moments features. The KNN method is claimed to be better than SVM, with a global accuracy of 0.74. Yussof et al. [17], developed a sea turtle identification system using transfer learning, CNN AlexNet, and SVM. The dataset is sourced from the Biodiversity Research Center, Academia Sinica, Taiwan. The highest level of accuracy of the classification system is 62.9%. Dunbar et al. [18] conducted a study on the practical use of photographic identification (PID) methods to identify sea turtles. PID case studies were conducted to identify sea turtles in Reunion Island (France), Roatan (Honduras), and the Republic of Maldives. The study results show that PID can be an effective and efficient method for gathering information about animals. Different from the studies mentioned above, the learning method used in this study is based on the concept of deep learning training via the well-known and successful use of transfer learning with appropriate pre-trained models [19]. Then combine the power of transfer learning models known as "deep learning ensembles" [20]. In this case, VGG-16 , ResNet-50, InceptionV3, DenseNet201, and Resnet152 [21]. From the training results, it is known that each CNN model has different generalization abilities on the dataset. Based on these observations, the three most successful CNN models, ResNet-50, InceptionV3, and DenseNet201, were selected for the ensemble method. The classification results obtained from the selected CNN model are combined using the ensemble average voting method to reach the final output of the classification. As a result of this ensemble method, satisfactory classification results were obtained. Therefore, this study proposes an ensemble method using three transfer learning models to strengthen the final decision and observes the use of original and augmented data in the model. 2. METHOD This study will be built using the cross-industry standard process for data mining (CRISP-DM) method. Cross-industry standard process for data mining (CRISP-DM) was developed in 1996 by the analysis of several industries such as standardization Daimler Chrysler (Daimler-Benz), statistical package for the social sciences (SPSS), and non-conformance report (NCR). CRISP-DM can be used as a general problem-solving strategy for a business or research unit [22]โ€“[24]. The flow of this method can be seen in Figure 1. The CRISP-DM method begins with the Business Understanding Phase, which is the business understanding phase to determine the direction of research to be carried out. Then proceed with the data understanding phase, which is the data understanding phase for dealing with data needs related to business goals. Furthermore, the data preparation phase is carried out, which is a phase to improve data quality so that the data is in accordance with the modeling process to be carried out. This modeling phase involves the creation of a model, after which the data is ready for the model-based training process. Next is the Evaluation phase, in this phase an evaluation will be carried out on the model in which the iteration is made. The last phase is the deployment phase, in which the model will be implemented on the desired platform.
  • 3. ๏ฒ ISSN: 2722-3221 Comput Sci Inf Technol, Vol. 4, No. 1, March 2023: 24-32 26 Figure 1. CRISP-DM method [24] 2.1. Business understanding Coastal communities and other communities, in general, are often mistaken and cannot distinguish the types of turtles they find on the coast. Reports of turtle weaving that is still manual also cause the process of handling and saving turtles to take a long time. This problem hinders conservation parties from making semi-natural nests, which results in increased mortality and eggs that fail to hatch. To reduce threats and aid conservation, a technology capable of classifying turtle species is required. One of the emerging and popular technologies for classifying is deep learning. Deep learning can perform classification through images or videos. The advantage of deep learning is the ability to transfer learning, which means that the model learned from one task can be reapplied to another task that may have limited data. Transfer learning performance can be improved by combining transfer learning, also known as the "ensemble deep learning model. The deep learning ensemble model generated in this study can be implemented into a web- or mobile-based system to assist the classification and reporting process when the community finds turtles. As a result, this system is expected to help the community and conservation organizations protect turtles by providing access to a system for the classification and reporting of turtle findings that can be accessed via cellphones or personal computers. 2.2. Data understanding This study requires analysis of data needs and data collection carried out in three ways: literature study, observation, and interviews. The dataset used is a turtle image consisting of 4 classes according to the types of turtles that have been validated by experts: green turtles, hawksbill turtles, olive ridley turtles, and loggerhead turtles. Figure 2 depicts an example sea turtle images from the dataset. Figures 2(a) to 2(d) show green turtle (Chelonia mydas), olive ridley (Lepidochelys olivacea), hawksbill turtle (Eretmochelys imbricata), and Loggerhead turtle (Lepidochelys olivacea), in that order. Before data augmentation, the data was generated with different positions of the turtles, specifically when they were on the coast and when they were at sea. (a) (b) (c) (d) Figure 2. Sample image of sea turtles in the dataset: (a) green turtle (Chelonia mydas), (b) olive ridley (Lepidochelys olivacea), (c) hawksbill turtle (Eretmochelys imbricata), (d) Loggerhead turtle (Lepidochelys olivacea)
  • 4. Comput Sci Inf Technol ISSN: 2722-3221 ๏ฒ Comparative study of ensemble deep learning models to โ€ฆ (Ruvita Faurina) 27 The image dataset used in this study consists of a primary dataset and a secondary dataset of images taken from public datasets. The primary dataset of 654 images was collected by the research team at the โ€œKonservasi Penyu Alun Utaraโ€ located in Pekik Nyaring Village, Central Bengkulu Regency, Bengkulu Province, Indonesia. While the secondary dataset of 850 images was taken from Smaranjit Ghose's public dataset on Kaggle [25]. The composition of the dataset is shown in Table 1. Table 1. Dataset composition No Name of Data Number Image Original 1 Green Turtles 376 2 Olive Ridley Turtles 376 3 Loggerhead Turtles 376 4 Hawksbill Turtles 376 Total 1504 2.3. Data preparation At the data preparation stage, the research team resizes, augments and separates the dataset from the data that has been obtained. The image size is resized to 224ร—224 px, then augmented with rotation, noise, brightness, and blur augmentation techniques, and then the dataset is divided into three parts, namely training data, validation data, and test data. Before being divided, the data, especially the distribution of the dataset after processing, are shown in Table 2. The augmentation technique is performed with random values in a range, each of which is rotation: -40 to 40, noise: 1 to 5%, brightness: -25% to +25. %, blur: 1 to 5 px. The distribution of the dataset after the process is shown in Table 2. Table 2. Split dataset No Name of Data Number Image Original 1 Training 70% of the total = 4228 2 Validation 20% of the total = 1208 3 Test 10% of the total = 580 Total 6016 2.4. Modeling The ensemble deep learning that will be carried out in this study will use the average voting strategy. The average vote will take the probabilities made for each data point in the average. In this method, the ensemble classifier system takes the average of the predictions from all the models and uses it to make the final prediction. At this stage, we will simulate the ensemble deep learning by adjusting the parameters to produce the best model. The parameters needed to be set in the model training process are input, batch size, epoch, sea turtle dataset, hyperparameter, and weight evaluation. The same parameter properties are applied to five types of transfer learning: InceptionV3, DenseNet, VGG16, ResNet50, and ResNet152. Three of the five models will be selected, which are good for an ensemble model. Details of the design stages of the sea turtleโ€™s classification model are shown in Figure 3. From the detailed steps in Figure 3, it can be seen that the training dataset is trained and validated using transfer learning with the InceptionV3, DenseNet, VGG16, ResNet50, and ResNet152 architectures. A test dataset is used to evaluate the performance of each architecture's output model. The average vote of the three best models was taken based on the performance of the validation and evaluation of the test dataset to be used as the final ensemble model for the classification system of the turtle. In the training process, the initial weights of the pre-trained model used have been trained with the ImageNet dataset; the only layer taken is the feature extraction layer, while the last dense layer is replaced with a fully connected layer for the sea turtle classifier. The training process is evaluated based on data loss and accuracy in the training and validation datasets, as well as the values of precision, recall, and TF1 score. Five well-known CNN architectures (InceptionV3, DenseNet, VGG16, ResNet50, and ResNet152) were trained in the study with a batch size of 16 and a learning rate of 0.0001. We trained models with the same epoch size (300 epoch). The callbacks list method will save accuracy for the training model. Adam was used as the optimization function to minimize the categorical cross-entropy loss function. The softmax activation function was used in the last layer for classification. Early stopping was utilized to overcome overfitting in models. All experiments were carried out on a Windows-based PC with 4 GB of RAM, a 4 GB hard drive, and a 256-bit Nvidia Core i5 graphics card. The computer languages Python and the keras module
  • 5. ๏ฒ ISSN: 2722-3221 Comput Sci Inf Technol, Vol. 4, No. 1, March 2023: 24-32 28 are utilized in the software development process. The three most successful CNN models were chosen for the ensemble approach from among the five. Figure 3. Model deep learning 2.5. Evaluation The performance of the classification model is evaluated based on precision, recall, accuracy, and F1 Score. These metrics are calculated based on true positive (TP), true negative (TN), false positive (FP), and false negative (FN) data from the confusion matrix based on (1)-(4). TP is the number of true positive predictions, TN is the number of true negative predictions, FP is the number of false positive predictions, and FN is the number of false negative predictions [26]โ€“[28]. ๐‘ƒ๐‘Ÿ๐‘’๐‘๐‘–๐‘ ๐‘–๐‘œ๐‘› = ๐‘‡๐‘ƒ ๐‘‡๐‘ƒ+๐น๐‘ƒ (1) ๐‘…๐‘’๐‘๐‘Ž๐‘™๐‘™ = ๐‘‡๐‘ƒ ๐‘‡๐‘ƒ+๐น๐‘ (2) ๐ด๐‘๐‘๐‘ข๐‘Ÿ๐‘Ž๐‘๐‘ฆ = ๐‘‡๐‘ƒ+๐‘‡๐‘ ๐‘‡๐‘ƒ+๐น๐‘+๐‘‡๐‘+๐น๐‘ƒ (3) ๐น1 ๐‘†๐‘๐‘œ๐‘Ÿ๐‘’ = 2 ร— ๐‘Ÿ๐‘’๐‘๐‘Ž๐‘™๐‘™ร—๐‘๐‘Ÿ๐‘’๐‘๐‘–๐‘ ๐‘–๐‘œ๐‘› ๐‘Ÿ๐‘’๐‘๐‘Ž๐‘™๐‘™+๐‘๐‘Ÿ๐‘’๐‘๐‘–๐‘ ๐‘–๐‘œ๐‘› (4) 3. RESULTS AND DISCUSSION The evaluation metrics results for the trained models of InceptionV3, DenseNet, VGG16, ResNet50, and ResNet152 in this study are shown in Table 3. It can be seen that the three best models are InceptionV3, DenseNet201, and VGG16. Example of train-validation loss and accuracy graphs of the DenseNet201 are shown in Figure 4 and Figure 5. In the figure, it can be seen that the loss and accuracy of the DenseNet201
  • 6. Comput Sci Inf Technol ISSN: 2722-3221 ๏ฒ Comparative study of ensemble deep learning models to โ€ฆ (Ruvita Faurina) 29 model in the training process are approaching convergence above 25 epochs. The other models also started to converge around 25 epochs. Table 3. Evaluation metrics for the trained models of the sea turtle classifier No Models Accuracy Precison Recall F1-Score 1 InceptionV3 0.60 0.58 0.60 0.56 2 DenseNet201 0.70 0.76 0.70 0.70 3 VGG16 0.69 0.71 0.69 0.68 4 Resnet50 0.29 0.14 0.29 0.19 5 Resnet152 0.40 0.44 0.40 0.39 Figure 4. InceptionV3 train and validation loss Figure 5. InceptionV3 train and validation accuracy The ensemble model is composed of the three best models: Ensemble InceptionV3 - VGG16, Ensemble InceptionV3 - DenseNet201, VGG16 - DenseNet201, and Ensemble InceptionV3 - DenseNet201 - VGG16. The evaluation metrics for the ensemble models are shown in Table 4. It shows that the best ensemble model is VGG16 - DenseNet201 with accuracy, precision, recall, and F1-Score of 0.74, 0.75, 0.74, and 0.76, respectively. The ensemble model shows a significant performance improvement over the original models.
  • 7. ๏ฒ ISSN: 2722-3221 Comput Sci Inf Technol, Vol. 4, No. 1, March 2023: 24-32 30 Table 4. Evaluation metrics for the ensemble trained models of the sea turtle classifier No Ensemble Models Accuracy Precision Recall F1-Score 1 InceptionV3 - VGG16 0.70 0.71 0.70 0.69 2 InceptionV3 - DenseNet201 0.72 0.75 0.72 0.72 3 VGG16 - DenseNet201 0.74 0.75 0.74 0.76 4 InceptionV3 - DenseNet201 - VGG16 0.70 0.72 0.70 0.70 Table 5 shows the comparison of the performance of the VGG16 - DenseNet201 ensemble model with the original model (VGG16 and DenseNet201) for each class; in this case, only precision, recall and F1- Score were observed. It can be seen that the model ensemble shows better performance. Evaluation metrics increased for all classes except for the green turtles class, the ensemble model experienced a decrease in precision compared to the VGG16 model and a decrease in recall compared to the DenseNet201 model. It can be said that the ensemble model as a whole has a better classification performance for all performance classes compared to the original model. Table 5. Comparison transfer learning VGG16, DenseNet201 (D201), and ensemble model (EM) Sea Turtles Precision Recall F1-Score D201 VGG16 EM D201 VGG EM D201 VGG EM Green Turtles 0.54 0.71 0.65 0.83 0.37 0.76 0.65 0.48 0.70 Olive Ridley Turtles 0.81 0.79 0.84 0.84 0.86 0.86 0.84 0.83 0.85 Loggerhead Turtles 0.50 0.71 0.81 0.47 0.67 0.57 0.62 0.69 0.67 Hawksbill Turtles 0.52 0.58 0.71 0.56 0.88 0.74 0.60 0.70 0.72 4. CONCLUSION In this study, a deep learning ensemble CNN-based marine turtle classification model was developed. The ensemble model was selected from the InceptionV3, DenseNet, VGG16, ResNet50, and ResNet152 architectures. Based on individual model evaluation, it was found that the three best models are InceptionV3, DenseNet201, and VGG16. The ensemble model is composed of the three best models from individual evaluation: InceptionV3 - VGG16, InceptionV3 - DenseNet201, VGG16 - DenseNet201, and InceptionV3 - DenseNet201 - VGG16. VGG16 - DenseNet201 is the best ensemble model obtained, with accuracy, precision, recall, and F1-Score values of 0.74, 0.75, 0.74, and 0.76, respectively. The result shows that the ensemble model outperforms the original models. Based on the performance of the classifier for each class prediction, all evaluation metrics show an improvement except for the green turtles class. The VGG16 precision for the green turtles class decreased to 0.65 from 0.71 and the DenseNet201 recall decreased to 0.76 from 0.83, but there was still some improvement at F1-Score from 0.65 to 0.70. Overall, this study shows that the ensemble method can improve classification performance better than the individual model. ACKNOWLEDGEMENTS This research was funded by the University of Bengkulu through a fundamental research scheme with contract No. 2015/UN30.15/PP/2022. This research also received non-financial support from Alun Utara Turtle Conservation, Central Bengkulu Regency, Bengkulu Province, Indonesia. REFERENCES [1] R. W. Ibrahim, โ€œConformal geometry of the turtle shell,โ€ Journal of King Saud University - Science, vol. 32, no. 3, pp. 2202โ€“ 2206, 2020, doi: 10.1016/j.jksus.2020.02.024. [2] J. U. Van Dyke, R. J. Spencer, M. B. Thompson, B. Chessman, K. Howard, and A. Georges, โ€œConservation implications of turtle declines in Australiaโ€™s Murray River system,โ€ Scientific Reports, vol. 9, no. 1, 2019, doi: 10.1038/s41598-019-39096-3. [3] H. Barrios-Garrido, T. Shimada, A. Diedrich, and M. Hamann, โ€œConservation and enforcement capacity index (CECi): Integrating human development, economy, and marine turtle status,โ€ Journal of Environmental Management, vol. 262, 2020, doi: 10.1016/j.jenvman.2020.110311. [4] M. Matiddi et al., โ€œLoggerhead sea turtles (Caretta caretta): A target species for monitoring litter ingested by marine organisms in the Mediterranean Sea,โ€ Environmental Pollution, vol. 230, pp. 199โ€“209, 2017, doi: 10.1016/j.envpol.2017.06.054. [5] J. E. Moore et al., โ€œAn interview-based approach to assess marine mammal and sea turtle captures in artisanal fisheries,โ€ Biological Conservation, vol. 143, no. 3, pp. 795โ€“805, 2010, doi: 10.1016/j.biocon.2009.12.023. [6] R. F. Tapilatu, H. Wona, and R. H. S. Siburian, โ€œData on environmental contaminants in sea turtle eggs at Venu Island, Kaimana โ€“ West Papua, Indonesia,โ€ Data in Brief, vol. 31, 2020, doi: 10.1016/j.dib.2020.105778. [7] M. H. Mohd Salleh, Y. Esa, S. M. Salleh, and S. A. Mohd Sah, โ€œTurtles in Malaysia: A review of conservation status and a call for research,โ€ Animals, vol. 12, no. 17, 2022, doi: 10.3390/ani12172184. [8] Sunarto et al., โ€œA geomorphological evaluation of sea turtles nesting in the southern sea of West Java,โ€ IOP Conference Series:
  • 8. Comput Sci Inf Technol ISSN: 2722-3221 ๏ฒ Comparative study of ensemble deep learning models to โ€ฆ (Ruvita Faurina) 31 Earth and Environmental Science, vol. 256, no. 1, 2019, doi: 10.1088/1755-1315/256/1/012028. [9] B. Nahill, โ€œSea turtle research and conservation. lesson from working in the field,โ€ Academic Press, p. 244/207, 2020. [10] L. Cรกceres-Farias, E. Resรฉndiz, J. Espinoza, H. Fernรกndez-Sanz, and A. Alfaro-Nรบรฑez, โ€œThreats and vulnerabilities for the globally distributed Olive Ridley (Lepidochelys olivacea) sea turtle: A historical and current status evaluation,โ€ Animals, vol. 12, no. 14, 2022, doi: 10.3390/ani12141837. [11] A. Gulli and S. Pal, โ€œDeep learning with Keras: Beginners guide to deep learning with Keras,โ€ Packt Publishing Ltd, p. 318, 2017, [Online]. Available: https://www.packtpub.com/big-data-and-business-intelligence/deep-learning-keras. [12] J. Heaton, โ€œIan Goodfellow, Yoshua Bengio, and Aaron Courville: Deep learning,โ€ Genetic Programming and Evolvable Machines, vol. 19, no. 1โ€“2, pp. 305โ€“307, 2018, doi: 10.1007/s10710-017-9314-z. [13] Y. Bengio, Y. Lecun, and G. Hinton, โ€œDeep learning for AI,โ€ Communications of the ACM, vol. 64, no. 7, pp. 58โ€“65, 2021, doi: 10.1145/3448250. [14] A. Bakhshi, S. Chalup, and N. Noman, โ€œFast evolution of CNN architecture for image classification,โ€ Natural Computing Series, pp. 209โ€“229, 2020, doi: 10.1007/978-981-15-3685-4_8. [15] J. Liu, M. Wang, L. Bao, X. Li, J. Sun, and Y. Ming, โ€œClassification and recognition of turtle images based on convolutional neural network,โ€ IOP Conference Series: Materials Science and Engineering, vol. 782, no. 5, 2020, doi: 10.1088/1757- 899X/782/5/052044. [16] W. R. da Paixao, T. M. Paixao, M. C. B. da Costa, J. O. Andrade, F. G. Pereira, and K. S. Komati, โ€œTexture classification of sea turtle shell based on color features: Color histograms and chromaticity moments,โ€ International Journal of Artificial Intelligence & Applications, vol. 9, no. 2, pp. 55โ€“67, 2018, doi: 10.5121/ijaia.2018.9205. [17] W. N. J. Hj Wan Yussof, N. Shaharudin, M. S. Hitam, E. A. Awalludin, M. U. Rusli, and D. Z. Hoh, โ€œPhoto identification of sea turtles using alexnet and multi-class SVM,โ€ Frontiers in Artificial Intelligence and Applications, vol. 327, pp. 23โ€“31, 2020, doi: 10.3233/FAIA200549. [18] S. G. Dunbar, J. Hudgins, and C. Jean, โ€œApplications of photo identification in sea turtle studies,โ€ Sea Turtle Research and Conservation: Lessons From Working In The Field, pp. 45โ€“55, 2020, doi: 10.1016/B978-0-12-821029-1.00005-2. [19] M. Hussain, J. J. Bird, and D. R. Faria, โ€œA study on CNN transfer learning for image classification,โ€ Advances in Intelligent Systems and Computing, vol. 840, pp. 191โ€“202, 2019, doi: 10.1007/978-3-319-97982-3_16. [20] Y. Cao, T. A. Geddes, J. Y. H. Yang, and P. Yang, โ€œEnsemble deep learning in bioinformatics,โ€ Nature Machine Intelligence, vol. 2, no. 9, pp. 500โ€“508, 2020, doi: 10.1038/s42256-020-0217-y. [21] L. Alzubaidi et al., โ€œReview of deep learning: concepts, CNN architectures, challenges, applications, future directions,โ€ Journal of Big Data, vol. 8, no. 1, 2021, doi: 10.1186/s40537-021-00444-8. [22] C. Schrรถer, F. Kruse, and J. M. Gรณmez, โ€œA systematic literature review on applying CRISP-DM process model,โ€ Procedia Computer Science, vol. 181, pp. 526โ€“534, 2021, doi: 10.1016/j.procs.2021.01.199. [23] F. Martinez-Plumed et al., โ€œCRISP-DM twenty years later: From data mining processes to data science trajectories,โ€ IEEE Transactions on Knowledge and Data Engineering, vol. 33, no. 8, pp. 3048โ€“3061, 2021, doi: 10.1109/TKDE.2019.2962680. [24] IBM, โ€œIBM documentation,โ€ 2021, [Online]. Available: https://www.ibm.com/docs/en/spss-modeler/saas?topic=dm-crisp-help- overview. [25] S. Ghose, โ€œSea turtle face detection,โ€ 2022, [Online]. Available: https://www.kaggle.com/datasets/smaranjitghose/sea-turtle-face- detection. [26] C. Goutte and E. Gaussier, โ€œA probabilistic interpretation of precision, recall and f-score, with implication for evaluation,โ€ Lecture Notes in Computer Science, vol. 3408, pp. 345โ€“359, 2005, doi: 10.1007/978-3-540-31865-1_25. [27] C. Ferri, J. Hernรกndez-Orallo, and R. Modroiu, โ€œAn experimental comparison of performance measures for classification,โ€ Pattern Recognition Letters, vol. 30, no. 1, pp. 27โ€“38, 2009, doi: 10.1016/j.patrec.2008.08.010. [28] ลฝ. Vujoviฤ‡, โ€œClassification model evaluation metrics,โ€ International Journal of Advanced Computer Science and Applications, vol. 12, no. 6, pp. 599โ€“606, 2021, doi: 10.14569/IJACSA.2021.0120670. BIOGRAPHIES OF AUTHORS Ruvita Faurina received the S.T. degree in informatics from University of Bengkulu, Indonesia and the M.Eng. degree in electrical engineering and information technology from University of Gadjah Mada, Indonesia, respectively. Currently, she is an Assistant Professor at the Department of Informatics, University of Bengkulu. Her research interests include artificial intelligence, natural language processing, image captioning and attention mechanism. She can be contacted at email: ruvita.faurina@unib.ac.id Andang Wijanarko received the S.Kom. degree in information system and the M.Kom. degree in informatics from Universitas Amikom Yogyakarta. Currently, he is an Assistant Professor at the Department of information system, University of Bengkulu. His research interests include artificial intelligence, multimeda, UI/UX design, mobile and website development. He can be contacted at email: andang@unib.ac.id
  • 9. ๏ฒ ISSN: 2722-3221 Comput Sci Inf Technol, Vol. 4, No. 1, March 2023: 24-32 32 Aknia Faza Heryuanti currently is an undergraduate student in department of Informatics, University of Bengkulu. Her research includes Artificial intelligence. She can be contacted at email: akniaheryuanti@gmail.com Sahrial Ihsani Ishak received the S.Kom. degree in informatics from the department of informatics at the University of Bengkulu, Indonesia. Currently, he is a graduate student in the Department of Computer Science, Faculty of Mathematics and Natural Sciences, IPB University, Indonesia. His research interests include artificial intelligence. He can be contacted at email: sahrialishak@gmail.com Indra Agustian received the S.T. and M.Eng. degrees in electrical engineering from University of Gadjah Mada, Indonesia. Currently, he is an Assistant Professor at the Department of Electrical Engineering, University of Bengkulu, Indonesia. His research interests include control engineering, robotics and artificial intelligence, He can be contacted at email: indraagustian@unib.ac.id