This document summarizes research comparing three machine learning classification methods - Decision Tree, Support Vector Machine (SVM), and k-Nearest Neighbors (k-NN) - for classifying land use from high and low resolution satellite imagery. The researchers applied each method to classify Pleiades satellite images of Taiwan and Colorado. SVM achieved the highest overall accuracy of 78.6% for high resolution imagery and 83.3% for low resolution imagery. Decision Trees and k-NN were less accurate. The document outlines the methodology, including image preprocessing, parameter selection, accuracy assessment, and findings.
Basic Introduction about Image Restoration (Order Statistics Filters)
Median Filter
Max and Min Filter
MidPoint Filter
Alpha-trimmed Mean filter.
and Brief Introduction to Periodic Noise
Any Question contact kalyan.acharjya@gmail.com
In computer science, digital image processing is the use of computer algorithms to perform image processing on digital images. As a subcategory or field of digital signal processing, digital image processing has many advantages over analog image processing.It allows a much wider range of algorithms to be applied to the input data and can avoid problems such as the build-up of noise and signal ...
digital image processing pdf
digital image processing books
digital image processing textbook pdf
digital image processing textbook
digital image processing pdf book
digital image processing gonzalez pdf
digital image processing 4th pdf
digital image processing 3rd pdf
digital image processing slides
history of image processing
digital image processing third edition
digital image processing pdf
digital image processing gonzalez ppt
digital image processing 3rd edition pdf
digital image processing third edition pdf
image processing basics
Basic Introduction about Image Restoration (Order Statistics Filters)
Median Filter
Max and Min Filter
MidPoint Filter
Alpha-trimmed Mean filter.
and Brief Introduction to Periodic Noise
Any Question contact kalyan.acharjya@gmail.com
In computer science, digital image processing is the use of computer algorithms to perform image processing on digital images. As a subcategory or field of digital signal processing, digital image processing has many advantages over analog image processing.It allows a much wider range of algorithms to be applied to the input data and can avoid problems such as the build-up of noise and signal ...
digital image processing pdf
digital image processing books
digital image processing textbook pdf
digital image processing textbook
digital image processing pdf book
digital image processing gonzalez pdf
digital image processing 4th pdf
digital image processing 3rd pdf
digital image processing slides
history of image processing
digital image processing third edition
digital image processing pdf
digital image processing gonzalez ppt
digital image processing 3rd edition pdf
digital image processing third edition pdf
image processing basics
Image Enhancement: Introduction to Spatial Filters, Low Pass Filter and High Pass Filters. Here Discussed Image Smoothing and Image Sharping, Gaussian Filters
Object Classification of Satellite Images Using Cluster Repulsion Based Kerne...IOSR Journals
Abstract: We investigated the Classification of satellite images and multispectral remote sensing data .we
focused on uncertainty analysis in the produced land-cover maps .we proposed an efficient technique for
classifying the multispectral satellite images using Support Vector Machine (SVM) into road area, building area
and green area. We carried out classification in three modules namely (a) Preprocessing using Gaussian
filtering and conversion from conversion of RGB to Lab color space image (b) object segmentation using
proposed Cluster repulsion based kernel Fuzzy C- Means (FCM) and (c) classification using one-to-many SVM
classifier. The goal of this research is to provide the efficiency in classification of satellite images using the
object-based image analysis. The proposed work is evaluated using the satellite images and the accuracy of the
proposed work is compared to FCM based classification. The results showed that the proposed technique has
achieved better results reaching an accuracy of 79%, 84%, 81% and 97.9% for road, tree, building and vehicle
classification respectively.
Keywords:-Satellite image, FCM Clustering, Classification, SVM classifier.
Comparison of Segmentation Algorithms and Estimation of Optimal Segmentation ...Pinaki Ranjan Sarkar
Recent advancement in sensor technology allows very high spatial resolution along with multiple spectral bands. There are many studies, which highlight that Object Based Image Analysis(OBIA) is more accurate than pixel-based classification for high resolution(< 2m) imagery. Image segmentation is a crucial step for OBIA and it is a very formidable task to estimate optimal parameters for segmentation as it does not have any unique solution. In this paper, we have studied different segmentation algorithms (both mono-scale and multi-scale) for different terrain categories and showed how the segmented output depends on upon various parameters. Later, we have introduced a novel method to estimate optimal segmentation parameters. The main objectives of this study are to highlight the effectiveness of presently available segmentation techniques on very high-resolution satellite data and to automate segmentation process. Pre-estimation of segmentation parameter is more practical and efficient in OBIA. Assessment of segmentation algorithms and estimation of segmentation parameters are examined based on the very high-resolution multi-spectral WorldView-3(0.3m, PAN sharpened) data.
Image Enhancement: Introduction to Spatial Filters, Low Pass Filter and High Pass Filters. Here Discussed Image Smoothing and Image Sharping, Gaussian Filters
Object Classification of Satellite Images Using Cluster Repulsion Based Kerne...IOSR Journals
Abstract: We investigated the Classification of satellite images and multispectral remote sensing data .we
focused on uncertainty analysis in the produced land-cover maps .we proposed an efficient technique for
classifying the multispectral satellite images using Support Vector Machine (SVM) into road area, building area
and green area. We carried out classification in three modules namely (a) Preprocessing using Gaussian
filtering and conversion from conversion of RGB to Lab color space image (b) object segmentation using
proposed Cluster repulsion based kernel Fuzzy C- Means (FCM) and (c) classification using one-to-many SVM
classifier. The goal of this research is to provide the efficiency in classification of satellite images using the
object-based image analysis. The proposed work is evaluated using the satellite images and the accuracy of the
proposed work is compared to FCM based classification. The results showed that the proposed technique has
achieved better results reaching an accuracy of 79%, 84%, 81% and 97.9% for road, tree, building and vehicle
classification respectively.
Keywords:-Satellite image, FCM Clustering, Classification, SVM classifier.
Comparison of Segmentation Algorithms and Estimation of Optimal Segmentation ...Pinaki Ranjan Sarkar
Recent advancement in sensor technology allows very high spatial resolution along with multiple spectral bands. There are many studies, which highlight that Object Based Image Analysis(OBIA) is more accurate than pixel-based classification for high resolution(< 2m) imagery. Image segmentation is a crucial step for OBIA and it is a very formidable task to estimate optimal parameters for segmentation as it does not have any unique solution. In this paper, we have studied different segmentation algorithms (both mono-scale and multi-scale) for different terrain categories and showed how the segmented output depends on upon various parameters. Later, we have introduced a novel method to estimate optimal segmentation parameters. The main objectives of this study are to highlight the effectiveness of presently available segmentation techniques on very high-resolution satellite data and to automate segmentation process. Pre-estimation of segmentation parameter is more practical and efficient in OBIA. Assessment of segmentation algorithms and estimation of segmentation parameters are examined based on the very high-resolution multi-spectral WorldView-3(0.3m, PAN sharpened) data.
A STUDY AND ANALYSIS OF DIFFERENT EDGE DETECTION TECHNIQUEScscpconf
In the first study [1], a combination of K-means, watershed segmentation method, and Difference In Strength (DIS) map were used to perform image segmentation and edge detection
tasks. We obtained an initial segmentation based on K-means clustering technique. Starting from this, we used two techniques; the first is watershed technique with new merging
procedures based on mean intensity value to segment the image regions and to detect their boundaries. The second is edge strength technique to obtain accurate edge maps of our images without using watershed method. In this technique: We solved the problem of undesirable over segmentation results produced by the watershed algorithm, when used directly with raw data images. Also, the edge maps we obtained have no broken lines on entire image. In the 2nd study level set methods are used for the implementation of curve/interface evolution under various forces. In the third study the main idea is to detect regions (objects) boundaries, to isolate and extract individual components from a medical image. This is done using an active contours to detect regions in a given image, based on techniques of curve evolution, Mumford–Shah functional for segmentation and level sets. Once we classified our images into different intensity regions based on Markov Random Field. Then we detect regions whose boundaries are not necessarily defined by gradient by minimize an energy of Mumford–Shah functional forsegmentation, where in the level set formulation, the problem becomes a mean-curvature which will stop on the desired boundary. The stopping term does not depend on the gradient of the image as in the classical active contour. The initial curve of level set can be anywhere in the image, and interior contours are automatically detected. The final image segmentation is one
closed boundary per actual region in the image.
International Journal of Engineering Research and Applications (IJERA) is an open access online peer reviewed international journal that publishes research and review articles in the fields of Computer Science, Neural Networks, Electrical Engineering, Software Engineering, Information Technology, Mechanical Engineering, Chemical Engineering, Plastic Engineering, Food Technology, Textile Engineering, Nano Technology & science, Power Electronics, Electronics & Communication Engineering, Computational mathematics, Image processing, Civil Engineering, Structural Engineering, Environmental Engineering, VLSI Testing & Low Power VLSI Design etc.
International Journal of Engineering and Science Invention (IJESI)inventionjournals
International Journal of Engineering and Science Invention (IJESI) is an international journal intended for professionals and researchers in all fields of computer science and electronics. IJESI publishes research articles and reviews within the whole field Engineering Science and Technology, new teaching methods, assessment, validation and the impact of new technologies and it will continue to provide information on the latest trends and developments in this ever-expanding subject. The publications of papers are selected through double peer reviewed to ensure originality, relevance, and readability. The articles published in our journal can be accessed online.
IJERA (International journal of Engineering Research and Applications) is International online, ... peer reviewed journal. For more detail or submit your article, please visit www.ijera.com
International Journal of Engineering Research and Applications (IJERA) is an open access online peer reviewed international journal that publishes research and review articles in the fields of Computer Science, Neural Networks, Electrical Engineering, Software Engineering, Information Technology, Mechanical Engineering, Chemical Engineering, Plastic Engineering, Food Technology, Textile Engineering, Nano Technology & science, Power Electronics, Electronics & Communication Engineering, Computational mathematics, Image processing, Civil Engineering, Structural Engineering, Environmental Engineering, VLSI Testing & Low Power VLSI Design etc.
Multispectral images are used for space Arial application, target detection and remote sensing application. MS images are very rich in spectral resolution but at a cost of spatial resolution. We propose a new method to increase a spatial resolution MS images. For spatial resolution enhancement of MS images we need to employ a super-resolution technique which uses a Principal Component Analysis (PCA) based approach by learning an edge details from database. Experiments have been carried out on both real multispectral (MS) data and MS data. This experiment is done with the usefulness for hyper spectral (HS) data as a future work.
Orientation Spectral Resolution Coding for Pattern RecognitionIOSRjournaljce
In the approach of pattern recognition, feature descriptions are of greater importance. Features are represented in spatial domain and transformed domain. Wherein, spatial domain features are of lower representation, transformed domains are finer and more informative. In the transformed domain representation, features are represented using spectral coding using advanced transformation technique such as wavelet transformation. However, the feature extraction approach considers the band coefficients; the orientation variation is not considered. In this paper towards inherent orientation variation among each spectral band is derived, and the approach of orientation filtration is made for effective feature representation. The obtained result illustrates an improvement in the recognition accuracy, in comparison to conventional retrieval system.
Sensitivity of Support Vector Machine Classification to Various Training Feat...Nooria Sukmaningtyas
Remote sensing image classification is one of the most important techniques in image
interpretation, which can be used for environmental monitoring, evaluation and prediction. Many algorithms
have been developed for image classification in the literature. Support vector machine (SVM) is a kind of
supervised classification that has been widely used recently. The classification accuracy produced by SVM
may show variation depending on the choice of training features. In this paper, SVM was used for land
cover classification using Quickbird images. Spectral and textural features were extracted for the
classification and the results were analyzed thoroughly. Results showed that the number of features
employed in SVM was not the more the better. Different features are suitable for different type of land
cover extraction. This study verifies the effectiveness and robustness of SVM in the classification of high
spatial resolution remote sensing images.
Validation Study of Dimensionality Reduction Impact on Breast Cancer Classifi...ijcsit
A fundamental problem in machine learning is identifying the most representative subset of features from
which we can construct a predictive model for a classification task. This paper aims to present a validation
study of dimensionality reduction effect on the classification accuracy of mammographic images. The
studied dimensionality reduction methods were: locality-preserving projection (LPP), locally linear
embedding (LLE), Isometric Mapping (ISOMAP) and spectral regression (SR). We have achieved high
rates of classifications. In some combinations the classification rate was 100%. But in most of the cases the
classification rate is about 95%. It was also found that the classification rate increases with the size of the
reduced space and the optimal value of space dimension is 60. We proceeded to validate the obtained
results by measuring some validation indices such as: Xie-Beni index, Dun index and Alternative Dun
index. The measurement of these indices confirms that the optimal value of reduced space dimension is
d=60.
An Improved Way of Segmentation and Classification of Remote Sensing Images U...ijsrd.com
The Ultimate significance of Images lies in processing the digital image which stems from two principal application areas: Advances of pictorial information for human interpretation; and dispensation of image data for storage, communication, and illustration for self-sufficient machine perception. The objective of this research work is to define the meaning and possibility of image segmentation based on remote sensing images which are successively classified with statistical measures. In this paper kernel induced Possiblistic C-means clustering algorithm has been implemented for classifying remote sensing image data with image features. As a final point of the proposed work is to point out that this algorithm works well for segmenting and classifying the image with better accuracy with statistical metrices.
Abstract— Rekonstruksi model tiga dimensi (3D) dapat digunakan untuk tujuan navigasi, dan aplikasi virtual reality. Namun, saat ini model 3D juga digunakan sebagai upaya untuk mitigasi bencana seperti perencanaan evakuasi kebakaran dan gempa bumi. Penelitian ini bertujuan untuk membentuk 3D model bangunan menggunakan gambar panorama 720 derajat. Penilaian akurasi menggunakan akurasi aerial triangulasi, akurasi digitasi sudut dan juga mengambil data terrestrial laser scanning (TLS) untuk membandingkan dan mengukur ground control points (GCPs) menggunakan total station untuk analisa akurasi. Kamera Spherical Garmin VIRB 360 digunakan untuk mengambil video pada 30 fps dengan ukuran gambar 3840 x 2178. Video yang sudah didapatkan akan di ekstrak ke dalam bentuk gambar statis yang berurutan dengan interval 1.23 detik. Gambar panorama yang sudah terbentuk diolah menggunakan Agisoft Photoscan Pro untuk pemodelan 3D. Penilaian akurasi posisi menggunakan GCPs didalam Photoscan Pro. Hasil dense point cloud akan di bandingkan dengan data TLS didalam software CloudCompare. Hasil penelitian yang pertama adalah akurasi posisi 3D (RMSE) setelah SfM adalah 18.9 cm, selain itu perbedaan jarak 3D antara dense point cloud yang dihasilkan dengan data TLS adalah 3.47 cm. Model rekonstruksi bangunan didapatkan menggunakan point cloud dengan memproses didalam Autodesk Revit sehingga dapat digunakan sebagai upaya untuk perencanaan mitigasi bencana.
Kata Kunci—3D Model Rekonstruksi, Gambar Panorama, Fotogrammetri Jarak Dekat.
Sachpazis:Terzaghi Bearing Capacity Estimation in simple terms with Calculati...Dr.Costas Sachpazis
Terzaghi's soil bearing capacity theory, developed by Karl Terzaghi, is a fundamental principle in geotechnical engineering used to determine the bearing capacity of shallow foundations. This theory provides a method to calculate the ultimate bearing capacity of soil, which is the maximum load per unit area that the soil can support without undergoing shear failure. The Calculation HTML Code included.
Water scarcity is the lack of fresh water resources to meet the standard water demand. There are two type of water scarcity. One is physical. The other is economic water scarcity.
Industrial Training at Shahjalal Fertilizer Company Limited (SFCL)MdTanvirMahtab2
This presentation is about the working procedure of Shahjalal Fertilizer Company Limited (SFCL). A Govt. owned Company of Bangladesh Chemical Industries Corporation under Ministry of Industries.
Quality defects in TMT Bars, Possible causes and Potential Solutions.PrashantGoswami42
Maintaining high-quality standards in the production of TMT bars is crucial for ensuring structural integrity in construction. Addressing common defects through careful monitoring, standardized processes, and advanced technology can significantly improve the quality of TMT bars. Continuous training and adherence to quality control measures will also play a pivotal role in minimizing these defects.
Courier management system project report.pdfKamal Acharya
It is now-a-days very important for the people to send or receive articles like imported furniture, electronic items, gifts, business goods and the like. People depend vastly on different transport systems which mostly use the manual way of receiving and delivering the articles. There is no way to track the articles till they are received and there is no way to let the customer know what happened in transit, once he booked some articles. In such a situation, we need a system which completely computerizes the cargo activities including time to time tracking of the articles sent. This need is fulfilled by Courier Management System software which is online software for the cargo management people that enables them to receive the goods from a source and send them to a required destination and track their status from time to time.
Hybrid optimization of pumped hydro system and solar- Engr. Abdul-Azeez.pdffxintegritypublishin
Advancements in technology unveil a myriad of electrical and electronic breakthroughs geared towards efficiently harnessing limited resources to meet human energy demands. The optimization of hybrid solar PV panels and pumped hydro energy supply systems plays a pivotal role in utilizing natural resources effectively. This initiative not only benefits humanity but also fosters environmental sustainability. The study investigated the design optimization of these hybrid systems, focusing on understanding solar radiation patterns, identifying geographical influences on solar radiation, formulating a mathematical model for system optimization, and determining the optimal configuration of PV panels and pumped hydro storage. Through a comparative analysis approach and eight weeks of data collection, the study addressed key research questions related to solar radiation patterns and optimal system design. The findings highlighted regions with heightened solar radiation levels, showcasing substantial potential for power generation and emphasizing the system's efficiency. Optimizing system design significantly boosted power generation, promoted renewable energy utilization, and enhanced energy storage capacity. The study underscored the benefits of optimizing hybrid solar PV panels and pumped hydro energy supply systems for sustainable energy usage. Optimizing the design of solar PV panels and pumped hydro energy supply systems as examined across diverse climatic conditions in a developing country, not only enhances power generation but also improves the integration of renewable energy sources and boosts energy storage capacities, particularly beneficial for less economically prosperous regions. Additionally, the study provides valuable insights for advancing energy research in economically viable areas. Recommendations included conducting site-specific assessments, utilizing advanced modeling tools, implementing regular maintenance protocols, and enhancing communication among system components.
Explore the innovative world of trenchless pipe repair with our comprehensive guide, "The Benefits and Techniques of Trenchless Pipe Repair." This document delves into the modern methods of repairing underground pipes without the need for extensive excavation, highlighting the numerous advantages and the latest techniques used in the industry.
Learn about the cost savings, reduced environmental impact, and minimal disruption associated with trenchless technology. Discover detailed explanations of popular techniques such as pipe bursting, cured-in-place pipe (CIPP) lining, and directional drilling. Understand how these methods can be applied to various types of infrastructure, from residential plumbing to large-scale municipal systems.
Ideal for homeowners, contractors, engineers, and anyone interested in modern plumbing solutions, this guide provides valuable insights into why trenchless pipe repair is becoming the preferred choice for pipe rehabilitation. Stay informed about the latest advancements and best practices in the field.
Cosmetic shop management system project report.pdfKamal Acharya
Buying new cosmetic products is difficult. It can even be scary for those who have sensitive skin and are prone to skin trouble. The information needed to alleviate this problem is on the back of each product, but it's thought to interpret those ingredient lists unless you have a background in chemistry.
Instead of buying and hoping for the best, we can use data science to help us predict which products may be good fits for us. It includes various function programs to do the above mentioned tasks.
Data file handling has been effectively used in the program.
The automated cosmetic shop management system should deal with the automation of general workflow and administration process of the shop. The main processes of the system focus on customer's request where the system is able to search the most appropriate products and deliver it to the customers. It should help the employees to quickly identify the list of cosmetic product that have reached the minimum quantity and also keep a track of expired date for each cosmetic product. It should help the employees to find the rack number in which the product is placed.It is also Faster and more efficient way.
Saudi Arabia stands as a titan in the global energy landscape, renowned for its abundant oil and gas resources. It's the largest exporter of petroleum and holds some of the world's most significant reserves. Let's delve into the top 10 oil and gas projects shaping Saudi Arabia's energy future in 2024.
NO1 Uk best vashikaran specialist in delhi vashikaran baba near me online vas...Amil Baba Dawood bangali
Contact with Dawood Bhai Just call on +92322-6382012 and we'll help you. We'll solve all your problems within 12 to 24 hours and with 101% guarantee and with astrology systematic. If you want to take any personal or professional advice then also you can call us on +92322-6382012 , ONLINE LOVE PROBLEM & Other all types of Daily Life Problem's.Then CALL or WHATSAPP us on +92322-6382012 and Get all these problems solutions here by Amil Baba DAWOOD BANGALI
#vashikaranspecialist #astrologer #palmistry #amliyaat #taweez #manpasandshadi #horoscope #spiritual #lovelife #lovespell #marriagespell#aamilbabainpakistan #amilbabainkarachi #powerfullblackmagicspell #kalajadumantarspecialist #realamilbaba #AmilbabainPakistan #astrologerincanada #astrologerindubai #lovespellsmaster #kalajaduspecialist #lovespellsthatwork #aamilbabainlahore#blackmagicformarriage #aamilbaba #kalajadu #kalailam #taweez #wazifaexpert #jadumantar #vashikaranspecialist #astrologer #palmistry #amliyaat #taweez #manpasandshadi #horoscope #spiritual #lovelife #lovespell #marriagespell#aamilbabainpakistan #amilbabainkarachi #powerfullblackmagicspell #kalajadumantarspecialist #realamilbaba #AmilbabainPakistan #astrologerincanada #astrologerindubai #lovespellsmaster #kalajaduspecialist #lovespellsthatwork #aamilbabainlahore #blackmagicforlove #blackmagicformarriage #aamilbaba #kalajadu #kalailam #taweez #wazifaexpert #jadumantar #vashikaranspecialist #astrologer #palmistry #amliyaat #taweez #manpasandshadi #horoscope #spiritual #lovelife #lovespell #marriagespell#aamilbabainpakistan #amilbabainkarachi #powerfullblackmagicspell #kalajadumantarspecialist #realamilbaba #AmilbabainPakistan #astrologerincanada #astrologerindubai #lovespellsmaster #kalajaduspecialist #lovespellsthatwork #aamilbabainlahore #Amilbabainuk #amilbabainspain #amilbabaindubai #Amilbabainnorway #amilbabainkrachi #amilbabainlahore #amilbabaingujranwalan #amilbabainislamabad
Satellite Image Classification using Decision Tree, SVM and k-Nearest Neighbor
1. Satellite Image Classification using Decision Tree,
SVM and k-Nearest Neighbor
Iva Nurwauziyah1
, Umroh Dian S.2
, I Gede Brawiswa Putra3
, Muhammad Irsyadi Firdaus4
1,2,3,4 Department of Geomatics, National Cheng Kung University, Tainan, Taiwan
e-mail: ivanurwauziyah@gmail.com1
, umrohdians@gmail.com2
, brawiswa@gmail.com3
, irsyadifirdaus@gmail.com4
Abstract — There is undoubtedly a high demand for land
use/cover maps for the monitoring and management of natural
resources, development strategies, and global change studies. A
variety of classification methods have been developed and
tested for land use/cover to extract the knowledge. Knowledge
discovery is also important because it gives a basic model for
selection, preprocessing, transformation, data mining and
interpretation of datasets. Here, the project are performed on
satellite images with applying 3 different data mining
classification method which is Decision Tree, SVM and k-NN
methods to find the most efficient method. In geomatics, we
used satellite image to measure the characteristics of an object
or surface from a distance by interpretation of million number
of pixel. It is now very complex and critical task for engineers
and researchers to obtain the meaningful information from
massive data sets. From those pixels image datasets, we can use
data mining tools and efficient algorithms for getting
meaningful information. In this project using Pleiades
Satellite Images data in Taiwan. The result shows SVM
method has best accuracy compared to the Decision Tree and
k-Nearest Neighbor methods with the number of overall
accuracy is 78.6% and 83.30% for high and low resolution
satellite imagery respectively.
I. INTRODUCTION
Image classification [7] is taken as growing field of
both computer vision and data mining. We all know
computer vision is the field of acquiring, processing,
analyzing and understanding images which are later used
for knowledge discovery from high-dimensional image data.
Remote sensing satellite images [3] are considered as
one of the most important data sources for land use/cover
mapping due to their extensive geographical coverage at an
efficient cost while providing irreplaceable information on
the earth’s surface. Land use/cover maps are usually
produced based on remote sensing image classification
approaches. However, the accuracy and processing time of
land use/cover maps using remote sensing images is still a
challenge to the remote sensing community.
In order to understand a classification of satellite image,
the first step is to recognize the objects and then recognize
the category of the scene. In order to do this in computer
vision, we use various classifiers that all have different
characteristics and features.
Many classifiers have been developed by various
researchers. These methods include naïve Bayes classifier,
support vector machines, k-nearest neighbors, Gaussian
mixture model, decision tree and radial basis function (RBF)
classifiers.
In this paper, we will be comparing three different
classification methods: Experimental evaluation is
conducted on the high resolution satellite image and low
resolution satellite image dataset to see the difference
between three classification methods. Then, we will explain
the three different classification performance of this three
methods that we have used: DT, KNN and SVM.
II. RELATED WORK
According to Lu and Weng [5], it is not only the
imagery appropriateness but also the right choice of
classification method that affects the results of land
use/cover mapping. In literature, a variety of classification
methods have been developed and tested for land use/cover
mapping using remote sensing data. These methods range
from unsupervised algorithms (i.e., ISODATA or K-means)
to parametric supervised algorithms (i.e., maximum
likelihood) and machine learning algorithms such as
artificial neural networks (ANN), k-Nearest Neighbors
(kNN), decision trees (DT), support vector machines (SVM),
and random forest (RF).
In [9], Landslide image data is taken for data mining
purpose. Vegetation Index and the thresholds are of each
attribute on target categories. A conventional approach,
C4.5 Decision Tree Analysis, is used as a comparison. And
it helps to analyze the landslide problems and thus
facilitates the informed decision-making process.
In [4], comparison is based on traditional Classification
tree results to stochastic gradient boosting for three remote
sensing based data sets, an IKONOS image from the Sierra
Nevada Mountains of California, a Probe-1 hyperspectral
image from the Virginia City mining district of Montana,
and a series of Landsat images from the Greater
Yellowstone Ecosystem.
III. METHODOLOGY
A. Study Area
In this study, in order to compare the performance of
different classification algorithms on different data training
sample strategies, an area of 4300 x 4300 pixels of a peri-
urban and rural with heterogeneous land cover area in the
north of Taiwan was chosen (Figure 2). Second training
data is High Resolution Satellite Image using Pleiades
image with 1300 x 1300 pixels image size in colorado, USA
was chosen (Figure 1). The study area mainly four typical
classes: resident (fragment and distribution over the study
2. area), impervious surface (including factory, block building
and transportation, roads), and park.
B. Image Dataset Used
Figure 1. High Resolution Satellite Image
Figure 2. Low Resolution Satellite Image
C. Flowchart
A support vector machine (SVM) [2], a promising
method for classification of both linear and nonlinear data.
SVM classification uses different planes in space to divide
data points. It gains flexibility in the choice of threshold
and handles more input data very efficiently. Its
performance and accuracy depend upon the selection of
hyper plane and kernel parameter. The goal of SVM
Classification is to produce a model, based on the training
data, which will be able to predict class labels of the test
data accurately.
K-nearest neighbor (KNN) algorithm [1] is a method
for classifying objects based on closest training examples
in the feature space. K-nearest neighbor algorithm is
among the simplest of all machine learning algorithms.
Training process for this algorithm only consists of
storing feature vectors and labels of the training images.
In the classification process, the unlabeled query point is
simply assigned to the label of its k-nearest neighbors.
The Decision Tree (DT) classifier [8] is one of the
inductive learning algorithms that generates classification
tree using the training data/sample. It is based on the
“divide and conquer” strategy. It consists of mainly three
parts: Partitioning the nodes, find the terminal nodes and
allocate class label to terminal nodes. It is based on
hierarchical rule. It handles high dimensional data and
representation of knowledge in tree form which is easy to
humans for understanding purpose. When decision tree
built, many of branches reflects noise in the training
pattern so, tree pruning attempts to identify and remove
such branches and improve the accuracy of classification.
Figure 3. General Flowchart of SVM and K-NN classifier
The process is illustrated by the figure 3. Start from
choosing high and low resolution that used for classification
process. These images will be segmented based on the
correlation between neighborhood pixels. Next step is
selecting training sample data wherein this step needs to
select 70% of the total pixel for generating a proper
classification result. There are 2 methods that used in this
project which are SVM and k-NN where in this stage, it
need to select several parameters to run the algorithm.
Lastly, the classification result is compared to the ground-
truth data to get the accuracy assessment.
The DT classification algorithm is shown in figure 4
and 5 for high and low resolution satellite imagery,
respectively. In the high resolution satellite imagery, B4
(NIR) is the band used for initial binary splitting of the
3. image, which is subsequently supported by B2 (green).
While, in the low resolution satellite imagery, the only
parameter that used to classified the images is NDVI.
Figure 4. Thresholding of DT classifier for high resolution satellite image
Figure 5. Thresholding of DT classifier for low resolution satellite image
Next, the classification result will compare with ground
truth image which generate from manual interpretation and
manual digitation to get the overall accuracy. Lastly, each
accuracy will compare to judge the best classification
method for high and low resolution images
D. Segmentation
Segmentation is the process of dividing an image into
segments that have similar spectral, spatial, and/or texture
characteristics. The segments in the image ideally
correspond to real-world features. Effective segmentation
ensures that your classification results are more accurate.
There two parameters that have to consider for
segmentation which is scale level and merge level. Adjust
the Scale Level slider as needed to effectively delineate the
boundaries of features as much as possible without over-
segmenting the features. While merging is used primarily to
combine segments with similar spectral information
For high resolution satellite image, the scale level is set
into 40 and merge level is 80. Similar to the low resolution,
the scale and merge level are set into 40 and 90 respectively.
If the Scale Value is higher, some rooftop segments would
be combined with segments representing adjacent backyards
or trees because they have a similar intensity.
Figure 6. Segmentation Result of High Resolution Satellite Image
In the Pleiades image (figure 6), the rooftops appear
much darker, while the concrete area is lighter. The road
already segmented very well and the vegetation area has
many tiny segment area because it has many different color
in example tree and grass has different color which
automatically will segmented.
Figure 7. Segmentation Result of Low Resolution Satellite Image
Segmentation on Landsat image (figure 7), show the
urban area have smaller segment size than vegetation area,
because urban area has various pixel value. However, the
water region has least segment area, because the pixel value
is very similar.
E. Training and Testing Sample Datasets
The training data (training and testing samples) was
collected based on the manual interpretation of the original
Pleiades data and low-resolution imagery available from
Landsat 8. To collect training sample data, the create
training sample in the ENVI 5.3
4. Figure 8. Training data for high resolution satellite image
The training data are obtained as shown in Fig. 8, and
Fig. 9. Training data for high resolution satellite image (Fig.
8), the red color shows building region, the green color
shows vegetation region, blue color shows road region and
yellow color shows concrete region. While, training data for
low resolution satellite image (Fig. 9), the red color shows
urban region, the green color shows vegetation region and
blue color shows water region.
Figure 9. Training data for low resolution satellite image
Table 1. Training sample sizes of high resolution satellite image used in
this study
Land Cover Training Area (Segment)
Vegetation 1726
Building 486
Road 72
Concrete 420
Table 2. Training sample sizes of low resolution satellite image used in
this study
Land Cover Training Area (Segment)
Vegetation 11275
Water 98
Urban 10964
IV. RESULT AND DISCUSSION
All the experiments are carried out in Intel(R) Core(TM)
i7 4.20 GHz processor with 1 TB HDD, 32 GB RAM,
Windows 10 Operating system. Here, image analysis tool is
used for our experiment with Data mining application in
ENVI version 5.3.
A. Low Resolution Satellite Image
Figure 10. SVM Classification
Table 3 shows the confusion matrix performance of
SVM classifier for each individual class with the actual
class represented on the above and the predicted class
represented on the left. the diagonally shaded boxes show
5. the percent of accurately classified images for each class
while the other boxes show the percent of erroneously
classified images.
Table 3. The Confusion Matrix Performance of SVM classifier
Ground Truth (Percent)
Class
Vegetation Water Urban
Vegetation 97.22 0.09 50.42
Water 0.19 99.56 10.14
Urban 2.59 0.35 39.43
Figure 11. Decision Tree Classification
Vegetation as actual class and vegetation as predicted
class has value confusion matrix is high when compared
with other classes. It is indication
Table 4. The confusion matrix Performance of DT classifier
Ground Truth (Percent)
Class Water Urban Vegetation
Water 49.48 8.36 0.07
Urban 1.02 37.1 9.25
Vegetation 0.02 46.18 90.6
Figure 12. k-Nearest Neighbor
Table 5. The Confusion Matrix Performance of KNN classifier
Ground Truth (Percent)
Class
Vegetation Water Urban
Vegetation 92.87 0.07 46.53
Water 0.22 99.54 10.18
Urban 4.79 0.34 42.53
B. High Resolution Satellite Image
Figure 13. SVM Classification
6. Table 6. The Confusion Matrix Performance of SVM classifier
Ground Truth (Percent)
Class Building Road Vegetation Concrete
Building
87.4 1.36 16.82 0.46
Road
0.07 91.47 7.55 0.78
Vegetation
11.74 5.04 74.59 2.41
Concrete
0.79 2.14 1.04 96.36
Figure 14. Decision Tree Classification
Table 7. Shows the confusion matrix of DT classifier
Ground Truth (Percent)
Class
Vegetation Road Building Concrete
Vegetation
68.86 6.97 10.79 4.01
Road
7.31 61.89 18.27 0.62
Building
23.75 27.4 68.12 0.12
Concrete
0.09 3.74 2.81 95.24
In high resolution satellite images using the DT method
has a confusion matrix as shown in Table 7. Concrete as
actual class and concrete as predicted class has value
confusion matrix is high when compared with other classes.
Figure 15. k-Nearest Neighbor
Table 8. The Confusion Matrix Performance of KNN classifier
Ground Truth (Percent)
Class Building Road Vegetation Concrete
Building
87.37 1.09 18.37 0.62
Road
0.24 93.56 8.58 0.81
Vegetation
11.12 2.92 71.09 2.36
Concrete
1.27 2.43 1.95 96.2
C. Accuracy Assessment and Comparisons
In order to assess the accuracy of classification
performance, there are many metrics available in the
literature. The two most popular metrics are overall
accuracy (OA) and Kappa Coefficient.
The overall accuracy rate for the SVM classifier was
78.6% and 83.30% for high and low resolution satellite
imagery, respectively. We found that unlike KNN
classification, SVM classification was much more adept at
classifying land use which is the main reason.
Table 9. Performance of accuracy classifier in percent
Image SVM DT KNN
High Resolution 78.60 68.41 76.26
Low Resolution 83.30 59.08 82.34
As show in Table 9 and Table 10, with all datasets, SVM
always showed the most accurate results, followed by
7. Decision Tree and KNN. In high resolution, the
classification accuracy of SVM and DT were significantly
different. However, the classification accuracy of SVM and
KNN were not significantly different.
Figure 16. Training Sample comparison
Figure 16 illustrated different training sample number
will affect the overall accuracy in SVM and K-NN method.
It is indicated that the sample size of training samples has
more impact on the classification accuracy for K-NN than
for SVM. In addition, SVM has flexibility in choice of
threshold than both methods.
Table 10. Performance of Kappa Coefficient
Image SVM DT KNN
High Resolution 0.5967 0.4294 0.5673
Low Resolution 0.7375 0.4459 0.7253
Table 10 is performance of Kappa Coefficient. The lowest
error was achieved with SVM for all datasets. Therefore, the
optimal Kappa Coefficient for SVM classifier was chosen
as 0.59 and 0.73 in the high and low resolution, respectively.
V. CONCLUSION
In this paper, Decision tree, SVM and k-Nearest
Neighbor data mining techniques are applied to classify the
region of interest from images in order to get the
meaningful observations. The main objective of this paper is
to help the researchers to select best technique for image
classification. The SVM method has good accuracy
compared to the Decision Tree and k-Nearest Neighbor
methods. For High Resolution Satellite Image and Low
Resolution Satellite Image has an accuracy of 78.60% and
82.34% respectively by using SVM method. It can also be
seen that the value of Kappa coefficient in the SVM method
has a high value compared to both methods.
ACKNOWLEDGMENT
We would like to thank Prof. Hsueh-Chan Lu, Research
Instructor from Department of Geomatics, National Cheng
Kung University, for creating this opportunity for research.
REFERENCES
[1] Bremner D, Demaine E, Erickson J, Iacono J, Langerman S, Morin
P, Toussaint G, Output- sensitive algorithms for computing nearest-
neighbor decision boundaries, Discrete and Computational
Geometry, 2005, pp. 593 – 604.
[2] Christoper, J.C.B. 1998. A Tutorial on Support Vector Machines for
Pattern Recognition. Data Mining and Knowledge Discovery, 121–
167.
[3] J. Kim, B. S. Kim, and S. Savarese, Comparing Image Classification
Methods: K-Nearest-Neighbor and Support-Vector-Machines,
Applied Mathematics in Electrical and Computer Engineering, pp.
133-138.
[4] Lawrence, R., Bunn, A., Powell, S. and Zambon, M. 2004.
Classification of remotely sensed imagery using stochastic gradient
boosting as a refinement of classification tree analysis. Remote
sensing of environment. 90, 3 (2004), 331–336.
[5] Lu, D.; Weng, Q.A. Survey of image classification methods and
techniques for improving classification performance. Int. J. Remote
Sens. 2007, 28, 823–870.
[6] P. T. Noi and M. Kappas, “Comparison of Random Forest, k-Nearest
Neighbor, and Support Vector Machine Classifiers for Land Cover
Classification Using Sentinel-2 Imagery”, Journal Sensor, vol. 18,
2018.
[7] S. K. Dash and M. Panda, “Image Classification using Data Mining
Techniques,” Advances in Computer Science and Information
Technology (ACSIT), vol. 3, pp. 157–162, April-June 2016.
[8] Vyoma Patel, G. J. Sahani, A Survey on Image Classification using
Data Mining Techniques, IJSRD - International Journal for Scientific
Research & Development, Vol. 2, Issue 10, 2014, pp. 746 - 750
[9] Wan, S., Lei, Tc. and Chou, Ty. 2010. A novel data mining
technique of analysis and classification for landslide problems.
Natural hazards. 52, 1 (2010), pp. 211 – 230.