SlideShare a Scribd company logo
Analysis of Multispectral Satellite Imagery
using Deep Learning
Internal Guide : Dr. Raghunandan S, NMIT
M. Tech. (VLSI Design and Embedded Systems)
By –Yogesh SAwate
NMIT-1NT16LVS10
Nitte Meenakshi Institute of Technology, Bangalore
Outline
• Aim of project
• My approach
• Semantic segmentation
• Gathering data
• CNN Models
• Implementation method
• Topics/Tools learning
• Project plan
• References
9-Aug-18 Nitte Meenakshi Institute of Technology 2
Aim of Project
• To create a deep learning model which can be used to
identify vegetation, buildings, water and roads in the
multispectral satellite imagery.
9-Aug-18 Nitte Meenakshi Institute of Technology 3
My Approach
• Semantic segmentation
• Gathering Data
• Preparing the dataset
• Standard model
• My Models
• Evaluation of models
9-Aug-18 Nitte Meenakshi Institute of Technology 4
Semantic Segmentation
9-Aug-18 Nitte Meenakshi Institute of Technology 5
• Semantic segmentation, in simple words, is pixel wise
representation of classes
• It attempts to partition the image into semantically
meaningful parts, and to classify each part into one of the
pre-determined classes
• Semantic segmentation helps in proper understanding of
scenes for computer vision
RGB image SS image
Gathering data - Satellite Images
9-Aug-18 Nitte Meenakshi Institute of Technology 6
Blue band
Green band
Red band
NIR band
RGB Image
9-Aug-18 Nitte Meenakshi Institute of Technology 7
True Colour Composition
Red band – Red, Green band – Green, Blue band – Blue
Resolution- 2m, Pixel resolution – 2713*2032
Composite Image
9-Aug-18 Nitte Meenakshi Institute of Technology 8
False Colour Composition
NIR band – Red, Green band – Green, Blue band – Blue
Resolution- 2m, Pixel resolution – 2713*2032
Preparing dataset- Ground Truth
9-Aug-18 Nitte Meenakshi Institute of Technology 9
Ground Truth:
Red–Trees, Blue–Buildings, White–Water body, Cyan-Roads,
Resolution- 2m, Pixel resolution – 2713*2032
Patches
• To make a complete dataset for training and evaluation, the
multispectral images are converted into patches
• 577 patches (256*256) of each bands and Ground truth were
made for this project
• 500 images for training and 77 for evaluation were separated
• Augmentations like rotations and mirroring were done for better
learning
9-Aug-18 Nitte Meenakshi Institute of Technology 10
Patches
9-Aug-18 Nitte Meenakshi Institute of Technology 11
• Geographical Area 1
• Geographical Area 2
• Geographical Area 3
Convolutional Neural Network
• The Convolutional layer has deep layers of filters, it can directly
access images
• Each Convolutional layer gives feature maps, number of
channels of feature maps is depending upon number of filters
9-Aug-18 Nitte Meenakshi Institute of Technology 12
VGG-13
9-Aug-18 Nitte Meenakshi Institute of Technology 13
• VGG-16 is one of the standard
architectures in deep learning
• I removed fully connected 3
layers
• Making it useful for semantic
segmentation
CNN
9-Aug-18 Nitte Meenakshi Institute of Technology 14
CNN with skip
9-Aug-18 Nitte Meenakshi Institute of Technology 15
Evaluation
• Evaluation of a model is done by taking the total class elements
• Class elements include True positives and negatives, False
positives and negatives
9-Aug-18 Nitte Meenakshi Institute of Technology 16
True
positives
False
positives
False negatives True negatives
Relevant elements
Scores description
• Precision scores- how many selected items are relevant?
• Recall scores- how many relevant items are selected?
• F1 scores- It is harmonic average of Precision and Recall
9-Aug-18 Nitte Meenakshi Institute of Technology 17
Specification table
Parameters VGG CNN CNN-skip
Layers 26 10 10
Upsampling Maxpooling Maxpooling Maxpooling
Downsampling Unpooling Deconvolution Deconvolution
Concatenation No No Yes
Batchsize 20 20 20
Epochs 1000 1000 1000
Precision score 0.887265 0.970273 0.987265
Recall score 0.880484 0.97801 0.980484
F1-score 0.883858 0.974121 0.983858
Loss 0.14895 0.092365 0.0743113
9-Aug-18 Nitte Meenakshi Institute of Technology 18
Results
9-Aug-18 Nitte Meenakshi Institute of Technology 19
• G A 1
• G A 2
• G A 3
GT VGG13 CNN CNN-skip
Precision score
The graph shows Precision score comparison between VGG-13,
FCN and FCN-skip. The FCN-skip out performs VGG-13and
FCN with 0.9724018 score. Therefore FCN-skip model has
higher positive predictive value.
9-Aug-18 Nitte Meenakshi Institute of Technology 20
Recall score
The graph shows Recall score comparison between VGG-13,
FCN and FCN-skip. The FCN-skip out performs VGG-13and
FCN with 0.9541074 score. The recall score shows the
sensitivity of model. As we can see FCN-skip has higher
sensitivity as compared VGG-13 and FCN.
9-Aug-18 Nitte Meenakshi Institute of Technology 21
F1-score
The graph shows the F1-score comparison between VGG-13,
FCN and FCN-skip. The FCN-skip out performs VGG-13and
FCN with 0.944082 score. F1 score shows the accuracy of the
model. As we can see FCN-skip architecture is efficient.
9-Aug-18 Nitte Meenakshi Institute of Technology 22
Reference
[1] R. Kemker, C. Salvaggio, and C. Kanan, “Algorithms for semantic segmentation of multispectral remote sensing
imagery using deep learning,” ISPRS Journal of Photogrammetry and Remote Sensing, 2018.
https://arxiv.org/pdf/1703.06452.pdf
[2] J. E. Ball, D. T. Anderson, and C. S. Chan, “Comprehensive survey of deep learning in remote sensing: theories,
tools, and challenges for the community,” Journal of Applied Remote Sensing, vol. 11, no. 4, p. 042609, 2017.
[3] C. Luo, J. Wang, G. Feng, S. Xu, and S. Wang, “Do deep convolutional neural ;networks really need to be deep
when applied for remote scene classification?” Journal of Applied Remote Sensing, vol. 11, no. 4, p. 042613,
2017.
[4] T. Ishii, E. Simo-Serra, S. Iizuka, Y. Mochizuki, A. Sugimoto, H. Ishikawa, and R. Nakamura, “Detection by
classification of buildings in multispectral satellite imagery,” in Pattern Recognition (ICPR), 2016 23rd
International Conference on. IEEE, 2016, pp. 3344–3349.
[5] Y. Tarabalka, J. Benediktsson, J. Chanussot, and J. Tilton, “multiple spectralspatial classification approach for
hyperspectral data, ieee trans. on geoscience and remote sensing, under review.” Classification of hyperspectral
data using spectral-spatial approaches, p. 169.
[6] M. Teichmann, M. Weber, M. Zoellner, R. Cipolla, and R. Urtasun, “Multinet: Real-time joint semantic
reasoning for autonomous driving,” arXiv preprint: arXiv:1612.07695, 2016.
https://arxiv.org/pdf/1612.07695.pdf
[7] X. Cao, F. Zhou, L. Xu, D. Meng, Z. Xu, and J. Paisley, “Hyperspectral image classification with markov
random fields and a convolutional neural network,” IEEE Transactions on Image Processing, vol. 27, no. 5, pp.
2354–2367, 2018.
[8] Y. Tarabalka, J. Chanussot, J. A. Benediktsson, J. Angulo, and M. Fauvel, “Segmentation and classification of
hyperspectral data using watershed,” in Geoscience and Remote Sensing Symposium, 2008. IGARSS 2008.
IEEE International, vol. 3. IEEE, 2008, pp. III–652.
9-Aug-18 Nitte Meenakshi Institute of Technology 23
Thank You

More Related Content

What's hot

Object Detection using Deep Neural Networks
Object Detection using Deep Neural NetworksObject Detection using Deep Neural Networks
Object Detection using Deep Neural Networks
Usman Qayyum
 
YOLACT
YOLACTYOLACT
Introduction to object detection
Introduction to object detectionIntroduction to object detection
Introduction to object detection
Brodmann17
 
Object Detection and Recognition
Object Detection and Recognition Object Detection and Recognition
Object Detection and Recognition
Intel Nervana
 
Digital photogrammetry
Digital photogrammetryDigital photogrammetry
Digital photogrammetry
Mr Amol Ghogare
 
Mask R-CNN
Mask R-CNNMask R-CNN
Mask R-CNN
Chanuk Lim
 
Image Registration (Digital Image Processing)
Image Registration (Digital Image Processing)Image Registration (Digital Image Processing)
Image Registration (Digital Image Processing)
VARUN KUMAR
 
Batch normalization presentation
Batch normalization presentationBatch normalization presentation
Batch normalization presentation
Owin Will
 
Image Segmentation (D3L1 2017 UPC Deep Learning for Computer Vision)
Image Segmentation (D3L1 2017 UPC Deep Learning for Computer Vision)Image Segmentation (D3L1 2017 UPC Deep Learning for Computer Vision)
Image Segmentation (D3L1 2017 UPC Deep Learning for Computer Vision)
Universitat Politècnica de Catalunya
 
Master's Thesis Presentation
Master's Thesis PresentationMaster's Thesis Presentation
Master's Thesis Presentation
Wajdi Khattel
 
Video Segmentation
Video SegmentationVideo Segmentation
Video Segmentation
Smriti Jain
 
Introduction to Graph Neural Networks: Basics and Applications - Katsuhiko Is...
Introduction to Graph Neural Networks: Basics and Applications - Katsuhiko Is...Introduction to Graph Neural Networks: Basics and Applications - Katsuhiko Is...
Introduction to Graph Neural Networks: Basics and Applications - Katsuhiko Is...
Preferred Networks
 
THE SENTINEL-1 MISSION AND ITS APPLICATION CAPABILITIES
THE SENTINEL-1 MISSION AND ITS APPLICATION CAPABILITIESTHE SENTINEL-1 MISSION AND ITS APPLICATION CAPABILITIES
THE SENTINEL-1 MISSION AND ITS APPLICATION CAPABILITIESgrssieee
 
Snakes in Images (Active contour tutorial)
Snakes in Images (Active contour tutorial)Snakes in Images (Active contour tutorial)
Snakes in Images (Active contour tutorial)Yan Xu
 
Introduction to image contrast and enhancement method
Introduction to image contrast and enhancement methodIntroduction to image contrast and enhancement method
Introduction to image contrast and enhancement method
Abhishekvb
 
Image classification using CNN
Image classification using CNNImage classification using CNN
Image classification using CNN
Noura Hussein
 
Lecture 06 geometric transformations and image registration
Lecture 06 geometric transformations and image registrationLecture 06 geometric transformations and image registration
Lecture 06 geometric transformations and image registration
obertksg
 
Chicago Crime Dataset Project Proposal
Chicago Crime Dataset Project ProposalChicago Crime Dataset Project Proposal
Chicago Crime Dataset Project Proposal
Aashri Tandon
 
Image classification
Image classificationImage classification
Image classification
Ali A Jalil
 
Deep learning based object detection basics
Deep learning based object detection basicsDeep learning based object detection basics
Deep learning based object detection basics
Brodmann17
 

What's hot (20)

Object Detection using Deep Neural Networks
Object Detection using Deep Neural NetworksObject Detection using Deep Neural Networks
Object Detection using Deep Neural Networks
 
YOLACT
YOLACTYOLACT
YOLACT
 
Introduction to object detection
Introduction to object detectionIntroduction to object detection
Introduction to object detection
 
Object Detection and Recognition
Object Detection and Recognition Object Detection and Recognition
Object Detection and Recognition
 
Digital photogrammetry
Digital photogrammetryDigital photogrammetry
Digital photogrammetry
 
Mask R-CNN
Mask R-CNNMask R-CNN
Mask R-CNN
 
Image Registration (Digital Image Processing)
Image Registration (Digital Image Processing)Image Registration (Digital Image Processing)
Image Registration (Digital Image Processing)
 
Batch normalization presentation
Batch normalization presentationBatch normalization presentation
Batch normalization presentation
 
Image Segmentation (D3L1 2017 UPC Deep Learning for Computer Vision)
Image Segmentation (D3L1 2017 UPC Deep Learning for Computer Vision)Image Segmentation (D3L1 2017 UPC Deep Learning for Computer Vision)
Image Segmentation (D3L1 2017 UPC Deep Learning for Computer Vision)
 
Master's Thesis Presentation
Master's Thesis PresentationMaster's Thesis Presentation
Master's Thesis Presentation
 
Video Segmentation
Video SegmentationVideo Segmentation
Video Segmentation
 
Introduction to Graph Neural Networks: Basics and Applications - Katsuhiko Is...
Introduction to Graph Neural Networks: Basics and Applications - Katsuhiko Is...Introduction to Graph Neural Networks: Basics and Applications - Katsuhiko Is...
Introduction to Graph Neural Networks: Basics and Applications - Katsuhiko Is...
 
THE SENTINEL-1 MISSION AND ITS APPLICATION CAPABILITIES
THE SENTINEL-1 MISSION AND ITS APPLICATION CAPABILITIESTHE SENTINEL-1 MISSION AND ITS APPLICATION CAPABILITIES
THE SENTINEL-1 MISSION AND ITS APPLICATION CAPABILITIES
 
Snakes in Images (Active contour tutorial)
Snakes in Images (Active contour tutorial)Snakes in Images (Active contour tutorial)
Snakes in Images (Active contour tutorial)
 
Introduction to image contrast and enhancement method
Introduction to image contrast and enhancement methodIntroduction to image contrast and enhancement method
Introduction to image contrast and enhancement method
 
Image classification using CNN
Image classification using CNNImage classification using CNN
Image classification using CNN
 
Lecture 06 geometric transformations and image registration
Lecture 06 geometric transformations and image registrationLecture 06 geometric transformations and image registration
Lecture 06 geometric transformations and image registration
 
Chicago Crime Dataset Project Proposal
Chicago Crime Dataset Project ProposalChicago Crime Dataset Project Proposal
Chicago Crime Dataset Project Proposal
 
Image classification
Image classificationImage classification
Image classification
 
Deep learning based object detection basics
Deep learning based object detection basicsDeep learning based object detection basics
Deep learning based object detection basics
 

Similar to Analysis by semantic segmentation of Multispectral satellite imagery using deep learning

IRJET- 3D Object Recognition of Car Image Detection
IRJET-  	  3D Object Recognition of Car Image DetectionIRJET-  	  3D Object Recognition of Car Image Detection
IRJET- 3D Object Recognition of Car Image Detection
IRJET Journal
 
A SURVEY ON KIDNEY STONE DETECTION USING IMAGE PROCESSING AND DEEP LEARNING
A SURVEY ON KIDNEY STONE DETECTION USING IMAGE PROCESSING AND DEEP LEARNINGA SURVEY ON KIDNEY STONE DETECTION USING IMAGE PROCESSING AND DEEP LEARNING
A SURVEY ON KIDNEY STONE DETECTION USING IMAGE PROCESSING AND DEEP LEARNING
IRJET Journal
 
Spectral Clustering and Vantage Point Indexing for Efficient Data Retrieval
Spectral Clustering and Vantage Point Indexing for Efficient Data Retrieval Spectral Clustering and Vantage Point Indexing for Efficient Data Retrieval
Spectral Clustering and Vantage Point Indexing for Efficient Data Retrieval
IJECEIAES
 
Unet 3+ For Brain Tumor Segmentation : A Study
Unet 3+ For Brain Tumor Segmentation : A StudyUnet 3+ For Brain Tumor Segmentation : A Study
Unet 3+ For Brain Tumor Segmentation : A Study
IRJET Journal
 
Garbage Classification Using Deep Learning Techniques
Garbage Classification Using Deep Learning TechniquesGarbage Classification Using Deep Learning Techniques
Garbage Classification Using Deep Learning Techniques
IRJET Journal
 
Dilated Inception U-Net for Nuclei Segmentation in Multi-Organ Histology Images
Dilated Inception U-Net for Nuclei Segmentation in Multi-Organ Histology ImagesDilated Inception U-Net for Nuclei Segmentation in Multi-Organ Histology Images
Dilated Inception U-Net for Nuclei Segmentation in Multi-Organ Histology Images
IRJET Journal
 
Satellite Image Classification and Analysis using Machine Learning with ISRO ...
Satellite Image Classification and Analysis using Machine Learning with ISRO ...Satellite Image Classification and Analysis using Machine Learning with ISRO ...
Satellite Image Classification and Analysis using Machine Learning with ISRO ...
IRJET Journal
 
Semantic segmentation with Convolutional Neural Network Approaches
Semantic segmentation with Convolutional Neural Network ApproachesSemantic segmentation with Convolutional Neural Network Approaches
Semantic segmentation with Convolutional Neural Network Approaches
Fellowship at Vodafone FutureLab
 
Artificial Intelligence for Vision: A walkthrough of recent breakthroughs
Artificial Intelligence for Vision:  A walkthrough of recent breakthroughsArtificial Intelligence for Vision:  A walkthrough of recent breakthroughs
Artificial Intelligence for Vision: A walkthrough of recent breakthroughs
Nikolas Markou
 
Performance evaluation of transfer learning based deep convolutional neural n...
Performance evaluation of transfer learning based deep convolutional neural n...Performance evaluation of transfer learning based deep convolutional neural n...
Performance evaluation of transfer learning based deep convolutional neural n...
IJECEIAES
 
RICE INSECTS CLASSIFICATION USIING TRANSFER LEARNING AND CNN
RICE INSECTS CLASSIFICATION USIING TRANSFER LEARNING AND CNNRICE INSECTS CLASSIFICATION USIING TRANSFER LEARNING AND CNN
RICE INSECTS CLASSIFICATION USIING TRANSFER LEARNING AND CNN
IRJET Journal
 
YOLO BASED SHIP IMAGE DETECTION AND CLASSIFICATION
YOLO BASED SHIP IMAGE DETECTION AND CLASSIFICATIONYOLO BASED SHIP IMAGE DETECTION AND CLASSIFICATION
YOLO BASED SHIP IMAGE DETECTION AND CLASSIFICATION
IRJET Journal
 
Satellite Image Classification with Deep Learning Survey
Satellite Image Classification with Deep Learning SurveySatellite Image Classification with Deep Learning Survey
Satellite Image Classification with Deep Learning Survey
ijtsrd
 
Efficient mobilenet architecture_as_image_recognit
Efficient mobilenet architecture_as_image_recognitEfficient mobilenet architecture_as_image_recognit
Efficient mobilenet architecture_as_image_recognit
EL Mehdi RAOUHI
 
IRJET- Rice QA using Deep Learning
IRJET- Rice QA using Deep LearningIRJET- Rice QA using Deep Learning
IRJET- Rice QA using Deep Learning
IRJET Journal
 
PointNet
PointNetPointNet
Unsupervised Building Extraction from High Resolution Satellite Images Irresp...
Unsupervised Building Extraction from High Resolution Satellite Images Irresp...Unsupervised Building Extraction from High Resolution Satellite Images Irresp...
Unsupervised Building Extraction from High Resolution Satellite Images Irresp...
CSCJournals
 
A Review On Single Image Depth Prediction with Wavelet Decomposition
A Review On Single Image Depth Prediction with Wavelet DecompositionA Review On Single Image Depth Prediction with Wavelet Decomposition
A Review On Single Image Depth Prediction with Wavelet Decomposition
IRJET Journal
 
Satellite and Land Cover Image Classification using Deep Learning
Satellite and Land Cover Image Classification using Deep LearningSatellite and Land Cover Image Classification using Deep Learning
Satellite and Land Cover Image Classification using Deep Learning
ijtsrd
 

Similar to Analysis by semantic segmentation of Multispectral satellite imagery using deep learning (20)

IRJET- 3D Object Recognition of Car Image Detection
IRJET-  	  3D Object Recognition of Car Image DetectionIRJET-  	  3D Object Recognition of Car Image Detection
IRJET- 3D Object Recognition of Car Image Detection
 
A SURVEY ON KIDNEY STONE DETECTION USING IMAGE PROCESSING AND DEEP LEARNING
A SURVEY ON KIDNEY STONE DETECTION USING IMAGE PROCESSING AND DEEP LEARNINGA SURVEY ON KIDNEY STONE DETECTION USING IMAGE PROCESSING AND DEEP LEARNING
A SURVEY ON KIDNEY STONE DETECTION USING IMAGE PROCESSING AND DEEP LEARNING
 
Spectral Clustering and Vantage Point Indexing for Efficient Data Retrieval
Spectral Clustering and Vantage Point Indexing for Efficient Data Retrieval Spectral Clustering and Vantage Point Indexing for Efficient Data Retrieval
Spectral Clustering and Vantage Point Indexing for Efficient Data Retrieval
 
Unet 3+ For Brain Tumor Segmentation : A Study
Unet 3+ For Brain Tumor Segmentation : A StudyUnet 3+ For Brain Tumor Segmentation : A Study
Unet 3+ For Brain Tumor Segmentation : A Study
 
Ijetcas14 474
Ijetcas14 474Ijetcas14 474
Ijetcas14 474
 
Garbage Classification Using Deep Learning Techniques
Garbage Classification Using Deep Learning TechniquesGarbage Classification Using Deep Learning Techniques
Garbage Classification Using Deep Learning Techniques
 
Dilated Inception U-Net for Nuclei Segmentation in Multi-Organ Histology Images
Dilated Inception U-Net for Nuclei Segmentation in Multi-Organ Histology ImagesDilated Inception U-Net for Nuclei Segmentation in Multi-Organ Histology Images
Dilated Inception U-Net for Nuclei Segmentation in Multi-Organ Histology Images
 
Satellite Image Classification and Analysis using Machine Learning with ISRO ...
Satellite Image Classification and Analysis using Machine Learning with ISRO ...Satellite Image Classification and Analysis using Machine Learning with ISRO ...
Satellite Image Classification and Analysis using Machine Learning with ISRO ...
 
Semantic segmentation with Convolutional Neural Network Approaches
Semantic segmentation with Convolutional Neural Network ApproachesSemantic segmentation with Convolutional Neural Network Approaches
Semantic segmentation with Convolutional Neural Network Approaches
 
Artificial Intelligence for Vision: A walkthrough of recent breakthroughs
Artificial Intelligence for Vision:  A walkthrough of recent breakthroughsArtificial Intelligence for Vision:  A walkthrough of recent breakthroughs
Artificial Intelligence for Vision: A walkthrough of recent breakthroughs
 
Performance evaluation of transfer learning based deep convolutional neural n...
Performance evaluation of transfer learning based deep convolutional neural n...Performance evaluation of transfer learning based deep convolutional neural n...
Performance evaluation of transfer learning based deep convolutional neural n...
 
RICE INSECTS CLASSIFICATION USIING TRANSFER LEARNING AND CNN
RICE INSECTS CLASSIFICATION USIING TRANSFER LEARNING AND CNNRICE INSECTS CLASSIFICATION USIING TRANSFER LEARNING AND CNN
RICE INSECTS CLASSIFICATION USIING TRANSFER LEARNING AND CNN
 
YOLO BASED SHIP IMAGE DETECTION AND CLASSIFICATION
YOLO BASED SHIP IMAGE DETECTION AND CLASSIFICATIONYOLO BASED SHIP IMAGE DETECTION AND CLASSIFICATION
YOLO BASED SHIP IMAGE DETECTION AND CLASSIFICATION
 
Satellite Image Classification with Deep Learning Survey
Satellite Image Classification with Deep Learning SurveySatellite Image Classification with Deep Learning Survey
Satellite Image Classification with Deep Learning Survey
 
Efficient mobilenet architecture_as_image_recognit
Efficient mobilenet architecture_as_image_recognitEfficient mobilenet architecture_as_image_recognit
Efficient mobilenet architecture_as_image_recognit
 
IRJET- Rice QA using Deep Learning
IRJET- Rice QA using Deep LearningIRJET- Rice QA using Deep Learning
IRJET- Rice QA using Deep Learning
 
PointNet
PointNetPointNet
PointNet
 
Unsupervised Building Extraction from High Resolution Satellite Images Irresp...
Unsupervised Building Extraction from High Resolution Satellite Images Irresp...Unsupervised Building Extraction from High Resolution Satellite Images Irresp...
Unsupervised Building Extraction from High Resolution Satellite Images Irresp...
 
A Review On Single Image Depth Prediction with Wavelet Decomposition
A Review On Single Image Depth Prediction with Wavelet DecompositionA Review On Single Image Depth Prediction with Wavelet Decomposition
A Review On Single Image Depth Prediction with Wavelet Decomposition
 
Satellite and Land Cover Image Classification using Deep Learning
Satellite and Land Cover Image Classification using Deep LearningSatellite and Land Cover Image Classification using Deep Learning
Satellite and Land Cover Image Classification using Deep Learning
 

Recently uploaded

Railway Signalling Principles Edition 3.pdf
Railway Signalling Principles Edition 3.pdfRailway Signalling Principles Edition 3.pdf
Railway Signalling Principles Edition 3.pdf
TeeVichai
 
Nuclear Power Economics and Structuring 2024
Nuclear Power Economics and Structuring 2024Nuclear Power Economics and Structuring 2024
Nuclear Power Economics and Structuring 2024
Massimo Talia
 
Standard Reomte Control Interface - Neometrix
Standard Reomte Control Interface - NeometrixStandard Reomte Control Interface - Neometrix
Standard Reomte Control Interface - Neometrix
Neometrix_Engineering_Pvt_Ltd
 
Gen AI Study Jams _ For the GDSC Leads in India.pdf
Gen AI Study Jams _ For the GDSC Leads in India.pdfGen AI Study Jams _ For the GDSC Leads in India.pdf
Gen AI Study Jams _ For the GDSC Leads in India.pdf
gdsczhcet
 
CFD Simulation of By-pass Flow in a HRSG module by R&R Consult.pptx
CFD Simulation of By-pass Flow in a HRSG module by R&R Consult.pptxCFD Simulation of By-pass Flow in a HRSG module by R&R Consult.pptx
CFD Simulation of By-pass Flow in a HRSG module by R&R Consult.pptx
R&R Consult
 
English lab ppt no titlespecENG PPTt.pdf
English lab ppt no titlespecENG PPTt.pdfEnglish lab ppt no titlespecENG PPTt.pdf
English lab ppt no titlespecENG PPTt.pdf
BrazilAccount1
 
road safety engineering r s e unit 3.pdf
road safety engineering  r s e unit 3.pdfroad safety engineering  r s e unit 3.pdf
road safety engineering r s e unit 3.pdf
VENKATESHvenky89705
 
Design and Analysis of Algorithms-DP,Backtracking,Graphs,B&B
Design and Analysis of Algorithms-DP,Backtracking,Graphs,B&BDesign and Analysis of Algorithms-DP,Backtracking,Graphs,B&B
Design and Analysis of Algorithms-DP,Backtracking,Graphs,B&B
Sreedhar Chowdam
 
Student information management system project report ii.pdf
Student information management system project report ii.pdfStudent information management system project report ii.pdf
Student information management system project report ii.pdf
Kamal Acharya
 
ethical hacking-mobile hacking methods.ppt
ethical hacking-mobile hacking methods.pptethical hacking-mobile hacking methods.ppt
ethical hacking-mobile hacking methods.ppt
Jayaprasanna4
 
Industrial Training at Shahjalal Fertilizer Company Limited (SFCL)
Industrial Training at Shahjalal Fertilizer Company Limited (SFCL)Industrial Training at Shahjalal Fertilizer Company Limited (SFCL)
Industrial Training at Shahjalal Fertilizer Company Limited (SFCL)
MdTanvirMahtab2
 
weather web application report.pdf
weather web application report.pdfweather web application report.pdf
weather web application report.pdf
Pratik Pawar
 
WATER CRISIS and its solutions-pptx 1234
WATER CRISIS and its solutions-pptx 1234WATER CRISIS and its solutions-pptx 1234
WATER CRISIS and its solutions-pptx 1234
AafreenAbuthahir2
 
DESIGN A COTTON SEED SEPARATION MACHINE.docx
DESIGN A COTTON SEED SEPARATION MACHINE.docxDESIGN A COTTON SEED SEPARATION MACHINE.docx
DESIGN A COTTON SEED SEPARATION MACHINE.docx
FluxPrime1
 
ASME IX(9) 2007 Full Version .pdf
ASME IX(9)  2007 Full Version       .pdfASME IX(9)  2007 Full Version       .pdf
ASME IX(9) 2007 Full Version .pdf
AhmedHussein950959
 
Immunizing Image Classifiers Against Localized Adversary Attacks
Immunizing Image Classifiers Against Localized Adversary AttacksImmunizing Image Classifiers Against Localized Adversary Attacks
Immunizing Image Classifiers Against Localized Adversary Attacks
gerogepatton
 
ML for identifying fraud using open blockchain data.pptx
ML for identifying fraud using open blockchain data.pptxML for identifying fraud using open blockchain data.pptx
ML for identifying fraud using open blockchain data.pptx
Vijay Dialani, PhD
 
NO1 Uk best vashikaran specialist in delhi vashikaran baba near me online vas...
NO1 Uk best vashikaran specialist in delhi vashikaran baba near me online vas...NO1 Uk best vashikaran specialist in delhi vashikaran baba near me online vas...
NO1 Uk best vashikaran specialist in delhi vashikaran baba near me online vas...
Amil Baba Dawood bangali
 
Pile Foundation by Venkatesh Taduvai (Sub Geotechnical Engineering II)-conver...
Pile Foundation by Venkatesh Taduvai (Sub Geotechnical Engineering II)-conver...Pile Foundation by Venkatesh Taduvai (Sub Geotechnical Engineering II)-conver...
Pile Foundation by Venkatesh Taduvai (Sub Geotechnical Engineering II)-conver...
AJAYKUMARPUND1
 
RAT: Retrieval Augmented Thoughts Elicit Context-Aware Reasoning in Long-Hori...
RAT: Retrieval Augmented Thoughts Elicit Context-Aware Reasoning in Long-Hori...RAT: Retrieval Augmented Thoughts Elicit Context-Aware Reasoning in Long-Hori...
RAT: Retrieval Augmented Thoughts Elicit Context-Aware Reasoning in Long-Hori...
thanhdowork
 

Recently uploaded (20)

Railway Signalling Principles Edition 3.pdf
Railway Signalling Principles Edition 3.pdfRailway Signalling Principles Edition 3.pdf
Railway Signalling Principles Edition 3.pdf
 
Nuclear Power Economics and Structuring 2024
Nuclear Power Economics and Structuring 2024Nuclear Power Economics and Structuring 2024
Nuclear Power Economics and Structuring 2024
 
Standard Reomte Control Interface - Neometrix
Standard Reomte Control Interface - NeometrixStandard Reomte Control Interface - Neometrix
Standard Reomte Control Interface - Neometrix
 
Gen AI Study Jams _ For the GDSC Leads in India.pdf
Gen AI Study Jams _ For the GDSC Leads in India.pdfGen AI Study Jams _ For the GDSC Leads in India.pdf
Gen AI Study Jams _ For the GDSC Leads in India.pdf
 
CFD Simulation of By-pass Flow in a HRSG module by R&R Consult.pptx
CFD Simulation of By-pass Flow in a HRSG module by R&R Consult.pptxCFD Simulation of By-pass Flow in a HRSG module by R&R Consult.pptx
CFD Simulation of By-pass Flow in a HRSG module by R&R Consult.pptx
 
English lab ppt no titlespecENG PPTt.pdf
English lab ppt no titlespecENG PPTt.pdfEnglish lab ppt no titlespecENG PPTt.pdf
English lab ppt no titlespecENG PPTt.pdf
 
road safety engineering r s e unit 3.pdf
road safety engineering  r s e unit 3.pdfroad safety engineering  r s e unit 3.pdf
road safety engineering r s e unit 3.pdf
 
Design and Analysis of Algorithms-DP,Backtracking,Graphs,B&B
Design and Analysis of Algorithms-DP,Backtracking,Graphs,B&BDesign and Analysis of Algorithms-DP,Backtracking,Graphs,B&B
Design and Analysis of Algorithms-DP,Backtracking,Graphs,B&B
 
Student information management system project report ii.pdf
Student information management system project report ii.pdfStudent information management system project report ii.pdf
Student information management system project report ii.pdf
 
ethical hacking-mobile hacking methods.ppt
ethical hacking-mobile hacking methods.pptethical hacking-mobile hacking methods.ppt
ethical hacking-mobile hacking methods.ppt
 
Industrial Training at Shahjalal Fertilizer Company Limited (SFCL)
Industrial Training at Shahjalal Fertilizer Company Limited (SFCL)Industrial Training at Shahjalal Fertilizer Company Limited (SFCL)
Industrial Training at Shahjalal Fertilizer Company Limited (SFCL)
 
weather web application report.pdf
weather web application report.pdfweather web application report.pdf
weather web application report.pdf
 
WATER CRISIS and its solutions-pptx 1234
WATER CRISIS and its solutions-pptx 1234WATER CRISIS and its solutions-pptx 1234
WATER CRISIS and its solutions-pptx 1234
 
DESIGN A COTTON SEED SEPARATION MACHINE.docx
DESIGN A COTTON SEED SEPARATION MACHINE.docxDESIGN A COTTON SEED SEPARATION MACHINE.docx
DESIGN A COTTON SEED SEPARATION MACHINE.docx
 
ASME IX(9) 2007 Full Version .pdf
ASME IX(9)  2007 Full Version       .pdfASME IX(9)  2007 Full Version       .pdf
ASME IX(9) 2007 Full Version .pdf
 
Immunizing Image Classifiers Against Localized Adversary Attacks
Immunizing Image Classifiers Against Localized Adversary AttacksImmunizing Image Classifiers Against Localized Adversary Attacks
Immunizing Image Classifiers Against Localized Adversary Attacks
 
ML for identifying fraud using open blockchain data.pptx
ML for identifying fraud using open blockchain data.pptxML for identifying fraud using open blockchain data.pptx
ML for identifying fraud using open blockchain data.pptx
 
NO1 Uk best vashikaran specialist in delhi vashikaran baba near me online vas...
NO1 Uk best vashikaran specialist in delhi vashikaran baba near me online vas...NO1 Uk best vashikaran specialist in delhi vashikaran baba near me online vas...
NO1 Uk best vashikaran specialist in delhi vashikaran baba near me online vas...
 
Pile Foundation by Venkatesh Taduvai (Sub Geotechnical Engineering II)-conver...
Pile Foundation by Venkatesh Taduvai (Sub Geotechnical Engineering II)-conver...Pile Foundation by Venkatesh Taduvai (Sub Geotechnical Engineering II)-conver...
Pile Foundation by Venkatesh Taduvai (Sub Geotechnical Engineering II)-conver...
 
RAT: Retrieval Augmented Thoughts Elicit Context-Aware Reasoning in Long-Hori...
RAT: Retrieval Augmented Thoughts Elicit Context-Aware Reasoning in Long-Hori...RAT: Retrieval Augmented Thoughts Elicit Context-Aware Reasoning in Long-Hori...
RAT: Retrieval Augmented Thoughts Elicit Context-Aware Reasoning in Long-Hori...
 

Analysis by semantic segmentation of Multispectral satellite imagery using deep learning

  • 1. Analysis of Multispectral Satellite Imagery using Deep Learning Internal Guide : Dr. Raghunandan S, NMIT M. Tech. (VLSI Design and Embedded Systems) By –Yogesh SAwate NMIT-1NT16LVS10 Nitte Meenakshi Institute of Technology, Bangalore
  • 2. Outline • Aim of project • My approach • Semantic segmentation • Gathering data • CNN Models • Implementation method • Topics/Tools learning • Project plan • References 9-Aug-18 Nitte Meenakshi Institute of Technology 2
  • 3. Aim of Project • To create a deep learning model which can be used to identify vegetation, buildings, water and roads in the multispectral satellite imagery. 9-Aug-18 Nitte Meenakshi Institute of Technology 3
  • 4. My Approach • Semantic segmentation • Gathering Data • Preparing the dataset • Standard model • My Models • Evaluation of models 9-Aug-18 Nitte Meenakshi Institute of Technology 4
  • 5. Semantic Segmentation 9-Aug-18 Nitte Meenakshi Institute of Technology 5 • Semantic segmentation, in simple words, is pixel wise representation of classes • It attempts to partition the image into semantically meaningful parts, and to classify each part into one of the pre-determined classes • Semantic segmentation helps in proper understanding of scenes for computer vision RGB image SS image
  • 6. Gathering data - Satellite Images 9-Aug-18 Nitte Meenakshi Institute of Technology 6 Blue band Green band Red band NIR band
  • 7. RGB Image 9-Aug-18 Nitte Meenakshi Institute of Technology 7 True Colour Composition Red band – Red, Green band – Green, Blue band – Blue Resolution- 2m, Pixel resolution – 2713*2032
  • 8. Composite Image 9-Aug-18 Nitte Meenakshi Institute of Technology 8 False Colour Composition NIR band – Red, Green band – Green, Blue band – Blue Resolution- 2m, Pixel resolution – 2713*2032
  • 9. Preparing dataset- Ground Truth 9-Aug-18 Nitte Meenakshi Institute of Technology 9 Ground Truth: Red–Trees, Blue–Buildings, White–Water body, Cyan-Roads, Resolution- 2m, Pixel resolution – 2713*2032
  • 10. Patches • To make a complete dataset for training and evaluation, the multispectral images are converted into patches • 577 patches (256*256) of each bands and Ground truth were made for this project • 500 images for training and 77 for evaluation were separated • Augmentations like rotations and mirroring were done for better learning 9-Aug-18 Nitte Meenakshi Institute of Technology 10
  • 11. Patches 9-Aug-18 Nitte Meenakshi Institute of Technology 11 • Geographical Area 1 • Geographical Area 2 • Geographical Area 3
  • 12. Convolutional Neural Network • The Convolutional layer has deep layers of filters, it can directly access images • Each Convolutional layer gives feature maps, number of channels of feature maps is depending upon number of filters 9-Aug-18 Nitte Meenakshi Institute of Technology 12
  • 13. VGG-13 9-Aug-18 Nitte Meenakshi Institute of Technology 13 • VGG-16 is one of the standard architectures in deep learning • I removed fully connected 3 layers • Making it useful for semantic segmentation
  • 14. CNN 9-Aug-18 Nitte Meenakshi Institute of Technology 14
  • 15. CNN with skip 9-Aug-18 Nitte Meenakshi Institute of Technology 15
  • 16. Evaluation • Evaluation of a model is done by taking the total class elements • Class elements include True positives and negatives, False positives and negatives 9-Aug-18 Nitte Meenakshi Institute of Technology 16 True positives False positives False negatives True negatives Relevant elements
  • 17. Scores description • Precision scores- how many selected items are relevant? • Recall scores- how many relevant items are selected? • F1 scores- It is harmonic average of Precision and Recall 9-Aug-18 Nitte Meenakshi Institute of Technology 17
  • 18. Specification table Parameters VGG CNN CNN-skip Layers 26 10 10 Upsampling Maxpooling Maxpooling Maxpooling Downsampling Unpooling Deconvolution Deconvolution Concatenation No No Yes Batchsize 20 20 20 Epochs 1000 1000 1000 Precision score 0.887265 0.970273 0.987265 Recall score 0.880484 0.97801 0.980484 F1-score 0.883858 0.974121 0.983858 Loss 0.14895 0.092365 0.0743113 9-Aug-18 Nitte Meenakshi Institute of Technology 18
  • 19. Results 9-Aug-18 Nitte Meenakshi Institute of Technology 19 • G A 1 • G A 2 • G A 3 GT VGG13 CNN CNN-skip
  • 20. Precision score The graph shows Precision score comparison between VGG-13, FCN and FCN-skip. The FCN-skip out performs VGG-13and FCN with 0.9724018 score. Therefore FCN-skip model has higher positive predictive value. 9-Aug-18 Nitte Meenakshi Institute of Technology 20
  • 21. Recall score The graph shows Recall score comparison between VGG-13, FCN and FCN-skip. The FCN-skip out performs VGG-13and FCN with 0.9541074 score. The recall score shows the sensitivity of model. As we can see FCN-skip has higher sensitivity as compared VGG-13 and FCN. 9-Aug-18 Nitte Meenakshi Institute of Technology 21
  • 22. F1-score The graph shows the F1-score comparison between VGG-13, FCN and FCN-skip. The FCN-skip out performs VGG-13and FCN with 0.944082 score. F1 score shows the accuracy of the model. As we can see FCN-skip architecture is efficient. 9-Aug-18 Nitte Meenakshi Institute of Technology 22
  • 23. Reference [1] R. Kemker, C. Salvaggio, and C. Kanan, “Algorithms for semantic segmentation of multispectral remote sensing imagery using deep learning,” ISPRS Journal of Photogrammetry and Remote Sensing, 2018. https://arxiv.org/pdf/1703.06452.pdf [2] J. E. Ball, D. T. Anderson, and C. S. Chan, “Comprehensive survey of deep learning in remote sensing: theories, tools, and challenges for the community,” Journal of Applied Remote Sensing, vol. 11, no. 4, p. 042609, 2017. [3] C. Luo, J. Wang, G. Feng, S. Xu, and S. Wang, “Do deep convolutional neural ;networks really need to be deep when applied for remote scene classification?” Journal of Applied Remote Sensing, vol. 11, no. 4, p. 042613, 2017. [4] T. Ishii, E. Simo-Serra, S. Iizuka, Y. Mochizuki, A. Sugimoto, H. Ishikawa, and R. Nakamura, “Detection by classification of buildings in multispectral satellite imagery,” in Pattern Recognition (ICPR), 2016 23rd International Conference on. IEEE, 2016, pp. 3344–3349. [5] Y. Tarabalka, J. Benediktsson, J. Chanussot, and J. Tilton, “multiple spectralspatial classification approach for hyperspectral data, ieee trans. on geoscience and remote sensing, under review.” Classification of hyperspectral data using spectral-spatial approaches, p. 169. [6] M. Teichmann, M. Weber, M. Zoellner, R. Cipolla, and R. Urtasun, “Multinet: Real-time joint semantic reasoning for autonomous driving,” arXiv preprint: arXiv:1612.07695, 2016. https://arxiv.org/pdf/1612.07695.pdf [7] X. Cao, F. Zhou, L. Xu, D. Meng, Z. Xu, and J. Paisley, “Hyperspectral image classification with markov random fields and a convolutional neural network,” IEEE Transactions on Image Processing, vol. 27, no. 5, pp. 2354–2367, 2018. [8] Y. Tarabalka, J. Chanussot, J. A. Benediktsson, J. Angulo, and M. Fauvel, “Segmentation and classification of hyperspectral data using watershed,” in Geoscience and Remote Sensing Symposium, 2008. IGARSS 2008. IEEE International, vol. 3. IEEE, 2008, pp. III–652. 9-Aug-18 Nitte Meenakshi Institute of Technology 23