SlideShare a Scribd company logo
1 of 15
Computer aided detection of diabetic foot
ulcer using asymmetry analysis of
texture and temperature features
Guide by Utkarsh Nag
Authors of the paper: J. Saminathan, M. Sasikala, VB. Narayanamurthy, K. Rajesh, R. Arvind
Link to paper: https://doi.org/10.1016/j.infrared.2020.103219
Background
• Asymmetric analysis in temperature distribution and external stress
analysis have been the most common analyses for identifying diabetic
foot complications.
• In the foot thermograms of the control group, symmetric temperature
distributions are habitually observed in both foot region and, hence,
texture and temperature features extracted from ipsilateral and
contralateral regions of the foot (ROIs) are almost the same. Thus, the
difference in feature values between them will be negligible.
• However, this difference will be noteworthy in the case of diabetic foot
complications, due to the inherent thermal asymmetry between the
ipsilateral and contralateral region of foot regions.
Approach
1. The left and right foot regions are segmented using region growing
method then the binary image of the segmented foot is multiplied with
the temperature profile to acquire the temperature distribution.
2. Manually marking ROIs in segmented images.
3. The texture and temperature features are extracted from the 11
regions of interest from the foot and asymmetric analysis was
performed for the features extracted from the ipsilateral and
contralateral regions of the foot.
4. Support vector machine was used to classify the region of interest into
normal and ulcer.
1. Segmentation
• Watershed segmentation is a region-based method that has its
origins in mathematical morphology.
• In watershed segmentation an image is regarded as a topographic
landscape with ridges and valleys. The elevation values of the
landscape are typically defined by the Gray values of the
respective pixels or their gradient magnitude.
• The watershed transform decomposes an image completely and
thus assigns each pixel either to a region or a watershed.
Note: Images available in dataset have already been segmented.
1a. Tools to implement Watershed
• Insight Segmentation and Registration Toolkit
• OpenCV (The OpenCV library gives an implementation of the
modified algorithm for processing of color images with the
watersheds construction)
• Mahotas
• Skimage
• Mamba
• SMIL
1b. Resources for watershed algorithm
• OpenCV tutorial: https://opencv-python-
tutroals.readthedocs.io/en/latest/py_tutorials/py_imgproc/py_w
atershed/py_watershed.html
• Simulations for better understanding: http://www.cmm.mines-
paristech.fr/~beucher/wtshed.html
2. Marking ROIs and creating masks
• Used drawer.py from the pyvision library to get the coordinates of
ROIs.
• Used the coordinates to create a mask using OpenCV.
• Used the mask to obtain segmented pictures of ROIs which will be
used for feature extraction.
2a. Tools to implement interactive marking
• drawer.py from pyvision
• roipoly.py
• Rectangle selector from matplotlib
• imrect in MATLAB
2b. Resources for marking and creating masks
• https://raw.githubusercontent.com/cvondrick/pyvision/master/vi
sion/drawer.py
• https://stackoverflow.com/questions/25074488/how-to-mask-an-
image-using-numpy-opencv
• https://stackoverflow.com/questions/23720875/how-to-draw-a-
rectangle-around-a-region-of-interest-in-
python#:~:text=rectangle()%20%3A,corners%20are%20pt1%20and%2
0pt2.
• https://note.nkmk.me/en/python-opencv-numpy-alpha-blend-
mask/
3. Feature extraction
• The Gray level co-occurrence matrix (GLCM), a renowned
statistical technique based on joint probability distribution of pair
of pixels is used for extracting second order texture features from
ROIs in this study.
• Twelve texture features are extracted from the GLCM of the
eleven ROIs for both left and right foot region and stored as
feature vectors in the database for training the network.
3a. Tools to extract GLCM features
• Mahotas
• OpenCV
• Skimage
3b. Resources for GLCM
• Mahotas code: https://gogul.dev/software/texture-recognition
• Skimage tutorial: https://scikit-
image.org/docs/dev/auto_examples/features_detection/plot_glc
m.html
• For a detailed study:
https://prism.ucalgary.ca/bitstream/handle/1880/51900/texture
%20tutorial%20v%203_0%20180206.pdf?sequence=11&isAllowed=y
4. Classification
• Support Vector Machine (SVM) is a discriminative classifier
algorithm and was used in this paper to detect diabetes.
• The features of 11 ROIs were flattened into 1D array and fed into
the SVM for training.
4a. Tools to implement SVM
• Scikit-learn
4b. Resources for SVM
• Scikit-learn tutorial: https://scikit-
learn.org/stable/modules/svm.html
• Practical Guide:
https://www.csie.ntu.edu.tw/~cjlin/papers/guide/guide.pdf

More Related Content

Similar to Computer aided detection of diabetic foot ulcer using asymmetry analysis of texture and temperature features (GUIDE)

Understanding Users Behaviours in User-Centric Immersive Communications
Understanding Users Behaviours in User-Centric Immersive CommunicationsUnderstanding Users Behaviours in User-Centric Immersive Communications
Understanding Users Behaviours in User-Centric Immersive Communications
Förderverein Technische Fakultät
 
OBJECT DETECTION, EXTRACTION AND CLASSIFICATION USING IMAGE PROCESSING TECHNIQUE
OBJECT DETECTION, EXTRACTION AND CLASSIFICATION USING IMAGE PROCESSING TECHNIQUEOBJECT DETECTION, EXTRACTION AND CLASSIFICATION USING IMAGE PROCESSING TECHNIQUE
OBJECT DETECTION, EXTRACTION AND CLASSIFICATION USING IMAGE PROCESSING TECHNIQUE
Journal For Research
 
INTERACTIVE ANALYTICAL TOOL FOR CORNEAL CONFOCAL IMAGING
INTERACTIVE ANALYTICAL TOOL FOR CORNEAL CONFOCAL IMAGINGINTERACTIVE ANALYTICAL TOOL FOR CORNEAL CONFOCAL IMAGING
INTERACTIVE ANALYTICAL TOOL FOR CORNEAL CONFOCAL IMAGING
Madhavi Tippani
 

Similar to Computer aided detection of diabetic foot ulcer using asymmetry analysis of texture and temperature features (GUIDE) (20)

Temporal Contrast Vision Sensor
Temporal Contrast Vision SensorTemporal Contrast Vision Sensor
Temporal Contrast Vision Sensor
 
Thermal Imaging in Surgical Site Infection (SSI) Detection
Thermal Imaging in Surgical Site Infection (SSI) DetectionThermal Imaging in Surgical Site Infection (SSI) Detection
Thermal Imaging in Surgical Site Infection (SSI) Detection
 
E017443136
E017443136E017443136
E017443136
 
IRJET - Human Eye Pupil Detection Technique using Center of Gravity Method
IRJET - Human Eye Pupil Detection Technique using Center of Gravity MethodIRJET - Human Eye Pupil Detection Technique using Center of Gravity Method
IRJET - Human Eye Pupil Detection Technique using Center of Gravity Method
 
DNA microarray Technique
DNA microarray TechniqueDNA microarray Technique
DNA microarray Technique
 
A novel approach to face recognition based on thermal imaging
A novel approach to face recognition based on thermal imagingA novel approach to face recognition based on thermal imaging
A novel approach to face recognition based on thermal imaging
 
A novel approach to face recognition based on thermal imaging
A novel approach to face recognition based on thermal imagingA novel approach to face recognition based on thermal imaging
A novel approach to face recognition based on thermal imaging
 
Details about INSA projects by Vitalina Ostapenko (english)
Details about INSA projects by Vitalina Ostapenko (english)Details about INSA projects by Vitalina Ostapenko (english)
Details about INSA projects by Vitalina Ostapenko (english)
 
Digital cephalometrics
Digital cephalometricsDigital cephalometrics
Digital cephalometrics
 
INTERNET OF THINGS IMPLEMENTATION FOR WIRELESS MONITORING OF AGRICULTURAL...
INTERNET OF THINGS IMPLEMENTATION FOR WIRELESS MONITORING     OF AGRICULTURAL...INTERNET OF THINGS IMPLEMENTATION FOR WIRELESS MONITORING     OF AGRICULTURAL...
INTERNET OF THINGS IMPLEMENTATION FOR WIRELESS MONITORING OF AGRICULTURAL...
 
Human Action Recognition using Contour History Images and Neural Networks Cla...
Human Action Recognition using Contour History Images and Neural Networks Cla...Human Action Recognition using Contour History Images and Neural Networks Cla...
Human Action Recognition using Contour History Images and Neural Networks Cla...
 
04 sem cert hparticipation_final
04 sem cert hparticipation_final04 sem cert hparticipation_final
04 sem cert hparticipation_final
 
Understanding Users Behaviours in User-Centric Immersive Communications
Understanding Users Behaviours in User-Centric Immersive CommunicationsUnderstanding Users Behaviours in User-Centric Immersive Communications
Understanding Users Behaviours in User-Centric Immersive Communications
 
Comparison of Segmentation Algorithms and Estimation of Optimal Segmentation ...
Comparison of Segmentation Algorithms and Estimation of Optimal Segmentation ...Comparison of Segmentation Algorithms and Estimation of Optimal Segmentation ...
Comparison of Segmentation Algorithms and Estimation of Optimal Segmentation ...
 
Prof. Dermot Diamond
Prof. Dermot DiamondProf. Dermot Diamond
Prof. Dermot Diamond
 
IRJET- Smart Mirror using Eye Gaze Tracking
IRJET- Smart Mirror using Eye Gaze TrackingIRJET- Smart Mirror using Eye Gaze Tracking
IRJET- Smart Mirror using Eye Gaze Tracking
 
Retina recognition biometrics drishtysharma
Retina recognition biometrics drishtysharmaRetina recognition biometrics drishtysharma
Retina recognition biometrics drishtysharma
 
OBJECT DETECTION, EXTRACTION AND CLASSIFICATION USING IMAGE PROCESSING TECHNIQUE
OBJECT DETECTION, EXTRACTION AND CLASSIFICATION USING IMAGE PROCESSING TECHNIQUEOBJECT DETECTION, EXTRACTION AND CLASSIFICATION USING IMAGE PROCESSING TECHNIQUE
OBJECT DETECTION, EXTRACTION AND CLASSIFICATION USING IMAGE PROCESSING TECHNIQUE
 
INTERACTIVE ANALYTICAL TOOL FOR CORNEAL CONFOCAL IMAGING
INTERACTIVE ANALYTICAL TOOL FOR CORNEAL CONFOCAL IMAGINGINTERACTIVE ANALYTICAL TOOL FOR CORNEAL CONFOCAL IMAGING
INTERACTIVE ANALYTICAL TOOL FOR CORNEAL CONFOCAL IMAGING
 
IRJET - Object Identification in Steel Container through Thermal Image Pi...
IRJET -  	  Object Identification in Steel Container through Thermal Image Pi...IRJET -  	  Object Identification in Steel Container through Thermal Image Pi...
IRJET - Object Identification in Steel Container through Thermal Image Pi...
 

Recently uploaded

The basics of sentences session 3pptx.pptx
The basics of sentences session 3pptx.pptxThe basics of sentences session 3pptx.pptx
The basics of sentences session 3pptx.pptx
heathfieldcps1
 

Recently uploaded (20)

How to Manage Call for Tendor in Odoo 17
How to Manage Call for Tendor in Odoo 17How to Manage Call for Tendor in Odoo 17
How to Manage Call for Tendor in Odoo 17
 
Basic Civil Engineering first year Notes- Chapter 4 Building.pptx
Basic Civil Engineering first year Notes- Chapter 4 Building.pptxBasic Civil Engineering first year Notes- Chapter 4 Building.pptx
Basic Civil Engineering first year Notes- Chapter 4 Building.pptx
 
How to Add New Custom Addons Path in Odoo 17
How to Add New Custom Addons Path in Odoo 17How to Add New Custom Addons Path in Odoo 17
How to Add New Custom Addons Path in Odoo 17
 
latest AZ-104 Exam Questions and Answers
latest AZ-104 Exam Questions and Answerslatest AZ-104 Exam Questions and Answers
latest AZ-104 Exam Questions and Answers
 
Food safety_Challenges food safety laboratories_.pdf
Food safety_Challenges food safety laboratories_.pdfFood safety_Challenges food safety laboratories_.pdf
Food safety_Challenges food safety laboratories_.pdf
 
OSCM Unit 2_Operations Processes & Systems
OSCM Unit 2_Operations Processes & SystemsOSCM Unit 2_Operations Processes & Systems
OSCM Unit 2_Operations Processes & Systems
 
Beyond_Borders_Understanding_Anime_and_Manga_Fandom_A_Comprehensive_Audience_...
Beyond_Borders_Understanding_Anime_and_Manga_Fandom_A_Comprehensive_Audience_...Beyond_Borders_Understanding_Anime_and_Manga_Fandom_A_Comprehensive_Audience_...
Beyond_Borders_Understanding_Anime_and_Manga_Fandom_A_Comprehensive_Audience_...
 
TỔNG ÔN TẬP THI VÀO LỚP 10 MÔN TIẾNG ANH NĂM HỌC 2023 - 2024 CÓ ĐÁP ÁN (NGỮ Â...
TỔNG ÔN TẬP THI VÀO LỚP 10 MÔN TIẾNG ANH NĂM HỌC 2023 - 2024 CÓ ĐÁP ÁN (NGỮ Â...TỔNG ÔN TẬP THI VÀO LỚP 10 MÔN TIẾNG ANH NĂM HỌC 2023 - 2024 CÓ ĐÁP ÁN (NGỮ Â...
TỔNG ÔN TẬP THI VÀO LỚP 10 MÔN TIẾNG ANH NĂM HỌC 2023 - 2024 CÓ ĐÁP ÁN (NGỮ Â...
 
General Principles of Intellectual Property: Concepts of Intellectual Proper...
General Principles of Intellectual Property: Concepts of Intellectual  Proper...General Principles of Intellectual Property: Concepts of Intellectual  Proper...
General Principles of Intellectual Property: Concepts of Intellectual Proper...
 
On National Teacher Day, meet the 2024-25 Kenan Fellows
On National Teacher Day, meet the 2024-25 Kenan FellowsOn National Teacher Day, meet the 2024-25 Kenan Fellows
On National Teacher Day, meet the 2024-25 Kenan Fellows
 
Towards a code of practice for AI in AT.pptx
Towards a code of practice for AI in AT.pptxTowards a code of practice for AI in AT.pptx
Towards a code of practice for AI in AT.pptx
 
The basics of sentences session 3pptx.pptx
The basics of sentences session 3pptx.pptxThe basics of sentences session 3pptx.pptx
The basics of sentences session 3pptx.pptx
 
dusjagr & nano talk on open tools for agriculture research and learning
dusjagr & nano talk on open tools for agriculture research and learningdusjagr & nano talk on open tools for agriculture research and learning
dusjagr & nano talk on open tools for agriculture research and learning
 
How to setup Pycharm environment for Odoo 17.pptx
How to setup Pycharm environment for Odoo 17.pptxHow to setup Pycharm environment for Odoo 17.pptx
How to setup Pycharm environment for Odoo 17.pptx
 
Jamworks pilot and AI at Jisc (20/03/2024)
Jamworks pilot and AI at Jisc (20/03/2024)Jamworks pilot and AI at Jisc (20/03/2024)
Jamworks pilot and AI at Jisc (20/03/2024)
 
Details on CBSE Compartment Exam.pptx1111
Details on CBSE Compartment Exam.pptx1111Details on CBSE Compartment Exam.pptx1111
Details on CBSE Compartment Exam.pptx1111
 
Simple, Complex, and Compound Sentences Exercises.pdf
Simple, Complex, and Compound Sentences Exercises.pdfSimple, Complex, and Compound Sentences Exercises.pdf
Simple, Complex, and Compound Sentences Exercises.pdf
 
Philosophy of china and it's charactistics
Philosophy of china and it's charactisticsPhilosophy of china and it's charactistics
Philosophy of china and it's charactistics
 
21st_Century_Skills_Framework_Final_Presentation_2.pptx
21st_Century_Skills_Framework_Final_Presentation_2.pptx21st_Century_Skills_Framework_Final_Presentation_2.pptx
21st_Century_Skills_Framework_Final_Presentation_2.pptx
 
Wellbeing inclusion and digital dystopias.pptx
Wellbeing inclusion and digital dystopias.pptxWellbeing inclusion and digital dystopias.pptx
Wellbeing inclusion and digital dystopias.pptx
 

Computer aided detection of diabetic foot ulcer using asymmetry analysis of texture and temperature features (GUIDE)

  • 1. Computer aided detection of diabetic foot ulcer using asymmetry analysis of texture and temperature features Guide by Utkarsh Nag Authors of the paper: J. Saminathan, M. Sasikala, VB. Narayanamurthy, K. Rajesh, R. Arvind Link to paper: https://doi.org/10.1016/j.infrared.2020.103219
  • 2. Background • Asymmetric analysis in temperature distribution and external stress analysis have been the most common analyses for identifying diabetic foot complications. • In the foot thermograms of the control group, symmetric temperature distributions are habitually observed in both foot region and, hence, texture and temperature features extracted from ipsilateral and contralateral regions of the foot (ROIs) are almost the same. Thus, the difference in feature values between them will be negligible. • However, this difference will be noteworthy in the case of diabetic foot complications, due to the inherent thermal asymmetry between the ipsilateral and contralateral region of foot regions.
  • 3. Approach 1. The left and right foot regions are segmented using region growing method then the binary image of the segmented foot is multiplied with the temperature profile to acquire the temperature distribution. 2. Manually marking ROIs in segmented images. 3. The texture and temperature features are extracted from the 11 regions of interest from the foot and asymmetric analysis was performed for the features extracted from the ipsilateral and contralateral regions of the foot. 4. Support vector machine was used to classify the region of interest into normal and ulcer.
  • 4. 1. Segmentation • Watershed segmentation is a region-based method that has its origins in mathematical morphology. • In watershed segmentation an image is regarded as a topographic landscape with ridges and valleys. The elevation values of the landscape are typically defined by the Gray values of the respective pixels or their gradient magnitude. • The watershed transform decomposes an image completely and thus assigns each pixel either to a region or a watershed. Note: Images available in dataset have already been segmented.
  • 5. 1a. Tools to implement Watershed • Insight Segmentation and Registration Toolkit • OpenCV (The OpenCV library gives an implementation of the modified algorithm for processing of color images with the watersheds construction) • Mahotas • Skimage • Mamba • SMIL
  • 6. 1b. Resources for watershed algorithm • OpenCV tutorial: https://opencv-python- tutroals.readthedocs.io/en/latest/py_tutorials/py_imgproc/py_w atershed/py_watershed.html • Simulations for better understanding: http://www.cmm.mines- paristech.fr/~beucher/wtshed.html
  • 7. 2. Marking ROIs and creating masks • Used drawer.py from the pyvision library to get the coordinates of ROIs. • Used the coordinates to create a mask using OpenCV. • Used the mask to obtain segmented pictures of ROIs which will be used for feature extraction.
  • 8. 2a. Tools to implement interactive marking • drawer.py from pyvision • roipoly.py • Rectangle selector from matplotlib • imrect in MATLAB
  • 9. 2b. Resources for marking and creating masks • https://raw.githubusercontent.com/cvondrick/pyvision/master/vi sion/drawer.py • https://stackoverflow.com/questions/25074488/how-to-mask-an- image-using-numpy-opencv • https://stackoverflow.com/questions/23720875/how-to-draw-a- rectangle-around-a-region-of-interest-in- python#:~:text=rectangle()%20%3A,corners%20are%20pt1%20and%2 0pt2. • https://note.nkmk.me/en/python-opencv-numpy-alpha-blend- mask/
  • 10. 3. Feature extraction • The Gray level co-occurrence matrix (GLCM), a renowned statistical technique based on joint probability distribution of pair of pixels is used for extracting second order texture features from ROIs in this study. • Twelve texture features are extracted from the GLCM of the eleven ROIs for both left and right foot region and stored as feature vectors in the database for training the network.
  • 11. 3a. Tools to extract GLCM features • Mahotas • OpenCV • Skimage
  • 12. 3b. Resources for GLCM • Mahotas code: https://gogul.dev/software/texture-recognition • Skimage tutorial: https://scikit- image.org/docs/dev/auto_examples/features_detection/plot_glc m.html • For a detailed study: https://prism.ucalgary.ca/bitstream/handle/1880/51900/texture %20tutorial%20v%203_0%20180206.pdf?sequence=11&isAllowed=y
  • 13. 4. Classification • Support Vector Machine (SVM) is a discriminative classifier algorithm and was used in this paper to detect diabetes. • The features of 11 ROIs were flattened into 1D array and fed into the SVM for training.
  • 14. 4a. Tools to implement SVM • Scikit-learn
  • 15. 4b. Resources for SVM • Scikit-learn tutorial: https://scikit- learn.org/stable/modules/svm.html • Practical Guide: https://www.csie.ntu.edu.tw/~cjlin/papers/guide/guide.pdf