SlideShare a Scribd company logo
CONTENT BASED IMAGE RETRIEVAL BY METRIC LEARNING FROM
RADIOLOGY REPORTS: APPLICATION TO INTERSTITIAL LUNG DISEASES
ABSTRACT
Content Based Image Retrieval (CBIR) is a searchtechnology that could aid medical
diagnosis by retrieving andpresenting earlier reported cases that are related to the one
beingdiagnosed. To retrieve relevant cases, CBIR systems depend onsupervised learning to map
low level image contents to high leveldiagnostic concepts. However, the annotation by medical
doctorsfor training and evaluation purposes is a difficult and timeconsumingtask, which restricts
the supervised learning phaseto specific CBIR problems of well defined clinical
applications.This paper proposes a new technique that automatically learnsthe similarity between
the several exams from textual distancesextracted from radiology reports, thereby successfully
reducing the number of annotations needed. Our method firstly infersthe relation between
patients by using information retrievaltechniques to determine the textual distances between
patientradiology reports. These distances are subsequently used tosupervise a metric learning
algorithm, that transforms the image space accordingly to textual distances. CBIRsystemswith
different image descriptions and different levels of medicalannotations were evaluated, with and
without supervision fromtextual distances, using a database of computer tomographyscans of
patients with interstitial lung diseases. The proposedmethod consistently improves CBIR mean
average precision, withimprovements that can reach 38%, and more marked gains forsmall
annotation sets. Given the overall availability of radiology reports in Picture Archiving and
Communication Systems, theproposed approach can be broadly applied to CBIR systems
indifferent medical problems, and may facilitate the introductionof CBIR in clinical practice.

More Related Content

What's hot

E-book Thesis Sara Carvalho
E-book Thesis  Sara CarvalhoE-book Thesis  Sara Carvalho
E-book Thesis Sara Carvalho
Sara Carvalho
 

What's hot (13)

Statistical Feature-based Neural Network Approach for the Detection of Lung C...
Statistical Feature-based Neural Network Approach for the Detection of Lung C...Statistical Feature-based Neural Network Approach for the Detection of Lung C...
Statistical Feature-based Neural Network Approach for the Detection of Lung C...
 
E-book Thesis Sara Carvalho
E-book Thesis  Sara CarvalhoE-book Thesis  Sara Carvalho
E-book Thesis Sara Carvalho
 
Lung Cancer Detection on CT Images by using Image Processing
Lung Cancer Detection on CT Images by using Image ProcessingLung Cancer Detection on CT Images by using Image Processing
Lung Cancer Detection on CT Images by using Image Processing
 
M sc research_project_report_x18134599
M sc research_project_report_x18134599M sc research_project_report_x18134599
M sc research_project_report_x18134599
 
IRJET - Classification of Cancer Images using Deep Learning
IRJET -  	  Classification of Cancer Images using Deep LearningIRJET -  	  Classification of Cancer Images using Deep Learning
IRJET - Classification of Cancer Images using Deep Learning
 
Master's Thesis
Master's ThesisMaster's Thesis
Master's Thesis
 
Pneumonia Detection using CNN
Pneumonia Detection using CNNPneumonia Detection using CNN
Pneumonia Detection using CNN
 
Lung Cancer Detection using Machine Learning
Lung Cancer Detection using Machine LearningLung Cancer Detection using Machine Learning
Lung Cancer Detection using Machine Learning
 
Neural Network Based Brain Tumor Detection using MR Images
Neural Network Based Brain Tumor Detection using MR ImagesNeural Network Based Brain Tumor Detection using MR Images
Neural Network Based Brain Tumor Detection using MR Images
 
Convolutional capsule network for covid 19 detection
Convolutional capsule network for covid 19 detectionConvolutional capsule network for covid 19 detection
Convolutional capsule network for covid 19 detection
 
A New Algorithm for Fully Automatic Brain Tumor Segmentation with 3-D Convolu...
A New Algorithm for Fully Automatic Brain Tumor Segmentation with 3-D Convolu...A New Algorithm for Fully Automatic Brain Tumor Segmentation with 3-D Convolu...
A New Algorithm for Fully Automatic Brain Tumor Segmentation with 3-D Convolu...
 
A new approach for content-based image retrieval for medical applications usi...
A new approach for content-based image retrieval for medical applications usi...A new approach for content-based image retrieval for medical applications usi...
A new approach for content-based image retrieval for medical applications usi...
 
BREAST CANCER DIAGNOSIS USING MACHINE LEARNING ALGORITHMS –A SURVEY
BREAST CANCER DIAGNOSIS USING MACHINE LEARNING ALGORITHMS –A SURVEYBREAST CANCER DIAGNOSIS USING MACHINE LEARNING ALGORITHMS –A SURVEY
BREAST CANCER DIAGNOSIS USING MACHINE LEARNING ALGORITHMS –A SURVEY
 

Similar to Content based image retrieval by metric learning from radiology reports application to interstitial lung diseases

IJCER (www.ijceronline.com) International Journal of computational Engineerin...
IJCER (www.ijceronline.com) International Journal of computational Engineerin...IJCER (www.ijceronline.com) International Journal of computational Engineerin...
IJCER (www.ijceronline.com) International Journal of computational Engineerin...
ijceronline
 
i2164-2591-8-6-4 (1).pdf presentation cm
i2164-2591-8-6-4 (1).pdf presentation cmi2164-2591-8-6-4 (1).pdf presentation cm
i2164-2591-8-6-4 (1).pdf presentation cm
ahsamjutt1234
 
ADVANCED HIERARCHICAL IMAGING TECHNIQUES IN TB DIAGNOSIS: LEVERAGING SWIN TRA...
ADVANCED HIERARCHICAL IMAGING TECHNIQUES IN TB DIAGNOSIS: LEVERAGING SWIN TRA...ADVANCED HIERARCHICAL IMAGING TECHNIQUES IN TB DIAGNOSIS: LEVERAGING SWIN TRA...
ADVANCED HIERARCHICAL IMAGING TECHNIQUES IN TB DIAGNOSIS: LEVERAGING SWIN TRA...
sipij
 

Similar to Content based image retrieval by metric learning from radiology reports application to interstitial lung diseases (20)

Content based image retrieval by metric learning from radiology reports appli...
Content based image retrieval by metric learning from radiology reports appli...Content based image retrieval by metric learning from radiology reports appli...
Content based image retrieval by metric learning from radiology reports appli...
 
International Journal of Computational Engineering Research(IJCER)
International Journal of Computational Engineering Research(IJCER)International Journal of Computational Engineering Research(IJCER)
International Journal of Computational Engineering Research(IJCER)
 
IJCER (www.ijceronline.com) International Journal of computational Engineerin...
IJCER (www.ijceronline.com) International Journal of computational Engineerin...IJCER (www.ijceronline.com) International Journal of computational Engineerin...
IJCER (www.ijceronline.com) International Journal of computational Engineerin...
 
International Journal of Computational Engineering Research(IJCER)
International Journal of Computational Engineering Research(IJCER)International Journal of Computational Engineering Research(IJCER)
International Journal of Computational Engineering Research(IJCER)
 
IRJET- Breast Cancer Detection from Histopathology Images: A Review
IRJET-  	  Breast Cancer Detection from Histopathology Images: A ReviewIRJET-  	  Breast Cancer Detection from Histopathology Images: A Review
IRJET- Breast Cancer Detection from Histopathology Images: A Review
 
IRJET- Content based Medical Image Retrieval for Diagnosing Lung Diseases usi...
IRJET- Content based Medical Image Retrieval for Diagnosing Lung Diseases usi...IRJET- Content based Medical Image Retrieval for Diagnosing Lung Diseases usi...
IRJET- Content based Medical Image Retrieval for Diagnosing Lung Diseases usi...
 
i2164-2591-8-6-4 (1).pdf presentation cm
i2164-2591-8-6-4 (1).pdf presentation cmi2164-2591-8-6-4 (1).pdf presentation cm
i2164-2591-8-6-4 (1).pdf presentation cm
 
Top Cited Articles in Signal & Image Processing 2021-2022
Top Cited Articles in Signal & Image Processing 2021-2022Top Cited Articles in Signal & Image Processing 2021-2022
Top Cited Articles in Signal & Image Processing 2021-2022
 
Performance Comparison Analysis for Medical Images Using Deep Learning Approa...
Performance Comparison Analysis for Medical Images Using Deep Learning Approa...Performance Comparison Analysis for Medical Images Using Deep Learning Approa...
Performance Comparison Analysis for Medical Images Using Deep Learning Approa...
 
harsh final ppt (2).pptx
harsh final ppt (2).pptxharsh final ppt (2).pptx
harsh final ppt (2).pptx
 
Pneumonia Detection Using Convolutional Neural Network Writers
Pneumonia Detection Using Convolutional Neural Network WritersPneumonia Detection Using Convolutional Neural Network Writers
Pneumonia Detection Using Convolutional Neural Network Writers
 
A statistical approach on pulmonary tuberculosis detection system based on X-...
A statistical approach on pulmonary tuberculosis detection system based on X-...A statistical approach on pulmonary tuberculosis detection system based on X-...
A statistical approach on pulmonary tuberculosis detection system based on X-...
 
S4502115119
S4502115119S4502115119
S4502115119
 
ADVANCED HIERARCHICAL IMAGING TECHNIQUES IN TB DIAGNOSIS: LEVERAGING SWIN TRA...
ADVANCED HIERARCHICAL IMAGING TECHNIQUES IN TB DIAGNOSIS: LEVERAGING SWIN TRA...ADVANCED HIERARCHICAL IMAGING TECHNIQUES IN TB DIAGNOSIS: LEVERAGING SWIN TRA...
ADVANCED HIERARCHICAL IMAGING TECHNIQUES IN TB DIAGNOSIS: LEVERAGING SWIN TRA...
 
FYP SEM VIII TT1 Presentation.pptx
FYP SEM VIII TT1 Presentation.pptxFYP SEM VIII TT1 Presentation.pptx
FYP SEM VIII TT1 Presentation.pptx
 
Automated Generation Of Synoptic Reports From Narrative Pathology Reports In ...
Automated Generation Of Synoptic Reports From Narrative Pathology Reports In ...Automated Generation Of Synoptic Reports From Narrative Pathology Reports In ...
Automated Generation Of Synoptic Reports From Narrative Pathology Reports In ...
 
iknife
iknifeiknife
iknife
 
deep learning applications in medical image analysis brain tumor
deep learning applications in medical image analysis brain tumordeep learning applications in medical image analysis brain tumor
deep learning applications in medical image analysis brain tumor
 
The Clinical use of Artificial Intelligence in the Analysis of Chest Radiogra...
The Clinical use of Artificial Intelligence in the Analysis of Chest Radiogra...The Clinical use of Artificial Intelligence in the Analysis of Chest Radiogra...
The Clinical use of Artificial Intelligence in the Analysis of Chest Radiogra...
 
The Clinical use of Artificial Intelligence in the Analysis of Chest Radiogra...
The Clinical use of Artificial Intelligence in the Analysis of Chest Radiogra...The Clinical use of Artificial Intelligence in the Analysis of Chest Radiogra...
The Clinical use of Artificial Intelligence in the Analysis of Chest Radiogra...
 

More from I3E Technologies

More from I3E Technologies (20)

Add
AddAdd
Add
 
Design of a low voltage low-dropout regulator
Design of a low voltage low-dropout regulatorDesign of a low voltage low-dropout regulator
Design of a low voltage low-dropout regulator
 
An efficient constant multiplier architecture based on vertical horizontal bi...
An efficient constant multiplier architecture based on vertical horizontal bi...An efficient constant multiplier architecture based on vertical horizontal bi...
An efficient constant multiplier architecture based on vertical horizontal bi...
 
Aging aware reliable multiplier design with adaptive hold logic
Aging aware reliable multiplier design with adaptive hold logicAging aware reliable multiplier design with adaptive hold logic
Aging aware reliable multiplier design with adaptive hold logic
 
A high performance fir filter architecture for fixed and reconfigurable appli...
A high performance fir filter architecture for fixed and reconfigurable appli...A high performance fir filter architecture for fixed and reconfigurable appli...
A high performance fir filter architecture for fixed and reconfigurable appli...
 
A generalized algorithm and reconfigurable architecture for efficient and sca...
A generalized algorithm and reconfigurable architecture for efficient and sca...A generalized algorithm and reconfigurable architecture for efficient and sca...
A generalized algorithm and reconfigurable architecture for efficient and sca...
 
A combined sdc sdf architecture for normal i o pipelined radix-2 fft
A combined sdc sdf architecture for normal i o pipelined radix-2 fftA combined sdc sdf architecture for normal i o pipelined radix-2 fft
A combined sdc sdf architecture for normal i o pipelined radix-2 fft
 
Reverse converter design via parallel prefix adders novel components, method...
Reverse converter design via parallel prefix adders  novel components, method...Reverse converter design via parallel prefix adders  novel components, method...
Reverse converter design via parallel prefix adders novel components, method...
 
Pre encoded multipliers based on non-redundant radix-4 signed-digit encoding
Pre encoded multipliers based on non-redundant radix-4 signed-digit encodingPre encoded multipliers based on non-redundant radix-4 signed-digit encoding
Pre encoded multipliers based on non-redundant radix-4 signed-digit encoding
 
Energy optimized subthreshold vlsi logic family with unbalanced pull up down ...
Energy optimized subthreshold vlsi logic family with unbalanced pull up down ...Energy optimized subthreshold vlsi logic family with unbalanced pull up down ...
Energy optimized subthreshold vlsi logic family with unbalanced pull up down ...
 
Variable form carrier-based pwm for boost-voltage motor driver with a charge-...
Variable form carrier-based pwm for boost-voltage motor driver with a charge-...Variable form carrier-based pwm for boost-voltage motor driver with a charge-...
Variable form carrier-based pwm for boost-voltage motor driver with a charge-...
 
Ultrasparse ac link converters
Ultrasparse ac link convertersUltrasparse ac link converters
Ultrasparse ac link converters
 
Single inductor dual-output buck–boost power factor correction converter
Single inductor dual-output buck–boost power factor correction converterSingle inductor dual-output buck–boost power factor correction converter
Single inductor dual-output buck–boost power factor correction converter
 
Ripple minimization through harmonic elimination in asymmetric interleaved mu...
Ripple minimization through harmonic elimination in asymmetric interleaved mu...Ripple minimization through harmonic elimination in asymmetric interleaved mu...
Ripple minimization through harmonic elimination in asymmetric interleaved mu...
 
Resonance analysis and soft switching design of isolated boost converter with...
Resonance analysis and soft switching design of isolated boost converter with...Resonance analysis and soft switching design of isolated boost converter with...
Resonance analysis and soft switching design of isolated boost converter with...
 
Reliability evaluation of conventional and interleaved dc–dc boost converters
Reliability evaluation of conventional and interleaved dc–dc boost convertersReliability evaluation of conventional and interleaved dc–dc boost converters
Reliability evaluation of conventional and interleaved dc–dc boost converters
 
Power factor corrected zeta converter based improved power quality switched m...
Power factor corrected zeta converter based improved power quality switched m...Power factor corrected zeta converter based improved power quality switched m...
Power factor corrected zeta converter based improved power quality switched m...
 
Pfc cuk converter fed bldc motor drive
Pfc cuk converter fed bldc motor drivePfc cuk converter fed bldc motor drive
Pfc cuk converter fed bldc motor drive
 
Optimized operation of current fed dual active bridge dc dc converter for pv ...
Optimized operation of current fed dual active bridge dc dc converter for pv ...Optimized operation of current fed dual active bridge dc dc converter for pv ...
Optimized operation of current fed dual active bridge dc dc converter for pv ...
 
Online variable topology type photovoltaic grid-connected inverter
Online variable topology type photovoltaic grid-connected inverterOnline variable topology type photovoltaic grid-connected inverter
Online variable topology type photovoltaic grid-connected inverter
 

Recently uploaded

Automobile Management System Project Report.pdf
Automobile Management System Project Report.pdfAutomobile Management System Project Report.pdf
Automobile Management System Project Report.pdf
Kamal Acharya
 
CFD Simulation of By-pass Flow in a HRSG module by R&R Consult.pptx
CFD Simulation of By-pass Flow in a HRSG module by R&R Consult.pptxCFD Simulation of By-pass Flow in a HRSG module by R&R Consult.pptx
CFD Simulation of By-pass Flow in a HRSG module by R&R Consult.pptx
R&R Consult
 
Online blood donation management system project.pdf
Online blood donation management system project.pdfOnline blood donation management system project.pdf
Online blood donation management system project.pdf
Kamal Acharya
 
Digital Signal Processing Lecture notes n.pdf
Digital Signal Processing Lecture notes n.pdfDigital Signal Processing Lecture notes n.pdf
Digital Signal Processing Lecture notes n.pdf
AbrahamGadissa
 
Hall booking system project report .pdf
Hall booking system project report  .pdfHall booking system project report  .pdf
Hall booking system project report .pdf
Kamal Acharya
 
ONLINE VEHICLE RENTAL SYSTEM PROJECT REPORT.pdf
ONLINE VEHICLE RENTAL SYSTEM PROJECT REPORT.pdfONLINE VEHICLE RENTAL SYSTEM PROJECT REPORT.pdf
ONLINE VEHICLE RENTAL SYSTEM PROJECT REPORT.pdf
Kamal Acharya
 

Recently uploaded (20)

BRAKING SYSTEM IN INDIAN RAILWAY AutoCAD DRAWING
BRAKING SYSTEM IN INDIAN RAILWAY AutoCAD DRAWINGBRAKING SYSTEM IN INDIAN RAILWAY AutoCAD DRAWING
BRAKING SYSTEM IN INDIAN RAILWAY AutoCAD DRAWING
 
Toll tax management system project report..pdf
Toll tax management system project report..pdfToll tax management system project report..pdf
Toll tax management system project report..pdf
 
KIT-601 Lecture Notes-UNIT-3.pdf Mining Data Stream
KIT-601 Lecture Notes-UNIT-3.pdf Mining Data StreamKIT-601 Lecture Notes-UNIT-3.pdf Mining Data Stream
KIT-601 Lecture Notes-UNIT-3.pdf Mining Data Stream
 
Automobile Management System Project Report.pdf
Automobile Management System Project Report.pdfAutomobile Management System Project Report.pdf
Automobile Management System Project Report.pdf
 
NO1 Pandit Amil Baba In Bahawalpur, Sargodha, Sialkot, Sheikhupura, Rahim Yar...
NO1 Pandit Amil Baba In Bahawalpur, Sargodha, Sialkot, Sheikhupura, Rahim Yar...NO1 Pandit Amil Baba In Bahawalpur, Sargodha, Sialkot, Sheikhupura, Rahim Yar...
NO1 Pandit Amil Baba In Bahawalpur, Sargodha, Sialkot, Sheikhupura, Rahim Yar...
 
CFD Simulation of By-pass Flow in a HRSG module by R&R Consult.pptx
CFD Simulation of By-pass Flow in a HRSG module by R&R Consult.pptxCFD Simulation of By-pass Flow in a HRSG module by R&R Consult.pptx
CFD Simulation of By-pass Flow in a HRSG module by R&R Consult.pptx
 
Online blood donation management system project.pdf
Online blood donation management system project.pdfOnline blood donation management system project.pdf
Online blood donation management system project.pdf
 
Construction method of steel structure space frame .pptx
Construction method of steel structure space frame .pptxConstruction method of steel structure space frame .pptx
Construction method of steel structure space frame .pptx
 
Cloud-Computing_CSE311_Computer-Networking CSE GUB BD - Shahidul.pptx
Cloud-Computing_CSE311_Computer-Networking CSE GUB BD - Shahidul.pptxCloud-Computing_CSE311_Computer-Networking CSE GUB BD - Shahidul.pptx
Cloud-Computing_CSE311_Computer-Networking CSE GUB BD - Shahidul.pptx
 
HYDROPOWER - Hydroelectric power generation
HYDROPOWER - Hydroelectric power generationHYDROPOWER - Hydroelectric power generation
HYDROPOWER - Hydroelectric power generation
 
Digital Signal Processing Lecture notes n.pdf
Digital Signal Processing Lecture notes n.pdfDigital Signal Processing Lecture notes n.pdf
Digital Signal Processing Lecture notes n.pdf
 
KIT-601 Lecture Notes-UNIT-5.pdf Frame Works and Visualization
KIT-601 Lecture Notes-UNIT-5.pdf Frame Works and VisualizationKIT-601 Lecture Notes-UNIT-5.pdf Frame Works and Visualization
KIT-601 Lecture Notes-UNIT-5.pdf Frame Works and Visualization
 
RESORT MANAGEMENT AND RESERVATION SYSTEM PROJECT REPORT.pdf
RESORT MANAGEMENT AND RESERVATION SYSTEM PROJECT REPORT.pdfRESORT MANAGEMENT AND RESERVATION SYSTEM PROJECT REPORT.pdf
RESORT MANAGEMENT AND RESERVATION SYSTEM PROJECT REPORT.pdf
 
2024 DevOps Pro Europe - Growing at the edge
2024 DevOps Pro Europe - Growing at the edge2024 DevOps Pro Europe - Growing at the edge
2024 DevOps Pro Europe - Growing at the edge
 
Natalia Rutkowska - BIM School Course in Kraków
Natalia Rutkowska - BIM School Course in KrakówNatalia Rutkowska - BIM School Course in Kraków
Natalia Rutkowska - BIM School Course in Kraków
 
Event Management System Vb Net Project Report.pdf
Event Management System Vb Net  Project Report.pdfEvent Management System Vb Net  Project Report.pdf
Event Management System Vb Net Project Report.pdf
 
Hall booking system project report .pdf
Hall booking system project report  .pdfHall booking system project report  .pdf
Hall booking system project report .pdf
 
Introduction to Machine Learning Unit-4 Notes for II-II Mechanical Engineering
Introduction to Machine Learning Unit-4 Notes for II-II Mechanical EngineeringIntroduction to Machine Learning Unit-4 Notes for II-II Mechanical Engineering
Introduction to Machine Learning Unit-4 Notes for II-II Mechanical Engineering
 
Democratizing Fuzzing at Scale by Abhishek Arya
Democratizing Fuzzing at Scale by Abhishek AryaDemocratizing Fuzzing at Scale by Abhishek Arya
Democratizing Fuzzing at Scale by Abhishek Arya
 
ONLINE VEHICLE RENTAL SYSTEM PROJECT REPORT.pdf
ONLINE VEHICLE RENTAL SYSTEM PROJECT REPORT.pdfONLINE VEHICLE RENTAL SYSTEM PROJECT REPORT.pdf
ONLINE VEHICLE RENTAL SYSTEM PROJECT REPORT.pdf
 

Content based image retrieval by metric learning from radiology reports application to interstitial lung diseases

  • 1. CONTENT BASED IMAGE RETRIEVAL BY METRIC LEARNING FROM RADIOLOGY REPORTS: APPLICATION TO INTERSTITIAL LUNG DISEASES ABSTRACT Content Based Image Retrieval (CBIR) is a searchtechnology that could aid medical diagnosis by retrieving andpresenting earlier reported cases that are related to the one beingdiagnosed. To retrieve relevant cases, CBIR systems depend onsupervised learning to map low level image contents to high leveldiagnostic concepts. However, the annotation by medical doctorsfor training and evaluation purposes is a difficult and timeconsumingtask, which restricts the supervised learning phaseto specific CBIR problems of well defined clinical applications.This paper proposes a new technique that automatically learnsthe similarity between the several exams from textual distancesextracted from radiology reports, thereby successfully reducing the number of annotations needed. Our method firstly infersthe relation between patients by using information retrievaltechniques to determine the textual distances between patientradiology reports. These distances are subsequently used tosupervise a metric learning algorithm, that transforms the image space accordingly to textual distances. CBIRsystemswith different image descriptions and different levels of medicalannotations were evaluated, with and without supervision fromtextual distances, using a database of computer tomographyscans of patients with interstitial lung diseases. The proposedmethod consistently improves CBIR mean average precision, withimprovements that can reach 38%, and more marked gains forsmall annotation sets. Given the overall availability of radiology reports in Picture Archiving and Communication Systems, theproposed approach can be broadly applied to CBIR systems indifferent medical problems, and may facilitate the introductionof CBIR in clinical practice.