SlideShare a Scribd company logo

Multi-Centre Optimization and Validation of an Open Deep Learning Model for COVID-19 Detection on Chest Radiographs

•
•
Institute for Clinical Research (ICR)
Institute for Clinical Research (ICR)

NCCR 2020: Conference Of Very Important Disease (COVID-19) | 24 - 26 August 2020 Young Investigator Awards Presentation Kim-Ann Git1, Aida binti Abdul Aziz2, Lau Kiew Siong3, Lau Song Lung3, Preetvinder Singh a/l Dheer Singh4, Tan Ying Sern5, Eric Chung6 1-Selayang Hospital 2-Sungai Buloh Hospital 3-Sarawak General Hospital 4-Hospital Raja Permaisuri Bainun 5-Taiping Hospital 6-University of Malaya Medical Centre https://doi.org/10.5281/zenodo.4004461

Health & Medicine
1 of 18
Download to read offline
Multi-Centre Optimization and Validation of an Open Deep Learning Model for Covid-19 Detection on Chest Radiographs Kim-Ann Git1, Aida binti Abdul Aziz2, Lau Kiew Siong3, Lau Song Lung3, Preetvinder Singh a/l Dheer Singh4, Tan Ying Sern5, Eric Chung6 1Selayang Hospital 2Sungai Buloh Hospital 3Sarawak General Hospital 4Hospital Raja Permaisuri Bainun 5Taiping Hospital 6University of Malaya Medical Centre NMRR-20-949-54941
Introduction Consolidation Bilateral, peripheral, lower-zone No pleural effusion Ground-glass Imaging Features of Covid-19 Chest Infection
Introduction Comparison between Covid-19 Chest Infection and Non-Covid Infection Covid-19 Tuberculosis Pneumonia Can an AI model reliably detect Covid-19?
Introduction COVID-Net https://github.com/lindawangg/COVID-Net Deep-learning model developed by researchers at the University of Waterloo Tensorflow Open-Source (AGPLv3) Initial training: COVIDx Dataset & RSNA Kaggle Pneumonia Dataset 4th release Sensitivity & specificity around 90%
Hospital A Introduction COVID-Net ? Model Generalizability Model Hospital B Model Hospital A & B Model Hospital C Model Model Optimization Hospital A Model Hospital B Model Retrain Model Sensitivity & specificity around 90% Potential Solutions 6% 94% External Validation Used Not used
Objective To optimize and validate COVID-Net for the prediction of Covid-19 in CXRs of Malaysian patients To optimize COVID-Net with additional training using local CXRs To validate and compare the accuracy of the published (unoptimized) model with the optimized model using local CXRs General Objective Specific Objectives
Methodology Convenient sampling from each hospital: Cases: up to 100-150 Covid PCR+ CXRs Controls: up to 150-200 CXRs from October 2019 Training Set: 318 Cases & 368 Controls Test Set: 318 Cases & 367 Controls Data Collection: Hospital Sungai Buloh Sarawak General Hospital Hospital Raja Permaisuri Bainun Hospital Taiping University of Malaya Medical Centre Optimization Validation Published COVID- Net Model (Unoptimized) Published COVID- Net Model (Unoptimized) Optimized COVID- Net Model Optimized COVID- Net Model vs
Pre-Optimization Validation Unoptimized (4A) Prediction Normal Pneumonia Covid Ground Truth Normal 78 3 235 Pneumonia 1 16 34 Covid 96 11 211 Published (Unoptimized) COVID-Net Model 44.5% 66.4% Accuracy (All) Sensitivity (Covid-19) Published (Unoptimized)
Optimization • Training Parameters: • Image augmentation • Batch size: 4 • Optimizer: Adam • Variable learning rate: 0.0001 to 0.00003 • Epochs at each learning rate: 40+ 0 0.2 0.4 0.6 0.8 1 1.2 1.4 0 10 20 30 40 50 60 70 80 90 100 Epochs loss accuracy
Post-Optimization Validation Unoptimized (4A) Prediction Normal Pneumonia Covid Ground Truth Normal 78 3 235 Pneumonia 1 16 34 Covid 96 11 211 Published (Unoptimized) COVID-Net Model 44.5% 66.4% 77.7% 83.0% 85.3% 92.5% Accuracy (All) Sensitivity (Covid-19) Published (Unoptimized) Partially Optimized Optimized 90+ Epochs LR: 0.0001 → 0.00003 Prediction Normal Pneumonia Covid Ground Truth Normal 269 6 41 Pneumonia 12 21 18 Covid 19 5 294 Optimized COVID-Net Model 20+ Epochs LR: 0.0001 Prediction Normal Pneumonia Covid Ground Truth Normal 251 7 58 Pneumonia 13 17 21 Covid 45 9 264 Partially Optimized COVID-Net Model
Model Explainability (Grad-CAM) Sample Covid-19 PCR+ CXRs Correctly Classified as Covid-19
Model Explainability (Grad-CAM) Sample Normal CXR Correctly Classified as Normal Sample Covid PCR+ CXR Incorrectly Classified as Normal
Conclusion The published (unoptimized) COVID-Net model has mediocre performance which improved tremendously after optimization.  Model is robust but requires optimization with local CXRs before consideration for clinical use. Grad-CAMs do not reflect disease distribution. Further work is required for model explainability.
Limitations Limited GPU for optimization → Cloud Machine Learning Platforms Small number of centres → Ongoing NIH-Crest Collaborative Covid-19 Chest Radiograph (NC4R) Repository Project
Clinical Use
Acknowledgements Dr Aida binti Abdul Aziz Dr Lau Song Lung Dr Lau Kiew Siong Dr Preetvinder Singh Dr Eric Chung Dr Tan Ying Sern The authors would also like to thank the Director-General, Ministry of Health, for permission to present this paper. Dr Alexander Wong The authors would like to thank Alexander Wong of the Vision and Image Processing Lab, University of Waterloo, for his guidance on model optimization and explainability. Team Members Special Acknowledgement
References • Ai, T. Y. (2020). Correlation of chest CT and RT-PCR testing in coronavirus disease 2019 (COVID-19) in China: a report of 1014 cases. Radiology. • Chan, J. Y. (2020). Improved molecular diagnosis of COVID-19 by the novel, highly sensitive and specific COVID-19- RdRp/Hel real-time reverse transcription-PCR assay validated in vitro and with clinical specimens. Journal of Clinical Microbiology. • Hellewell, J. A. (2020). Feasibility of controlling COVID-19 outbreaks by isolation of cases and contacts. The Lacet Global Health. • Johns Hopkins University. (2020, 05 08). Coronavirus Resource Center. Retrieved from Coronavirus Resource Center: https://coronavirus.jhu.edu/map.html • Wang, L. a. (2020). COVID-Net: A tailored deep convolutional neural network design for detection of COVID-19 cases from chest radiography images. arXiv preprint.
Multi-Centre Optimization and Validation of an Open Deep Learning Model for Covid-19 Detection on Chest Radiographs Kim-Ann Git1, Aida binti Abdul Aziz2, Lau Kiew Siong3, Lau Song Lung3, Preetvinder Singh a/l Dheer Singh4, Tan Ying Sern5, Eric Chung6 1Selayang Hospital 2Sungai Buloh Hospital 3Sarawak General Hospital 4Hospital Raja Permaisuri Bainun 5Taiping Hospital 6University of Malaya Medical Centre NMRR-20-949-54941 Thank You for Your Attention!

Recommended

Detect COVID-19 with Deep Learning- A survey on Deep Learning for Pulmonary M...
Detect COVID-19 with Deep Learning- A survey on Deep Learning for Pulmonary M...Detect COVID-19 with Deep Learning- A survey on Deep Learning for Pulmonary M...
Detect COVID-19 with Deep Learning- A survey on Deep Learning for Pulmonary M...JumanaNadir
 
Covid 19 diagnosis using x-ray images and deep learning
Covid 19 diagnosis using x-ray images and deep learningCovid 19 diagnosis using x-ray images and deep learning
Covid 19 diagnosis using x-ray images and deep learningShamik Tiwari
 
Covid-19 Detection using Chest X-Ray Images
Covid-19 Detection using Chest X-Ray ImagesCovid-19 Detection using Chest X-Ray Images
Covid-19 Detection using Chest X-Ray ImagesIRJET Journal
 
Pneumonia detection using cnn
Pneumonia detection using cnnPneumonia detection using cnn
Pneumonia detection using cnnTushar Dalvi
 
PhD Defense
PhD DefensePhD Defense
PhD DefenseTaehoon Lee
 
COVID-19 detection using Chest X-rays.pdf
COVID-19 detection using Chest X-rays.pdfCOVID-19 detection using Chest X-rays.pdf
COVID-19 detection using Chest X-rays.pdfDeepakSahu480384
 
Deep Convolutional Neural Networks and Covid19 by Dr.Sana Komal
Deep Convolutional Neural Networks and Covid19 by Dr.Sana KomalDeep Convolutional Neural Networks and Covid19 by Dr.Sana Komal
Deep Convolutional Neural Networks and Covid19 by Dr.Sana KomalSana Komal
 
Chest X-ray Pneumonia Classification with Deep Learning
Chest X-ray Pneumonia Classification with Deep LearningChest X-ray Pneumonia Classification with Deep Learning
Chest X-ray Pneumonia Classification with Deep LearningBaoTramDuong2
 

Recommended

Detect COVID-19 with Deep Learning- A survey on Deep Learning for Pulmonary M...
Detect COVID-19 with Deep Learning- A survey on Deep Learning for Pulmonary M...Detect COVID-19 with Deep Learning- A survey on Deep Learning for Pulmonary M...
Detect COVID-19 with Deep Learning- A survey on Deep Learning for Pulmonary M...JumanaNadir
 
Covid 19 diagnosis using x-ray images and deep learning
Covid 19 diagnosis using x-ray images and deep learningCovid 19 diagnosis using x-ray images and deep learning
Covid 19 diagnosis using x-ray images and deep learningShamik Tiwari
 
Covid-19 Detection using Chest X-Ray Images
Covid-19 Detection using Chest X-Ray ImagesCovid-19 Detection using Chest X-Ray Images
Covid-19 Detection using Chest X-Ray ImagesIRJET Journal
 
Pneumonia detection using cnn
Pneumonia detection using cnnPneumonia detection using cnn
Pneumonia detection using cnnTushar Dalvi
 
PhD Defense
PhD DefensePhD Defense
PhD DefenseTaehoon Lee
 
COVID-19 detection using Chest X-rays.pdf
COVID-19 detection using Chest X-rays.pdfCOVID-19 detection using Chest X-rays.pdf
COVID-19 detection using Chest X-rays.pdfDeepakSahu480384
 
Deep Convolutional Neural Networks and Covid19 by Dr.Sana Komal
Deep Convolutional Neural Networks and Covid19 by Dr.Sana KomalDeep Convolutional Neural Networks and Covid19 by Dr.Sana Komal
Deep Convolutional Neural Networks and Covid19 by Dr.Sana KomalSana Komal
 
Chest X-ray Pneumonia Classification with Deep Learning
Chest X-ray Pneumonia Classification with Deep LearningChest X-ray Pneumonia Classification with Deep Learning
Chest X-ray Pneumonia Classification with Deep LearningBaoTramDuong2
 
A new classification model for covid 19 based on convolutional neural networks
A new classification model for covid 19 based on convolutional neural networksA new classification model for covid 19 based on convolutional neural networks
A new classification model for covid 19 based on convolutional neural networksAboul Ella Hassanien
 
Object classification using CNN & VGG16 Model (Keras and Tensorflow)
Object classification using CNN & VGG16 Model (Keras and Tensorflow) Object classification using CNN & VGG16 Model (Keras and Tensorflow)
Object classification using CNN & VGG16 Model (Keras and Tensorflow) Lalit Jain
 
presentation on Artificial intelligence by prince kumar kushwaha from rustamj...
presentation on Artificial intelligence by prince kumar kushwaha from rustamj...presentation on Artificial intelligence by prince kumar kushwaha from rustamj...
presentation on Artificial intelligence by prince kumar kushwaha from rustamj...Rustamji Institute of Technology
 
Deep neural networks
Deep neural networksDeep neural networks
Deep neural networksSi Haem
 
Master's Thesis Presentation
Master's Thesis PresentationMaster's Thesis Presentation
Master's Thesis PresentationWajdi Khattel
 
Transfer Learning -- The Next Frontier for Machine Learning
Transfer Learning -- The Next Frontier for Machine LearningTransfer Learning -- The Next Frontier for Machine Learning
Transfer Learning -- The Next Frontier for Machine LearningSebastian Ruder
 
UNet-VGG16 with transfer learning for MRI-based brain tumor segmentation
UNet-VGG16 with transfer learning for MRI-based brain tumor segmentationUNet-VGG16 with transfer learning for MRI-based brain tumor segmentation
UNet-VGG16 with transfer learning for MRI-based brain tumor segmentationTELKOMNIKA JOURNAL
 
Artificial Intelligence
Artificial IntelligenceArtificial Intelligence
Artificial IntelligenceGagan Deep
 
Convolution Neural Network (CNN)
Convolution Neural Network (CNN)Convolution Neural Network (CNN)
Convolution Neural Network (CNN)Suraj Aavula
 
Object Detection Using R-CNN Deep Learning Framework
Object Detection Using R-CNN Deep Learning FrameworkObject Detection Using R-CNN Deep Learning Framework
Object Detection Using R-CNN Deep Learning FrameworkNader Karimi
 
Object Detection and Ship Classification Using YOLOv5
Object Detection and Ship Classification Using YOLOv5Object Detection and Ship Classification Using YOLOv5
Object Detection and Ship Classification Using YOLOv5BOHR International Journal of Computer Science (BIJCS)
 
Fundamentals of Artificial Intelligence — QU AIO Leadership in AI
Fundamentals of Artificial Intelligence — QU AIO Leadership in AIFundamentals of Artificial Intelligence — QU AIO Leadership in AI
Fundamentals of Artificial Intelligence — QU AIO Leadership in AIJunaid Qadir
 
Image classification using CNN
Image classification using CNNImage classification using CNN
Image classification using CNNNoura Hussein
 
An introduction to Deep Learning
An introduction to Deep LearningAn introduction to Deep Learning
An introduction to Deep LearningJulien SIMON
 
Deep learning
Deep learningDeep learning
Deep learningMohamed Loey
 
Image classification using cnn
Image classification using cnnImage classification using cnn
Image classification using cnnSumeraHangi
 
Project loon
Project loonProject loon
Project loonSneh Raval
 
مقدمة خوارزميات جنينية ‫‬.ppt
مقدمة خوارزميات جنينية ‫‬.pptمقدمة خوارزميات جنينية ‫‬.ppt
مقدمة خوارزميات جنينية ‫‬.pptAlmutasemBillahAlwas
 
Ai & ml
Ai & mlAi & ml
Ai & mlAvilay Parekh
 
Introduction to Deep learning
Introduction to Deep learningIntroduction to Deep learning
Introduction to Deep learningleopauly
 
Dl covid19 ver3
Dl covid19 ver3Dl covid19 ver3
Dl covid19 ver3YujinOh12
 
CDC dec 2015 - Strengthening a Culture of Laboratory Safety
CDC dec 2015 - Strengthening a Culture of Laboratory SafetyCDC dec 2015 - Strengthening a Culture of Laboratory Safety
CDC dec 2015 - Strengthening a Culture of Laboratory SafetyMark Lacic
 

More Related Content

What's hot

A new classification model for covid 19 based on convolutional neural networks
A new classification model for covid 19 based on convolutional neural networksA new classification model for covid 19 based on convolutional neural networks
A new classification model for covid 19 based on convolutional neural networksAboul Ella Hassanien
 
Object classification using CNN & VGG16 Model (Keras and Tensorflow)
Object classification using CNN & VGG16 Model (Keras and Tensorflow) Object classification using CNN & VGG16 Model (Keras and Tensorflow)
Object classification using CNN & VGG16 Model (Keras and Tensorflow) Lalit Jain
 
presentation on Artificial intelligence by prince kumar kushwaha from rustamj...
presentation on Artificial intelligence by prince kumar kushwaha from rustamj...presentation on Artificial intelligence by prince kumar kushwaha from rustamj...
presentation on Artificial intelligence by prince kumar kushwaha from rustamj...Rustamji Institute of Technology
 
Deep neural networks
Deep neural networksDeep neural networks
Deep neural networksSi Haem
 
Master's Thesis Presentation
Master's Thesis PresentationMaster's Thesis Presentation
Master's Thesis PresentationWajdi Khattel
 
Transfer Learning -- The Next Frontier for Machine Learning
Transfer Learning -- The Next Frontier for Machine LearningTransfer Learning -- The Next Frontier for Machine Learning
Transfer Learning -- The Next Frontier for Machine LearningSebastian Ruder
 
UNet-VGG16 with transfer learning for MRI-based brain tumor segmentation
UNet-VGG16 with transfer learning for MRI-based brain tumor segmentationUNet-VGG16 with transfer learning for MRI-based brain tumor segmentation
UNet-VGG16 with transfer learning for MRI-based brain tumor segmentationTELKOMNIKA JOURNAL
 
Artificial Intelligence
Artificial IntelligenceArtificial Intelligence
Artificial IntelligenceGagan Deep
 
Convolution Neural Network (CNN)
Convolution Neural Network (CNN)Convolution Neural Network (CNN)
Convolution Neural Network (CNN)Suraj Aavula
 
Object Detection Using R-CNN Deep Learning Framework
Object Detection Using R-CNN Deep Learning FrameworkObject Detection Using R-CNN Deep Learning Framework
Object Detection Using R-CNN Deep Learning FrameworkNader Karimi
 
Fundamentals of Artificial Intelligence — QU AIO Leadership in AI
Fundamentals of Artificial Intelligence — QU AIO Leadership in AIFundamentals of Artificial Intelligence — QU AIO Leadership in AI
Fundamentals of Artificial Intelligence — QU AIO Leadership in AIJunaid Qadir
 
Image classification using CNN
Image classification using CNNImage classification using CNN
Image classification using CNNNoura Hussein
 
An introduction to Deep Learning
An introduction to Deep LearningAn introduction to Deep Learning
An introduction to Deep LearningJulien SIMON
 
Image classification using cnn
Image classification using cnnImage classification using cnn
Image classification using cnnSumeraHangi
 
مقدمة خوارزميات جنينية ‫‬.ppt
مقدمة خوارزميات جنينية ‫‬.pptمقدمة خوارزميات جنينية ‫‬.ppt
مقدمة خوارزميات جنينية ‫‬.pptAlmutasemBillahAlwas
 
Introduction to Deep learning
Introduction to Deep learningIntroduction to Deep learning
Introduction to Deep learningleopauly
 

What's hot (20)

A new classification model for covid 19 based on convolutional neural networks
A new classification model for covid 19 based on convolutional neural networksA new classification model for covid 19 based on convolutional neural networks
A new classification model for covid 19 based on convolutional neural networks
 
Object classification using CNN & VGG16 Model (Keras and Tensorflow)
Object classification using CNN & VGG16 Model (Keras and Tensorflow) Object classification using CNN & VGG16 Model (Keras and Tensorflow)
Object classification using CNN & VGG16 Model (Keras and Tensorflow)
 
presentation on Artificial intelligence by prince kumar kushwaha from rustamj...
presentation on Artificial intelligence by prince kumar kushwaha from rustamj...presentation on Artificial intelligence by prince kumar kushwaha from rustamj...
presentation on Artificial intelligence by prince kumar kushwaha from rustamj...
 
Deep neural networks
Deep neural networksDeep neural networks
Deep neural networks
 
Master's Thesis Presentation
Master's Thesis PresentationMaster's Thesis Presentation
Master's Thesis Presentation
 
Transfer Learning -- The Next Frontier for Machine Learning
Transfer Learning -- The Next Frontier for Machine LearningTransfer Learning -- The Next Frontier for Machine Learning
Transfer Learning -- The Next Frontier for Machine Learning
 
UNet-VGG16 with transfer learning for MRI-based brain tumor segmentation
UNet-VGG16 with transfer learning for MRI-based brain tumor segmentationUNet-VGG16 with transfer learning for MRI-based brain tumor segmentation
UNet-VGG16 with transfer learning for MRI-based brain tumor segmentation
 
Artificial Intelligence
Artificial IntelligenceArtificial Intelligence
Artificial Intelligence
 
Convolution Neural Network (CNN)
Convolution Neural Network (CNN)Convolution Neural Network (CNN)
Convolution Neural Network (CNN)
 
Object Detection Using R-CNN Deep Learning Framework
Object Detection Using R-CNN Deep Learning FrameworkObject Detection Using R-CNN Deep Learning Framework
Object Detection Using R-CNN Deep Learning Framework
 
Object Detection and Ship Classification Using YOLOv5
Object Detection and Ship Classification Using YOLOv5Object Detection and Ship Classification Using YOLOv5
Object Detection and Ship Classification Using YOLOv5
 
Fundamentals of Artificial Intelligence — QU AIO Leadership in AI
Fundamentals of Artificial Intelligence — QU AIO Leadership in AIFundamentals of Artificial Intelligence — QU AIO Leadership in AI
Fundamentals of Artificial Intelligence — QU AIO Leadership in AI
 
Image classification using CNN
Image classification using CNNImage classification using CNN
Image classification using CNN
 
An introduction to Deep Learning
An introduction to Deep LearningAn introduction to Deep Learning
An introduction to Deep Learning
 
Deep learning
Deep learningDeep learning
Deep learning
 
Image classification using cnn
Image classification using cnnImage classification using cnn
Image classification using cnn
 
Project loon
Project loonProject loon
Project loon
 
مقدمة خوارزميات جنينية ‫‬.ppt
مقدمة خوارزميات جنينية ‫‬.pptمقدمة خوارزميات جنينية ‫‬.ppt
مقدمة خوارزميات جنينية ‫‬.ppt
 
Ai & ml
Ai & mlAi & ml
Ai & ml
 
Introduction to Deep learning
Introduction to Deep learningIntroduction to Deep learning
Introduction to Deep learning
 

Similar to Multi-Centre Optimization and Validation of an Open Deep Learning Model for COVID-19 Detection on Chest Radiographs

Dl covid19 ver3
Dl covid19 ver3Dl covid19 ver3
Dl covid19 ver3YujinOh12
 
CDC dec 2015 - Strengthening a Culture of Laboratory Safety
CDC dec 2015 - Strengthening a Culture of Laboratory SafetyCDC dec 2015 - Strengthening a Culture of Laboratory Safety
CDC dec 2015 - Strengthening a Culture of Laboratory SafetyMark Lacic
 
Investigation of Long term Hazards and Multi organ Impact of SARS COV-2 in Po...
Investigation of Long term Hazards and Multi organ Impact of SARS COV-2 in Po...Investigation of Long term Hazards and Multi organ Impact of SARS COV-2 in Po...
Investigation of Long term Hazards and Multi organ Impact of SARS COV-2 in Po...Jagruti Marathe
 
Molecular diagnostics in the future July 14 - Prof. Bert Niesters
Molecular diagnostics in the future July 14 - Prof. Bert NiestersMolecular diagnostics in the future July 14 - Prof. Bert Niesters
Molecular diagnostics in the future July 14 - Prof. Bert NiestersWAidid
 
Laboratory Assays Cross-sectional Incidence Testing, Blood Spots, and HIV Vir...
Laboratory Assays Cross-sectional Incidence Testing, Blood Spots, and HIV Vir...Laboratory Assays Cross-sectional Incidence Testing, Blood Spots, and HIV Vir...
Laboratory Assays Cross-sectional Incidence Testing, Blood Spots, and HIV Vir...HopkinsCFAR
 
Bus Forum Preso Bio 2009 Ec6
Bus Forum Preso Bio 2009 Ec6Bus Forum Preso Bio 2009 Ec6
Bus Forum Preso Bio 2009 Ec6guest93170a
 
PATTERN OF HOSPITAL-ACQUIRED PNEUMONIA IN INTENSIVE CARE UNIT OF SUEZ CANAL U...
PATTERN OF HOSPITAL-ACQUIRED PNEUMONIA IN INTENSIVE CARE UNIT OF SUEZ CANAL U...PATTERN OF HOSPITAL-ACQUIRED PNEUMONIA IN INTENSIVE CARE UNIT OF SUEZ CANAL U...
PATTERN OF HOSPITAL-ACQUIRED PNEUMONIA IN INTENSIVE CARE UNIT OF SUEZ CANAL U...Khaled Mohamed
 
Automatic COVID-19 lung images classification system based on convolution ne...
Automatic COVID-19 lung images classification system based on convolution ne...Automatic COVID-19 lung images classification system based on convolution ne...
Automatic COVID-19 lung images classification system based on convolution ne...IJECEIAES
 
Four Unique Laboratory Characteristics Applied to Assess the Severity of COVI...
Four Unique Laboratory Characteristics Applied to Assess the Severity of COVI...Four Unique Laboratory Characteristics Applied to Assess the Severity of COVI...
Four Unique Laboratory Characteristics Applied to Assess the Severity of COVI...semualkaira
 
Four Unique Laboratory Characteristics Applied to Assess the Severity of COVI...
Four Unique Laboratory Characteristics Applied to Assess the Severity of COVI...Four Unique Laboratory Characteristics Applied to Assess the Severity of COVI...
Four Unique Laboratory Characteristics Applied to Assess the Severity of COVI...komalicarol
 
covid 19 detection using x ray based on neural network
covid 19 detection using x ray based on neural networkcovid 19 detection using x ray based on neural network
covid 19 detection using x ray based on neural networkArifuzzamanFaisal2
 
Amany m. elshamy why the negative covid19 pcr test is a misguide results
Amany m. elshamy why the negative covid19 pcr test is a misguide resultsAmany m. elshamy why the negative covid19 pcr test is a misguide results
Amany m. elshamy why the negative covid19 pcr test is a misguide resultsAmany Elshamy
 
The future of the emergency room | Jean-Louis Vincent at TBS23
The future of the emergency room | Jean-Louis Vincent at TBS23The future of the emergency room | Jean-Louis Vincent at TBS23
The future of the emergency room | Jean-Louis Vincent at TBS23scanFOAM
 
Ashok Rattan swine flu diagnosis
Ashok Rattan swine flu diagnosisAshok Rattan swine flu diagnosis
Ashok Rattan swine flu diagnosisPathKind Labs
 
Современное лечение ВИЧ: новые парадигмы в АРТ / Contemporary Management of H...
Современное лечение ВИЧ: новые парадигмы в АРТ / Contemporary Management of H...Современное лечение ВИЧ: новые парадигмы в АРТ / Contemporary Management of H...
Современное лечение ВИЧ: новые парадигмы в АРТ / Contemporary Management of H...hivlifeinfo
 
Immunotherapy update
Immunotherapy updateImmunotherapy update
Immunotherapy updateAdilDaud
 

Similar to Multi-Centre Optimization and Validation of an Open Deep Learning Model for COVID-19 Detection on Chest Radiographs (20)

Dl covid19 ver3
Dl covid19 ver3Dl covid19 ver3
Dl covid19 ver3
 
CDC dec 2015 - Strengthening a Culture of Laboratory Safety
CDC dec 2015 - Strengthening a Culture of Laboratory SafetyCDC dec 2015 - Strengthening a Culture of Laboratory Safety
CDC dec 2015 - Strengthening a Culture of Laboratory Safety
 
Investigation of Long term Hazards and Multi organ Impact of SARS COV-2 in Po...
Investigation of Long term Hazards and Multi organ Impact of SARS COV-2 in Po...Investigation of Long term Hazards and Multi organ Impact of SARS COV-2 in Po...
Investigation of Long term Hazards and Multi organ Impact of SARS COV-2 in Po...
 
Molecular diagnostics in the future July 14 - Prof. Bert Niesters
Molecular diagnostics in the future July 14 - Prof. Bert NiestersMolecular diagnostics in the future July 14 - Prof. Bert Niesters
Molecular diagnostics in the future July 14 - Prof. Bert Niesters
 
Laboratory Assays Cross-sectional Incidence Testing, Blood Spots, and HIV Vir...
Laboratory Assays Cross-sectional Incidence Testing, Blood Spots, and HIV Vir...Laboratory Assays Cross-sectional Incidence Testing, Blood Spots, and HIV Vir...
Laboratory Assays Cross-sectional Incidence Testing, Blood Spots, and HIV Vir...
 
Bus Forum Preso Bio 2009 Ec6
Bus Forum Preso Bio 2009 Ec6Bus Forum Preso Bio 2009 Ec6
Bus Forum Preso Bio 2009 Ec6
 
Gene Xpert & Advances
Gene Xpert & AdvancesGene Xpert & Advances
Gene Xpert & Advances
 
PATTERN OF HOSPITAL-ACQUIRED PNEUMONIA IN INTENSIVE CARE UNIT OF SUEZ CANAL U...
PATTERN OF HOSPITAL-ACQUIRED PNEUMONIA IN INTENSIVE CARE UNIT OF SUEZ CANAL U...PATTERN OF HOSPITAL-ACQUIRED PNEUMONIA IN INTENSIVE CARE UNIT OF SUEZ CANAL U...
PATTERN OF HOSPITAL-ACQUIRED PNEUMONIA IN INTENSIVE CARE UNIT OF SUEZ CANAL U...
 
Automatic COVID-19 lung images classification system based on convolution ne...
Automatic COVID-19 lung images classification system based on convolution ne...Automatic COVID-19 lung images classification system based on convolution ne...
Automatic COVID-19 lung images classification system based on convolution ne...
 
Four Unique Laboratory Characteristics Applied to Assess the Severity of COVI...
Four Unique Laboratory Characteristics Applied to Assess the Severity of COVI...Four Unique Laboratory Characteristics Applied to Assess the Severity of COVI...
Four Unique Laboratory Characteristics Applied to Assess the Severity of COVI...
 
Four Unique Laboratory Characteristics Applied to Assess the Severity of COVI...
Four Unique Laboratory Characteristics Applied to Assess the Severity of COVI...Four Unique Laboratory Characteristics Applied to Assess the Severity of COVI...
Four Unique Laboratory Characteristics Applied to Assess the Severity of COVI...
 
covid 19 detection using x ray based on neural network
covid 19 detection using x ray based on neural networkcovid 19 detection using x ray based on neural network
covid 19 detection using x ray based on neural network
 
04.09.21 | Making Sense of the COVID-19 Data in Persons with HIV
04.09.21 | Making Sense of the COVID-19 Data in Persons with HIV04.09.21 | Making Sense of the COVID-19 Data in Persons with HIV
04.09.21 | Making Sense of the COVID-19 Data in Persons with HIV
 
Amany m. elshamy why the negative covid19 pcr test is a misguide results
Amany m. elshamy why the negative covid19 pcr test is a misguide resultsAmany m. elshamy why the negative covid19 pcr test is a misguide results
Amany m. elshamy why the negative covid19 pcr test is a misguide results
 
Tuberculosis diagnostics
Tuberculosis diagnosticsTuberculosis diagnostics
Tuberculosis diagnostics
 
The future of the emergency room | Jean-Louis Vincent at TBS23
The future of the emergency room | Jean-Louis Vincent at TBS23The future of the emergency room | Jean-Louis Vincent at TBS23
The future of the emergency room | Jean-Louis Vincent at TBS23
 
20171021 Personalized Prevention Strategy for Cervical Cancer
20171021 Personalized Prevention Strategy for Cervical Cancer20171021 Personalized Prevention Strategy for Cervical Cancer
20171021 Personalized Prevention Strategy for Cervical Cancer
 
Ashok Rattan swine flu diagnosis
Ashok Rattan swine flu diagnosisAshok Rattan swine flu diagnosis
Ashok Rattan swine flu diagnosis
 
Современное лечение ВИЧ: новые парадигмы в АРТ / Contemporary Management of H...
Современное лечение ВИЧ: новые парадигмы в АРТ / Contemporary Management of H...Современное лечение ВИЧ: новые парадигмы в АРТ / Contemporary Management of H...
Современное лечение ВИЧ: новые парадигмы в АРТ / Contemporary Management of H...
 
Immunotherapy update
Immunotherapy updateImmunotherapy update
Immunotherapy update
 

More from Institute for Clinical Research (ICR)

The Impact of COVID-19 Lockdown on Palliative Care Services in Malaysia
The Impact of COVID-19 Lockdown on Palliative Care Services in MalaysiaThe Impact of COVID-19 Lockdown on Palliative Care Services in Malaysia
The Impact of COVID-19 Lockdown on Palliative Care Services in MalaysiaInstitute for Clinical Research (ICR)
 
USE OF ARTIFICIAL INTELLIGENCE (DR.MATA SYSTEM) FOR THE DETECTION AND INTERVE...
USE OF ARTIFICIAL INTELLIGENCE (DR.MATA SYSTEM) FOR THE DETECTION AND INTERVE...USE OF ARTIFICIAL INTELLIGENCE (DR.MATA SYSTEM) FOR THE DETECTION AND INTERVE...
USE OF ARTIFICIAL INTELLIGENCE (DR.MATA SYSTEM) FOR THE DETECTION AND INTERVE...Institute for Clinical Research (ICR)
 
An introduction to Clinical Research Centre (CRC) Hospital Tuanku Fauziah
An introduction to Clinical Research Centre (CRC) Hospital Tuanku FauziahAn introduction to Clinical Research Centre (CRC) Hospital Tuanku Fauziah
An introduction to Clinical Research Centre (CRC) Hospital Tuanku FauziahInstitute for Clinical Research (ICR)
 
MHPSS Infographic - Strengthening Mental Health And Psychosocial Support Syst...
MHPSS Infographic - Strengthening Mental Health And Psychosocial Support Syst...MHPSS Infographic - Strengthening Mental Health And Psychosocial Support Syst...
MHPSS Infographic - Strengthening Mental Health And Psychosocial Support Syst...Institute for Clinical Research (ICR)
 
Strengthening Mental Health And Psychosocial Support Systems And Services For...
Strengthening Mental Health And Psychosocial Support Systems And Services For...Strengthening Mental Health And Psychosocial Support Systems And Services For...
Strengthening Mental Health And Psychosocial Support Systems And Services For...Institute for Clinical Research (ICR)
 
NIH Guidelines for Conducting Research in Ministry of Health (MOH) Institutio...
NIH Guidelines for Conducting Research in Ministry of Health (MOH) Institutio...NIH Guidelines for Conducting Research in Ministry of Health (MOH) Institutio...
NIH Guidelines for Conducting Research in Ministry of Health (MOH) Institutio...Institute for Clinical Research (ICR)
 

More from Institute for Clinical Research (ICR) (20)

HKL Research Day 2023
HKL Research Day 2023HKL Research Day 2023
HKL Research Day 2023
 
The Impact of COVID-19 Lockdown on Palliative Care Services in Malaysia
The Impact of COVID-19 Lockdown on Palliative Care Services in MalaysiaThe Impact of COVID-19 Lockdown on Palliative Care Services in Malaysia
The Impact of COVID-19 Lockdown on Palliative Care Services in Malaysia
 
USE OF ARTIFICIAL INTELLIGENCE (DR.MATA SYSTEM) FOR THE DETECTION AND INTERVE...
USE OF ARTIFICIAL INTELLIGENCE (DR.MATA SYSTEM) FOR THE DETECTION AND INTERVE...USE OF ARTIFICIAL INTELLIGENCE (DR.MATA SYSTEM) FOR THE DETECTION AND INTERVE...
USE OF ARTIFICIAL INTELLIGENCE (DR.MATA SYSTEM) FOR THE DETECTION AND INTERVE...
 
15th National Conference for Clinical Research (NCCR)
15th National Conference for Clinical Research (NCCR)15th National Conference for Clinical Research (NCCR)
15th National Conference for Clinical Research (NCCR)
 
14th National Conference for Clinical Research 2021
14th National Conference for Clinical Research 202114th National Conference for Clinical Research 2021
14th National Conference for Clinical Research 2021
 
An introduction to Clinical Research Centre (CRC) Hospital Tuanku Fauziah
An introduction to Clinical Research Centre (CRC) Hospital Tuanku FauziahAn introduction to Clinical Research Centre (CRC) Hospital Tuanku Fauziah
An introduction to Clinical Research Centre (CRC) Hospital Tuanku Fauziah
 
Melaka Research Day 2023 Booklet
Melaka Research Day 2023 BookletMelaka Research Day 2023 Booklet
Melaka Research Day 2023 Booklet
 
CRC Perak Bulletin Issue 05
CRC Perak Bulletin Issue 05CRC Perak Bulletin Issue 05
CRC Perak Bulletin Issue 05
 
PERTANDINGAN MENULIS NOTA HATI -BAHASAKU BANGSAKU DR AZIZ AMIR.pdf
PERTANDINGAN MENULIS NOTA HATI -BAHASAKU BANGSAKU DR AZIZ AMIR.pdfPERTANDINGAN MENULIS NOTA HATI -BAHASAKU BANGSAKU DR AZIZ AMIR.pdf
PERTANDINGAN MENULIS NOTA HATI -BAHASAKU BANGSAKU DR AZIZ AMIR.pdf
 
22 Years of Evolution: From NCRC To ICR
22 Years of Evolution: From NCRC To ICR22 Years of Evolution: From NCRC To ICR
22 Years of Evolution: From NCRC To ICR
 
PDU PKD Kinta - Perkhidmatan Doktor Udara (Flying Doctor Service)
PDU PKD Kinta - Perkhidmatan Doktor Udara (Flying Doctor Service)PDU PKD Kinta - Perkhidmatan Doktor Udara (Flying Doctor Service)
PDU PKD Kinta - Perkhidmatan Doktor Udara (Flying Doctor Service)
 
CRC SGH Newsletter Issue 52
CRC SGH Newsletter Issue 52CRC SGH Newsletter Issue 52
CRC SGH Newsletter Issue 52
 
MHPSS Infographic - Strengthening Mental Health And Psychosocial Support Syst...
MHPSS Infographic - Strengthening Mental Health And Psychosocial Support Syst...MHPSS Infographic - Strengthening Mental Health And Psychosocial Support Syst...
MHPSS Infographic - Strengthening Mental Health And Psychosocial Support Syst...
 
Strengthening Mental Health And Psychosocial Support Systems And Services For...
Strengthening Mental Health And Psychosocial Support Systems And Services For...Strengthening Mental Health And Psychosocial Support Systems And Services For...
Strengthening Mental Health And Psychosocial Support Systems And Services For...
 
CRC Seremban Bulletin Newsletter
CRC Seremban Bulletin NewsletterCRC Seremban Bulletin Newsletter
CRC Seremban Bulletin Newsletter
 
HFMD vs Monkeypox
HFMD vs Monkeypox HFMD vs Monkeypox
HFMD vs Monkeypox
 
MYLONGCOVID Study
MYLONGCOVID StudyMYLONGCOVID Study
MYLONGCOVID Study
 
Kajian MYLONGCOVID
Kajian MYLONGCOVIDKajian MYLONGCOVID
Kajian MYLONGCOVID
 
NIH Guidelines for Conducting Research in Ministry of Health (MOH) Institutio...
NIH Guidelines for Conducting Research in Ministry of Health (MOH) Institutio...NIH Guidelines for Conducting Research in Ministry of Health (MOH) Institutio...
NIH Guidelines for Conducting Research in Ministry of Health (MOH) Institutio...
 
4th Issue of CRC Perak Network Bulletin (2021)
4th Issue of CRC Perak Network Bulletin (2021)4th Issue of CRC Perak Network Bulletin (2021)
4th Issue of CRC Perak Network Bulletin (2021)
 

Recently uploaded

Chandigarh Call Girls Service ❤️🍑 9809698092 👄🫦Independent Escort Service Cha...
Chandigarh Call Girls Service ❤️🍑 9809698092 👄🫦Independent Escort Service Cha...Chandigarh Call Girls Service ❤️🍑 9809698092 👄🫦Independent Escort Service Cha...
Chandigarh Call Girls Service ❤️🍑 9809698092 👄🫦Independent Escort Service Cha...Sheetaleventcompany
 
Pune Call Girl Service 📞9xx000xx09📞Just Call Divya📲 Call Girl In Pune No💰Adva...
Pune Call Girl Service 📞9xx000xx09📞Just Call Divya📲 Call Girl In Pune No💰Adva...Pune Call Girl Service 📞9xx000xx09📞Just Call Divya📲 Call Girl In Pune No💰Adva...
Pune Call Girl Service 📞9xx000xx09📞Just Call Divya📲 Call Girl In Pune No💰Adva...Sheetaleventcompany
 
❤️Call Girl Service In Chandigarh☎️9814379184☎️ Call Girl in Chandigarh☎️ Cha...
❤️Call Girl Service In Chandigarh☎️9814379184☎️ Call Girl in Chandigarh☎️ Cha...❤️Call Girl Service In Chandigarh☎️9814379184☎️ Call Girl in Chandigarh☎️ Cha...
❤️Call Girl Service In Chandigarh☎️9814379184☎️ Call Girl in Chandigarh☎️ Cha...Sheetaleventcompany
 
Nagpur Call Girl Service 📞9xx000xx09📞Just Call Divya📲 Call Girl In Nagpur No💰...
Nagpur Call Girl Service 📞9xx000xx09📞Just Call Divya📲 Call Girl In Nagpur No💰...Nagpur Call Girl Service 📞9xx000xx09📞Just Call Divya📲 Call Girl In Nagpur No💰...
Nagpur Call Girl Service 📞9xx000xx09📞Just Call Divya📲 Call Girl In Nagpur No💰...Sheetaleventcompany
 
Circulatory Shock, types and stages, compensatory mechanisms
Circulatory Shock, types and stages, compensatory mechanismsCirculatory Shock, types and stages, compensatory mechanisms
Circulatory Shock, types and stages, compensatory mechanismsMedicoseAcademics
 
ANATOMY AND PHYSIOLOGY OF RESPIRATORY SYSTEM.pptx
ANATOMY AND PHYSIOLOGY OF RESPIRATORY SYSTEM.pptxANATOMY AND PHYSIOLOGY OF RESPIRATORY SYSTEM.pptx
ANATOMY AND PHYSIOLOGY OF RESPIRATORY SYSTEM.pptxSwetaba Besh
 
Call Girls Shahdol Just Call 8250077686 Top Class Call Girl Service Available
Call Girls Shahdol Just Call 8250077686 Top Class Call Girl Service AvailableCall Girls Shahdol Just Call 8250077686 Top Class Call Girl Service Available
Call Girls Shahdol Just Call 8250077686 Top Class Call Girl Service AvailableDipal Arora
 
Gorgeous Call Girls Dehradun {8854095900} ❤️VVIP ROCKY Call Girls in Dehradun...
Gorgeous Call Girls Dehradun {8854095900} ❤️VVIP ROCKY Call Girls in Dehradun...Gorgeous Call Girls Dehradun {8854095900} ❤️VVIP ROCKY Call Girls in Dehradun...
Gorgeous Call Girls Dehradun {8854095900} ❤️VVIP ROCKY Call Girls in Dehradun...Sheetaleventcompany
 
💚Chandigarh Call Girls 💯Riya 📲🔝8868886958🔝Call Girls In Chandigarh No💰Advance...
💚Chandigarh Call Girls 💯Riya 📲🔝8868886958🔝Call Girls In Chandigarh No💰Advance...💚Chandigarh Call Girls 💯Riya 📲🔝8868886958🔝Call Girls In Chandigarh No💰Advance...
💚Chandigarh Call Girls 💯Riya 📲🔝8868886958🔝Call Girls In Chandigarh No💰Advance...Sheetaleventcompany
 
Electrocardiogram (ECG) physiological basis .pdf
Electrocardiogram (ECG) physiological basis .pdfElectrocardiogram (ECG) physiological basis .pdf
Electrocardiogram (ECG) physiological basis .pdfMedicoseAcademics
 
Dehradun Call Girl Service ❤️🍑 8854095900 👄🫦Independent Escort Service Dehradun
Dehradun Call Girl Service ❤️🍑 8854095900 👄🫦Independent Escort Service DehradunDehradun Call Girl Service ❤️🍑 8854095900 👄🫦Independent Escort Service Dehradun
Dehradun Call Girl Service ❤️🍑 8854095900 👄🫦Independent Escort Service DehradunSheetaleventcompany
 
Genuine Call Girls Hyderabad 9630942363 Book High Profile Call Girl in Hydera...
Genuine Call Girls Hyderabad 9630942363 Book High Profile Call Girl in Hydera...Genuine Call Girls Hyderabad 9630942363 Book High Profile Call Girl in Hydera...
Genuine Call Girls Hyderabad 9630942363 Book High Profile Call Girl in Hydera...GENUINE ESCORT AGENCY
 
💰Call Girl In Bangalore☎️63788-78445💰 Call Girl service in Bangalore☎️Bangalo...
💰Call Girl In Bangalore☎️63788-78445💰 Call Girl service in Bangalore☎️Bangalo...💰Call Girl In Bangalore☎️63788-78445💰 Call Girl service in Bangalore☎️Bangalo...
💰Call Girl In Bangalore☎️63788-78445💰 Call Girl service in Bangalore☎️Bangalo...gragneelam30
 
Control of Local Blood Flow: acute and chronic
Control of Local Blood Flow: acute and chronicControl of Local Blood Flow: acute and chronic
Control of Local Blood Flow: acute and chronicMedicoseAcademics
 
Cardiac Output, Venous Return, and Their Regulation
Cardiac Output, Venous Return, and Their RegulationCardiac Output, Venous Return, and Their Regulation
Cardiac Output, Venous Return, and Their RegulationMedicoseAcademics
 
Jual Obat Aborsi Di Dubai UAE Wa 0838-4800-7379 Obat Penggugur Kandungan Cytotec
Jual Obat Aborsi Di Dubai UAE Wa 0838-4800-7379 Obat Penggugur Kandungan CytotecJual Obat Aborsi Di Dubai UAE Wa 0838-4800-7379 Obat Penggugur Kandungan Cytotec
Jual Obat Aborsi Di Dubai UAE Wa 0838-4800-7379 Obat Penggugur Kandungan Cytotecjualobat34
 
VIP Hyderabad Call Girls KPHB 7877925207 ₹5000 To 25K With AC Room 💚😋
VIP Hyderabad Call Girls KPHB 7877925207 ₹5000 To 25K With AC Room 💚😋VIP Hyderabad Call Girls KPHB 7877925207 ₹5000 To 25K With AC Room 💚😋
VIP Hyderabad Call Girls KPHB 7877925207 ₹5000 To 25K With AC Room 💚😋mahima pandey
 
ANATOMY AND PHYSIOLOGY OF REPRODUCTIVE SYSTEM.pptx
ANATOMY AND PHYSIOLOGY OF REPRODUCTIVE SYSTEM.pptxANATOMY AND PHYSIOLOGY OF REPRODUCTIVE SYSTEM.pptx
ANATOMY AND PHYSIOLOGY OF REPRODUCTIVE SYSTEM.pptxSwetaba Besh
 
Race Course Road } Book Call Girls in Bangalore | Whatsapp No 6378878445 VIP ...
Race Course Road } Book Call Girls in Bangalore | Whatsapp No 6378878445 VIP ...Race Course Road } Book Call Girls in Bangalore | Whatsapp No 6378878445 VIP ...
Race Course Road } Book Call Girls in Bangalore | Whatsapp No 6378878445 VIP ...dishamehta3332
 
Ahmedabad Call Girls Book Now 9630942363 Top Class Ahmedabad Escort Service A...
Ahmedabad Call Girls Book Now 9630942363 Top Class Ahmedabad Escort Service A...Ahmedabad Call Girls Book Now 9630942363 Top Class Ahmedabad Escort Service A...
Ahmedabad Call Girls Book Now 9630942363 Top Class Ahmedabad Escort Service A...GENUINE ESCORT AGENCY
 

Recently uploaded (20)

Chandigarh Call Girls Service ❤️🍑 9809698092 👄🫦Independent Escort Service Cha...
Chandigarh Call Girls Service ❤️🍑 9809698092 👄🫦Independent Escort Service Cha...Chandigarh Call Girls Service ❤️🍑 9809698092 👄🫦Independent Escort Service Cha...
Chandigarh Call Girls Service ❤️🍑 9809698092 👄🫦Independent Escort Service Cha...
 
Pune Call Girl Service 📞9xx000xx09📞Just Call Divya📲 Call Girl In Pune No💰Adva...
Pune Call Girl Service 📞9xx000xx09📞Just Call Divya📲 Call Girl In Pune No💰Adva...Pune Call Girl Service 📞9xx000xx09📞Just Call Divya📲 Call Girl In Pune No💰Adva...
Pune Call Girl Service 📞9xx000xx09📞Just Call Divya📲 Call Girl In Pune No💰Adva...
 
❤️Call Girl Service In Chandigarh☎️9814379184☎️ Call Girl in Chandigarh☎️ Cha...
❤️Call Girl Service In Chandigarh☎️9814379184☎️ Call Girl in Chandigarh☎️ Cha...❤️Call Girl Service In Chandigarh☎️9814379184☎️ Call Girl in Chandigarh☎️ Cha...
❤️Call Girl Service In Chandigarh☎️9814379184☎️ Call Girl in Chandigarh☎️ Cha...
 
Nagpur Call Girl Service 📞9xx000xx09📞Just Call Divya📲 Call Girl In Nagpur No💰...
Nagpur Call Girl Service 📞9xx000xx09📞Just Call Divya📲 Call Girl In Nagpur No💰...Nagpur Call Girl Service 📞9xx000xx09📞Just Call Divya📲 Call Girl In Nagpur No💰...
Nagpur Call Girl Service 📞9xx000xx09📞Just Call Divya📲 Call Girl In Nagpur No💰...
 
Circulatory Shock, types and stages, compensatory mechanisms
Circulatory Shock, types and stages, compensatory mechanismsCirculatory Shock, types and stages, compensatory mechanisms
Circulatory Shock, types and stages, compensatory mechanisms
 
ANATOMY AND PHYSIOLOGY OF RESPIRATORY SYSTEM.pptx
ANATOMY AND PHYSIOLOGY OF RESPIRATORY SYSTEM.pptxANATOMY AND PHYSIOLOGY OF RESPIRATORY SYSTEM.pptx
ANATOMY AND PHYSIOLOGY OF RESPIRATORY SYSTEM.pptx
 
Call Girls Shahdol Just Call 8250077686 Top Class Call Girl Service Available
Call Girls Shahdol Just Call 8250077686 Top Class Call Girl Service AvailableCall Girls Shahdol Just Call 8250077686 Top Class Call Girl Service Available
Call Girls Shahdol Just Call 8250077686 Top Class Call Girl Service Available
 
Gorgeous Call Girls Dehradun {8854095900} ❤️VVIP ROCKY Call Girls in Dehradun...
Gorgeous Call Girls Dehradun {8854095900} ❤️VVIP ROCKY Call Girls in Dehradun...Gorgeous Call Girls Dehradun {8854095900} ❤️VVIP ROCKY Call Girls in Dehradun...
Gorgeous Call Girls Dehradun {8854095900} ❤️VVIP ROCKY Call Girls in Dehradun...
 
💚Chandigarh Call Girls 💯Riya 📲🔝8868886958🔝Call Girls In Chandigarh No💰Advance...
💚Chandigarh Call Girls 💯Riya 📲🔝8868886958🔝Call Girls In Chandigarh No💰Advance...💚Chandigarh Call Girls 💯Riya 📲🔝8868886958🔝Call Girls In Chandigarh No💰Advance...
💚Chandigarh Call Girls 💯Riya 📲🔝8868886958🔝Call Girls In Chandigarh No💰Advance...
 
Electrocardiogram (ECG) physiological basis .pdf
Electrocardiogram (ECG) physiological basis .pdfElectrocardiogram (ECG) physiological basis .pdf
Electrocardiogram (ECG) physiological basis .pdf
 
Dehradun Call Girl Service ❤️🍑 8854095900 👄🫦Independent Escort Service Dehradun
Dehradun Call Girl Service ❤️🍑 8854095900 👄🫦Independent Escort Service DehradunDehradun Call Girl Service ❤️🍑 8854095900 👄🫦Independent Escort Service Dehradun
Dehradun Call Girl Service ❤️🍑 8854095900 👄🫦Independent Escort Service Dehradun
 
Genuine Call Girls Hyderabad 9630942363 Book High Profile Call Girl in Hydera...
Genuine Call Girls Hyderabad 9630942363 Book High Profile Call Girl in Hydera...Genuine Call Girls Hyderabad 9630942363 Book High Profile Call Girl in Hydera...
Genuine Call Girls Hyderabad 9630942363 Book High Profile Call Girl in Hydera...
 
💰Call Girl In Bangalore☎️63788-78445💰 Call Girl service in Bangalore☎️Bangalo...
💰Call Girl In Bangalore☎️63788-78445💰 Call Girl service in Bangalore☎️Bangalo...💰Call Girl In Bangalore☎️63788-78445💰 Call Girl service in Bangalore☎️Bangalo...
💰Call Girl In Bangalore☎️63788-78445💰 Call Girl service in Bangalore☎️Bangalo...
 
Control of Local Blood Flow: acute and chronic
Control of Local Blood Flow: acute and chronicControl of Local Blood Flow: acute and chronic
Control of Local Blood Flow: acute and chronic
 
Cardiac Output, Venous Return, and Their Regulation
Cardiac Output, Venous Return, and Their RegulationCardiac Output, Venous Return, and Their Regulation
Cardiac Output, Venous Return, and Their Regulation
 
Jual Obat Aborsi Di Dubai UAE Wa 0838-4800-7379 Obat Penggugur Kandungan Cytotec
Jual Obat Aborsi Di Dubai UAE Wa 0838-4800-7379 Obat Penggugur Kandungan CytotecJual Obat Aborsi Di Dubai UAE Wa 0838-4800-7379 Obat Penggugur Kandungan Cytotec
Jual Obat Aborsi Di Dubai UAE Wa 0838-4800-7379 Obat Penggugur Kandungan Cytotec
 
VIP Hyderabad Call Girls KPHB 7877925207 ₹5000 To 25K With AC Room 💚😋
VIP Hyderabad Call Girls KPHB 7877925207 ₹5000 To 25K With AC Room 💚😋VIP Hyderabad Call Girls KPHB 7877925207 ₹5000 To 25K With AC Room 💚😋
VIP Hyderabad Call Girls KPHB 7877925207 ₹5000 To 25K With AC Room 💚😋
 
ANATOMY AND PHYSIOLOGY OF REPRODUCTIVE SYSTEM.pptx
ANATOMY AND PHYSIOLOGY OF REPRODUCTIVE SYSTEM.pptxANATOMY AND PHYSIOLOGY OF REPRODUCTIVE SYSTEM.pptx
ANATOMY AND PHYSIOLOGY OF REPRODUCTIVE SYSTEM.pptx
 
Race Course Road } Book Call Girls in Bangalore | Whatsapp No 6378878445 VIP ...
Race Course Road } Book Call Girls in Bangalore | Whatsapp No 6378878445 VIP ...Race Course Road } Book Call Girls in Bangalore | Whatsapp No 6378878445 VIP ...
Race Course Road } Book Call Girls in Bangalore | Whatsapp No 6378878445 VIP ...
 
Ahmedabad Call Girls Book Now 9630942363 Top Class Ahmedabad Escort Service A...
Ahmedabad Call Girls Book Now 9630942363 Top Class Ahmedabad Escort Service A...Ahmedabad Call Girls Book Now 9630942363 Top Class Ahmedabad Escort Service A...
Ahmedabad Call Girls Book Now 9630942363 Top Class Ahmedabad Escort Service A...
 

Multi-Centre Optimization and Validation of an Open Deep Learning Model for COVID-19 Detection on Chest Radiographs

  • 1. Multi-Centre Optimization and Validation of an Open Deep Learning Model for Covid-19 Detection on Chest Radiographs Kim-Ann Git1, Aida binti Abdul Aziz2, Lau Kiew Siong3, Lau Song Lung3, Preetvinder Singh a/l Dheer Singh4, Tan Ying Sern5, Eric Chung6 1Selayang Hospital 2Sungai Buloh Hospital 3Sarawak General Hospital 4Hospital Raja Permaisuri Bainun 5Taiping Hospital 6University of Malaya Medical Centre NMRR-20-949-54941
  • 2. Introduction Consolidation Bilateral, peripheral, lower-zone No pleural effusion Ground-glass Imaging Features of Covid-19 Chest Infection
  • 3. Introduction Comparison between Covid-19 Chest Infection and Non-Covid Infection Covid-19 Tuberculosis Pneumonia Can an AI model reliably detect Covid-19?
  • 4. Introduction COVID-Net https://github.com/lindawangg/COVID-Net Deep-learning model developed by researchers at the University of Waterloo Tensorflow Open-Source (AGPLv3) Initial training: COVIDx Dataset & RSNA Kaggle Pneumonia Dataset 4th release Sensitivity & specificity around 90%
  • 5. Hospital A Introduction COVID-Net ? Model Generalizability Model Hospital B Model Hospital A & B Model Hospital C Model Model Optimization Hospital A Model Hospital B Model Retrain Model Sensitivity & specificity around 90% Potential Solutions 6% 94% External Validation Used Not used
  • 6. Objective To optimize and validate COVID-Net for the prediction of Covid-19 in CXRs of Malaysian patients To optimize COVID-Net with additional training using local CXRs To validate and compare the accuracy of the published (unoptimized) model with the optimized model using local CXRs General Objective Specific Objectives
  • 7. Methodology Convenient sampling from each hospital: Cases: up to 100-150 Covid PCR+ CXRs Controls: up to 150-200 CXRs from October 2019 Training Set: 318 Cases & 368 Controls Test Set: 318 Cases & 367 Controls Data Collection: Hospital Sungai Buloh Sarawak General Hospital Hospital Raja Permaisuri Bainun Hospital Taiping University of Malaya Medical Centre Optimization Validation Published COVID- Net Model (Unoptimized) Published COVID- Net Model (Unoptimized) Optimized COVID- Net Model Optimized COVID- Net Model vs
  • 8. Pre-Optimization Validation Unoptimized (4A) Prediction Normal Pneumonia Covid Ground Truth Normal 78 3 235 Pneumonia 1 16 34 Covid 96 11 211 Published (Unoptimized) COVID-Net Model 44.5% 66.4% Accuracy (All) Sensitivity (Covid-19) Published (Unoptimized)
  • 9. Optimization • Training Parameters: • Image augmentation • Batch size: 4 • Optimizer: Adam • Variable learning rate: 0.0001 to 0.00003 • Epochs at each learning rate: 40+ 0 0.2 0.4 0.6 0.8 1 1.2 1.4 0 10 20 30 40 50 60 70 80 90 100 Epochs loss accuracy
  • 10. Post-Optimization Validation Unoptimized (4A) Prediction Normal Pneumonia Covid Ground Truth Normal 78 3 235 Pneumonia 1 16 34 Covid 96 11 211 Published (Unoptimized) COVID-Net Model 44.5% 66.4% 77.7% 83.0% 85.3% 92.5% Accuracy (All) Sensitivity (Covid-19) Published (Unoptimized) Partially Optimized Optimized 90+ Epochs LR: 0.0001 → 0.00003 Prediction Normal Pneumonia Covid Ground Truth Normal 269 6 41 Pneumonia 12 21 18 Covid 19 5 294 Optimized COVID-Net Model 20+ Epochs LR: 0.0001 Prediction Normal Pneumonia Covid Ground Truth Normal 251 7 58 Pneumonia 13 17 21 Covid 45 9 264 Partially Optimized COVID-Net Model
  • 11. Model Explainability (Grad-CAM) Sample Covid-19 PCR+ CXRs Correctly Classified as Covid-19
  • 12. Model Explainability (Grad-CAM) Sample Normal CXR Correctly Classified as Normal Sample Covid PCR+ CXR Incorrectly Classified as Normal
  • 13. Conclusion The published (unoptimized) COVID-Net model has mediocre performance which improved tremendously after optimization.  Model is robust but requires optimization with local CXRs before consideration for clinical use. Grad-CAMs do not reflect disease distribution. Further work is required for model explainability.
  • 14. Limitations Limited GPU for optimization → Cloud Machine Learning Platforms Small number of centres → Ongoing NIH-Crest Collaborative Covid-19 Chest Radiograph (NC4R) Repository Project
  • 16. Acknowledgements Dr Aida binti Abdul Aziz Dr Lau Song Lung Dr Lau Kiew Siong Dr Preetvinder Singh Dr Eric Chung Dr Tan Ying Sern The authors would also like to thank the Director-General, Ministry of Health, for permission to present this paper. Dr Alexander Wong The authors would like to thank Alexander Wong of the Vision and Image Processing Lab, University of Waterloo, for his guidance on model optimization and explainability. Team Members Special Acknowledgement
  • 17. References • Ai, T. Y. (2020). Correlation of chest CT and RT-PCR testing in coronavirus disease 2019 (COVID-19) in China: a report of 1014 cases. Radiology. • Chan, J. Y. (2020). Improved molecular diagnosis of COVID-19 by the novel, highly sensitive and specific COVID-19- RdRp/Hel real-time reverse transcription-PCR assay validated in vitro and with clinical specimens. Journal of Clinical Microbiology. • Hellewell, J. A. (2020). Feasibility of controlling COVID-19 outbreaks by isolation of cases and contacts. The Lacet Global Health. • Johns Hopkins University. (2020, 05 08). Coronavirus Resource Center. Retrieved from Coronavirus Resource Center: https://coronavirus.jhu.edu/map.html • Wang, L. a. (2020). COVID-Net: A tailored deep convolutional neural network design for detection of COVID-19 cases from chest radiography images. arXiv preprint.
  • 18. Multi-Centre Optimization and Validation of an Open Deep Learning Model for Covid-19 Detection on Chest Radiographs Kim-Ann Git1, Aida binti Abdul Aziz2, Lau Kiew Siong3, Lau Song Lung3, Preetvinder Singh a/l Dheer Singh4, Tan Ying Sern5, Eric Chung6 1Selayang Hospital 2Sungai Buloh Hospital 3Sarawak General Hospital 4Hospital Raja Permaisuri Bainun 5Taiping Hospital 6University of Malaya Medical Centre NMRR-20-949-54941 Thank You for Your Attention!