SlideShare a Scribd company logo
Master in Computer Vision and Artificial Intelligence LV Contour Segmentation in TMR Images Using Semantic Description of Tissue and Prior Knowledge Correction Student: Albert AndaluzGonzález Advisors: Débora Gil Resina & Jaume Garcia iBarnés
Index Introduction Our Contribution Results Conclusions ●○○○○○○○○○○○○○○○○○○○○○○○
Clinical problem ♥ The problem:  30% of  global deaths are caused by heart diseases   Treatment: diagnose of the heart function  Method: Extraction of clinical scores from regional wall motion  Requirements: accurate contour estimation ●●○○○○○○○○○○○○○○○○○○○○○○
Contour Segmentation Manual:  slow  Inter/intra observer variability  -> requires high expertise.  Automatic Objective for all subjects Requires accurate estimation of the LV boundaries ●●●○○○○○○○○○○○○○○○○○○○○○
Tagged Magnetic Resonance  LV(*) TMR in SA view Long Axis (LA) Base Mid Short Axis (SA) cuts Apex  (*)LV = LeftVentricle ●●●●○○○○○○○○○○○○○○○○○○○○
Problems in Tagged Magnetic Resonance Blood pool and tissue appearance is similar at time=0 … Tag pattern misleads some common image descriptors… Contours LV Boundaries …and few algorithms for TMR automatic segmentation currently exist ●●●●●○○○○○○○○○○○○○○○○○○○
Introduction Our Contribution Results Conclusions ●●●●●●○○○○○○○○○○○○○○○○○○
Our Contribution Goal: Algorithm for automatic segmentation for the extraction of clinical regional scores of the LV Semantic definition of the LV Two steps: Shape approximation Shape correction ●●●●●●●○○○○○○○○○○○○○○○○○
Classic snakes formulation Snakes minimize the energy potential given by the following equation: Internal energy External energy Elasticity Rigidity ,[object Object]
Internal energy:  avoids deviation from anatomical LV shapes●●●●●●●●○○○○○○○○○○○○○○○○
External energy computation Define contour for image potential LV Contour extraction Distance map to the LV contours ●●●●●●●●●○○○○○○○○○○○○○○○
Semantic descriptors Amplitude1 Amplitude 2 Motion module Original t=0 t=1 … t=end ●●●●●●●●●●○○○○○○○○○○○○○○
Energy definition Amplitude 2 Motion module Amplitude1 * * mean mean mean * * * * * * mean * * * * ●●●●●●●●●●●○○○○○○○○○○○○○
Contour extraction 2 Detection 3 Selection 1 Clustering from E1|E2 K-Means Contours+ Binary Morphology Region area Filtering Epicardium (outerboundary of the LV) Endocardium (innerboundary of the LV) ●●●●●●●●●●●●○○○○○○○○○○○○
Distance map Epicardium Endocardium Distance to  LV contours Distance  map Vector  Field ●●●●●●●●●●●●●○○○○○○○○○○○
Shape Correction  Converged snake shape is corrected using PCA and GOPA: Incoming shape Mean shape Variation modes PCA  eigenvalues then     If                            for  Correction applied No correction  needed Externalenergy Converged snake Correction ●●●●●●●●●●●●●●○○○○○○○○○○
Introduction Our Contribution Results Conclusions ●●●●●●●●●●●●●●●○○○○○○○○○
Test set 29 real cases from 15 healthy patients 2 cuts (basal and mid) 2 energies           for automatic segmentation TMR sequences from the Clinica La Creu Blanca  ●●●●●●●●●●●●●●●●○○○○○○○○
[object Object]
 distance between contours
Accuracy of Clinical Scores for clinicialaplicability
Compare global & regional  rotation auto vs manual	Validation protocol ●●●●●●●●●●●●●●●●○○○○○○○○
Segmentation error Accuracy (pixels) Base Accuracy (pixels) Externalenergy Manual Mid Automatic ●●●●●●●●●●●●●●●●●●○○○○○○
Rotation (low error) Regional LV Contours IS AS I A Global score LV IL AL Manual Automatic ●●●●●●●●●●●●●●●●●●●○○○○○
Rotation (mild error) Regional LV Contours IS AS I A Global score LV IL AL Manual Automatic ●●●●●●●●●●●●●●●●●●●●○○○○
Absolute error (in degrees) ●●●●●●●●●●●●●●●●●●●●●○○○

More Related Content

Viewers also liked

Breast Lesion Segmentation in Ultrasound Images
Breast Lesion Segmentation in Ultrasound ImagesBreast Lesion Segmentation in Ultrasound Images
Breast Lesion Segmentation in Ultrasound Images
Mohamed Elawady
 
Andrey Mukhtarov - The Study of Applicability of the Decision Tree Method for...
Andrey Mukhtarov - The Study of Applicability of the Decision Tree Method for...Andrey Mukhtarov - The Study of Applicability of the Decision Tree Method for...
Andrey Mukhtarov - The Study of Applicability of the Decision Tree Method for...
AIST
 
Exposé segmentation
Exposé segmentationExposé segmentation
Exposé segmentation
Donia Hammami
 
Echo assessment of lv systolic function and swma
Echo assessment of lv systolic function and swmaEcho assessment of lv systolic function and swma
Echo assessment of lv systolic function and swmaFuad Farooq
 
Image segmentation
Image segmentationImage segmentation
Image segmentationDeepak Kumar
 
Applications of Digital image processing in Medical Field
Applications of Digital image processing in Medical FieldApplications of Digital image processing in Medical Field
Applications of Digital image processing in Medical Field
Ashwani Srivastava
 
Biomedical image processing ppt
Biomedical image processing pptBiomedical image processing ppt
Biomedical image processing ppt
Priyanka Goswami
 
IMAGE SEGMENTATION.
IMAGE SEGMENTATION.IMAGE SEGMENTATION.
IMAGE SEGMENTATION.
Tawose Olamide Timothy
 
PPT on BRAIN TUMOR detection in MRI images based on IMAGE SEGMENTATION
PPT on BRAIN TUMOR detection in MRI images based on  IMAGE SEGMENTATION PPT on BRAIN TUMOR detection in MRI images based on  IMAGE SEGMENTATION
PPT on BRAIN TUMOR detection in MRI images based on IMAGE SEGMENTATION
khanam22
 
Image segmentation ppt
Image segmentation pptImage segmentation ppt
Image segmentation pptGichelle Amon
 
Medical image analysis
Medical image analysisMedical image analysis
Medical image analysis
Aboul Ella Hassanien
 

Viewers also liked (12)

Breast Lesion Segmentation in Ultrasound Images
Breast Lesion Segmentation in Ultrasound ImagesBreast Lesion Segmentation in Ultrasound Images
Breast Lesion Segmentation in Ultrasound Images
 
Andrey Mukhtarov - The Study of Applicability of the Decision Tree Method for...
Andrey Mukhtarov - The Study of Applicability of the Decision Tree Method for...Andrey Mukhtarov - The Study of Applicability of the Decision Tree Method for...
Andrey Mukhtarov - The Study of Applicability of the Decision Tree Method for...
 
Exposé segmentation
Exposé segmentationExposé segmentation
Exposé segmentation
 
Echo assessment of lv systolic function and swma
Echo assessment of lv systolic function and swmaEcho assessment of lv systolic function and swma
Echo assessment of lv systolic function and swma
 
Segmentation
SegmentationSegmentation
Segmentation
 
Image segmentation
Image segmentationImage segmentation
Image segmentation
 
Applications of Digital image processing in Medical Field
Applications of Digital image processing in Medical FieldApplications of Digital image processing in Medical Field
Applications of Digital image processing in Medical Field
 
Biomedical image processing ppt
Biomedical image processing pptBiomedical image processing ppt
Biomedical image processing ppt
 
IMAGE SEGMENTATION.
IMAGE SEGMENTATION.IMAGE SEGMENTATION.
IMAGE SEGMENTATION.
 
PPT on BRAIN TUMOR detection in MRI images based on IMAGE SEGMENTATION
PPT on BRAIN TUMOR detection in MRI images based on  IMAGE SEGMENTATION PPT on BRAIN TUMOR detection in MRI images based on  IMAGE SEGMENTATION
PPT on BRAIN TUMOR detection in MRI images based on IMAGE SEGMENTATION
 
Image segmentation ppt
Image segmentation pptImage segmentation ppt
Image segmentation ppt
 
Medical image analysis
Medical image analysisMedical image analysis
Medical image analysis
 

Master Presentation

  • 1. Master in Computer Vision and Artificial Intelligence LV Contour Segmentation in TMR Images Using Semantic Description of Tissue and Prior Knowledge Correction Student: Albert AndaluzGonzález Advisors: Débora Gil Resina & Jaume Garcia iBarnés
  • 2. Index Introduction Our Contribution Results Conclusions ●○○○○○○○○○○○○○○○○○○○○○○○
  • 3. Clinical problem ♥ The problem: 30% of global deaths are caused by heart diseases  Treatment: diagnose of the heart function  Method: Extraction of clinical scores from regional wall motion  Requirements: accurate contour estimation ●●○○○○○○○○○○○○○○○○○○○○○○
  • 4. Contour Segmentation Manual: slow Inter/intra observer variability -> requires high expertise. Automatic Objective for all subjects Requires accurate estimation of the LV boundaries ●●●○○○○○○○○○○○○○○○○○○○○○
  • 5. Tagged Magnetic Resonance LV(*) TMR in SA view Long Axis (LA) Base Mid Short Axis (SA) cuts Apex (*)LV = LeftVentricle ●●●●○○○○○○○○○○○○○○○○○○○○
  • 6. Problems in Tagged Magnetic Resonance Blood pool and tissue appearance is similar at time=0 … Tag pattern misleads some common image descriptors… Contours LV Boundaries …and few algorithms for TMR automatic segmentation currently exist ●●●●●○○○○○○○○○○○○○○○○○○○
  • 7. Introduction Our Contribution Results Conclusions ●●●●●●○○○○○○○○○○○○○○○○○○
  • 8. Our Contribution Goal: Algorithm for automatic segmentation for the extraction of clinical regional scores of the LV Semantic definition of the LV Two steps: Shape approximation Shape correction ●●●●●●●○○○○○○○○○○○○○○○○○
  • 9.
  • 10. Internal energy: avoids deviation from anatomical LV shapes●●●●●●●●○○○○○○○○○○○○○○○○
  • 11. External energy computation Define contour for image potential LV Contour extraction Distance map to the LV contours ●●●●●●●●●○○○○○○○○○○○○○○○
  • 12. Semantic descriptors Amplitude1 Amplitude 2 Motion module Original t=0 t=1 … t=end ●●●●●●●●●●○○○○○○○○○○○○○○
  • 13. Energy definition Amplitude 2 Motion module Amplitude1 * * mean mean mean * * * * * * mean * * * * ●●●●●●●●●●●○○○○○○○○○○○○○
  • 14. Contour extraction 2 Detection 3 Selection 1 Clustering from E1|E2 K-Means Contours+ Binary Morphology Region area Filtering Epicardium (outerboundary of the LV) Endocardium (innerboundary of the LV) ●●●●●●●●●●●●○○○○○○○○○○○○
  • 15. Distance map Epicardium Endocardium Distance to LV contours Distance map Vector Field ●●●●●●●●●●●●●○○○○○○○○○○○
  • 16. Shape Correction Converged snake shape is corrected using PCA and GOPA: Incoming shape Mean shape Variation modes PCA eigenvalues then If for Correction applied No correction needed Externalenergy Converged snake Correction ●●●●●●●●●●●●●●○○○○○○○○○○
  • 17. Introduction Our Contribution Results Conclusions ●●●●●●●●●●●●●●●○○○○○○○○○
  • 18. Test set 29 real cases from 15 healthy patients 2 cuts (basal and mid) 2 energies for automatic segmentation TMR sequences from the Clinica La Creu Blanca ●●●●●●●●●●●●●●●●○○○○○○○○
  • 19.
  • 21. Accuracy of Clinical Scores for clinicialaplicability
  • 22. Compare global & regional rotation auto vs manual Validation protocol ●●●●●●●●●●●●●●●●○○○○○○○○
  • 23. Segmentation error Accuracy (pixels) Base Accuracy (pixels) Externalenergy Manual Mid Automatic ●●●●●●●●●●●●●●●●●●○○○○○○
  • 24. Rotation (low error) Regional LV Contours IS AS I A Global score LV IL AL Manual Automatic ●●●●●●●●●●●●●●●●●●●○○○○○
  • 25. Rotation (mild error) Regional LV Contours IS AS I A Global score LV IL AL Manual Automatic ●●●●●●●●●●●●●●●●●●●●○○○○
  • 26. Absolute error (in degrees) ●●●●●●●●●●●●●●●●●●●●●○○○
  • 27. Introduction Our Contribution Results Conclusions ●●●●●●●●●●●●●●●●●●●●●●○○
  • 28.
  • 29. < 1º mean regional rotationPromising support tool for clinical analysis ●●●●●●●●●●●●●●●●●●●●●●●○
  • 30. Future work Validate in apical cuts Use Mean shift for improved clustering Validate our method in pathologic patients ●●●●●●●●●●●●●●●●●●●●●●●●
  • 31. “Coronary heart disease is a silent disease and the first manifestation frequently is sudden death.” Dr. Herman K.Hellerstein - Cardiologist 1916- 1993 (Ohio, USA)

Editor's Notes

  1. There are severalreason f
  2. There are severalreason f
  3. There are severalreasonforblablaWewillnow show visuallythegeometry of theheart and theinnergroundsfortheissuespresententher
  4. The vertical plane divides the heart in two parts. Whereas the three horizontal cuts (the sort axis) cretae the base mid and apex cutsThe videos show the evolution at those sections of the myocardium motion.
  5. Aswehaveseen, theimages look blurry. Indeed, blablabla,Moreover, tagpatternsblabla. Thegreenboundaries are manual segmentations done bymedicalexperts. NoticehowusingcontourdetectiontecniquesdoesnotdetectedtheseboundariesIN fact, fewalgorithmfow
  6. Wehaveseemthelimitations, nowletsmoveouttoourcontribution
  7. Classicsnakes are curves thatdeformundertheinfluence of twoenergies. Theexternalenergyattractsthesnakestowardsthe LV contours, whereastheinternalenergyavoids…
  8. Asforthesemanticdescriptors, foreachframe of thetaggedsequence, we compute the amplitude3 of thegaborfiltger in twodirection. Wealso compute themotion module of theimage. Thus, allthreefeatureslackthetaggedgrid
  9. We define twoenergyes. Thefirstisobtained as follows. Wecomptuethe mean of everysequence of imagedescitpros. Thethreemeans are combiendinto a single energypotential, namely E1In thesecondeneryg, foreachframewe combine alltheedescriptorsinto a single one and compute the mean. Weget a new sequence, whichisavergaged , into a global mean image
  10. Theimagepotentialisclusteredby pixel intentsyusingkmenas. Next, we use commoncontourdetectionstodetectthecanditateregions. Finally, weselectedthe externa landinternalboundaries of the LV byusingregionareafiltering.
  11. Foreachboundary, we compute thedistancemaptothecontours. Next, weextractthe vector fieldwhcihatttractsthesnakestowardsthedesiredcontours.
  12. Wehaveseenhowourmethodwork. Now, letsmoveontotheresults
  13. The test set balbalb
  14. Tovalidateiourmethod, wedefinedtwocritera:Thesegmentation error isthedistancebetwweemourautomawticsegmentation and manual shapesbymedicalexperts.Moreover, oneachboundary, we compute the global and regional rotationforboth cases fortestingtheaccuracy
  15. In vertical, we can seethetwo short axis cuts,. Eachcolumnrepresents a diferentenedy,. The manual and automaticaproximations are shown. Thetablesrefertothewhole set, values show similar behaviour in bouth cases
  16. In the case of a goodaproxiamtion, the manual and automatic curves are veryclose, which shows thatouraproximationbehavessimilarytothe manual (groundtruth) segmentation,. Thisfactisfurtherconfirmedbythe global score, whichiscomputed in thewhole disc.
  17. Whenthereis considerable deviation, the scores diverge in some sector (A, AS). In therestits more orlessthesmaAlkso, thegtlobal scores are afected in themiddle of thesystoliccycle. However, thedifferenceisnotthatgreat
  18. Bothenergies show similar behaviour. In both cases, the mean rotationisbelow 1 degree in both cases forregionalscores. In the CASE of global scores, the mean rotationisbelwo 0.2 degreesw
  19. There are severalreason f
  20. Acceptablerotationvalues showbebelow 1 degreese
  21. Beforeendingthispresentation, I wouldliketoquote a cardiologistfromthestaes. He saidthat
  22. Whatwehaveseekwithourworkistobecomethefirstmanifestation