Slicer Training 10  EMAtlasBrainClassifier Sonia Pujol, Ph.D. Randy Gollub, M.D.,Ph.D.
Acknowledgments <ul><li>National Alliance for Medical Image Computing </li></ul><ul><li>NIH U54EB005149  </li></ul><ul><li...
Disclaimer <ul><li>It is the responsibility of the user of 3DSlicer </li></ul><ul><li>to comply with both the terms of the...
Goal of the tutorial Guiding you step by step through the process of using the Expectation-Maximization algorithm to  auto...
Material <ul><li>Slicer 2.6 </li></ul><ul><li>www.na-mic.org/Wiki/index.php/Slicer:Slicer2.6_Getting_Started </li></ul><ul...
Computer Resources <ul><li>The first part of this tutorial teaches you how the module works; it uses  pre-computed  result...
EMBrainAtlasClassifier
<ul><li>Pre-computed  Generic atlas of the brain…………………. </li></ul><ul><li>Pre-computed  T1 and T2 volumes aligned ……. </l...
Overview <ul><li>Part 1: Generic Atlas and EM Pipeline   </li></ul><ul><li>Part 2: Loading tutorial data </li></ul><ul><li...
Generic Atlas and EM Pipeline  <ul><li>This module relies on a previously computed generic atlas. </li></ul><ul><li>Runnin...
Generic Atlas Generation (Step 1) Register all the subjects to the training subject … .. S1 S2 Sn n=80 healthy subjects, a...
Segment all 80 images into 4 classes … .. T’(S1) T’(S2) T’(Sn) n=80 registered subjects … .. … .. … .. … .. Generate the g...
EM Pipeline: Data Normalization Align t2 to t1 Normalize the intensity of each image  t2 t1 Patient data  Normalized Patie...
EM Pipeline: Patient-Specific Atlas Generation Register the generic atlas to the images to create the patient-specific atl...
EM Pipeline: Segmentation Patient-specific atlas white matter csf grey matter background Segment using the Expectation Max...
EP Pipeline: Algorithm   Maximization Step applies the intensity correction as a function of the tissue class Expectation ...
Overview <ul><li>Part 1: Generic Atlas and EM Pipeline </li></ul><ul><li>Part 2: Loading tutorial data </li></ul><ul><li>P...
Loading T1 volume Click  Add Volume  in the Panel  Data
Loading T1 volume Load the volume  t1  from the directory named  /BrainAtlasClassifier/data Click  Add Volume  and select ...
Loading T1 volume Slicer loads the volume  t1  in the viewer.
Loading T2 volume Click on Image Headers  Manual Click  Add Volume  and select  Basic  in the Panel  Props  of the module ...
Loading T2 volume <ul><li>The tutorial dataset t2 was acquired in the Coronal Posterior-Anterior orientation. </li></ul>Se...
Loading T2 volume Slicer loads the volume  t2  in the viewer.
Loading the generic atlas of the brain   Select  File  OpenScene  in the Main menu. Select the file  generic_atlas.xml  i...
Loading the generic atlas of the brain <ul><li>Slicer loads the generic atlas, composed of 4 volumes:  </li></ul><ul><li>W...
Viewing the generic atlas of the brain   Move the mouse over the images to see atlas values (0-80) in different brain regi...
Loading the generic atlas of the brain   Left click on  Bg  to step through viewing each component.
Viewing the generic atlas of the brain   In the  Control Panel  left-click on  Views  and select the view  Sylvian Fissure
Viewing the generic atlas of the brain Slicer displays a coronal view of the  Sylvian fissure  from the Grey Matter atlas
Loading the patient-specific atlas of the brain   Select  File  OpenScene  in the Main menu Select the file  patientSpeci...
Loading the patient-specific atlas of the brain   <ul><li>Slicer loads the patient-specific atlas, composed of 4 volumes: ...
Loading the patient-specific atlas of the brain Slicer displays the  Gray Matter  volume of the atlas in the viewer Move t...
Loading the Segmentation results Select  File  OpenScene  in the Main menu. Select the file  segmentation  in the directo...
Loading the Segmentation results Slicer superimposes the results of the segmentation on T1 images
Loading the Segmentation results Move the mouse over the images in the 2D Viewer <ul><li>Slicer displays the names of the ...
Building 3D models Double-click on the volume  Volume:EMBrainSegResult1
Building 3D models Select the module  ModelMaker
Building 3D models Select the label  White Matter  corresponding to the color label of the   White Matter segmentation. Cr...
Building 3D models Slicer generates a 3D model of the White Matter
Overview <ul><li>Part 1: Generic Atlas and EM Pipeline  </li></ul><ul><li>Part 2: Loading tutorial data </li></ul><ul><li>...
Hardware: constraints <ul><li>Minimal requirements </li></ul><ul><li>RAM: 1 GB </li></ul><ul><li>Processor: 2 GHz </li></u...
Module Performance <ul><li>Examples of processing time for the  EMBrainAtlasClassifier </li></ul><ul><li>Sun Solaris 12 Ul...
Overview <ul><li>Part 1: Generic Atlas and EM Pipeline </li></ul><ul><li>Part 2: Loading tutorial data </li></ul><ul><li>P...
Implementing the EM algorithm <ul><li>If your  processor meets the requirements  the following steps will guide you throug...
Parameter Settings In the  Main Menu  select  Modules  Segmentation   EMAtlasBrainClassifier
Parameter Settings The  Segmentation  panel of the module  EMAtlasBrainClassifier  appears.
Parameter Settings Select the panel  Segmentation  and select the input channels  t1  and  t2  that were previously loaded...
Parameter Settings Set  Save Segmentation On  to save the output of the segmentation Enter the path corresponding to the l...
Automatic Segmentation Click on  Start   Segmentation Expected mean processing time reminder :  45 min
Atlas loading The program looks for a generic atlas at the default location  Modules/vtkEMBrainAtlasClassifier
Atlas loading A message inviting you to download the generic atlas from the web appears. Click  OK.  This message will hap...
Atlas loading (automatic) Slicer downloads the atlas from the web. Click  OK  once the installation is completed.
Atlas loading (manual) <ul><li>If you experience problems with the automatic atlas loading,  manually  download the atlas ...
Atlas installation Manually unzip the archive of the atlas in the directory  Modules/vtkEMAtlasBrainClassifier/atlas
Atlas installation  (Non-Windows Users) Check that the atlas is located in the directory Modules/vtkEMAtlasBrainClassifier...
Atlas installation (additional step only required for  Windows Users) Built-in Windows unzip wizard adds an extra level of...
Overview <ul><li>Part 1: Generic Atlas and EM Pipeline </li></ul><ul><li>Part 2: Loading tutorial data </li></ul><ul><li>P...
Data Acquisition: Tutorial data <ul><li>The  tutorial dataset  was acquired with the following parameters </li></ul><ul><u...
Data Acquisition: your data <ul><li>You’ll need to experiment the EMBrainAtlasClassifier module with your own data. </li><...
Working with your own data Load T1 and T2 as  Input Channels, and set  Align T2 to T1   On  to register  the two volumes.
Working with your own data Set  Save Segmentation On  to save the output of the segmentation Enter the path corresponding ...
Conclusion <ul><li>Automatic segmentation of MRI brain data in White Matter, Grey Matter and Cerebrospinal Fluid. </li></u...
Upcoming SlideShare
Loading in...5
×

Automatic Brain Segmentation-3770

3,557

Published on

http://hdl.handle.net/1926/530

Published in: Technology
0 Comments
1 Like
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total Views
3,557
On Slideshare
0
From Embeds
0
Number of Embeds
0
Actions
Shares
0
Downloads
38
Comments
0
Likes
1
Embeds 0
No embeds

No notes for slide

Automatic Brain Segmentation-3770

  1. 1. Slicer Training 10 EMAtlasBrainClassifier Sonia Pujol, Ph.D. Randy Gollub, M.D.,Ph.D.
  2. 2. Acknowledgments <ul><li>National Alliance for Medical Image Computing </li></ul><ul><li>NIH U54EB005149 </li></ul><ul><li>Neuroimage Analysis Center </li></ul><ul><li>NIH P41RR013218 </li></ul><ul><li>Computer Science and Artificial Intelligence Lab-MIT, </li></ul><ul><li>Surgical Planning Lab-Harvard Medical School </li></ul><ul><li>Thanks to Kilian Pohl, Sandy Wells, Martha Shenton, Sylvain Bouix, </li></ul><ul><li>Alex Guimond, Eric Grimson and Simon Warfield. </li></ul>
  3. 3. Disclaimer <ul><li>It is the responsibility of the user of 3DSlicer </li></ul><ul><li>to comply with both the terms of the license </li></ul><ul><li>and with the applicable laws, regulations </li></ul><ul><li>and rules. </li></ul>
  4. 4. Goal of the tutorial Guiding you step by step through the process of using the Expectation-Maximization algorithm to automatically segment brain structures from MRI data within Slicer.
  5. 5. Material <ul><li>Slicer 2.6 </li></ul><ul><li>www.na-mic.org/Wiki/index.php/Slicer:Slicer2.6_Getting_Started </li></ul><ul><li>BrainAtlasClassifierTutorial.zip </li></ul><ul><li>www.na-mic.org/Wiki/index.php/Slicer:Workshops:User_Training_101 </li></ul><ul><li>This tutorial assumes that you have already completed Slicer Basics Loading and Viewing Data (Slicer Training 1) and Saving Data ( Slicer Training 7) </li></ul>
  6. 6. Computer Resources <ul><li>The first part of this tutorial teaches you how the module works; it uses pre-computed results. </li></ul><ul><li>The second part guides you through processing the tutorial data yourself with the EMBrainAtlasClassifier module (Slide 40). For this part, your computer must have adequate processing speed and RAM. </li></ul><ul><li>The final part shows you how to run this module on your own data (Slide 51). </li></ul>
  7. 7. EMBrainAtlasClassifier
  8. 8. <ul><li>Pre-computed Generic atlas of the brain…………………. </li></ul><ul><li>Pre-computed T1 and T2 volumes aligned ……. </li></ul><ul><li>Pre-computed T1 and T2 volumes normalized...... </li></ul><ul><li>Pre-computed Patient-specific atlas of the brain ….. </li></ul><ul><li>Pre-computed Segmentation results…………………….. </li></ul>Tutorial dataset
  9. 9. Overview <ul><li>Part 1: Generic Atlas and EM Pipeline </li></ul><ul><li>Part 2: Loading tutorial data </li></ul><ul><li>Part 3: Hardware requirements </li></ul><ul><li>Part 4: Working with tutorial data </li></ul><ul><li>Part 5: Working with your own data </li></ul>
  10. 10. Generic Atlas and EM Pipeline <ul><li>This module relies on a previously computed generic atlas. </li></ul><ul><li>Running the EM segmentation requires that you have installed the generic atlas and that your target datasets go through a processing pipeline. </li></ul>
  11. 11. Generic Atlas Generation (Step 1) Register all the subjects to the training subject … .. S1 S2 Sn n=80 healthy subjects, ages 25-40 Training subject (randomly chosen) … .. T’(S1) T’(S2) T’(Sn) n=80 registered subjects A Binary Entropy Measure to Assess Non-rigid Registration Algorithms. S.Warfield, J. Rexilius, P. Huppi, T.Inder, E. Miller, W.Wells, G. Zientara, F. Jolesz, R. Kikinis. In Proc. MICCAI 2001: Medical Image Computing and Computer-Assisted Interventions, pp 266-274.
  12. 12. Segment all 80 images into 4 classes … .. T’(S1) T’(S2) T’(Sn) n=80 registered subjects … .. … .. … .. … .. Generate the generic atlas (voxel wise map of the number of subjects/80 possible that belong to that class) Adaptative Segmentation of MRI data. Wells W., Grimson E., Kikinis R and Jolesz F. IEEE Transactions on Medical Imaging, vol.15, p 429-442, 1996. Generic Atlas Generation (Step 2) white matter csf grey matter background
  13. 13. EM Pipeline: Data Normalization Align t2 to t1 Normalize the intensity of each image t2 t1 Patient data Normalized Patient data t1 T(t2) t1 normalized T(t2) normalized
  14. 14. EM Pipeline: Patient-Specific Atlas Generation Register the generic atlas to the images to create the patient-specific atlas white matter csf grey matter background Generic atlas Anatomical Guided Segmentation with non-stationary tissue class distributions in an expectation maximization framework. Pohl K., Bouix S., Kikinis R. and Grimson E. In Proc.ISBIT 2004: IEEE International Symposium on Biomedical Imaging:From Nano to Macro, pp 81-84 Patient-specific atlas white matter csf grey matter background Normalized Patient data t1 normalized T(t2) normalized
  15. 15. EM Pipeline: Segmentation Patient-specific atlas white matter csf grey matter background Segment using the Expectation Maximization algorithm Normalized Patient data Anatomical Guided Segmentation with non-stationary tissue class distributions in an expectation maximization framework. Pohl K., Bouix S., Kikinis R. and Grimson E. In Proc.ISBIT 2004: IEEE International Symposium on Biomedical Imaging:From Nano to Macro, pp 81-84 T1 normalized T(t2) normalized
  16. 16. EP Pipeline: Algorithm Maximization Step applies the intensity correction as a function of the tissue class Expectation Step classifies the MR voxels in tissue classes Gray Matter, White Matter, CSF Loop iterated 4 times
  17. 17. Overview <ul><li>Part 1: Generic Atlas and EM Pipeline </li></ul><ul><li>Part 2: Loading tutorial data </li></ul><ul><li>Part 3: Hardware requirements </li></ul><ul><li>Part 4: Working with tutorial data </li></ul><ul><li>Part 5: Working with your own data </li></ul>
  18. 18. Loading T1 volume Click Add Volume in the Panel Data
  19. 19. Loading T1 volume Load the volume t1 from the directory named /BrainAtlasClassifier/data Click Add Volume and select Basic in the Panel Props of the module Volumes Click on Apply
  20. 20. Loading T1 volume Slicer loads the volume t1 in the viewer.
  21. 21. Loading T2 volume Click on Image Headers Manual Click Add Volume and select Basic in the Panel Props of the module Volumes Select the volume t2 Click on Apply
  22. 22. Loading T2 volume <ul><li>The tutorial dataset t2 was acquired in the Coronal Posterior-Anterior orientation. </li></ul>Select the Scan order Coronal:PA Click on Apply
  23. 23. Loading T2 volume Slicer loads the volume t2 in the viewer.
  24. 24. Loading the generic atlas of the brain Select File  OpenScene in the Main menu. Select the file generic_atlas.xml in the directory BrainAtlasClassifier/atlas Click on Apply
  25. 25. Loading the generic atlas of the brain <ul><li>Slicer loads the generic atlas, composed of 4 volumes: </li></ul><ul><li>White Matter </li></ul><ul><li>Gray Matter </li></ul><ul><li>CSF </li></ul><ul><li>Background </li></ul>
  26. 26. Viewing the generic atlas of the brain Move the mouse over the images to see atlas values (0-80) in different brain regions Slicer displays the generic atlas of the brain in the viewer.
  27. 27. Loading the generic atlas of the brain Left click on Bg to step through viewing each component.
  28. 28. Viewing the generic atlas of the brain In the Control Panel left-click on Views and select the view Sylvian Fissure
  29. 29. Viewing the generic atlas of the brain Slicer displays a coronal view of the Sylvian fissure from the Grey Matter atlas
  30. 30. Loading the patient-specific atlas of the brain Select File  OpenScene in the Main menu Select the file patientSpecific_atlas.xml in the directory BrainAtlasClassifier/working/atlas Click on Apply
  31. 31. Loading the patient-specific atlas of the brain <ul><li>Slicer loads the patient-specific atlas, composed of 4 volumes: </li></ul><ul><li>Background </li></ul><ul><li>White Matter </li></ul><ul><li>CSF </li></ul><ul><li>Grey Matter </li></ul>
  32. 32. Loading the patient-specific atlas of the brain Slicer displays the Gray Matter volume of the atlas in the viewer Move the mouse over the images to see atlas values (0-80) in different brain regions
  33. 33. Loading the Segmentation results Select File  OpenScene in the Main menu. Select the file segmentation in the directory BrainAtlasClassifier/working/EMSegmentation and click on Apply
  34. 34. Loading the Segmentation results Slicer superimposes the results of the segmentation on T1 images
  35. 35. Loading the Segmentation results Move the mouse over the images in the 2D Viewer <ul><li>Slicer displays the names of the labels corresponding to the segmented structures: </li></ul><ul><li>- White Matter (yellow) </li></ul><ul><li>Grey Matter (blue) </li></ul><ul><li>CSF (red) </li></ul><ul><li>Background (pink) </li></ul>
  36. 36. Building 3D models Double-click on the volume Volume:EMBrainSegResult1
  37. 37. Building 3D models Select the module ModelMaker
  38. 38. Building 3D models Select the label White Matter corresponding to the color label of the White Matter segmentation. Create on Create
  39. 39. Building 3D models Slicer generates a 3D model of the White Matter
  40. 40. Overview <ul><li>Part 1: Generic Atlas and EM Pipeline </li></ul><ul><li>Part 2: Loading tutorial data </li></ul><ul><li>Part 3: Hardware requirements </li></ul><ul><li>Part 4: Working with tutorial data </li></ul><ul><li>Part 5: Working with your own data </li></ul>
  41. 41. Hardware: constraints <ul><li>Minimal requirements </li></ul><ul><li>RAM: 1 GB </li></ul><ul><li>Processor: 2 GHz </li></ul><ul><ul><li>Segmentation algorithm is computationally demanding. </li></ul></ul>
  42. 42. Module Performance <ul><li>Examples of processing time for the EMBrainAtlasClassifier </li></ul><ul><li>Sun Solaris 12 UltraSparc-III processors 10 GB RAM: 55 min </li></ul><ul><li>Debian Pentium 4-M CPU 2.4 GHz, 2 GB RAM : 45 min </li></ul><ul><li>RedHat 64 bit 4 Gig 2x 3.0 GHz Xeon Processor: 40 min </li></ul>
  43. 43. Overview <ul><li>Part 1: Generic Atlas and EM Pipeline </li></ul><ul><li>Part 2: Loading tutorial data </li></ul><ul><li>Part 3: Hardware requirements </li></ul><ul><li>Part 4: Working with tutorial data </li></ul><ul><li>Part 5: Working with your own data </li></ul>
  44. 44. Implementing the EM algorithm <ul><li>If your processor meets the requirements the following steps will guide you through the process of segmenting your data using the EM algorithm </li></ul><ul><li>If your processor does not, read through (slide 40) to see what you need to do when you run it on a computer with adequate processing capabilities </li></ul>
  45. 45. Parameter Settings In the Main Menu select Modules  Segmentation  EMAtlasBrainClassifier
  46. 46. Parameter Settings The Segmentation panel of the module EMAtlasBrainClassifier appears.
  47. 47. Parameter Settings Select the panel Segmentation and select the input channels t1 and t2 that were previously loaded in the first part of the tutorial. Set alignment to On
  48. 48. Parameter Settings Set Save Segmentation On to save the output of the segmentation Enter the path corresponding to the location of the directory BrainAtlasClassifier/working in the tutorial data. Set Generate 3D Models On to reconstruct 3D models of the White Matter, Gray Matter and CSF.
  49. 49. Automatic Segmentation Click on Start Segmentation Expected mean processing time reminder : 45 min
  50. 50. Atlas loading The program looks for a generic atlas at the default location Modules/vtkEMBrainAtlasClassifier
  51. 51. Atlas loading A message inviting you to download the generic atlas from the web appears. Click OK. This message will happen only once after having installed Slicer.
  52. 52. Atlas loading (automatic) Slicer downloads the atlas from the web. Click OK once the installation is completed.
  53. 53. Atlas loading (manual) <ul><li>If you experience problems with the automatic atlas loading, manually download the atlas from the links stated below: </li></ul><ul><li>Unix/Linux/Mac: </li></ul><ul><li>http://na-mic.org/Wiki/images/8/8d/VtkEMAtlasBrainClassifier_AtlasDefault.tar.gz </li></ul><ul><li>Windows: </li></ul><ul><li>http://na-mic.org/Wiki/images/5/57/VtkEMAtlasBrainClassifier_AtlasDefault.zip </li></ul>
  54. 54. Atlas installation Manually unzip the archive of the atlas in the directory Modules/vtkEMAtlasBrainClassifier/atlas
  55. 55. Atlas installation (Non-Windows Users) Check that the atlas is located in the directory Modules/vtkEMAtlasBrainClassifier /atlas
  56. 56. Atlas installation (additional step only required for Windows Users) Built-in Windows unzip wizard adds an extra level of directory Modules/vtkEMAtlasBrainClassifier /atlas/atlas Move the atlas data one level-up to the correct directory Modules/vtkEMAtlasBrainClassifier /atlas and delete the unnecessary directory
  57. 57. Overview <ul><li>Part 1: Generic Atlas and EM Pipeline </li></ul><ul><li>Part 2: Loading tutorial data </li></ul><ul><li>Part 3: Hardware requirements </li></ul><ul><li>Part 4: Working with tutorial data </li></ul><ul><li>Part 5: Working with your own data </li></ul>
  58. 58. Data Acquisition: Tutorial data <ul><li>The tutorial dataset was acquired with the following parameters </li></ul><ul><ul><li>T1 volume: Coronal series of contiguous Spoiled Gradient (SPGR) images (124 slices of 1.5 mm thickness, voxel dimensions 0.9375 x 0.9375 x 1.5 mm) </li></ul></ul><ul><ul><li>T2 volume: Axial series of contiguous double-echo images (Proton Density and T2 Weighted, 108 slices of 3 mm slice thickness, voxel dimensions 0.9375 x 0.9375 x 3 mm) isotropic t2 Dimension 0.9375mm x 0.9375mm x 3mm </li></ul></ul><ul><li>More details can be found on the NA-MIC wiki </li></ul><ul><ul><li>http://www.na-mic.org/Wiki/index.php/Brockton_MRI_Scan_Parameters </li></ul></ul>
  59. 59. Data Acquisition: your data <ul><li>You’ll need to experiment the EMBrainAtlasClassifier module with your own data. </li></ul><ul><li>We suggest High resolution T1 and T2 weighted images . </li></ul>
  60. 60. Working with your own data Load T1 and T2 as Input Channels, and set Align T2 to T1 On to register the two volumes.
  61. 61. Working with your own data Set Save Segmentation On to save the output of the segmentation Enter the path corresponding to the working directory for your own data Set Generate 3D Models On to reconstruct 3D models of the White Matter, Gray Matter and CSF. Click on Start Segmentation
  62. 62. Conclusion <ul><li>Automatic segmentation of MRI brain data in White Matter, Grey Matter and Cerebrospinal Fluid. </li></ul><ul><li>Open-source environment </li></ul>
  1. A particular slide catching your eye?

    Clipping is a handy way to collect important slides you want to go back to later.

×