Slicer Overview Steve Pieper, PhD
Outline <ul><li>Slicer  </li></ul><ul><ul><li>Overview and History </li></ul></ul><ul><ul><li>Architecture / Implementatio...
What is 3D Slicer? <ul><li>3D Slicer is… </li></ul><ul><ul><li>An end-user application for 3D medical image computing rese...
Surgical Planning Example <ul><li>Dr. Jose Miguel Selman, Clinica Las Condes, Santiago, CHILE </li></ul><ul><li>Temporal L...
Virtual Endoscopy Example <ul><li>Delphine Nain, MIT AI Lab, now at Georgia Tech </li></ul><ul><li>Automatic or Manual Pat...
Slicer Background <ul><li>SPL Image Guided Surgery and Visualization (Kikinis, Westin, Hata, Halle, others) </li></ul><ul>...
Why Develop with Slicer? <ul><li>Start with a Powerful Platform </li></ul><ul><li>Remove Obstacles to Problem Solving </li...
Slicer Today <ul><li>300K Lines of Code </li></ul><ul><ul><li>Cross-Platform Tcl/Tk GUI </li></ul></ul><ul><ul><li>VTK/ITK...
Architecture <ul><li>Plug-in Modules consist of Tcl and C++ code with cross-platform file layout for building and loading ...
Features <ul><li>Load Medical Image Data: MR, CT in DICOM, GE, Analyze… </li></ul><ul><li>XML-based File Format: MRML (Med...
Administration <ul><li>Project Housed at Surgical Planning Lab, Brigham and Women’s Hospital / Harvard Medical School, Man...
Image/Scene Management <ul><li>XML-Based MRML File Stores Scene Description </li></ul><ul><ul><li>Volumes (Images, Label M...
Image Formats <ul><li>DICOM, GE, Headerless, Analyze </li></ul><ul><ul><li>Best Support for MR </li></ul></ul><ul><ul><li>...
User Segmentation Tools <ul><li>Label Map Editor </li></ul><ul><ul><li>Draw on Orthogonal Planes </li></ul></ul><ul><ul><l...
EM Segmenter <ul><li>Hierarchical segmentation   based on anatomy </li></ul><ul><li>Multi threaded  </li></ul><ul><li>User...
Models <ul><li>Triangle Meshes from Label  Maps </li></ul><ul><ul><li>Marching Cubes, Decimation, Smoothing </li></ul></ul...
Registration <ul><li>Interactive Manual Transform Editing </li></ul><ul><li>Landmark Based Alignment </li></ul><ul><li>Rig...
Diffusion Tensor Tractography <ul><li>Multiple MR Gradient Acquisitions </li></ul><ul><ul><li>Sensitive to Brownian Diffus...
DTMRI Tools <ul><li>Convert Gradient Images to Tensors </li></ul><ul><li>Generate Scalars </li></ul><ul><ul><li>ADC, FA, e...
Segmentation and Tractography <ul><li>Parcellation  </li></ul><ul><ul><li>Freesurfer (MGH) </li></ul></ul><ul><li>Tractogr...
DTMRI Examples <ul><li>White Matter Atlas </li></ul><ul><ul><li>Under Development in Slicer by James Fallon, UCI </li></ul...
Slicer fMRI Goals <ul><li>Advanced GUI and Interactive Visualization Environment </li></ul><ul><ul><li>iBrowser </li></ul>...
Application: Pre-Operative Map <ul><li>Structural </li></ul><ul><ul><li>MRI Tumor Segmentation </li></ul></ul><ul><li>DTI ...
Pre-Op Map Example
Upcoming SlideShare
Loading in...5
×

ITK Tutorial Presentation Slides-953

1,924

Published on

http://hdl.handle.net/1926/161

Published in: Technology
0 Comments
1 Like
Statistics
Notes
  • Be the first to comment

No Downloads
Views
Total Views
1,924
On Slideshare
0
From Embeds
0
Number of Embeds
1
Actions
Shares
0
Downloads
39
Comments
0
Likes
1
Embeds 0
No embeds

No notes for slide
  • ITK Tutorial Presentation Slides-953

    1. 1. Slicer Overview Steve Pieper, PhD
    2. 2. Outline <ul><li>Slicer </li></ul><ul><ul><li>Overview and History </li></ul></ul><ul><ul><li>Architecture / Implementation </li></ul></ul><ul><ul><li>Image I/O and Management </li></ul></ul><ul><ul><li>Segmentation Tools (EM, Editor) </li></ul></ul><ul><ul><li>DTMRI Tools </li></ul></ul><ul><ul><li>fMRI Tools </li></ul></ul><ul><ul><li>Applications (IGT, Clinical Research) </li></ul></ul>
    3. 3. What is 3D Slicer? <ul><li>3D Slicer is… </li></ul><ul><ul><li>An end-user application for 3D medical image computing research and Image Guided Therapy </li></ul></ul><ul><ul><li>A platform for research where new techniques can be plugged into a useful framework </li></ul></ul><ul><ul><li>A freely-downloadable program with source and binaries for Windows, Linux, Solaris and (sort-of) Mac OSX </li></ul></ul><ul><ul><li>NOT an FDA approved medical device and CANNOT be used clinically without proper research controls (IRB etc.) </li></ul></ul><ul><ul><li>NOT finished – some parts will work better than others </li></ul></ul>
    4. 4. Surgical Planning Example <ul><li>Dr. Jose Miguel Selman, Clinica Las Condes, Santiago, CHILE </li></ul><ul><li>Temporal Lobe Cavernoma </li></ul><ul><li>MR Cortex and White Matter Extracted by FreeSurfer (MGH software, interface created for BIRN) </li></ul><ul><li>Registration to CT and Visualization in Slicer </li></ul>
    5. 5. Virtual Endoscopy Example <ul><li>Delphine Nain, MIT AI Lab, now at Georgia Tech </li></ul><ul><li>Automatic or Manual Path Planning </li></ul><ul><li>Animated Camera and Controls </li></ul>http://www.ai.mit.edu/projects/medical-vision/virtual-endoscopy/
    6. 6. Slicer Background <ul><li>SPL Image Guided Surgery and Visualization (Kikinis, Westin, Hata, Halle, others) </li></ul><ul><li>Slicer Application Pulled Together by Dave Gering 1997-1999 with VTK and Tcl </li></ul><ul><li>Further Development and Architecture by Lauren O’Donnell 1999-2001 </li></ul><ul><li>Ongoing Development of Slicer’s Base Primarily by Steve Pieper and Nicole Aucoin </li></ul><ul><li>Many Modules and Contributions by Various Authors </li></ul><ul><ul><li>BWH, MIT, MGH, Georgia Tech, UCSD, JHU… </li></ul></ul>
    7. 7. Why Develop with Slicer? <ul><li>Start with a Powerful Platform </li></ul><ul><li>Remove Obstacles to Problem Solving </li></ul><ul><ul><li>Access to Every Layer of Source Code: Numeric, Graphic, Network, etc. </li></ul></ul><ul><li>Commit to an Environment that will Always be Available </li></ul><ul><ul><li>Not Tied Up in IP of Old Institution </li></ul></ul><ul><ul><li>Not Tied to Proprietary Platform with License Fees </li></ul></ul><ul><li>Keep Your Own Work Available to You </li></ul>
    8. 8. Slicer Today <ul><li>300K Lines of Code </li></ul><ul><ul><li>Cross-Platform Tcl/Tk GUI </li></ul></ul><ul><ul><li>VTK/ITK Based C++ Computing </li></ul></ul><ul><li>www.slicer.org </li></ul><ul><ul><li>166 on slicer-users </li></ul></ul><ul><ul><li>117 on slicer-devel </li></ul></ul><ul><ul><li>4000 Registered Downloads </li></ul></ul>
    9. 9. Architecture <ul><li>Plug-in Modules consist of Tcl and C++ code with cross-platform file layout for building and loading </li></ul><ul><li>Standard naming convention and hooks to add GUI and processing components </li></ul><ul><li>Personally, I find the speed of C++ and the interactive development of Tcl to be a near-perfect environment </li></ul>3D Slicer Application Slicer Base Module 1 Module N … VTK Tcl OpenGL Window System Computer Hardware
    10. 10. Features <ul><li>Load Medical Image Data: MR, CT in DICOM, GE, Analyze… </li></ul><ul><li>XML-based File Format: MRML (Medical Reality Markup Language) </li></ul><ul><li>Interactive Editor: Draw, Threshold, Math Morphology… </li></ul><ul><li>Automated Segmenters: EM Segmentation, Fast Marching, Level Sets… </li></ul><ul><li>Visualization: Model Building, Stereo Rendering, Animation… </li></ul><ul><li>Registration: Manual, ITK, CNI </li></ul><ul><li>Measurement: Fiducial-Based, Volumetric, Polyhedral Intersection, Vessel Cross-Section, Osteotomy Planning </li></ul><ul><li>IGT: Tracked Probes, Real-Time Images, Robot Control </li></ul><ul><li>Additional Application-Specific Features in Modules… </li></ul>
    11. 11. Administration <ul><li>Project Housed at Surgical Planning Lab, Brigham and Women’s Hospital / Harvard Medical School, Many MIT CSAIL (formerly AI Lab) Students and Faculty Involved </li></ul><ul><li>CVS, Mailing Lists, etc at the SPL </li></ul><ul><li>Funded Projects Supporting Slicer Base Development </li></ul><ul><ul><li>Neuroimage Analysis Center (NAC): NIH Center at SPL </li></ul></ul><ul><ul><li>Biomedical Informatics Research Network (BIRN): NIH Supported Neuroimaging Collaboration </li></ul></ul><ul><ul><li>Computer Integrated Surgical Systems and Technology (CISST): NSF Supported Robotics Collaboration Headed by JHU </li></ul></ul><ul><ul><li>Virtual Soldier: DARPA Organ Simulation Collaboration </li></ul></ul><ul><ul><li>National Alliance for Medical Image Processing </li></ul></ul><ul><li>Module Development Supported by Application-Oriented Grants </li></ul>
    12. 12. Image/Scene Management <ul><li>XML-Based MRML File Stores Scene Description </li></ul><ul><ul><li>Volumes (Images, Label Maps) </li></ul></ul><ul><ul><li>Models </li></ul></ul><ul><ul><li>Hierarchical Affine Transforms </li></ul></ul><ul><ul><li>Scene Data (Cameras, Colors, Fiducials, etc). </li></ul></ul><ul><li>Manipulated in World Coordinates based on Patient RAS </li></ul><ul><ul><li>Automatically Extracted from DICOM or GE Files </li></ul></ul>
    13. 13. Image Formats <ul><li>DICOM, GE, Headerless, Analyze </li></ul><ul><ul><li>Best Support for MR </li></ul></ul><ul><ul><li>CT and RGB Support limited </li></ul></ul><ul><ul><li>Real-Time from OpenMR and US </li></ul></ul><ul><li>Time Series </li></ul><ul><ul><li>Analyze Sequence </li></ul></ul><ul><ul><li>DICOM Sequence </li></ul></ul><ul><ul><li>BXH Files </li></ul></ul><ul><ul><ul><li>BIAC XML Header (Brian Image Analysis Center, Duke) </li></ul></ul></ul><ul><ul><ul><li>Like MRML for fMRI; Integration Work Ongoing </li></ul></ul></ul>
    14. 14. User Segmentation Tools <ul><li>Label Map Editor </li></ul><ul><ul><li>Draw on Orthogonal Planes </li></ul></ul><ul><ul><li>Connected Component “Island” Tools </li></ul></ul><ul><ul><li>Math Morphology </li></ul></ul><ul><ul><li>Image Masking and Logical Operations </li></ul></ul><ul><ul><li>Level Set, Fast Marching </li></ul></ul>
    15. 15. EM Segmenter <ul><li>Hierarchical segmentation based on anatomy </li></ul><ul><li>Multi threaded </li></ul><ul><li>User friendly interface </li></ul>* For further information see Pohl et al. “Incorporating Non-Rigid Registration into Expectation Maximization Algorithm to Segment MR Images”, MICCAI 2002, pp. 564-572 <ul><li>Segmentation tool designed for fully automatic, high-quality parcellation of the brain*: </li></ul><ul><li>Segmentation of cortical and ventricle substructures </li></ul><ul><li>Multi channel input </li></ul>
    16. 16. Models <ul><li>Triangle Meshes from Label Maps </li></ul><ul><ul><li>Marching Cubes, Decimation, Smoothing </li></ul></ul><ul><li>Model Hierarchies </li></ul><ul><li>Clipping By Slice Planes </li></ul>Image: Developmental Neuroinformatics, Simon Warfield
    17. 17. Registration <ul><li>Interactive Manual Transform Editing </li></ul><ul><li>Landmark Based Alignment </li></ul><ul><li>Rigid Intensity Registration </li></ul><ul><ul><li>Mutual Information Metric </li></ul></ul><ul><ul><li>ITK Implementation </li></ul></ul><ul><li>Non-Rigid Registration </li></ul><ul><ul><li>Demon’s Method </li></ul></ul><ul><ul><li>Available by Request to CNI </li></ul></ul>
    18. 18. Diffusion Tensor Tractography <ul><li>Multiple MR Gradient Acquisitions </li></ul><ul><ul><li>Sensitive to Brownian Diffusion of Water </li></ul></ul><ul><ul><li>Cell Membranes Restrict Diffusion </li></ul></ul><ul><li>Post Processing to Extract Probable White Matter Tracts </li></ul><ul><ul><li>Actual Tracts are Far Below the Resolution of the Scan </li></ul></ul>Images Provided by Westin, Park, O’Donnell et al
    19. 19. DTMRI Tools <ul><li>Convert Gradient Images to Tensors </li></ul><ul><li>Generate Scalars </li></ul><ul><ul><li>ADC, FA, etc </li></ul></ul><ul><li>Visualize Glyphs </li></ul><ul><li>Tractography </li></ul><ul><ul><li>User Guided </li></ul></ul><ul><ul><li>From ROI </li></ul></ul>
    20. 20. Segmentation and Tractography <ul><li>Parcellation </li></ul><ul><ul><li>Freesurfer (MGH) </li></ul></ul><ul><li>Tractography </li></ul><ul><ul><li>DoDTI (H.J. Park) </li></ul></ul><ul><li>Visualization </li></ul><ul><ul><li>Slicer </li></ul></ul><ul><li>Full Integration with Slicer Planned </li></ul>
    21. 21. DTMRI Examples <ul><li>White Matter Atlas </li></ul><ul><ul><li>Under Development in Slicer by James Fallon, UCI </li></ul></ul>
    22. 22. Slicer fMRI Goals <ul><li>Advanced GUI and Interactive Visualization Environment </li></ul><ul><ul><li>iBrowser </li></ul></ul><ul><li>Platform for Activation Detector Research </li></ul><ul><ul><li>fMRIEngine </li></ul></ul><ul><li>Framework for fMRI Integration with Other Modalities </li></ul>
    23. 23. Application: Pre-Operative Map <ul><li>Structural </li></ul><ul><ul><li>MRI Tumor Segmentation </li></ul></ul><ul><li>DTI </li></ul><ul><ul><li>Diffusion Tensor Imaging </li></ul></ul><ul><li>fMRI </li></ul><ul><ul><li>Functional MRI </li></ul></ul><ul><li>MEG </li></ul><ul><ul><li>Magneto Encephlogram </li></ul></ul><ul><li>Anatomy Atlas </li></ul><ul><ul><li>“ Textbook” Information </li></ul></ul>
    24. 24. Pre-Op Map Example
    1. A particular slide catching your eye?

      Clipping is a handy way to collect important slides you want to go back to later.

    ×