This paper proposes a method to display lung PET/CT scans in 3D using a perspective projection technique. The method analyzes DICOM files to calculate standardized uptake values and generate a body mask. Two views are generated using a perspective projection and parallax adjustment to create a stereoscopic 3D effect when viewed with shutter glasses. An experiment shows various views from 0 to 280 degrees. The 3D display expands vision from 2D and helps distinguish depth. Future work involves a medical analysis system with real-time stereoscopic display and auto-stereoscopic capabilities.

1. Stereoscopic Display of Lung PET/
CT DICOM Scans using Perspective
使用透視法於肺部 PET/CT DICOM 影像之三維立體顯示
Student:Yueh-Ju Chen
Advisor: Dr. Tang-Kai Yin
Institute of Computer Science and Information Engineering
National University of Kaohsiung

2. • Introduction
• Motivation
• Related Works
• Proposed Approach
• DICOM Analysis
• Stereoscopic
• Result
• Conclusion and Future Work
Institute of Computer Science and Information Engineering
2 National University of Kaohsiung

3. Introduction
Institute of Computer Science and Information Engineering
National University of Kaohsiung

4. Background
• Computed tomography:
• A medical imaging procedure
• Utilizing computer-processed
X-rays to produce tomographic
images or 'slices' of specific
areas of the body
• Stereoscopy:
• The illusion 3D depth from images on a 2D plane
Institute of Computer Science and Information Engineering
4 National University of Kaohsiung

5. Motivation
• 3D effect get popular
• Not a new technology
• Medical diagnosis:
• Improve the efficiency of diagnosis
• Surgical simulation
• Education training
Institute of Computer Science and Information Engineering
5 National University of Kaohsiung

6. Algorithm
Institute of Computer Science and Information Engineering
National University of Kaohsiung

7. Related Works
Institute of Computer Science and Information Engineering
National University of Kaohsiung

8. Medical Scans
• DICOM file:
• File format
• DICOM Standards Committee
• Widely used by hospitals
• Dividing into two parts:
• Image
• Header (metadata) files
Institute of Computer Science and Information Engineering
8 National University of Kaohsiung

9. Maximum Intensity
Projection (MIP)
• Volume rendering method
• Voxels with maximum intensity
• Orthographic projection
• Cannot distinguish between left or right,
front or back
• Detection of lung nodules
Institute of Computer Science and Information Engineering
9 National University of Kaohsiung

10. Standardized Uptake
Value (SUV)
• Distinguish between malignant lesions and
benign tumor
• Enhances the 3D nature of nodules
• Pulmonary bronchi and vasculature
• Cut-off value for malignant lesion is 2.5
Institute of Computer Science and Information Engineering
10 National University of Kaohsiung

11. Stereoscopic
• Illusion of 3D depth from images on a 2D
plane
• 3D viewer technology:
• Anaglyph
• Active shutter systems
• Polarization systems
Institute of Computer Science and Information Engineering
11 National University of Kaohsiung

12. NVIDIA 3D Vision
• Shutter glasses and driver software
• Direct3D software
• Mainstream consumers and PC gamers
• Requirement:
• 120 Hz LCD or CRT
monitors, DLP-projectors
• NVIDIA graphics card
Institute of Computer Science and Information Engineering
12 National University of Kaohsiung

13. Proposed Approach
Institute of Computer Science and Information Engineering
National University of Kaohsiung

14. DICOM Analysis
Institute of Computer Science and Information Engineering
National University of Kaohsiung

15. Calculation of SUV
• Referred to as the dose uptake ratio
• Main calculate source: PET DICOM
• The related attributed tags:
• Rescale Slope tag
• Rescale Intercept tag
Institute of Computer Science and Information Engineering
15 National University of Kaohsiung

16. Step 1: Convert Pixel Value to
Activity Concentration
• Rescale Slope tag are vary for every image
slice
Institute of Computer Science and Information Engineering
16 National University of Kaohsiung

17. Step 2: Decay Calibration Factor
Institute of Computer Science and Information Engineering
17 National University of Kaohsiung

18. Step 3: Calculate SUV
Institute of Computer Science and Information Engineering
18 National University of Kaohsiung

19. SUV
Number 147 and 195 slice (a)original PET (b)SUV (c) threshold with 2.5
Institute of Computer Science and Information Engineering
National University of Kaohsiung

20. Non-body Pixels
Non-body
Original CT
pixels removed
Institute of Computer Science and Information Engineering
20 National University of Kaohsiung

21. Body Mask
Institute of Computer Science and Information Engineering
21 National University of Kaohsiung

22. Body Mask (cont.)
Institute of Computer Science and Information Engineering
22 National University of Kaohsiung

23. Stereoscopic
Institute of Computer Science and Information Engineering
National University of Kaohsiung

24. Real 3D vs. Fake 3D
• Fake 3D
• Converting 2D films into 3D
• Depth map
• Real 3D
• Two views
• Two different cameras (or projections)
Institute of Computer Science and Information Engineering
24 National University of Kaohsiung

25. Stereoscopic Principle
• D: distance between the
viewpoint and the screen
• R: distance of stereo pair
of images on the screen
• S: distance between the
perceived object and the
screen
Institute of Computer Science and Information Engineering
25 National University of Kaohsiung

26. Optical Angle
• Best viewing range:
70~500cm
• Distance between the
two eyes: 6.5~7cm
•
Institute of Computer Science and Information Engineering
26 National University of Kaohsiung

27. Eye Separation
• The most suitable for the 3D effect:
• Distance: 140~210 cm
• Optical angle: 2.86~1.91 degree
Institute of Computer Science and Information Engineering
27 National University of Kaohsiung

28. Perspective
Institute of Computer Science and Information Engineering
28 National University of Kaohsiung

29. Perspective
Institute of Computer Science and Information Engineering
29 National University of Kaohsiung

30. Perspective
Institute of Computer Science and Information Engineering
30 National University of Kaohsiung

31. Perspective
Institute of Computer Science and Information Engineering
31 National University of Kaohsiung

32. Parallax
Institute of Computer Science and Information Engineering
National University of Kaohsiung

33. Positive and Zero
Parallax
• Positive Parallax
• Cross point of each eye sight with the
screen
• Behind the screen
• Zero Parallax
• Overlap on the screen
• No 3D effect
Institute of Computer Science and Information Engineering
33 National University of Kaohsiung

34. Negative Parallax
• Focus heating-point in front of the screen
• Out of screen
• The closer the screen is the smaller depth of
field will be generated
Institute of Computer Science and Information Engineering
34 National University of Kaohsiung

35. Parallax Adjustment
Institute of Computer Science and Information Engineering
National University of Kaohsiung

36. Result
Institute of Computer Science and Information Engineering
National University of Kaohsiung

37. NVIDIA 3D
Vision
1. OpenGL QuadBuffer
2. NVAPI
3. 3D Video
Institute of Computer Science and Information Engineering
37 National University of Kaohsiung

38. Experiment
Environment
ASUS G53J
Platform: Win7 64bit
CPU: Intel i7-7400QM @1.73GHz
RAM: 8GM
Graphic Card: NVIDIA GTX 460M
1.5G
Institute of Computer Science and Information Engineering
38 National University of Kaohsiung

39. MIP
0 degree of MIP
100 degree of MIP
Institute of Computer Science and Information Engineering
39 National University of Kaohsiung

40. MIP
240 degree of MIP
280 degree of MIP
Institute of Computer Science and Information Engineering
40 National University of Kaohsiung

41. Perspective of Mean Volume
Rendering
0 degree of Perspective of Mean Volume Rendering
100 degree of Perspective of Mean Volume Rendering
Institute of Computer Science and Information Engineering
National University of Kaohsiung

42. Perspective of Mean Volume
Rendering
240 degree of Perspective of Mean Volume Rendering
280 degree of Perspective of Mean Volume Rendering
Institute of Computer Science and Information Engineering
National University of Kaohsiung

43. Perspective with Bilinear
Interpolation
0 degree of Perspective with Bilinear Interpolation
100 degree of Perspective with Bilinear Interpolation
Institute of Computer Science and Information Engineering
National University of Kaohsiung

44. Perspective with Bilinear
Interpolation
240 degree of Perspective with Bilinear Interpolation
280 degree of Perspective with Bilinear Interpolation
Institute of Computer Science and Information Engineering
National University of Kaohsiung

45. Conclusion
&
Future Work
Institute of Computer Science and Information Engineering
National University of Kaohsiung

46. Conclusion
• The stereoscopic image created by a perspective
projection and applied with SUV calculation of PET
scans in 3D shutter system.
• Expending vision from 2D to 3D and the biggest
difference between them is the depth information.
• 2D images cannot distinguish three points which is
in the front or which is in the back, but after we
applied the stereoscopic techniques it is more
obvious and clear to distinguish points’ relation and
distance between them
Institute of Computer Science and Information Engineering
46 National University of Kaohsiung

47. Future Work
• A medical analyze system with stereoscopic
display
• More medical analyze functions
• Real time volume rendering
• Auto-stereoscopic
Institute of Computer Science and Information Engineering
47 National University of Kaohsiung

48. Demo
Institute of Computer Science and Information Engineering
National University of Kaohsiung

49. Q &A
Institute of Computer Science and Information Engineering
National University of Kaohsiung