Tablet Driven Paradigm for Hybrid Reality Surgery Interaction
•Download as PPTX, PDF•
1 like•132 views
Design Research Project
Recommended
Recommended
More Related Content
What's hot
What's hot (20)
Viewers also liked
Viewers also liked (12)
Similar to Tablet Driven Paradigm for Hybrid Reality Surgery Interaction
Similar to Tablet Driven Paradigm for Hybrid Reality Surgery Interaction (20)
More from Matthew Dunning
More from Matthew Dunning (9)
Recently uploaded
Recently uploaded (20)
Tablet Driven Paradigm for Hybrid Reality Surgery Interaction
- 1. A Tablet- Driven Paradigm For Hybrid Reality Surgery Interaction Presenters: Andrei Marroquin, Hamzah Shannag, Huyen Le, Matthew Dunning Advisor: Dr. Mahesh Shenai Co- advisor: Dr. Juan Cebral
- 2. What is Hybrid Reality? • The technology of the virtual reality world of computers. • Entering simulated worlds without leaving the physical environment. Introduction Relevance Problem Statement Design Process Engineering Challenges Future Direction Copyright businessinsider.com Copyright playgoogle.com
- 3. The Clinical Need • Visualization methods via hybrid/augmented reality in the OR. • To address various surgical methods in: • Neurosurgery • Impact: Increasing surgical precision and visualization during minimally invasive procedures. Introduction Relevance Problem Statement Design Process Engineering Challenges Future Direction Copyright from Dr. Shenai
- 4. Possible Applications for Hybrid Reality in Neurosurgery • Placement of drainage (burr) holes for hematomas. • Localization of tumors and other intracranial lesions. • Stereotactic placement of catheters/electrodes, biopsy needles Introduction Relevance Problem Statement Design Process Engineering Challenges Future Direction Copyright medicalimages.com Copyright youtube.com
- 5. Stereotactic Placement When Addressing Hydrocephalus. • Hydrocephalus: • Excessive accumulation of fluid in the brain • Causes: Brain damage, loss in mental and physical abilities, and even death • Surgery: • Ventriculostomy Copy right at aboukidhealth.ca Introduction Relevance Problem Statement Design Process Engineering Challenges Future Direction Copyright ipcphysicaltherapy.com
- 6. Ventriculostomy • Done Blindly • Landmarks Introduction Relevance Problem Statement Design Process Engineering Challenges Future Direction Copyright orion-group.net
- 7. Stealth Navigation Introduction Relevance Problem Statement Design Process Engineering Challenges Future Direction Existing Methodologies Copyright medtronic.com Copyright brainlab.com BrainLAB Navigation
- 8. Available Devices • Head mounted displays (HMD) • Semitransparent mirror reflection Introduction Relevance Problem Statement Design Process Engineering Challenges Future Direction Copyright helio-TEKD.com Copyright at Researchgate.net
- 9. Problems with Existing Methods • Superimposition • Price: • Stealth Navigation – Stealthstation costs 1 million dollars. • BrainLAB Navigation – Vector Vision-BrainLAB costs $225,000. • Proposed solution: • Augmented reality concept (superimposition) • Cheaper Introduction Relevance Problem Statement Design Process Engineering Challenges Future Direction Copyright trailx.com Copyright audaxceph.com
- 10. Introduction Relevance Problem Statement Design Process Engineering Challenges Future Direction Copyright orion-group.netCopyright synapse.korwamed.org
- 11. 45o β h1 3D-printed clamp Tripod Operating Table Semi- reflective screen Tablet h2 Foam head Surgeon Introduction Relevance Problem Statement Design Process Engineering Challenges Future Direction
- 13. How are we conducting the project ? Introduction Relevance Problem Statement Design Process Engineering Challenges Future Direction CT-scan Images Software Optical Device Imaging Re-slicing RegisteringSuperimposingRendering Projecting
- 14. CT scan of the Foam Head Introduction Relevance Problem Statement Design Process Engineering Challenges Future Direction
- 15. How are we conducting the project ? Introduction Relevance Problem Statement Design Process Engineering Challenges Future Direction CT-scan Images Software Optical Device Imaging Re-slicing RegisteringSuperimposingRendering Projecting
- 16. Methods - Programming Introduction Relevance Problem Statement Design Process Engineering Challenges Future Direction
- 17. How are we conducting the project ? Introduction Relevance Problem Statement Design Process Engineering Challenges Future Direction CT-scan Images Software Optical Device Imaging Re-slicing RegisteringSuperimposingRendering Projecting
- 18. Methods – Optical Device • Tripods • Adjustable Reflective screen & tablet • Foam head - fiducials • Machine Shop • 3D-printed table clamp • Tools: drilling, cutting, etc. Introduction Relevance Problem Statement Design Process Engineering Challenges Future Direction
- 19. Foam Head Fiducials Introduction Relevance Problem Statement Design Process Engineering Challenges Future Direction
- 21. Physical Prototype - Video
- 22. Future Plans Introduction Relevance Problem Statement Design Process Engineering Challenges Future Direction • Improve Code: Develop GUI- Graphical User Interface Increase speed • Improve Optical device: Improve stability Reduce area taken by the device • Validation- Testing: CT-scan cadaver head with fiducials Run code & superimpose Attempt ventriculostomy CT-scan again with catheter inserted Measure distance between the ROI and the placement of the catheter Determine the percent error of incision
- 23. Time Spent & Budget • Time: Each member spent approximately 8 hours a week. • Budget: • $200 – Windows tablet • $100 – optical device • $10 – foam head
- 24. • Dr. Cebral – Guidance for the physical design, methodology of the code, and how to prepare a professional PowerPoint. • Dr. Shenai – Aim and purpose of the project, CT scan of the foam head. • Dr. Bray – Guidance to where we stand and ideas regarding the project. • Dr. Cressman – Using the equipment at the machine shop and guidance to designing the required table clamp. • Dr. Chitnis – Thoughts regarding the code. • George Mason University – Providing the machine shop.
- 25. References 1. ”Facts about hydrocephalus”, National Hydrocephalus Foundation, http://nhfonline.org/facts-about- hydrocephalus.htm 2. (n.d.). Retrieved November 30, 2015, from http://www.nhs.uk/conditions/chiari- malformation/documents/etv.pdf 3. Brain Health Community. (2012, August 21). Retrieved November 30, 2015, from http://www.wellsphere.com/brain-health-article/hydrocephalus-and-treatment-shunts-and- endoscopic-third-ventriculostomy/1727082 4. Jones RFC, Kwok BCT, Stening WA, & Vonau M: The current status of endoscopic third ventriculostomy in the management of non-communicating hydrocephalus. Minim. Invas. Neurosurg, v. 37, pp. 28-36, 1994. 5. Perneczky A, Tschabitscher M, & Resch KDM: Endoscopic Anatomy for Neurosurgery. New York: Thieme Medical Publishers, Inc., 1993. 6. Assessment of ETV patency with the 3D-SPACE technique. (2015). Daily Bibliographic and Video Review of the Neurosurgery. doi:J Neurosurg 122:1347–1355, 2015 7. A Novel Protocol of Continuous Navigation Guidance for Endoscopic Third Ventriculostomy. (2014). Daily Bibliographic and Video Review of the Neurosurgery. doi:10:514–524, 2014
- 27. Extra - 3D-Printed Clamp
- 28. Extra - Reflective-Mounted Screen
- 29. Extra - Tablet-Holder • Double-sided sticky pads
- 30. Extra - Tripods
- 31. CT-scan Re-slices (proof that our software works) 90 degrees 45 degrees
Editor's Notes
- Extra slide to guide us for the presentation Focus on the clinical needs: sophisticated visualization methods via hybrid/augmented reality some operations are done blindly (no guidance). In minimally invasive neurosurgeries, surgeons are blind to the interior of the head when introducing instruments (like catheters) The idea: superimpose images on a the physical head during surgery to see the relative placement of the instruments with respect to anatomical structures. To: allow surgeons to be more precise and have more information to guide the procedure Give a few surgical procedures that would benefit from this system. Hydrocephalus is one of them spend the last 50% of your presentation discussing your solution at a level of detail that is easy for a general audience to understand, but with more than general statements.
- OR stands for Operating Room To address various surgical methods in: Neurosurgery: Stereotactic placement of medical instruments Localization of tumors and other intracranial lesions
- “so the possible applications where hybrid reality could be applied are:” Stereotactic placement of catheters/electrodes, biopsy needles. Localization of tumors and other intracranial lesions. Placement of drainage (burr) holes for hematomas. Hematoma is swelling of clotted blood within the tissue. The drainage is done where the swelling occurs here “point at the left side of the brain picture”.
- Hydrocephalus is a condition where the normal flow of Cerebrospinal Fluid (CSF), produced in the ventricles is interrupted (either by obstruction or a failure of the body to re-absorbed the CSF) causing intracranial pressure to increase and the ventricle to enlarge. Ventriculostomy surgery Ventriculostomy is the process of draining the excess CSF from the brain to release increased pressure. Incision of the catheter is done blindly, using landmarks to estimate the area for where incision should be done.
- There’s no better way than placing landmarks on the head and assuming proper placement for incision. Wouldn’t it be beneficial to superimpose the image on the head and to properly register it for guidance of this surgery? To know exactly where incisions should be made.
- (Mention that they do not superimpose) Interfaces with multiple imaging systems (iCT, iMRI) Navigational Camera or Electromagnetic System High Resolution Easy to access pre-op exams
- Head Mounted Displays are one of the most effective optical devices that have been used in various forms to assist surgeons and other medical personnel to support and improve visualization of the work site Semitransparent mirror reflection: Placed above the patient. The mirror reflects the virtual scene while the surgeon looks through the glass to see the patient. Control software refreshes the virtual images so that the projected scene matches the action in the OR by tracking everything that moves during a procedure. - Should mention that there are no marketed versions of these used today in medicine. And that Researchers have attempted to address these needs.
- Superimposition: both the methodologies do not superimpose the images onto the head during surgery, they are only used to display where the surgeon desires to look on one of the methodology’s screen next to the operating bed. Price: Stealth Navigation – The Stealthstation roughly costs 1 million dollars. BrainLAB Navigation – Vector Vision-BrainLAB costs $225,000. Proposed solution: Augmented reality concept (superimposition) The device built along with the software is significantly cheaper for hospitals to purchase. Engineering Problem: Aligning/registering medical images with physical objects simultaneously.
- There’s no better way than placing landmarks on the head and assuming proper placement for incision. Wouldn’t it be beneficial to superimpose the image on the head and to properly register it for guidance of this surgery? To know exactly where incisions should be made.
- So what will this project bring? Develop a digital platform, which displays pre-operative images onto a surgical field in an anatomically correct method. Provide digital landmarks for real-time surgical procedures. Observe internal anatomy without incisions nor surgical exposure. Reduce patient risk associated with unguided procedures. Adjustable angle β depends on: Height of the physician h1 which ranges 4’7’’- 7’4’’ Adjustable height of the tripod holding the tablet h2. ranges 16’’- 72’’ Height of the operating bed h3 Angle β is approximated by the equation: Measuring the angle from the face of the tablet to the horizontal operating bed and subtracting 45 from it 45 is the angle between the semi-reflective glass and the tablet. So β is most often approximately 45 degrees The CT scan is resliced at angle β to view the desired angle of the rendered volume. Tablet size at least 10 inches for the size of the head or foam head
- This is our setting that we have set up in dr cebrals lab. We shot it from different angles to show how its put together and the different parts.
- How are we conducting the project ? Rendering the 3D images obtained from a CT scan of the foam head. (MATLAB). Utilizing an optical device to superimpose the images onto the foam head. (Tripods, reflective plexigalss, tablet, 3D-printed clamp, foam head). Optical device screen must be perpendicular to the surgeons eye-sight. Tablet is 45* degrees from the optical device screen. “Brain” images displayed on the tablet and are reflected onto the perpendicular screen for real time guidance of ventriculostomy. Soo… Displaying images obtained from a CT scan of the foam head Building an optical device to support the superimposition process Using the fiducials on the foam head to align and register the images when superimposed onto the foam head
- How are we conducting the project ? Rendering the 3D images obtained from a CT scan of the foam head. (MATLAB). Utilizing an optical device to superimpose the images onto the foam head. (Tripods, reflective plexigalss, tablet, 3D-printed clamp, foam head). Optical device screen must be perpendicular to the surgeons eye-sight. Tablet is 45* degrees from the optical device screen. “Brain” images displayed on the tablet and are reflected onto the perpendicular screen for real time guidance of ventriculostomy. Soo… Displaying images obtained from a CT scan of the foam head Building an optical device to support the superimposition process Using the fiducials on the foam head to align and register the images when superimposed onto the foam head
- How are we conducting the project ? Rendering the 3D images obtained from a CT scan of the foam head. (MATLAB). Utilizing an optical device to superimpose the images onto the foam head. (Tripods, reflective plexigalss, tablet, 3D-printed clamp, foam head). Optical device screen must be perpendicular to the surgeons eye-sight. Tablet is 45* degrees from the optical device screen. “Brain” images displayed on the tablet and are reflected onto the perpendicular screen for real time guidance of ventriculostomy. Soo… Displaying images obtained from a CT scan of the foam head Building an optical device to support the superimposition process Using the fiducials on the foam head to align and register the images when superimposed onto the foam head
- We’re mounting the tablet and semi-reflective screen to the tripods for three dimensional orientation, since surgeons can be different heights
- This shows the image being displayed on the tablet that is superimposed onto the foam head.