This document summarizes VR/AR applications for medicine presented by the Korean Agency for Science and Technology Information. It describes several areas where VR/AR is being used including 3D medical imaging software, surgical simulation, planning and guidance. Specific applications mentioned include 3D modeling of patient anatomy, virtual surgical planning, and AI-based medical software using 3D data. Examples of VR/AR hardware platforms for medical use such as HoloLens, MOVERIO and Evena glasses are provided. The document concludes with future directions for VR/AR in medicine such as higher resolution displays, multi-sensory feedback, improved tracking and registration accuracy, and integration with AI.
These slides use concepts from my (Jeff Funk) course on Business Models at National University of Singapore to analyze the business model for Google Cardboard. Google Cardboard provides users with a virtual reality experience for a much lower price than that from Occulus Rift. It combines a fold-out cardboard mount with an Android smart phone to enable users to feel as though they are part of a video or game. It is light, does not require wires, and content will be available from YouTube and Google Play. Young males are expected to be the largest users of Google Cardboard. Google expects to make money from sales of content through Google Play. The slides describe the value proposition, method of value capture, customers, scope of activities, and method of strategic control for Google Cardboard.
COMP 4010 Lecture 8 on an Introduction to Augmented Reality. This lecture provides a basic introduction to AR. Taught by Gun Lee on September 17th 2019 at the University of South Australia.
Lecture given by Mark Billinghurst on June 18th 2022 about how the Metaverse can be used for corporate training. In particular how combining AR, VR and other Metaverse elements can be used to provide new types of learning experiences.
Lecture 7 from a course on Mobile Based Augmented Reality Development taught by Mark Billinghurst and Zi Siang See on November 29th and 30th 2015 at Johor Bahru in Malaysia. This lecture shows how to use Unity 3D and Vuforia to make mobile AR applications. Look for the other 9 lectures in the course.
Lecture prepared by Mark Billinghurst on Augmented Reality tracking. Taught on October 18th 2016 by Dr. Gun Lee as part of the COMP 4010 VR class at the University of South Australia.
These slides use concepts from my (Jeff Funk) course on Business Models at National University of Singapore to analyze the business model for Google Cardboard. Google Cardboard provides users with a virtual reality experience for a much lower price than that from Occulus Rift. It combines a fold-out cardboard mount with an Android smart phone to enable users to feel as though they are part of a video or game. It is light, does not require wires, and content will be available from YouTube and Google Play. Young males are expected to be the largest users of Google Cardboard. Google expects to make money from sales of content through Google Play. The slides describe the value proposition, method of value capture, customers, scope of activities, and method of strategic control for Google Cardboard.
COMP 4010 Lecture 8 on an Introduction to Augmented Reality. This lecture provides a basic introduction to AR. Taught by Gun Lee on September 17th 2019 at the University of South Australia.
Lecture given by Mark Billinghurst on June 18th 2022 about how the Metaverse can be used for corporate training. In particular how combining AR, VR and other Metaverse elements can be used to provide new types of learning experiences.
Lecture 7 from a course on Mobile Based Augmented Reality Development taught by Mark Billinghurst and Zi Siang See on November 29th and 30th 2015 at Johor Bahru in Malaysia. This lecture shows how to use Unity 3D and Vuforia to make mobile AR applications. Look for the other 9 lectures in the course.
Lecture prepared by Mark Billinghurst on Augmented Reality tracking. Taught on October 18th 2016 by Dr. Gun Lee as part of the COMP 4010 VR class at the University of South Australia.
360 camera can record all sphere at the same time.
360 Camera or Ominidirctional camera is a camera or combination of camera with a 360-degree field of view in the horizontal plane, or with a visual field that covers (approximately) the entire sphere. Omnidirectional cameras are important in areas where large visual field coverage is needed, such as in panoramic photography and robotics.
360 camera captures light from all directions falling onto the focal point, covering a full sphere.
Each camera have slots which have different takes of snap at the same time.
Each video takes 48 frames per second.
The videos will be arranged to specific template pattern.
Using the Stitching method all videos are combined and form a new 360 degree video.
Experiential Design for VR Chat World Builders - Kent ByeKent Bye
Presented as a part of the TLX Prefabs conference on Saturday, May 22, 2021
YouTube video of this talk is here: https://www.youtube.com/watch?v=YdqVnDuSg5I&t=21683s
TraumaCad Orthopedic Digital Templating BrochureBrainlab
Learn more: https://www.brainlab.com/traumacad
TraumaCad® provides orthopedic surgeons with digital tools to perform
preoperative planning and simulates the expected results prior to surgery.
Using digital images on-screen, you can perform measurements, fix prostheses, simulate osteotomies and visualize fracture reductions.
Talk to Me: Using Virtual Avatars to Improve Remote CollaborationMark Billinghurst
A talk given by Mark Billinging in the CLIPE workshop in Tubingen, Germant on April 27th 2023. This talk describes how virtual avatars can be used to support remote collaboration.
The Impact of VR and AR on Medical Research and HealthcareStanford University
The Impact of VR and AR Technologies on Medical Research and Healthcare
Walter Greenleaf, PhD
Virtual Human Interaction Lab | Stanford University
Although entertainment, social connection, and gaming will drive the initial adoption of Virtual Reality and Augmented Reality technology, the deepest and most significant impact of the next generation of VR/AR technology will be to enhance clinical care and to improve personal health and wellness.
We know from decades of clinical research that VR/AR technology can provide breakthrough solutions that address the most difficult problems in healthcare - ranging from mood disorders such as Anxiety and Depression to PTSD, Addictions, Autism, Cognitive Aging, Stroke Recovery and Physical Rehabilitation, to name just a few.
VR technology also improved clinical measurements and assessments, can greatly improve medical training such as surgical skill training and procedure planning. Personal health and wellness will be improved by using VR to promote healthy lifestyles and to reduce stress and anxiety. As the cost of healthcare rises, VR technology can serve as an effective telemedicine platform to reduce costs of care delivery, and improve clinical efficiency.
This presentation will provide an overview of how VR technology will impact medicine, clinical care, and personal health and wellness, and how it will help to facilitate the shift of medicine to direct personal care.
COMP 4010 lecture on AR Interaction Design. Lecture given by Gun Lee at the University of South Australia on October 12th 2017, from slides prepared by Mark Billinghurst
When youâre pregnant you will be concerned that any lower back pain treatment you undertake is safe. Some treatments will be quite risky for either you or your baby and you may want to opt for other treatments.
This presentation covers the introduction to augmented reality in iOs apps using Apple's ARKit framework. what are its uses in banking/finance sector.
It has a link to a sample code demonstrating how ARKit works.
COMP 4010 - Lecture 7: Introduction to Augmented RealityMark Billinghurst
Lecture 7 in the COMP 4010 class on Augmented Reality and Virtual Reality. This lecture provides an introduction to Augmented Reality. This class was taught on September 7th 2017 by Mark Billinghurst at the University of South Australia.
Lecture 1 of the COMP 4010 course on Augmented and Virtual Reality. Taught by Mark Billinghurst, Bruce Thomas and Gun Lee from the University of South Australia. This lecture provides an introduction to Virtual Reality. Taught on July 24th 2018.
This presentation describes and defines Virtual Really.
Its also mentions some of its ongoing research for its viable usage in the field of electrical engineering.
It was done a school project.
And the information was collected sources available on the internet.
360 camera can record all sphere at the same time.
360 Camera or Ominidirctional camera is a camera or combination of camera with a 360-degree field of view in the horizontal plane, or with a visual field that covers (approximately) the entire sphere. Omnidirectional cameras are important in areas where large visual field coverage is needed, such as in panoramic photography and robotics.
360 camera captures light from all directions falling onto the focal point, covering a full sphere.
Each camera have slots which have different takes of snap at the same time.
Each video takes 48 frames per second.
The videos will be arranged to specific template pattern.
Using the Stitching method all videos are combined and form a new 360 degree video.
Experiential Design for VR Chat World Builders - Kent ByeKent Bye
Presented as a part of the TLX Prefabs conference on Saturday, May 22, 2021
YouTube video of this talk is here: https://www.youtube.com/watch?v=YdqVnDuSg5I&t=21683s
TraumaCad Orthopedic Digital Templating BrochureBrainlab
Learn more: https://www.brainlab.com/traumacad
TraumaCad® provides orthopedic surgeons with digital tools to perform
preoperative planning and simulates the expected results prior to surgery.
Using digital images on-screen, you can perform measurements, fix prostheses, simulate osteotomies and visualize fracture reductions.
Talk to Me: Using Virtual Avatars to Improve Remote CollaborationMark Billinghurst
A talk given by Mark Billinging in the CLIPE workshop in Tubingen, Germant on April 27th 2023. This talk describes how virtual avatars can be used to support remote collaboration.
The Impact of VR and AR on Medical Research and HealthcareStanford University
The Impact of VR and AR Technologies on Medical Research and Healthcare
Walter Greenleaf, PhD
Virtual Human Interaction Lab | Stanford University
Although entertainment, social connection, and gaming will drive the initial adoption of Virtual Reality and Augmented Reality technology, the deepest and most significant impact of the next generation of VR/AR technology will be to enhance clinical care and to improve personal health and wellness.
We know from decades of clinical research that VR/AR technology can provide breakthrough solutions that address the most difficult problems in healthcare - ranging from mood disorders such as Anxiety and Depression to PTSD, Addictions, Autism, Cognitive Aging, Stroke Recovery and Physical Rehabilitation, to name just a few.
VR technology also improved clinical measurements and assessments, can greatly improve medical training such as surgical skill training and procedure planning. Personal health and wellness will be improved by using VR to promote healthy lifestyles and to reduce stress and anxiety. As the cost of healthcare rises, VR technology can serve as an effective telemedicine platform to reduce costs of care delivery, and improve clinical efficiency.
This presentation will provide an overview of how VR technology will impact medicine, clinical care, and personal health and wellness, and how it will help to facilitate the shift of medicine to direct personal care.
COMP 4010 lecture on AR Interaction Design. Lecture given by Gun Lee at the University of South Australia on October 12th 2017, from slides prepared by Mark Billinghurst
When youâre pregnant you will be concerned that any lower back pain treatment you undertake is safe. Some treatments will be quite risky for either you or your baby and you may want to opt for other treatments.
This presentation covers the introduction to augmented reality in iOs apps using Apple's ARKit framework. what are its uses in banking/finance sector.
It has a link to a sample code demonstrating how ARKit works.
COMP 4010 - Lecture 7: Introduction to Augmented RealityMark Billinghurst
Lecture 7 in the COMP 4010 class on Augmented Reality and Virtual Reality. This lecture provides an introduction to Augmented Reality. This class was taught on September 7th 2017 by Mark Billinghurst at the University of South Australia.
Lecture 1 of the COMP 4010 course on Augmented and Virtual Reality. Taught by Mark Billinghurst, Bruce Thomas and Gun Lee from the University of South Australia. This lecture provides an introduction to Virtual Reality. Taught on July 24th 2018.
This presentation describes and defines Virtual Really.
Its also mentions some of its ongoing research for its viable usage in the field of electrical engineering.
It was done a school project.
And the information was collected sources available on the internet.
Implementation of Lower Leg Bone Fracture Detection from X Ray Imagesijtsrd
A methodology and various techniques are presented for development of fracture detection system using digital image processing. This paper presents an implementation of bone fracture detection using medical X ray image. The goal of this paper is to generate a quick and diagnosis can save time, effort and cost as well as reduce errors. The main objective of this research is to classify the lower leg bone fracture using X ray image because this type of bone are the most commonly occur in bone. This paper classifies the two types of fracture Non fracture and fracture or Transverse fracture by using SVM classifier. The proposed system has basically five steps, namely, image acquisition, image pre processing, image segmentation, feature extraction and image classification. San Myint | Khaing Thinzar "Implementation of Lower Leg Bone Fracture Detection from X-Ray Images" Published in International Journal of Trend in Scientific Research and Development (ijtsrd), ISSN: 2456-6470, Volume-3 | Issue-5 , August 2019, URL: https://www.ijtsrd.com/papers/ijtsrd27957.pdfPaper URL: https://www.ijtsrd.com/engineering/electronics-and-communication-engineering/27957/implementation-of-lower-leg-bone-fracture-detection-from-x-ray-images/san-myint
Reliability of Three-dimensional Photonic Scanner Anthropometry Performed by ...CSCJournals
This work explored the relative and absolute reliability of three-dimensional (3D) anthropometry performed by skilled and naïve operators using a fast, pose tolerant whole-body 3D scanner device. Upon skin landmarking by an experienced operator (skilled anthropometrist, SA), twelve subjects (six males and six females) underwent a thorough 3D anthropometric evaluation by the SA and two naïve operators (NA). Using the same landmarks, the SA also performed traditional anthropometry measurements. All measurements were taken twice. Relative reliability was tested with the Pearson’s correlation coefficient r and the intraclass correlation coefficient (ICC); absolute reliability was tested calculating the percentage coefficient of variation (%CV), the standard error of measurement (SEM), the percentage technical error of measurement (%TEM), and paired Student’s t test. Results showed that intra-operator relative and absolute reliability was excellent for all and most 3D measurement items, respectively, independently of the operator’s skill. Inter-operator (SA vs. individual NA) relative reliability was excellent as well; inter-operator absolute reliability was not acceptable for about only 30% of measurement items. Results of this work show that 3D anthropometry has strong potential in anthropometry due to high intrinsic reliability and less need for operator training vs. traditional anthropometry.
Augmented Reality : Future of Orthopedic SurgeryPayelBanerjee17
I just wanted people to be aware of all the recent advancements occurring in surgeries, and in medicine. so here I'm uploading it in public. kindly look into it. also, you can check out my
https://thatindiangirl1.blogspot.com (blog)
A Simulation Method of Soft Tissue Cutting In Virtual Environment with HapticsIJERA Editor
Currently, virtual simulation has an increasing role in the medical field. Now virtual surgery simulation has been largely explored in medical field. Virtual surgery is a good complement to traditional Surgical Training. Modeling effects of soft tissue during cutting is quite complex, hence the concept of virtuality is used to develop realistic surgical instruments for providing exact force feedback to the surgeon during surgical operation and simulation of soft tissue processes. Scalpel is a basic instrument required for soft tissue simulation. Hence we will design a virtual organ to cut by using Scalpel in Haptic Environment.
A 2019 update on the current role of robotics and simulation in neurosurgery with updates from the recent edition of Youman and Winn's Textbook of Neurosurgery. Videos in the presentation cannot be uploaded but can be viewed from youtube.
Study: Development of a precision multimodal surgical navigation system for l...JeanmarcBasteMDPhD
Minimally invasive sublobar anatomical resection is becoming more and more popular to manage early lung lesions. Robotic-assisted thoracic surgery (RATS) is unique in comparison with other minimally invasive techniques. Indeed, RATS is able to better integrate multiple streams of information including advanced imaging techniques, in an immersive experience at the level of the robotic console.
Our aim was to describe three-dimensional (3D) imaging throughout the surgical procedure from preoperative planning to intraoperative assistance and complementary investigations such as radial endobronchial ultrasound (R-EBUS) and virtual bronchoscopy for pleural dye marking.
All cases were operated using the DaVinci SystemTM. Modelisation was provided by Visible PatientTM (Strasbourg, France). Image integration in the operative field was achieved using the Tile Pro multi display input of the DaVinci console.
Our experience was based on 114 robotic segmentectomies performed between January 2012 and October 2017. Progressively, we have reached the conclusion that the use of such an anatomic model improves the safety and reliability of procedures. The act of operating is being transformed and the surgeon now oversees a complex system that improves decision making.
It is in this dynamic and innovative setting, that my peers and I are curating an intensive training on this precision multimodal surgical system.
« Revolution in RATS » will be held in March 7th and 8th 2019.
http://bit.ly/2Ix7I48
It is intended to give thoracic surgeons the opportunity to take advantage of new advanced techniques and cutting-edge devices to achieve greater safety, precision and ease their decision-making process.
Please click on this link for further information on the Masterclass and registrations: http://bit.ly/2Ix7I48
Kind Regards,
Pr. Jean-Marc Baste
Similar to VR / AR for Medical Application (가상현실 / 증강현실의 의료 응용) (20)
Immunizing Image Classifiers Against Localized Adversary Attacksgerogepatton
This paper addresses the vulnerability of deep learning models, particularly convolutional neural networks
(CNN)s, to adversarial attacks and presents a proactive training technique designed to counter them. We
introduce a novel volumization algorithm, which transforms 2D images into 3D volumetric representations.
When combined with 3D convolution and deep curriculum learning optimization (CLO), itsignificantly improves
the immunity of models against localized universal attacks by up to 40%. We evaluate our proposed approach
using contemporary CNN architectures and the modified Canadian Institute for Advanced Research (CIFAR-10
and CIFAR-100) and ImageNet Large Scale Visual Recognition Challenge (ILSVRC12) datasets, showcasing
accuracy improvements over previous techniques. The results indicate that the combination of the volumetric
input and curriculum learning holds significant promise for mitigating adversarial attacks without necessitating
adversary training.
Courier management system project report.pdfKamal Acharya
It is now-a-days very important for the people to send or receive articles like imported furniture, electronic items, gifts, business goods and the like. People depend vastly on different transport systems which mostly use the manual way of receiving and delivering the articles. There is no way to track the articles till they are received and there is no way to let the customer know what happened in transit, once he booked some articles. In such a situation, we need a system which completely computerizes the cargo activities including time to time tracking of the articles sent. This need is fulfilled by Courier Management System software which is online software for the cargo management people that enables them to receive the goods from a source and send them to a required destination and track their status from time to time.
About
Indigenized remote control interface card suitable for MAFI system CCR equipment. Compatible for IDM8000 CCR. Backplane mounted serial and TCP/Ethernet communication module for CCR remote access. IDM 8000 CCR remote control on serial and TCP protocol.
• Remote control: Parallel or serial interface.
• Compatible with MAFI CCR system.
• Compatible with IDM8000 CCR.
• Compatible with Backplane mount serial communication.
• Compatible with commercial and Defence aviation CCR system.
• Remote control system for accessing CCR and allied system over serial or TCP.
• Indigenized local Support/presence in India.
• Easy in configuration using DIP switches.
Technical Specifications
Indigenized remote control interface card suitable for MAFI system CCR equipment. Compatible for IDM8000 CCR. Backplane mounted serial and TCP/Ethernet communication module for CCR remote access. IDM 8000 CCR remote control on serial and TCP protocol.
Key Features
Indigenized remote control interface card suitable for MAFI system CCR equipment. Compatible for IDM8000 CCR. Backplane mounted serial and TCP/Ethernet communication module for CCR remote access. IDM 8000 CCR remote control on serial and TCP protocol.
• Remote control: Parallel or serial interface
• Compatible with MAFI CCR system
• Copatiable with IDM8000 CCR
• Compatible with Backplane mount serial communication.
• Compatible with commercial and Defence aviation CCR system.
• Remote control system for accessing CCR and allied system over serial or TCP.
• Indigenized local Support/presence in India.
Application
• Remote control: Parallel or serial interface.
• Compatible with MAFI CCR system.
• Compatible with IDM8000 CCR.
• Compatible with Backplane mount serial communication.
• Compatible with commercial and Defence aviation CCR system.
• Remote control system for accessing CCR and allied system over serial or TCP.
• Indigenized local Support/presence in India.
• Easy in configuration using DIP switches.
Quality defects in TMT Bars, Possible causes and Potential Solutions.PrashantGoswami42
Maintaining high-quality standards in the production of TMT bars is crucial for ensuring structural integrity in construction. Addressing common defects through careful monitoring, standardized processes, and advanced technology can significantly improve the quality of TMT bars. Continuous training and adherence to quality control measures will also play a pivotal role in minimizing these defects.
Automobile Management System Project Report.pdfKamal Acharya
The proposed project is developed to manage the automobile in the automobile dealer company. The main module in this project is login, automobile management, customer management, sales, complaints and reports. The first module is the login. The automobile showroom owner should login to the project for usage. The username and password are verified and if it is correct, next form opens. If the username and password are not correct, it shows the error message.
When a customer search for a automobile, if the automobile is available, they will be taken to a page that shows the details of the automobile including automobile name, automobile ID, quantity, price etc. “Automobile Management System” is useful for maintaining automobiles, customers effectively and hence helps for establishing good relation between customer and automobile organization. It contains various customized modules for effectively maintaining automobiles and stock information accurately and safely.
When the automobile is sold to the customer, stock will be reduced automatically. When a new purchase is made, stock will be increased automatically. While selecting automobiles for sale, the proposed software will automatically check for total number of available stock of that particular item, if the total stock of that particular item is less than 5, software will notify the user to purchase the particular item.
Also when the user tries to sale items which are not in stock, the system will prompt the user that the stock is not enough. Customers of this system can search for a automobile; can purchase a automobile easily by selecting fast. On the other hand the stock of automobiles can be maintained perfectly by the automobile shop manager overcoming the drawbacks of existing system.
Explore the innovative world of trenchless pipe repair with our comprehensive guide, "The Benefits and Techniques of Trenchless Pipe Repair." This document delves into the modern methods of repairing underground pipes without the need for extensive excavation, highlighting the numerous advantages and the latest techniques used in the industry.
Learn about the cost savings, reduced environmental impact, and minimal disruption associated with trenchless technology. Discover detailed explanations of popular techniques such as pipe bursting, cured-in-place pipe (CIPP) lining, and directional drilling. Understand how these methods can be applied to various types of infrastructure, from residential plumbing to large-scale municipal systems.
Ideal for homeowners, contractors, engineers, and anyone interested in modern plumbing solutions, this guide provides valuable insights into why trenchless pipe repair is becoming the preferred choice for pipe rehabilitation. Stay informed about the latest advancements and best practices in the field.
Overview of the fundamental roles in Hydropower generation and the components involved in wider Electrical Engineering.
This paper presents the design and construction of hydroelectric dams from the hydrologist’s survey of the valley before construction, all aspects and involved disciplines, fluid dynamics, structural engineering, generation and mains frequency regulation to the very transmission of power through the network in the United Kingdom.
Author: Robbie Edward Sayers
Collaborators and co editors: Charlie Sims and Connor Healey.
(C) 2024 Robbie E. Sayers
Final project report on grocery store management system..pdfKamal Acharya
In today’s fast-changing business environment, it’s extremely important to be able to respond to client needs in the most effective and timely manner. If your customers wish to see your business online and have instant access to your products or services.
Online Grocery Store is an e-commerce website, which retails various grocery products. This project allows viewing various products available enables registered users to purchase desired products instantly using Paytm, UPI payment processor (Instant Pay) and also can place order by using Cash on Delivery (Pay Later) option. This project provides an easy access to Administrators and Managers to view orders placed using Pay Later and Instant Pay options.
In order to develop an e-commerce website, a number of Technologies must be studied and understood. These include multi-tiered architecture, server and client-side scripting techniques, implementation technologies, programming language (such as PHP, HTML, CSS, JavaScript) and MySQL relational databases. This is a project with the objective to develop a basic website where a consumer is provided with a shopping cart website and also to know about the technologies used to develop such a website.
This document will discuss each of the underlying technologies to create and implement an e- commerce website.
CFD Simulation of By-pass Flow in a HRSG module by R&R Consult.pptxR&R Consult
CFD analysis is incredibly effective at solving mysteries and improving the performance of complex systems!
Here's a great example: At a large natural gas-fired power plant, where they use waste heat to generate steam and energy, they were puzzled that their boiler wasn't producing as much steam as expected.
R&R and Tetra Engineering Group Inc. were asked to solve the issue with reduced steam production.
An inspection had shown that a significant amount of hot flue gas was bypassing the boiler tubes, where the heat was supposed to be transferred.
R&R Consult conducted a CFD analysis, which revealed that 6.3% of the flue gas was bypassing the boiler tubes without transferring heat. The analysis also showed that the flue gas was instead being directed along the sides of the boiler and between the modules that were supposed to capture the heat. This was the cause of the reduced performance.
Based on our results, Tetra Engineering installed covering plates to reduce the bypass flow. This improved the boiler's performance and increased electricity production.
It is always satisfying when we can help solve complex challenges like this. Do your systems also need a check-up or optimization? Give us a call!
Work done in cooperation with James Malloy and David Moelling from Tetra Engineering.
More examples of our work https://www.r-r-consult.dk/en/cases-en/
5. 3D 의료영상 처리 S/W
5
▶ 3D 가상 수술
▶ 3D 환자모델링
▶ 3D 형상 모델 처리기술
6. 6
3D Patient Modeling
Automatic Orbital Wall Modeling
Existing method: manual operation on >100 images
Proposed method: ~1 min. (1/40 less time)
Avr. 31m 12s
Avr. 43.7s
Comparison test of 3D modeling time
(manual vs. proposed method)
Semi-automatic 3D modeling of orbital wall
Resulted 3D orbital wall model
10. AI기반 3D 의료용 S/W 기술
10
임상 빅데이터
환자 3D 데이터
AI 진단
Classification
AI 치료 계획
치료방법 추천
AI 치료 분석
수술결과 분석
11. 3D CNN 기반 어깨 관절 진단
11
▪ 학습
Rotator Cuff Tear 진단
Voxception-ResNet 네트워크 사용, epoch 110
Train set 3573개 (None-RCT : 1749, RCT : 1824) , Test set 200
>95% 정확도
학습 진행에 따른 정확도 및 activation map 변화
Voxception-ResNet
37. Laparoscopic surgery simulator
SimSurgery / Norway
Surgical-Science / Sweden
Simbionix / USA
Mimic Technologies
/ USA
Mentice / Sweden
Haptica / USA
Immersion / USA
38. Laparoscopic Surgical Training Simulation
Deformable body modeling
3D visualization / haptic rendering / collision detection
Gallbladder removal simulation
38
Gallbladder removal simulation
Haptic device for laparoscopic
surgery simulation
41. Arthroscopic surgery simulator
3D human body modeling (bone, muscle, ligament, …)
Realistic visualization : normal mapping (texture) + lighting
Arthroscopic camera simulation
Arthroscopic camera simulation
3D human shoulder modeling
45. 혼합현실 기반 수술 계획 및 가이드
Pisa Univ. (이탈리아)
• 악안면 수술을 위한 AR 기반 네비게이션 시스템
• 수술계획대로 악안면 골 재배치 AR 수술계획 정보 제공
Tokyo Univ. (일본)
• 악안면 수술 환자 3차원 해부모델 AR
• 환자 치아형태 3D 매칭, makerless 실시간 트래킹
46. 혼합현실 기반 원격 치료
Proximie (미국)
• AR 기반 원격진료 솔루션
• 아이폰/아이패드로 연결된 두 지점의
전문가 수술보조 서비스 제공
Google, University of Alabama at Birmingham (미국)
• AR 기반 원격수술 가이드 솔루션
• 구글글래스 이용
• Teaching surgeon의 술기를 AR로 보면서 수술진행
47. Nadine Hachach-Haram(TEDWomen 2017)
How augmented reality could change the future of surgery
47
https://www.ted.com/talks/nadine_hachach_haram_how_augmented_reality_could_
change_the_future_of_surgery
48. Visible Korean (한국과학기술정보원, 2000)
Visible Human Project (NLM, 1986)
Anatomage Table Medical education(MS Hololense, 2016)
Medical Education
KIST 김래현
57. Future of VR
Hi resolution(8K), wide FOV(120), fast updated(120 fps)
Multimodal stimuli (tactile, smell,..)
Seamless and precise tracking ( <10 ms latency, sub-mm)
HTC VIVE (2K resolution, 110 degree FOV, 90 fps, 2 controller,
Tracking: sub-millimeter precision and < ~11ms latency)
KIST 김래현
58. Future of VR
Mobile VR
Multi-view 360 video
Social VR(Facebook)
360 Panoramic video (YouTube, Facebook)
Social VR
KIST 김래현
59. Future of AR
Lighter, Cableless, Brighter H/W
Wide FOV (Field of View)
Easy Calibration
MS HoloLens 3rd generation (2019)
Accurate Registration
AI for Improved Function
Magic Leap One (2018 spring)
MAXST
62. Journal Paper Publication (2017)
1. J. Charton, M. Laurentjoye, Y. Kim, "3D Boolean operations in virtual surgical planning", International Journal of Computer
Assisted Radiology and Surgery, Vol. 12, No. 10, pp. 1697-1709, Oct. 2017
2. J. Charton, L. Kim, Y. Kim, "Boolean operations by a robust, exact, and simple method between two colliding shells".
Journal of Advanced Mechanical Design, Systems, and Manufacturing, 11(4), Sep. 2017
3. S. Yoon, S. Shin, H. Cho, Y. Kim, D. Lee, L. Kim, G. Noh, "Enhanced markerless surgical robotic guidance system for
keyhole neurosurgery", Journal of Advanced Mechanical Design, Systems, and Manufacturing, Vol. 11, No. 4,
p.JAMDSM0046, Sep. 2017
4. S.W. Chung, K.S. Oh, S.G. Moon, N.R. Kim, J.W. Lee, E. Shim, S. Park, Y. Kim, "Serial Changes in 3-Dimensional
Supraspinatus Muscle Volume following Rotator Cuff Repair", The American Journal of Sports Medicine, Vol. 45, No. 10,
Aug. 2017
5. Y.D. Choi*, Y. Kim*, E. Park, “Patient-Specific Augmentation Rhinoplasty Using a Three-Dimensional Simulation Program
and Three-Dimensional Printing”, Aesthetic Surgery Journal, DOI: 10.1093/asj/sjx046, May, 2017
6. S. Kim, D. Lee, S. Park, K. Oh, S.W. Chung, Y. Kim, "Automatic segmentation of supraspinatus from MRI by internal shape
fitting and autocorrection", Computer Methods and Programs in Biomedicine, Vol. 140, pp. 165-174, Mar. 2017
7. Y. Kim, B.H. Lee, K. Mekuria, H. Cho, S. Park, J.H. Wang, D. Lee, "Registration accuracy enhancement of a surgical
navigation system for anterior cruciate ligament reconstruction: A phantom and cadaveric study", The Knee, S0968-
0160(16)30248-4, Feb. 2017
8. C. Kyu Lee, Y. Kim, N. Lee, B. Kim, D.Y. Kim, S. Yi, "Feasibility study of utilization of action camera, GoPro Hero 4, Google
glass and Panasonic HX-A100 in Spine surgery", Spine, Vol. 42, No. 4, pp. 275-280, Feb. 2017
9. S.H. Park, S.W. Moon, B.H. Lee, S. Park, Y. Kim, D. Lee, S. Lim, J.H. Wang, "Arthroscopically blind anatomical anterior
cruciate ligament reconstruction using only navigation guidance: a cadaveric study", The Knee, DOI:
10.1016/j.knee.2016.02.020, Feb. 2017
10. Q.C. Nguyen, Y. Kim, H. Kwon, "Optimization of layout and path planning of surgical robotic system", Int’l Journal of
Control, Automation and Systems, Vol. 15, No. 1, pp. 375-384, Jan. 2017
11. E. Shim, Y. Kim, D. Lee, B.H. Lee, S. Woo, K. Lee, “2D-3D registration for 3D analysis of lower limb alignment in a weight-
bearing condition”, Applied Mathematics – Journal of Chinese Universities (Accepted)
62
