SlideShare a Scribd company logo
1 of 128
2018. 05. 10.
의용전자연구실
박사과정 이동헌
인공지능을 위한
딥러닝 프로그래밍
<AI in Medicine>
Week3
Machine Learning
(18. 04. 12. 13:00-17:00)
Week4
Deep Learning
(18. 05. 03. 13:00-17:00)
Week5
AI in Medicine
(18. 05. 10. 13:00-17:00)
• Introduction to AI
• Machine Learning
Overview
• Image Classification
Pipeline
• Loss functions and
Optimization
• Neural Network and
Backpropagation
• Training Neural
Networks
• Convolutional Neural
Networks (CNNs)
• CNNs Models
• Applications of CNNs
• Recurrent Neural
Networks (RNNs)
• Deep Learning in
Practice
• Applications in Medicine
3
X1
X2
Xn
h1
h2
hn+1
y
w11
w(n+1)n
w21
w22
w12
wy1
wy2
wy(n+1)
h1 = f(w11X1 + w12X2 + w13X3)
h2 = f(w21X1 + w22X2 + w23X3)
…
hn+1 = f(w(n+1)1X1 + w(n+1)2X2 + w(n+1)3X3)
y = f(wy1h1 + wy2h2 + … + wy(n+1)hn+1)
Loss = D(y, Y)
Neural Network and Backpropagation
Training Neural Network
Convolutional Neural Networks
 Applications of CNNs
 Recurrent Neural Networks
 Deep Learning in Practice
 Applications in Medicine
• Detection
• Segmentation
• Understanding CNNs
• Autoencoder
• Generative Adversarial Networks
Detection
10
Segmentation
• Semantic Segmentation• Semantic Segmentation
• Instance Segmentation
Segmentation
• Semantic Segmentation
epoch 10 epoch 50 epoch 70 epoch 100
Segmentation
Cervical Vertebrae Segmentation in X-ray
U-Net Modified U-Net U-Net Modified U-Net
Segmentation
• Instance Segmentation
Segmentation
• Instance Segmentation
Understanding CNNs
http://gradcam.cloudcv.org/classification
Understanding CNNs
Bone Age Assessment
Autoencoders
• Dimensionality Reduction
• Denoising
https://github.com/hwalsuklee/tensorflow-mnist-VAE
Autoencoders
• MIT-BIH arrhythmia database
• INCART
• SVDB
ECG Signal Denoising
Generative Adversarial Networks
“Generative Adversarial Network is
the most interesting idea in the last ten years in machine learning”
- Yann LeCun, Director, Facebook AI
Generative Adversarial Networks
Linearity
• Principle Component Analysis (PCA)
Generative Adversarial Networks
Nonlinearity
Generative Adversarial Networks
https://phillipi.github.io/pix2pix/
Style Transfer
Generative Adversarial Networks
https://github.com/junyanz/CycleGAN
https://github.com/hwalsuklee/tensorflow-generative-model-collections
Style Transfer
https://github.com/SKTBrain/DiscoGAN
26
Generative Adversarial Networks
Super Resolution
Generative Adversarial Networks
Super Resolution
Generative Adversarial Networks
Generative Adversarial Networks
Super Resolution
• 순차적인 정보를 처리.
• 시간 스텝 단위의 출력 결과는 이전 계산 결과로부터 영향을 받음.
• 음성 인식, 텍스트, 번역, 비디오, 이미지 캡셔닝 등
Recurrent Neural Networks
• 입력 x, 출력 o, Hidden State h, 파라미터 U, V, W 로 구성.
• 모든 시간 스텝에 대해 파라미터 값을 공유 U, V, W
→ Backpropagation Through Time (BPTT)로 학습
→ (+) 학습해야 하는 파라미터의 수가 CNN에 비해 상대적으로 적음.
• h𝑡 는 네트워크의 메모리, 과거 시간에 일어난 일들에 대한 정보를 누적하여 기억.
→ (-) 출력값 𝑜𝑡는 현재 시간 t의 메모리에 의존하여 먼 과거에 대해서 반영이 어려움.
• Long-Term Dependency 문제
Long Short Term Memory (LSTM)
cell state gates
Outputt+1
OutputtOutputt-1
Inputt-1 Inputt
Inputt+1
Outputt+1
OutputtOutputt-1
Hidden
state
Inputt-1 Inputt
Inputt+1
Outputt+1
OutputtOutputt-1
Hidden
state
Forget
gate
Inputt-1 Inputt
Inputt+1
Outputt+1
OutputtOutputt-1
Hidden
state
Forget
gate Input
gate
Inputt-1 Inputt
Inputt+1
Outputt+1
OutputtOutputt-1
Hidden
state
Forget
gate Input
gate Output
gate
Inputt-1 Inputt
Inputt+1
Cell state
Outputt+1
OutputtOutputt-1
Hidden
state
Forget
gate Input
gate Output
gate
Inputt-1 Inputt
Inputt+1
Step1. Forget Gate Layer
Step2. Input Gate Layer
Step4. Output Gate Layer
Step3. Update
https://quickdraw.withgoogle.com/
e.g. Image Recognition
Image → Word
e.g. Image Captioning
Image → Sequence of words
Image Captioning
word2vec
word2vec
word2vec
word2vec
word2vec
word2vec
word2vec
e.g. Sentiment Classification
Sequence of words → Sentiment
Sentiment Classification
출처: 구글 이미지
e.g. Machine Translation
Sequence of words → Sequence of words
Machine Translation
e.g. Video Classification on frame Level
Video Classification on frame Level
 Data Augmentation
 Data Imbalance
 Transfer Learning
 Convolution Small Filters
 Implementation CPU-GPU
 Deep Learning Frameworks
 Limitations of Deep Learning
Data Augmentation
Data Augmentation
Data Augmentation
 Change Performance Metric
• Cohen’s Kappa
• ROC Curve
 Resampling
• Undersampling (a lot data)
• Oversampling
- Weighted Cross-entropy
- SMOTE, ADASYN and so on
 Penalized classification imposes an additional cost on the model
 Ensemble
 etc
79
Data Imbalance
Transfer Learning
Transfer Learning
Transfer Learning
Transfer Learning
84
Natural Language Datasets
• 4.4 million narrative radiology reports from Stanford
• 1 million narrative radiology reports from 3 other institutions
• 430,000 radiology reports identified as normal by the interpreting radiologist
• 110,000 chest CT reports annotated for presence/absence of pulmonary
embolism
• 150 chest CT reports with all concepts annotated
Imaging Datasets
• 1000 ICU chest radiographs
• 831 bone tumor radiographs annotated by an expert radiologist with 18
features and the pathologic diagnosis
• 4000 digital mammograms annotated with 13 quality attributes
• 4000 pediatric hand radiographs with radiologist bone age
• Soon: 4.4 million Stanford exams, each with a narrative report
Transfer Learning (Open Datasets)
Medical ImageNet
85
Transfer Learning (Open Datasets)
MURA
86
Transfer Learning (Open Datasets)
87
Transfer Learning (Open Datasets)
88
Transfer Learning (Open Datasets)
Convolution Small Filters
The power of small filters
The power of small filters
Convolution Small Filters
Implementation (CPU-GPU)
 Software
: NVIDIA 제공의 개발 도구 및 라이브러리
• 딥러닝 기초요소 (cuDNN)
• 딥러닝 추론 엔진 (TensorRT)
• 선형 대수 (cuBLAS)
• 다중 GPU 커뮤니케이션 (NCCL)
• etc
 Hardware
Implementation (CPU-GPU)
Implementation (CPU-GPU)
Floating Point Precision
Implementation (CPU-GPU)
95
Deep Learning Frameworks
Deep Learning Frameworks
97
Limitations of Deep Learning
Limitations of Deep Learning
Limitations of Deep Learning
Uncertainty
100
Limitations of Deep Learning
Adversarial Attack
• Ophthalmology
• Dermatology
• Pathology
• Cardioloy
• Neurosurgery
• EMR
A Survey on Deep Learning in Medical Image Analysis
Ophthalmology (1)
• Technology enabled by the steam engine, the electricmotor, the
microprocessor, the Internet, and many other scientific and engineering
breakthroughs has long been replacing humans in jobs that mostly involve
objective and routine tasks. … In this regard, AI is no difference, ...
• AI in Ophthalmology
① 망막(retina) 이미지
• 널리 이용가능하고 쉽게 구할 수 있으며, 눈 질병 진단을 위해 잘 정의된 기준이 있음.
• OCT 망막 이미지를 통해 나이와 관련된 황반변성과 당뇨성 망막증 분류.
② 안저(Fundus) 이미지
• 녹내장, 황반 부종 평가 및 심장 발장 및 뇌졸증 예측.
• Clinical validation of performance is one of the hurdles.
e.g 설명가능성(explainability)
→ 중요한(Salient) 이미지 특징(e.g. 혈관구조 패턴 → 나이, 혈압, 흡연 여부 예측)
• FDA 승인 (추진 중): Arterys cardio DL, Segments MRI images of the heart, and an algorithm for
the detection of diabetic retinopathy
• 알고리즘을 임상 정보와 함께 작동하도록 설계하는 것이 중요함.
Ophthalmology (2)
 Needs
• 당뇨성 망막병증(Diabetic Retinopathy)은 당뇨병력이 30년 이상인 환자의
90%에게 발병하게 되며, 세계 각국에서 실명의 주요 원인이 됨. 세계적으로
빠르게 증가, 약 415M명의 환자들이 위험군에 속함.
<당뇨성 망막병증의 진단을 위하여 찍은 안저 사진의 예시>
(A) 건강한 환자 (B) 당뇨성 망막병증 환자
 Objective
• 안저 이미지를 이용하여 당뇨성 망막변증 분류.
 Methods
• Inception-v3
 Datasets
• 후향적으로 128,175개의 안저 이미지 (Multiple grades)
① 당뇨성 qulity망막병증(Diabetic Retinopathy)
② 황반부종(Diabetic Macular Edema)
③ 이미지 quality
• 안과전문의들에게 3-7회 판독 받은 데이터
• 미국의 안과 전문의 54명이 2015년 3월부터 12월까지 참여
 Validation
• 오픈 안저 이미지 데이터셋에 검증
① EyePACS-1: 4,997명의 환자들로부터 9,963개의 이미지
② Messidor-2: 874명의 환자들로부터 1,748개의 이미지
• 인공지능 결과와 우수한 안과전문의들 7-8명의 판독 결과 비교
(개발에 참여했던 54명의 의사 중에 일관된 판독을 보여준 일부 의사가 참여)
 Results
• 매우 우수한 성능 (① EyePACS-1, AUC=0.991 ② Messidor-2, AUC=0.990)
Voets, Mike, Kajsa Møllersen, and Lars Ailo Bongo. "Replication study: Development and validation of deep learning
algorithm for detection of diabetic retinopathy in retinal fundus photographs." arXiv preprint arXiv:1803.04337 (2018).
Ophthalmology (3)
https://github.com/mikevoets/jama16-retina-replication
 Objective
• "Development and validation of a deep learning algorithm for detection of diabetic
retinopathy in retinal fundus photographs." Jama 316.22 (2016): 2402-2410. 재현
 Methods & Results
• Multiple grades per image → one grade per image (Acc 36% 하락)
• (Different) EyePACS AUC: 0.74 → 0.94 (after preprocessing)
• (Different) Messidor2 AUC: 0.59 → 0.82 (after preprocessing)
 Discussion
• Original study에서 자세한 설명이 부족하여 재현이 어려움.
→ Hyper-parameter setting, optimization function
→ Preprocessing method
→ Ungradable image 에 대한 알고리즘 설명 x
→ Main 알고리즘에 대한 설명만 있음
→ etc
Dermatology
 Needs
• 피부암은 매년 미국에서만 540만 명의 신규 환자
가 발생할 정도로 빈번한 질병.
• 피부암은 조기 발견이 중요하지만 초기에 자각
증상이 없는 경우가 많고, 피부에 있는 다른 점,
검버섯, 사마귀와 구분이 어려움.
• 흑색종의 자가진단 방법으로는 ABCDE법 권장함.
• Asymmetry: 대칭적인지
• Border : 경계가 명확한지
• Color: 색깔이 단일한지, 흰색이나 파란색이 섞여 있지 않은지
• Diameter: 직경이 6mm를 넘지 않는지
• Evolving: 점의 크기나 모양, 색깔이 시간이 지남에 따라서 변화
하고 출혈이 생기지 않는지
 Objective
• 이미지를 이용하여 피부암 종류 분류.
 Methods
• ‘Inception-v3’
 Datasets
• 스탠퍼드 병원, 에든버러 대학의 이미지 라이브
러리 및 인터넷에서 수집.
• 이 병변의 이미지들은 각도, 배율, 밝기 등이 각
각 다르며, 스탠퍼드 대학병원 피부과 전문의들
과의 협업을 통해서 판독함.
• 체계적으로 질병명을 지정해야 학습과 검증에
용이하므로, 다양한 피부과 질병의 계층 관계
(taxonomy)를 정의하였고, 그 결과 2,000개 이
상의 질병으로 체계적으로 판독되어 있는 약
13만 장의 피부 병변 이미지 데이터를 만듦.
 Validation
• 생검과 조직검사를 통해 기존에 확진한 이미지 데이터 사용.
• 의학적으로 구분이 중요한 세 가지 경우에 대해서 테스트를 진행.
① 표피세포 암 vs 지루각화증 (135장, 707장)
② 성 흑색종과 vs 양성 병변 (표준 이미지 데이터 기반 130장, 225장)
③ 성 흑색종과 vs 양성 병변 (더마토스코프로 찍은 이미지 기반 111장, 1,010장)
 Results
• 매우 우수한 성능 (① AUC=0.96 ② AUC=0.94 ③ AUC=0.91)
• 인공지능보다 정확성이 떨어지는 전문의 상당수 (의사들 성적의 평균: 초록색)
Pathology
 Methods
 Objective
• 림프 노드 전이를 찾는 딥러닝 알고리즘들과 전문의의 성능 비교.
• Task1: Metastasis Identification
• Task2: Whole-Slide Image Classification
 Datasets
• Challenge Competition (CAMELYON ‘16)
• Train (n=270 images) / Test (n=129 slides and images)
 Results
• 우수한 성능
• 전문의 (시간 제한 있음/없음)
Cardiology (1)
 Datasets
• Zio Patch monitor1 (wearable monitor) single-lead로
Arrhythmias 측정 (Turakhia et al., 2013)
• 다른 데이터셋보다 500배 큰 규모 (Moody & Mark,
2001; Goldberger et al., 2000)
• 대략 300,000 명의 환자 중에서 30,000명의 환자 선택
• Annotations / sec (Sampling rate = 200Hz)
 Objective
• ECG를 이용하여 다음 항목 분류.
• Sinus rhythm
• Atrial Fibrillation
• 12 Arrhythmia types
 Methods
• 34-layer CNN
 Results
• Sequence F1 (256 samples overlap)
• Set F1 (set of arrhythmias in 30 sec)
 Validation
• 336개의 기록 (328명의 환자)
• 6명의 cardiologists.
Cardiology (2)
 Datasets
• 14,011명 w/ 웨어러블 심박 모니터링 기기 (Apple Watch app heart rate sensors.)
• Medical History (이전 진단, 혈액 시험 결과, 약물 치료)
 Methods
• DeepHeart (network)
• Training Methods
① Unsupervised Sequence pretraining
② Weakly supervised Heuristic pretraining
 Objective
• ECG + 병력(Medical History) 이용하여 추정.
• 당뇨 (Diabetes)
• 높은 콜레스테롤 (High cholesterol)
• 고혈압 (High blood pressure)
• 코골이 및 수면 무호흡 (Sleep apnea)
 Results
 Validation
• 336개 기록 (328명의 환자)
• 심박 정보만 학습시키면 결과가 좋지 않음.
• 전반적인 physical activity 정보는 예측에 중요한 역할을 하지만, 심박은 딥러닝을
이용하기에 중요한 biomarker임.
Neurosurgery
 Objective
• 이미지를 보거나 상상할 때, fMRI
activity에서 구한 decoded features
를 통해, 보거나 상상한 이미지를 생
성/복원.
 Methods
• Image presentation experiments
: ① 일반 이미지 ② 기하하적인 모양 ③ 알파벳
• Imagery experiment
: 25개 이미지 (10개 일반 이미지, 15개 기하하적인 모양)
• 피험자 1 (남성, 33세), 피험자 2 (남성, 23세), 피험자 3 (여성, 23세)
Neurosurgery
 Objective
• 이미지를 보거나 상상할 때, fMRI
activity에서 구한 decoded features
를 통해, 보거나 상상한 이미지를 생
성/복원.
 Methods
• Image presentation experiments
: ① 일반 이미지 ② 기하하적인 모양 ③ 알파벳
• Imagery experiment
: 25개 이미지 (10개 일반 이미지, 15개 기하하적인 모양)
• 피험자 1 (남성, 33세), 피험자 2 (남성, 23세), 피험자 3 (여성, 23세)
VGG19
"Generic decoding of seen and imagined objects using hierarchical
visual features." Nature communications 8 (2017): 15037.
(Option) "Synthesizing the preferred inputs
for neurons in neural networks via deep
generator networks." Advances in Neural
Information Processing Systems. 2016.
Electronic Medical Record (EMR)
 Objective
• 딥러닝을 이용한 EMR 분석 방법 정리.
 Methods
1. (p3)
• Andrew L. Beam, machine learning and medicine, Deep Learning 101 - Part 1: History and Background,
https://beamandrew.github.io/deeplearning/2017/02/23/deep_learning_101_part1.html
• Abedini, R., et al. "The prediction of undersaturated crude oil viscosity: An artificial neural network and fuzzy
model approach." Petroleum Science and Technology 30.19 (2012): 2008-2021.
2. (p4)
• AIRI 400, “Machine Learning 기초” (이광희 박사)
• Standford, CS231n, http://cs231n.stanford.edu/
• Deniz Yuret’s Homepage, “Alec Radford's animations for optimization algorithms”,
http://www.denizyuret.com/2015/03/alec-radfords-animations-for.html
3. (p5)
• the data science blog, https://ujjwalkarn.me/2016/08/11/intuitive-explanation-convnets/
• Medium, “Neural Network Architecture”, https://towardsdatascience.com/neural-network-architectures-
156e5bad51ba
4. (p8-9) Ren, Shaoqing, et al. "Faster r-cnn: Towards real-time object detection with region proposal
networks." Advances in neural information processing systems. 2015.
5. (p10) Cireşan, Dan C., et al. "Mitosis detection in breast cancer histology images with deep neural
networks." International Conference on Medical Image Computing and Computer-assisted Intervention. Springer,
Berlin, Heidelberg, 2013.
6. (p11, p15-16) He, Kaiming, et al. "Mask r-cnn." Computer Vision (ICCV), 2017 IEEE International Conference on. IEEE,
2017.
7. (p12) Ronneberger, Olaf, Philipp Fischer, and Thomas Brox. "U-net: Convolutional networks for biomedical image
segmentation." International Conference on Medical image computing and computer-assisted intervention.
Springer, Cham, 2015.
8. (p17) Selvaraju, Ramprasaath R., et al. "Grad-CAM: Visual Explanations from Deep Networks via Gradient-Based
Localization." ICCV. 2017.
9. (p18) Lee, Hyunkwang, et al. "Fully automated deep learning system for bone age assessment." Journal of digital
imaging 30.4 (2017): 427-441.
10. (p19) Medium, Deep inside: Autoencoders, https://towardsdatascience.com/deep-inside-autoencoders-
7e41f319999f
11. (p20) Al Rahhal, Mohamad M., et al. "Deep learning approach for active classification of electrocardiogram
signals." Information Sciences 345 (2016): 340-354.
12. (p21) DL4J, GAN: A Beginner’s Guide to Generative Adversarial Networks, https://deeplearning4j.org/generative-
adversarial-network
13. (p22) PCA Reconstruction Example, http://www.cec.uchile.cl/~jruizd/faces/reconstruction/rec.htm
14. (p23)
• QUORA, https://www.quora.com/What-are-the-limitations-of-manifold-learning
• NVIDIA, “https://devblogs.nvidia.com/photo-editing-generative-adversarial-networks-2/”,
https://devblogs.nvidia.com/photo-editing-generative-adversarial-networks-2/
15. (p26) Madani, Ali, et al. "Semi-supervised learning with generative adversarial networks for chest X-ray
classification with ability of data domain adaptation." Biomedical Imaging (ISBI 2018), 2018 IEEE 15th International
Symposium on. IEEE, 2018.
16. (p27-28) Ledig, Christian, et al. "Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial
Network." CVPR. Vol. 2. No. 3. 2017.
17. (p29) Kang, Eunhee, Junhong Min, and Jong Chul Ye. "A deep convolutional neural network using directional
wavelets for low‐dose X‐ray CT reconstruction." Medical physics 44.10 (2017).
18. (p31-32) AIRI 400, “순환신경망(Recurrent Neural Networks) 응용” (서병락 박사)
19. (p33-46) Colah’s blog, Understanding LSTM Networks, http://colah.github.io/posts/2015-08-Understanding-LSTMs/
20. (p47-66, p68, p64-67, p70-73, p76-77, p80-83, p89-94) Standford, CS231n, http://cs231n.stanford.edu/
21. (p69) googleblogs, “Transformer: A Novel Neural Network Architecture for Language Understanding”,
http://www.googblogs.com/tag/machine-translation/
22. (p74)
• Donahue, Jeffrey, et al. "Long-term recurrent convolutional networks for visual recognition and
description." Proceedings of the IEEE conference on computer vision and pattern recognition. 2015.
• RSIP VISION, MACHINE LEARNING – VIDEO CLASSIFICATION & OBJECT RECOGNITION,
https://www.rsipvision.com/portfolio/machine-learning-video-classification/
23. (p78) imgaug, https://github.com/aleju/imgaug
24. (p79) Machine Learning Mastery, ”8 Tactics to Combat Imbalanced Classes in Your Machine Learning Dataset”,
https://machinelearningmastery.com/tactics-to-combat-imbalanced-classes-in-your-machine-learning-dataset/
25. (p84) Medical Image Net, http://langlotzlab.stanford.edu/projects/medical-image-net/
26. (p85) MURA, https://stanfordmlgroup.github.io/projects/mura/
27. (p91) NVIDIA, “DEEP LEARNING SOFTWARE (SDK)”, http://www.nvidia.com/content/apac/event/kr/deep-learning-
software/
28. (p95-96) POP it, “딥러닝 프레임워크 조사와 몇가지 홍보”,
https://www.popit.kr/%EB%94%A5%EB%9F%AC%EB%8B%9D-
%ED%94%84%EB%A0%88%EC%9E%84%EC%9B%8C%ED%81%AC-%EC%A1%B0%EC%82%AC%EC%99%80-
%EB%AA%87%EA%B0%80%EC%A7%80-%ED%99%8D%EB%B3%B4/
29. (p99) Alex Kandall blog, “Deep Learning Is Not Good Enough, We Need Bayesian Deep Learning for Safe AI“,
https://alexgkendall.com/computer_vision/bayesian_deep_learning_for_safe_ai/
30. (p100) OpenAI, “Attacking Machine Learning with Adversarial Examples“, https://blog.openai.com/adversarial-
example-research/
31. (p102) Litjens, Geert, et al. "A survey on deep learning in medical image analysis." Medical image analysis 42
(2017): 60-88.
32. (p103) Remarkably, A.I. "All eyes are on AI.” Nature Biomedical Engineering
33. (p104-106) Gulshan, Varun, et al. "Development and validation of a deep learning algorithm for detection of
diabetic retinopathy in retinal fundus photographs." Jama 316.22 (2016): 2402-2410.
34. (p107) Voets, Mike, Kajsa Møllersen, and Lars Ailo Bongo. "Replication study: Development and validation of deep
learning algorithm for detection of diabetic retinopathy in retinal fundus photographs." arXiv preprint
arXiv:1803.04337 (2018).
35. (p108-110) Esteva, Andre, et al. "Dermatologist-level classification of skin cancer with deep neural
networks." Nature 542.7639 (2017): 115.
36. (p111-112) Bejnordi, Babak Ehteshami, et al. "Diagnostic assessment of deep learning algorithms for detection of
lymph node metastases in women with breast cancer." Jama 318.22 (2017): 2199-2210.
37. (p113-114) Rajpurkar, Pranav, et al. "Cardiologist-level arrhythmia detection with convolutional neural
networks." arXiv preprint arXiv:1707.01836 (2017).
38. (p115-116) Ballinger, Brandon, et al. "DeepHeart: Semi-Supervised Sequence Learning for Cardiovascular Risk
Prediction." arXiv preprint arXiv:1802.02511 (2018).
39. (p117-119) Shen, Guohua, et al. "Deep image reconstruction from human brain activity." bioRxiv (2017): 240317.
40. (p120-121) Shickel, Benjamin, et al. "Deep EHR: A Survey of Recent Advances in Deep Learning Techniques for
Electronic Health Record (EHR) Analysis." IEEE Journal of Biomedical and Health Informatics (2017).
Deep Learning for AI (3)

More Related Content

What's hot

Koss 1605 machine_learning_mariocho_t10
Koss 1605 machine_learning_mariocho_t10Koss 1605 machine_learning_mariocho_t10
Koss 1605 machine_learning_mariocho_t10Mario Cho
 
Koss Lab 세미나 오픈소스 인공지능(AI) 프레임웍파헤치기
Koss Lab 세미나 오픈소스 인공지능(AI) 프레임웍파헤치기 Koss Lab 세미나 오픈소스 인공지능(AI) 프레임웍파헤치기
Koss Lab 세미나 오픈소스 인공지능(AI) 프레임웍파헤치기 Mario Cho
 
Applying your Convolutional Neural Networks
Applying your Convolutional Neural NetworksApplying your Convolutional Neural Networks
Applying your Convolutional Neural NetworksDatabricks
 
Alex Smola, Director of Machine Learning, AWS/Amazon, at MLconf SF 2016
Alex Smola, Director of Machine Learning, AWS/Amazon, at MLconf SF 2016Alex Smola, Director of Machine Learning, AWS/Amazon, at MLconf SF 2016
Alex Smola, Director of Machine Learning, AWS/Amazon, at MLconf SF 2016MLconf
 
[243] turning data into value
[243] turning data into value[243] turning data into value
[243] turning data into valueNAVER D2
 
Using Deep Learning to Find Similar Dresses
Using Deep Learning to Find Similar DressesUsing Deep Learning to Find Similar Dresses
Using Deep Learning to Find Similar DressesHJ van Veen
 
Machine Learning, Deep Learning and Data Analysis Introduction
Machine Learning, Deep Learning and Data Analysis IntroductionMachine Learning, Deep Learning and Data Analysis Introduction
Machine Learning, Deep Learning and Data Analysis IntroductionTe-Yen Liu
 
Deep Learning with TensorFlow: Understanding Tensors, Computations Graphs, Im...
Deep Learning with TensorFlow: Understanding Tensors, Computations Graphs, Im...Deep Learning with TensorFlow: Understanding Tensors, Computations Graphs, Im...
Deep Learning with TensorFlow: Understanding Tensors, Computations Graphs, Im...Altoros
 
[DSC 2016] 系列活動:李宏毅 / 一天搞懂深度學習
[DSC 2016] 系列活動:李宏毅 / 一天搞懂深度學習[DSC 2016] 系列活動:李宏毅 / 一天搞懂深度學習
[DSC 2016] 系列活動:李宏毅 / 一天搞懂深度學習台灣資料科學年會
 
Google Developer Groups Talk - TensorFlow
Google Developer Groups Talk - TensorFlowGoogle Developer Groups Talk - TensorFlow
Google Developer Groups Talk - TensorFlowHarini Gunabalan
 
H2O Deep Learning at Next.ML
H2O Deep Learning at Next.MLH2O Deep Learning at Next.ML
H2O Deep Learning at Next.MLSri Ambati
 
Deep machine learning by Mario Cho
Deep machine learning by Mario ChoDeep machine learning by Mario Cho
Deep machine learning by Mario ChoMario Cho
 
Ultrasound nerve segmentation, kaggle review
Ultrasound nerve segmentation, kaggle reviewUltrasound nerve segmentation, kaggle review
Ultrasound nerve segmentation, kaggle reviewEduard Tyantov
 
Introduction to Deep Learning with Python
Introduction to Deep Learning with PythonIntroduction to Deep Learning with Python
Introduction to Deep Learning with Pythonindico data
 
H2O Distributed Deep Learning by Arno Candel 071614
H2O Distributed Deep Learning by Arno Candel 071614H2O Distributed Deep Learning by Arno Candel 071614
H2O Distributed Deep Learning by Arno Candel 071614Sri Ambati
 
[2A4]DeepLearningAtNAVER
[2A4]DeepLearningAtNAVER[2A4]DeepLearningAtNAVER
[2A4]DeepLearningAtNAVERNAVER D2
 
Corinna Cortes, Head of Research, Google, at MLconf NYC 2017
Corinna Cortes, Head of Research, Google, at MLconf NYC 2017Corinna Cortes, Head of Research, Google, at MLconf NYC 2017
Corinna Cortes, Head of Research, Google, at MLconf NYC 2017MLconf
 
Language translation with Deep Learning (RNN) with TensorFlow
Language translation with Deep Learning (RNN) with TensorFlowLanguage translation with Deep Learning (RNN) with TensorFlow
Language translation with Deep Learning (RNN) with TensorFlowS N
 
[Pycon 2015] 오늘 당장 딥러닝 실험하기 제출용
[Pycon 2015] 오늘 당장 딥러닝 실험하기 제출용[Pycon 2015] 오늘 당장 딥러닝 실험하기 제출용
[Pycon 2015] 오늘 당장 딥러닝 실험하기 제출용현호 김
 

What's hot (20)

Koss 1605 machine_learning_mariocho_t10
Koss 1605 machine_learning_mariocho_t10Koss 1605 machine_learning_mariocho_t10
Koss 1605 machine_learning_mariocho_t10
 
Koss Lab 세미나 오픈소스 인공지능(AI) 프레임웍파헤치기
Koss Lab 세미나 오픈소스 인공지능(AI) 프레임웍파헤치기 Koss Lab 세미나 오픈소스 인공지능(AI) 프레임웍파헤치기
Koss Lab 세미나 오픈소스 인공지능(AI) 프레임웍파헤치기
 
Applying your Convolutional Neural Networks
Applying your Convolutional Neural NetworksApplying your Convolutional Neural Networks
Applying your Convolutional Neural Networks
 
Alex Smola, Director of Machine Learning, AWS/Amazon, at MLconf SF 2016
Alex Smola, Director of Machine Learning, AWS/Amazon, at MLconf SF 2016Alex Smola, Director of Machine Learning, AWS/Amazon, at MLconf SF 2016
Alex Smola, Director of Machine Learning, AWS/Amazon, at MLconf SF 2016
 
[243] turning data into value
[243] turning data into value[243] turning data into value
[243] turning data into value
 
Using Deep Learning to Find Similar Dresses
Using Deep Learning to Find Similar DressesUsing Deep Learning to Find Similar Dresses
Using Deep Learning to Find Similar Dresses
 
Machine Learning, Deep Learning and Data Analysis Introduction
Machine Learning, Deep Learning and Data Analysis IntroductionMachine Learning, Deep Learning and Data Analysis Introduction
Machine Learning, Deep Learning and Data Analysis Introduction
 
Deep Learning with TensorFlow: Understanding Tensors, Computations Graphs, Im...
Deep Learning with TensorFlow: Understanding Tensors, Computations Graphs, Im...Deep Learning with TensorFlow: Understanding Tensors, Computations Graphs, Im...
Deep Learning with TensorFlow: Understanding Tensors, Computations Graphs, Im...
 
Deeplearning in finance
Deeplearning in financeDeeplearning in finance
Deeplearning in finance
 
[DSC 2016] 系列活動:李宏毅 / 一天搞懂深度學習
[DSC 2016] 系列活動:李宏毅 / 一天搞懂深度學習[DSC 2016] 系列活動:李宏毅 / 一天搞懂深度學習
[DSC 2016] 系列活動:李宏毅 / 一天搞懂深度學習
 
Google Developer Groups Talk - TensorFlow
Google Developer Groups Talk - TensorFlowGoogle Developer Groups Talk - TensorFlow
Google Developer Groups Talk - TensorFlow
 
H2O Deep Learning at Next.ML
H2O Deep Learning at Next.MLH2O Deep Learning at Next.ML
H2O Deep Learning at Next.ML
 
Deep machine learning by Mario Cho
Deep machine learning by Mario ChoDeep machine learning by Mario Cho
Deep machine learning by Mario Cho
 
Ultrasound nerve segmentation, kaggle review
Ultrasound nerve segmentation, kaggle reviewUltrasound nerve segmentation, kaggle review
Ultrasound nerve segmentation, kaggle review
 
Introduction to Deep Learning with Python
Introduction to Deep Learning with PythonIntroduction to Deep Learning with Python
Introduction to Deep Learning with Python
 
H2O Distributed Deep Learning by Arno Candel 071614
H2O Distributed Deep Learning by Arno Candel 071614H2O Distributed Deep Learning by Arno Candel 071614
H2O Distributed Deep Learning by Arno Candel 071614
 
[2A4]DeepLearningAtNAVER
[2A4]DeepLearningAtNAVER[2A4]DeepLearningAtNAVER
[2A4]DeepLearningAtNAVER
 
Corinna Cortes, Head of Research, Google, at MLconf NYC 2017
Corinna Cortes, Head of Research, Google, at MLconf NYC 2017Corinna Cortes, Head of Research, Google, at MLconf NYC 2017
Corinna Cortes, Head of Research, Google, at MLconf NYC 2017
 
Language translation with Deep Learning (RNN) with TensorFlow
Language translation with Deep Learning (RNN) with TensorFlowLanguage translation with Deep Learning (RNN) with TensorFlow
Language translation with Deep Learning (RNN) with TensorFlow
 
[Pycon 2015] 오늘 당장 딥러닝 실험하기 제출용
[Pycon 2015] 오늘 당장 딥러닝 실험하기 제출용[Pycon 2015] 오늘 당장 딥러닝 실험하기 제출용
[Pycon 2015] 오늘 당장 딥러닝 실험하기 제출용
 

Similar to Deep Learning for AI (3)

Practical aspects of medical image ai for hospital (IRB course)
Practical aspects of medical image ai for hospital (IRB course)Practical aspects of medical image ai for hospital (IRB course)
Practical aspects of medical image ai for hospital (IRB course)Sean Yu
 
Neural Networks for Pattern Recognition
Neural Networks for Pattern RecognitionNeural Networks for Pattern Recognition
Neural Networks for Pattern RecognitionVipra Singh
 
Data Science, Big Data and You
Data Science, Big Data and YouData Science, Big Data and You
Data Science, Big Data and YouJoel Saltz
 
Artificial Intelligence in pathology
Artificial Intelligence in pathologyArtificial Intelligence in pathology
Artificial Intelligence in pathologynehaSingh1543
 
Farid Ali Presentation_Final.pptx
Farid Ali Presentation_Final.pptxFarid Ali Presentation_Final.pptx
Farid Ali Presentation_Final.pptxFaridAliMousa1
 
Supporting high throughput high-biotechnologies in today’s research environme...
Supporting high throughput high-biotechnologies in today’s research environme...Supporting high throughput high-biotechnologies in today’s research environme...
Supporting high throughput high-biotechnologies in today’s research environme...Ed Dodds
 
Endobronchial Ultrasound Image Diagnosis Using Convolutional Neural Network (...
Endobronchial Ultrasound Image Diagnosis Using Convolutional Neural Network (...Endobronchial Ultrasound Image Diagnosis Using Convolutional Neural Network (...
Endobronchial Ultrasound Image Diagnosis Using Convolutional Neural Network (...Yan-Wei Lee
 
Computer‐Aided Diagnosis of Breast Cancer Using Ensemble Convolutional Neural...
Computer‐Aided Diagnosis of Breast Cancer Using Ensemble Convolutional Neural...Computer‐Aided Diagnosis of Breast Cancer Using Ensemble Convolutional Neural...
Computer‐Aided Diagnosis of Breast Cancer Using Ensemble Convolutional Neural...Yan-Wei Lee
 
Machine learning and Internet of Things, the future of medical prevention
Machine learning and Internet of Things, the future of medical preventionMachine learning and Internet of Things, the future of medical prevention
Machine learning and Internet of Things, the future of medical preventionPierre Gutierrez
 
Diabetic Retinopathy
Diabetic RetinopathyDiabetic Retinopathy
Diabetic RetinopathyAtif Khan
 
Automatic System for Detection and Classification of Brain Tumors
Automatic System for Detection and Classification of Brain TumorsAutomatic System for Detection and Classification of Brain Tumors
Automatic System for Detection and Classification of Brain TumorsFatma Sayed Ibrahim
 
2016 bioinformatics i_wim_vancriekinge_vupload
2016 bioinformatics i_wim_vancriekinge_vupload2016 bioinformatics i_wim_vancriekinge_vupload
2016 bioinformatics i_wim_vancriekinge_vuploadProf. Wim Van Criekinge
 
Mammography with Inception
Mammography with InceptionMammography with Inception
Mammography with InceptionSeldon
 
Mammography with Inception
Mammography with Inception Mammography with Inception
Mammography with Inception Stephen Morrell
 
Detecting malaria using a deep convolutional neural network
Detecting malaria using a deep  convolutional neural networkDetecting malaria using a deep  convolutional neural network
Detecting malaria using a deep convolutional neural networkYusuf Brima
 
Bioinformatics t1-introduction wim-vancriekinge_v2013
Bioinformatics t1-introduction wim-vancriekinge_v2013Bioinformatics t1-introduction wim-vancriekinge_v2013
Bioinformatics t1-introduction wim-vancriekinge_v2013Prof. Wim Van Criekinge
 
Paris Data Ladies #14
Paris Data Ladies #14Paris Data Ladies #14
Paris Data Ladies #14Nina Bertrand
 

Similar to Deep Learning for AI (3) (20)

Practical aspects of medical image ai for hospital (IRB course)
Practical aspects of medical image ai for hospital (IRB course)Practical aspects of medical image ai for hospital (IRB course)
Practical aspects of medical image ai for hospital (IRB course)
 
Neural Networks for Pattern Recognition
Neural Networks for Pattern RecognitionNeural Networks for Pattern Recognition
Neural Networks for Pattern Recognition
 
Data Science, Big Data and You
Data Science, Big Data and YouData Science, Big Data and You
Data Science, Big Data and You
 
Artificial Intelligence in pathology
Artificial Intelligence in pathologyArtificial Intelligence in pathology
Artificial Intelligence in pathology
 
Parkinson disease classification recorded v2.0
Parkinson disease classification recorded   v2.0Parkinson disease classification recorded   v2.0
Parkinson disease classification recorded v2.0
 
Parkinson disease classification v2.0
Parkinson disease classification v2.0Parkinson disease classification v2.0
Parkinson disease classification v2.0
 
Farid Ali Presentation_Final.pptx
Farid Ali Presentation_Final.pptxFarid Ali Presentation_Final.pptx
Farid Ali Presentation_Final.pptx
 
Seminar nov2017
Seminar nov2017Seminar nov2017
Seminar nov2017
 
Supporting high throughput high-biotechnologies in today’s research environme...
Supporting high throughput high-biotechnologies in today’s research environme...Supporting high throughput high-biotechnologies in today’s research environme...
Supporting high throughput high-biotechnologies in today’s research environme...
 
Endobronchial Ultrasound Image Diagnosis Using Convolutional Neural Network (...
Endobronchial Ultrasound Image Diagnosis Using Convolutional Neural Network (...Endobronchial Ultrasound Image Diagnosis Using Convolutional Neural Network (...
Endobronchial Ultrasound Image Diagnosis Using Convolutional Neural Network (...
 
Computer‐Aided Diagnosis of Breast Cancer Using Ensemble Convolutional Neural...
Computer‐Aided Diagnosis of Breast Cancer Using Ensemble Convolutional Neural...Computer‐Aided Diagnosis of Breast Cancer Using Ensemble Convolutional Neural...
Computer‐Aided Diagnosis of Breast Cancer Using Ensemble Convolutional Neural...
 
Machine learning and Internet of Things, the future of medical prevention
Machine learning and Internet of Things, the future of medical preventionMachine learning and Internet of Things, the future of medical prevention
Machine learning and Internet of Things, the future of medical prevention
 
Diabetic Retinopathy
Diabetic RetinopathyDiabetic Retinopathy
Diabetic Retinopathy
 
Automatic System for Detection and Classification of Brain Tumors
Automatic System for Detection and Classification of Brain TumorsAutomatic System for Detection and Classification of Brain Tumors
Automatic System for Detection and Classification of Brain Tumors
 
2016 bioinformatics i_wim_vancriekinge_vupload
2016 bioinformatics i_wim_vancriekinge_vupload2016 bioinformatics i_wim_vancriekinge_vupload
2016 bioinformatics i_wim_vancriekinge_vupload
 
Mammography with Inception
Mammography with InceptionMammography with Inception
Mammography with Inception
 
Mammography with Inception
Mammography with Inception Mammography with Inception
Mammography with Inception
 
Detecting malaria using a deep convolutional neural network
Detecting malaria using a deep  convolutional neural networkDetecting malaria using a deep  convolutional neural network
Detecting malaria using a deep convolutional neural network
 
Bioinformatics t1-introduction wim-vancriekinge_v2013
Bioinformatics t1-introduction wim-vancriekinge_v2013Bioinformatics t1-introduction wim-vancriekinge_v2013
Bioinformatics t1-introduction wim-vancriekinge_v2013
 
Paris Data Ladies #14
Paris Data Ladies #14Paris Data Ladies #14
Paris Data Ladies #14
 

More from Dongheon Lee

Workshop 210417 dhlee
Workshop 210417 dhleeWorkshop 210417 dhlee
Workshop 210417 dhleeDongheon Lee
 
Pixel RNN to Pixel CNN++
Pixel RNN to Pixel CNN++Pixel RNN to Pixel CNN++
Pixel RNN to Pixel CNN++Dongheon Lee
 
ModuLab DLC-Medical5
ModuLab DLC-Medical5ModuLab DLC-Medical5
ModuLab DLC-Medical5Dongheon Lee
 
ModuLab DLC-Medical4
ModuLab DLC-Medical4ModuLab DLC-Medical4
ModuLab DLC-Medical4Dongheon Lee
 
ModuLab DLC-Medical1
ModuLab DLC-Medical1ModuLab DLC-Medical1
ModuLab DLC-Medical1Dongheon Lee
 
Deep Learning for AI (1)
Deep Learning for AI (1)Deep Learning for AI (1)
Deep Learning for AI (1)Dongheon Lee
 

More from Dongheon Lee (7)

Workshop 210417 dhlee
Workshop 210417 dhleeWorkshop 210417 dhlee
Workshop 210417 dhlee
 
BeautyGlow
BeautyGlowBeautyGlow
BeautyGlow
 
Pixel RNN to Pixel CNN++
Pixel RNN to Pixel CNN++Pixel RNN to Pixel CNN++
Pixel RNN to Pixel CNN++
 
ModuLab DLC-Medical5
ModuLab DLC-Medical5ModuLab DLC-Medical5
ModuLab DLC-Medical5
 
ModuLab DLC-Medical4
ModuLab DLC-Medical4ModuLab DLC-Medical4
ModuLab DLC-Medical4
 
ModuLab DLC-Medical1
ModuLab DLC-Medical1ModuLab DLC-Medical1
ModuLab DLC-Medical1
 
Deep Learning for AI (1)
Deep Learning for AI (1)Deep Learning for AI (1)
Deep Learning for AI (1)
 

Recently uploaded

Call Girls Cuttack Just Call 9907093804 Top Class Call Girl Service Available
Call Girls Cuttack Just Call 9907093804 Top Class Call Girl Service AvailableCall Girls Cuttack Just Call 9907093804 Top Class Call Girl Service Available
Call Girls Cuttack Just Call 9907093804 Top Class Call Girl Service AvailableDipal Arora
 
Call Girls Service Surat Samaira ❤️🍑 8250192130 👄 Independent Escort Service ...
Call Girls Service Surat Samaira ❤️🍑 8250192130 👄 Independent Escort Service ...Call Girls Service Surat Samaira ❤️🍑 8250192130 👄 Independent Escort Service ...
Call Girls Service Surat Samaira ❤️🍑 8250192130 👄 Independent Escort Service ...CALL GIRLS
 
Low Rate Call Girls Pune Esha 9907093804 Short 1500 Night 6000 Best call girl...
Low Rate Call Girls Pune Esha 9907093804 Short 1500 Night 6000 Best call girl...Low Rate Call Girls Pune Esha 9907093804 Short 1500 Night 6000 Best call girl...
Low Rate Call Girls Pune Esha 9907093804 Short 1500 Night 6000 Best call girl...Miss joya
 
VIP Call Girls Pune Vani 9907093804 Short 1500 Night 6000 Best call girls Ser...
VIP Call Girls Pune Vani 9907093804 Short 1500 Night 6000 Best call girls Ser...VIP Call Girls Pune Vani 9907093804 Short 1500 Night 6000 Best call girls Ser...
VIP Call Girls Pune Vani 9907093804 Short 1500 Night 6000 Best call girls Ser...Miss joya
 
Premium Call Girls Cottonpet Whatsapp 7001035870 Independent Escort Service
Premium Call Girls Cottonpet Whatsapp 7001035870 Independent Escort ServicePremium Call Girls Cottonpet Whatsapp 7001035870 Independent Escort Service
Premium Call Girls Cottonpet Whatsapp 7001035870 Independent Escort Servicevidya singh
 
Low Rate Call Girls Patna Anika 8250192130 Independent Escort Service Patna
Low Rate Call Girls Patna Anika 8250192130 Independent Escort Service PatnaLow Rate Call Girls Patna Anika 8250192130 Independent Escort Service Patna
Low Rate Call Girls Patna Anika 8250192130 Independent Escort Service Patnamakika9823
 
Call Girls Darjeeling Just Call 9907093804 Top Class Call Girl Service Available
Call Girls Darjeeling Just Call 9907093804 Top Class Call Girl Service AvailableCall Girls Darjeeling Just Call 9907093804 Top Class Call Girl Service Available
Call Girls Darjeeling Just Call 9907093804 Top Class Call Girl Service AvailableDipal Arora
 
Artifacts in Nuclear Medicine with Identifying and resolving artifacts.
Artifacts in Nuclear Medicine with Identifying and resolving artifacts.Artifacts in Nuclear Medicine with Identifying and resolving artifacts.
Artifacts in Nuclear Medicine with Identifying and resolving artifacts.MiadAlsulami
 
CALL ON ➥9907093804 🔝 Call Girls Baramati ( Pune) Girls Service
CALL ON ➥9907093804 🔝 Call Girls Baramati ( Pune)  Girls ServiceCALL ON ➥9907093804 🔝 Call Girls Baramati ( Pune)  Girls Service
CALL ON ➥9907093804 🔝 Call Girls Baramati ( Pune) Girls ServiceMiss joya
 
Russian Call Girls in Pune Riya 9907093804 Short 1500 Night 6000 Best call gi...
Russian Call Girls in Pune Riya 9907093804 Short 1500 Night 6000 Best call gi...Russian Call Girls in Pune Riya 9907093804 Short 1500 Night 6000 Best call gi...
Russian Call Girls in Pune Riya 9907093804 Short 1500 Night 6000 Best call gi...Miss joya
 
Book Paid Powai Call Girls Mumbai 𖠋 9930245274 𖠋Low Budget Full Independent H...
Book Paid Powai Call Girls Mumbai 𖠋 9930245274 𖠋Low Budget Full Independent H...Book Paid Powai Call Girls Mumbai 𖠋 9930245274 𖠋Low Budget Full Independent H...
Book Paid Powai Call Girls Mumbai 𖠋 9930245274 𖠋Low Budget Full Independent H...Call Girls in Nagpur High Profile
 
Call Girl Number in Vashi Mumbai📲 9833363713 💞 Full Night Enjoy
Call Girl Number in Vashi Mumbai📲 9833363713 💞 Full Night EnjoyCall Girl Number in Vashi Mumbai📲 9833363713 💞 Full Night Enjoy
Call Girl Number in Vashi Mumbai📲 9833363713 💞 Full Night Enjoybabeytanya
 
CALL ON ➥9907093804 🔝 Call Girls Hadapsar ( Pune) Girls Service
CALL ON ➥9907093804 🔝 Call Girls Hadapsar ( Pune)  Girls ServiceCALL ON ➥9907093804 🔝 Call Girls Hadapsar ( Pune)  Girls Service
CALL ON ➥9907093804 🔝 Call Girls Hadapsar ( Pune) Girls ServiceMiss joya
 
VIP Service Call Girls Sindhi Colony 📳 7877925207 For 18+ VIP Call Girl At Th...
VIP Service Call Girls Sindhi Colony 📳 7877925207 For 18+ VIP Call Girl At Th...VIP Service Call Girls Sindhi Colony 📳 7877925207 For 18+ VIP Call Girl At Th...
VIP Service Call Girls Sindhi Colony 📳 7877925207 For 18+ VIP Call Girl At Th...jageshsingh5554
 
Call Girls Ludhiana Just Call 9907093804 Top Class Call Girl Service Available
Call Girls Ludhiana Just Call 9907093804 Top Class Call Girl Service AvailableCall Girls Ludhiana Just Call 9907093804 Top Class Call Girl Service Available
Call Girls Ludhiana Just Call 9907093804 Top Class Call Girl Service AvailableDipal Arora
 
Bangalore Call Girls Marathahalli 📞 9907093804 High Profile Service 100% Safe
Bangalore Call Girls Marathahalli 📞 9907093804 High Profile Service 100% SafeBangalore Call Girls Marathahalli 📞 9907093804 High Profile Service 100% Safe
Bangalore Call Girls Marathahalli 📞 9907093804 High Profile Service 100% Safenarwatsonia7
 
College Call Girls Pune Mira 9907093804 Short 1500 Night 6000 Best call girls...
College Call Girls Pune Mira 9907093804 Short 1500 Night 6000 Best call girls...College Call Girls Pune Mira 9907093804 Short 1500 Night 6000 Best call girls...
College Call Girls Pune Mira 9907093804 Short 1500 Night 6000 Best call girls...Miss joya
 
VIP Call Girls Tirunelveli Aaradhya 8250192130 Independent Escort Service Tir...
VIP Call Girls Tirunelveli Aaradhya 8250192130 Independent Escort Service Tir...VIP Call Girls Tirunelveli Aaradhya 8250192130 Independent Escort Service Tir...
VIP Call Girls Tirunelveli Aaradhya 8250192130 Independent Escort Service Tir...narwatsonia7
 
💎VVIP Kolkata Call Girls Parganas🩱7001035870🩱Independent Girl ( Ac Rooms Avai...
💎VVIP Kolkata Call Girls Parganas🩱7001035870🩱Independent Girl ( Ac Rooms Avai...💎VVIP Kolkata Call Girls Parganas🩱7001035870🩱Independent Girl ( Ac Rooms Avai...
💎VVIP Kolkata Call Girls Parganas🩱7001035870🩱Independent Girl ( Ac Rooms Avai...Taniya Sharma
 

Recently uploaded (20)

Call Girls Cuttack Just Call 9907093804 Top Class Call Girl Service Available
Call Girls Cuttack Just Call 9907093804 Top Class Call Girl Service AvailableCall Girls Cuttack Just Call 9907093804 Top Class Call Girl Service Available
Call Girls Cuttack Just Call 9907093804 Top Class Call Girl Service Available
 
Call Girls Service Surat Samaira ❤️🍑 8250192130 👄 Independent Escort Service ...
Call Girls Service Surat Samaira ❤️🍑 8250192130 👄 Independent Escort Service ...Call Girls Service Surat Samaira ❤️🍑 8250192130 👄 Independent Escort Service ...
Call Girls Service Surat Samaira ❤️🍑 8250192130 👄 Independent Escort Service ...
 
Low Rate Call Girls Pune Esha 9907093804 Short 1500 Night 6000 Best call girl...
Low Rate Call Girls Pune Esha 9907093804 Short 1500 Night 6000 Best call girl...Low Rate Call Girls Pune Esha 9907093804 Short 1500 Night 6000 Best call girl...
Low Rate Call Girls Pune Esha 9907093804 Short 1500 Night 6000 Best call girl...
 
VIP Call Girls Pune Vani 9907093804 Short 1500 Night 6000 Best call girls Ser...
VIP Call Girls Pune Vani 9907093804 Short 1500 Night 6000 Best call girls Ser...VIP Call Girls Pune Vani 9907093804 Short 1500 Night 6000 Best call girls Ser...
VIP Call Girls Pune Vani 9907093804 Short 1500 Night 6000 Best call girls Ser...
 
Premium Call Girls Cottonpet Whatsapp 7001035870 Independent Escort Service
Premium Call Girls Cottonpet Whatsapp 7001035870 Independent Escort ServicePremium Call Girls Cottonpet Whatsapp 7001035870 Independent Escort Service
Premium Call Girls Cottonpet Whatsapp 7001035870 Independent Escort Service
 
Low Rate Call Girls Patna Anika 8250192130 Independent Escort Service Patna
Low Rate Call Girls Patna Anika 8250192130 Independent Escort Service PatnaLow Rate Call Girls Patna Anika 8250192130 Independent Escort Service Patna
Low Rate Call Girls Patna Anika 8250192130 Independent Escort Service Patna
 
Call Girls Darjeeling Just Call 9907093804 Top Class Call Girl Service Available
Call Girls Darjeeling Just Call 9907093804 Top Class Call Girl Service AvailableCall Girls Darjeeling Just Call 9907093804 Top Class Call Girl Service Available
Call Girls Darjeeling Just Call 9907093804 Top Class Call Girl Service Available
 
Artifacts in Nuclear Medicine with Identifying and resolving artifacts.
Artifacts in Nuclear Medicine with Identifying and resolving artifacts.Artifacts in Nuclear Medicine with Identifying and resolving artifacts.
Artifacts in Nuclear Medicine with Identifying and resolving artifacts.
 
Escort Service Call Girls In Sarita Vihar,, 99530°56974 Delhi NCR
Escort Service Call Girls In Sarita Vihar,, 99530°56974 Delhi NCREscort Service Call Girls In Sarita Vihar,, 99530°56974 Delhi NCR
Escort Service Call Girls In Sarita Vihar,, 99530°56974 Delhi NCR
 
CALL ON ➥9907093804 🔝 Call Girls Baramati ( Pune) Girls Service
CALL ON ➥9907093804 🔝 Call Girls Baramati ( Pune)  Girls ServiceCALL ON ➥9907093804 🔝 Call Girls Baramati ( Pune)  Girls Service
CALL ON ➥9907093804 🔝 Call Girls Baramati ( Pune) Girls Service
 
Russian Call Girls in Pune Riya 9907093804 Short 1500 Night 6000 Best call gi...
Russian Call Girls in Pune Riya 9907093804 Short 1500 Night 6000 Best call gi...Russian Call Girls in Pune Riya 9907093804 Short 1500 Night 6000 Best call gi...
Russian Call Girls in Pune Riya 9907093804 Short 1500 Night 6000 Best call gi...
 
Book Paid Powai Call Girls Mumbai 𖠋 9930245274 𖠋Low Budget Full Independent H...
Book Paid Powai Call Girls Mumbai 𖠋 9930245274 𖠋Low Budget Full Independent H...Book Paid Powai Call Girls Mumbai 𖠋 9930245274 𖠋Low Budget Full Independent H...
Book Paid Powai Call Girls Mumbai 𖠋 9930245274 𖠋Low Budget Full Independent H...
 
Call Girl Number in Vashi Mumbai📲 9833363713 💞 Full Night Enjoy
Call Girl Number in Vashi Mumbai📲 9833363713 💞 Full Night EnjoyCall Girl Number in Vashi Mumbai📲 9833363713 💞 Full Night Enjoy
Call Girl Number in Vashi Mumbai📲 9833363713 💞 Full Night Enjoy
 
CALL ON ➥9907093804 🔝 Call Girls Hadapsar ( Pune) Girls Service
CALL ON ➥9907093804 🔝 Call Girls Hadapsar ( Pune)  Girls ServiceCALL ON ➥9907093804 🔝 Call Girls Hadapsar ( Pune)  Girls Service
CALL ON ➥9907093804 🔝 Call Girls Hadapsar ( Pune) Girls Service
 
VIP Service Call Girls Sindhi Colony 📳 7877925207 For 18+ VIP Call Girl At Th...
VIP Service Call Girls Sindhi Colony 📳 7877925207 For 18+ VIP Call Girl At Th...VIP Service Call Girls Sindhi Colony 📳 7877925207 For 18+ VIP Call Girl At Th...
VIP Service Call Girls Sindhi Colony 📳 7877925207 For 18+ VIP Call Girl At Th...
 
Call Girls Ludhiana Just Call 9907093804 Top Class Call Girl Service Available
Call Girls Ludhiana Just Call 9907093804 Top Class Call Girl Service AvailableCall Girls Ludhiana Just Call 9907093804 Top Class Call Girl Service Available
Call Girls Ludhiana Just Call 9907093804 Top Class Call Girl Service Available
 
Bangalore Call Girls Marathahalli 📞 9907093804 High Profile Service 100% Safe
Bangalore Call Girls Marathahalli 📞 9907093804 High Profile Service 100% SafeBangalore Call Girls Marathahalli 📞 9907093804 High Profile Service 100% Safe
Bangalore Call Girls Marathahalli 📞 9907093804 High Profile Service 100% Safe
 
College Call Girls Pune Mira 9907093804 Short 1500 Night 6000 Best call girls...
College Call Girls Pune Mira 9907093804 Short 1500 Night 6000 Best call girls...College Call Girls Pune Mira 9907093804 Short 1500 Night 6000 Best call girls...
College Call Girls Pune Mira 9907093804 Short 1500 Night 6000 Best call girls...
 
VIP Call Girls Tirunelveli Aaradhya 8250192130 Independent Escort Service Tir...
VIP Call Girls Tirunelveli Aaradhya 8250192130 Independent Escort Service Tir...VIP Call Girls Tirunelveli Aaradhya 8250192130 Independent Escort Service Tir...
VIP Call Girls Tirunelveli Aaradhya 8250192130 Independent Escort Service Tir...
 
💎VVIP Kolkata Call Girls Parganas🩱7001035870🩱Independent Girl ( Ac Rooms Avai...
💎VVIP Kolkata Call Girls Parganas🩱7001035870🩱Independent Girl ( Ac Rooms Avai...💎VVIP Kolkata Call Girls Parganas🩱7001035870🩱Independent Girl ( Ac Rooms Avai...
💎VVIP Kolkata Call Girls Parganas🩱7001035870🩱Independent Girl ( Ac Rooms Avai...
 

Deep Learning for AI (3)

  • 1. 2018. 05. 10. 의용전자연구실 박사과정 이동헌 인공지능을 위한 딥러닝 프로그래밍 <AI in Medicine>
  • 2. Week3 Machine Learning (18. 04. 12. 13:00-17:00) Week4 Deep Learning (18. 05. 03. 13:00-17:00) Week5 AI in Medicine (18. 05. 10. 13:00-17:00) • Introduction to AI • Machine Learning Overview • Image Classification Pipeline • Loss functions and Optimization • Neural Network and Backpropagation • Training Neural Networks • Convolutional Neural Networks (CNNs) • CNNs Models • Applications of CNNs • Recurrent Neural Networks (RNNs) • Deep Learning in Practice • Applications in Medicine
  • 3. 3 X1 X2 Xn h1 h2 hn+1 y w11 w(n+1)n w21 w22 w12 wy1 wy2 wy(n+1) h1 = f(w11X1 + w12X2 + w13X3) h2 = f(w21X1 + w22X2 + w23X3) … hn+1 = f(w(n+1)1X1 + w(n+1)2X2 + w(n+1)3X3) y = f(wy1h1 + wy2h2 + … + wy(n+1)hn+1) Loss = D(y, Y) Neural Network and Backpropagation
  • 6.  Applications of CNNs  Recurrent Neural Networks  Deep Learning in Practice  Applications in Medicine
  • 7. • Detection • Segmentation • Understanding CNNs • Autoencoder • Generative Adversarial Networks
  • 9.
  • 10. 10
  • 11. Segmentation • Semantic Segmentation• Semantic Segmentation • Instance Segmentation
  • 13. epoch 10 epoch 50 epoch 70 epoch 100 Segmentation Cervical Vertebrae Segmentation in X-ray
  • 14. U-Net Modified U-Net U-Net Modified U-Net
  • 19. Autoencoders • Dimensionality Reduction • Denoising https://github.com/hwalsuklee/tensorflow-mnist-VAE
  • 20. Autoencoders • MIT-BIH arrhythmia database • INCART • SVDB ECG Signal Denoising
  • 21. Generative Adversarial Networks “Generative Adversarial Network is the most interesting idea in the last ten years in machine learning” - Yann LeCun, Director, Facebook AI
  • 22. Generative Adversarial Networks Linearity • Principle Component Analysis (PCA)
  • 30.
  • 31. • 순차적인 정보를 처리. • 시간 스텝 단위의 출력 결과는 이전 계산 결과로부터 영향을 받음. • 음성 인식, 텍스트, 번역, 비디오, 이미지 캡셔닝 등 Recurrent Neural Networks
  • 32. • 입력 x, 출력 o, Hidden State h, 파라미터 U, V, W 로 구성. • 모든 시간 스텝에 대해 파라미터 값을 공유 U, V, W → Backpropagation Through Time (BPTT)로 학습 → (+) 학습해야 하는 파라미터의 수가 CNN에 비해 상대적으로 적음. • h𝑡 는 네트워크의 메모리, 과거 시간에 일어난 일들에 대한 정보를 누적하여 기억. → (-) 출력값 𝑜𝑡는 현재 시간 t의 메모리에 의존하여 먼 과거에 대해서 반영이 어려움.
  • 33.
  • 34.
  • 36. Long Short Term Memory (LSTM)
  • 38.
  • 45. Step1. Forget Gate Layer Step2. Input Gate Layer
  • 46. Step4. Output Gate Layer Step3. Update
  • 47.
  • 48.
  • 49.
  • 50.
  • 51.
  • 52.
  • 54. e.g. Image Captioning Image → Sequence of words
  • 56.
  • 57.
  • 65.
  • 66. e.g. Sentiment Classification Sequence of words → Sentiment
  • 68. e.g. Machine Translation Sequence of words → Sequence of words
  • 70.
  • 71.
  • 72.
  • 73. e.g. Video Classification on frame Level
  • 74. Video Classification on frame Level
  • 75.  Data Augmentation  Data Imbalance  Transfer Learning  Convolution Small Filters  Implementation CPU-GPU  Deep Learning Frameworks  Limitations of Deep Learning
  • 79.  Change Performance Metric • Cohen’s Kappa • ROC Curve  Resampling • Undersampling (a lot data) • Oversampling - Weighted Cross-entropy - SMOTE, ADASYN and so on  Penalized classification imposes an additional cost on the model  Ensemble  etc 79 Data Imbalance
  • 84. 84 Natural Language Datasets • 4.4 million narrative radiology reports from Stanford • 1 million narrative radiology reports from 3 other institutions • 430,000 radiology reports identified as normal by the interpreting radiologist • 110,000 chest CT reports annotated for presence/absence of pulmonary embolism • 150 chest CT reports with all concepts annotated Imaging Datasets • 1000 ICU chest radiographs • 831 bone tumor radiographs annotated by an expert radiologist with 18 features and the pathologic diagnosis • 4000 digital mammograms annotated with 13 quality attributes • 4000 pediatric hand radiographs with radiologist bone age • Soon: 4.4 million Stanford exams, each with a narrative report Transfer Learning (Open Datasets) Medical ImageNet
  • 85. 85 Transfer Learning (Open Datasets) MURA
  • 89. Convolution Small Filters The power of small filters
  • 90. The power of small filters Convolution Small Filters
  • 91. Implementation (CPU-GPU)  Software : NVIDIA 제공의 개발 도구 및 라이브러리 • 딥러닝 기초요소 (cuDNN) • 딥러닝 추론 엔진 (TensorRT) • 선형 대수 (cuBLAS) • 다중 GPU 커뮤니케이션 (NCCL) • etc  Hardware
  • 99. Limitations of Deep Learning Uncertainty
  • 100. 100 Limitations of Deep Learning Adversarial Attack
  • 101. • Ophthalmology • Dermatology • Pathology • Cardioloy • Neurosurgery • EMR
  • 102. A Survey on Deep Learning in Medical Image Analysis
  • 103. Ophthalmology (1) • Technology enabled by the steam engine, the electricmotor, the microprocessor, the Internet, and many other scientific and engineering breakthroughs has long been replacing humans in jobs that mostly involve objective and routine tasks. … In this regard, AI is no difference, ... • AI in Ophthalmology ① 망막(retina) 이미지 • 널리 이용가능하고 쉽게 구할 수 있으며, 눈 질병 진단을 위해 잘 정의된 기준이 있음. • OCT 망막 이미지를 통해 나이와 관련된 황반변성과 당뇨성 망막증 분류. ② 안저(Fundus) 이미지 • 녹내장, 황반 부종 평가 및 심장 발장 및 뇌졸증 예측. • Clinical validation of performance is one of the hurdles. e.g 설명가능성(explainability) → 중요한(Salient) 이미지 특징(e.g. 혈관구조 패턴 → 나이, 혈압, 흡연 여부 예측) • FDA 승인 (추진 중): Arterys cardio DL, Segments MRI images of the heart, and an algorithm for the detection of diabetic retinopathy • 알고리즘을 임상 정보와 함께 작동하도록 설계하는 것이 중요함.
  • 104. Ophthalmology (2)  Needs • 당뇨성 망막병증(Diabetic Retinopathy)은 당뇨병력이 30년 이상인 환자의 90%에게 발병하게 되며, 세계 각국에서 실명의 주요 원인이 됨. 세계적으로 빠르게 증가, 약 415M명의 환자들이 위험군에 속함. <당뇨성 망막병증의 진단을 위하여 찍은 안저 사진의 예시> (A) 건강한 환자 (B) 당뇨성 망막병증 환자  Objective • 안저 이미지를 이용하여 당뇨성 망막변증 분류.
  • 105.  Methods • Inception-v3  Datasets • 후향적으로 128,175개의 안저 이미지 (Multiple grades) ① 당뇨성 qulity망막병증(Diabetic Retinopathy) ② 황반부종(Diabetic Macular Edema) ③ 이미지 quality • 안과전문의들에게 3-7회 판독 받은 데이터 • 미국의 안과 전문의 54명이 2015년 3월부터 12월까지 참여  Validation • 오픈 안저 이미지 데이터셋에 검증 ① EyePACS-1: 4,997명의 환자들로부터 9,963개의 이미지 ② Messidor-2: 874명의 환자들로부터 1,748개의 이미지 • 인공지능 결과와 우수한 안과전문의들 7-8명의 판독 결과 비교 (개발에 참여했던 54명의 의사 중에 일관된 판독을 보여준 일부 의사가 참여)
  • 106.  Results • 매우 우수한 성능 (① EyePACS-1, AUC=0.991 ② Messidor-2, AUC=0.990)
  • 107. Voets, Mike, Kajsa Møllersen, and Lars Ailo Bongo. "Replication study: Development and validation of deep learning algorithm for detection of diabetic retinopathy in retinal fundus photographs." arXiv preprint arXiv:1803.04337 (2018). Ophthalmology (3) https://github.com/mikevoets/jama16-retina-replication  Objective • "Development and validation of a deep learning algorithm for detection of diabetic retinopathy in retinal fundus photographs." Jama 316.22 (2016): 2402-2410. 재현  Methods & Results • Multiple grades per image → one grade per image (Acc 36% 하락) • (Different) EyePACS AUC: 0.74 → 0.94 (after preprocessing) • (Different) Messidor2 AUC: 0.59 → 0.82 (after preprocessing)  Discussion • Original study에서 자세한 설명이 부족하여 재현이 어려움. → Hyper-parameter setting, optimization function → Preprocessing method → Ungradable image 에 대한 알고리즘 설명 x → Main 알고리즘에 대한 설명만 있음 → etc
  • 108. Dermatology  Needs • 피부암은 매년 미국에서만 540만 명의 신규 환자 가 발생할 정도로 빈번한 질병. • 피부암은 조기 발견이 중요하지만 초기에 자각 증상이 없는 경우가 많고, 피부에 있는 다른 점, 검버섯, 사마귀와 구분이 어려움. • 흑색종의 자가진단 방법으로는 ABCDE법 권장함. • Asymmetry: 대칭적인지 • Border : 경계가 명확한지 • Color: 색깔이 단일한지, 흰색이나 파란색이 섞여 있지 않은지 • Diameter: 직경이 6mm를 넘지 않는지 • Evolving: 점의 크기나 모양, 색깔이 시간이 지남에 따라서 변화 하고 출혈이 생기지 않는지  Objective • 이미지를 이용하여 피부암 종류 분류.
  • 109.  Methods • ‘Inception-v3’  Datasets • 스탠퍼드 병원, 에든버러 대학의 이미지 라이브 러리 및 인터넷에서 수집. • 이 병변의 이미지들은 각도, 배율, 밝기 등이 각 각 다르며, 스탠퍼드 대학병원 피부과 전문의들 과의 협업을 통해서 판독함. • 체계적으로 질병명을 지정해야 학습과 검증에 용이하므로, 다양한 피부과 질병의 계층 관계 (taxonomy)를 정의하였고, 그 결과 2,000개 이 상의 질병으로 체계적으로 판독되어 있는 약 13만 장의 피부 병변 이미지 데이터를 만듦.
  • 110.  Validation • 생검과 조직검사를 통해 기존에 확진한 이미지 데이터 사용. • 의학적으로 구분이 중요한 세 가지 경우에 대해서 테스트를 진행. ① 표피세포 암 vs 지루각화증 (135장, 707장) ② 성 흑색종과 vs 양성 병변 (표준 이미지 데이터 기반 130장, 225장) ③ 성 흑색종과 vs 양성 병변 (더마토스코프로 찍은 이미지 기반 111장, 1,010장)  Results • 매우 우수한 성능 (① AUC=0.96 ② AUC=0.94 ③ AUC=0.91) • 인공지능보다 정확성이 떨어지는 전문의 상당수 (의사들 성적의 평균: 초록색)
  • 111. Pathology  Methods  Objective • 림프 노드 전이를 찾는 딥러닝 알고리즘들과 전문의의 성능 비교. • Task1: Metastasis Identification • Task2: Whole-Slide Image Classification  Datasets • Challenge Competition (CAMELYON ‘16) • Train (n=270 images) / Test (n=129 slides and images)
  • 112.  Results • 우수한 성능 • 전문의 (시간 제한 있음/없음)
  • 113. Cardiology (1)  Datasets • Zio Patch monitor1 (wearable monitor) single-lead로 Arrhythmias 측정 (Turakhia et al., 2013) • 다른 데이터셋보다 500배 큰 규모 (Moody & Mark, 2001; Goldberger et al., 2000) • 대략 300,000 명의 환자 중에서 30,000명의 환자 선택 • Annotations / sec (Sampling rate = 200Hz)  Objective • ECG를 이용하여 다음 항목 분류. • Sinus rhythm • Atrial Fibrillation • 12 Arrhythmia types  Methods • 34-layer CNN
  • 114.  Results • Sequence F1 (256 samples overlap) • Set F1 (set of arrhythmias in 30 sec)  Validation • 336개의 기록 (328명의 환자) • 6명의 cardiologists.
  • 115. Cardiology (2)  Datasets • 14,011명 w/ 웨어러블 심박 모니터링 기기 (Apple Watch app heart rate sensors.) • Medical History (이전 진단, 혈액 시험 결과, 약물 치료)  Methods • DeepHeart (network) • Training Methods ① Unsupervised Sequence pretraining ② Weakly supervised Heuristic pretraining  Objective • ECG + 병력(Medical History) 이용하여 추정. • 당뇨 (Diabetes) • 높은 콜레스테롤 (High cholesterol) • 고혈압 (High blood pressure) • 코골이 및 수면 무호흡 (Sleep apnea)
  • 116.  Results  Validation • 336개 기록 (328명의 환자) • 심박 정보만 학습시키면 결과가 좋지 않음. • 전반적인 physical activity 정보는 예측에 중요한 역할을 하지만, 심박은 딥러닝을 이용하기에 중요한 biomarker임.
  • 117. Neurosurgery  Objective • 이미지를 보거나 상상할 때, fMRI activity에서 구한 decoded features 를 통해, 보거나 상상한 이미지를 생 성/복원.  Methods • Image presentation experiments : ① 일반 이미지 ② 기하하적인 모양 ③ 알파벳 • Imagery experiment : 25개 이미지 (10개 일반 이미지, 15개 기하하적인 모양) • 피험자 1 (남성, 33세), 피험자 2 (남성, 23세), 피험자 3 (여성, 23세)
  • 118. Neurosurgery  Objective • 이미지를 보거나 상상할 때, fMRI activity에서 구한 decoded features 를 통해, 보거나 상상한 이미지를 생 성/복원.  Methods • Image presentation experiments : ① 일반 이미지 ② 기하하적인 모양 ③ 알파벳 • Imagery experiment : 25개 이미지 (10개 일반 이미지, 15개 기하하적인 모양) • 피험자 1 (남성, 33세), 피험자 2 (남성, 23세), 피험자 3 (여성, 23세) VGG19 "Generic decoding of seen and imagined objects using hierarchical visual features." Nature communications 8 (2017): 15037. (Option) "Synthesizing the preferred inputs for neurons in neural networks via deep generator networks." Advances in Neural Information Processing Systems. 2016.
  • 119.
  • 120. Electronic Medical Record (EMR)  Objective • 딥러닝을 이용한 EMR 분석 방법 정리.
  • 122.
  • 123. 1. (p3) • Andrew L. Beam, machine learning and medicine, Deep Learning 101 - Part 1: History and Background, https://beamandrew.github.io/deeplearning/2017/02/23/deep_learning_101_part1.html • Abedini, R., et al. "The prediction of undersaturated crude oil viscosity: An artificial neural network and fuzzy model approach." Petroleum Science and Technology 30.19 (2012): 2008-2021. 2. (p4) • AIRI 400, “Machine Learning 기초” (이광희 박사) • Standford, CS231n, http://cs231n.stanford.edu/ • Deniz Yuret’s Homepage, “Alec Radford's animations for optimization algorithms”, http://www.denizyuret.com/2015/03/alec-radfords-animations-for.html 3. (p5) • the data science blog, https://ujjwalkarn.me/2016/08/11/intuitive-explanation-convnets/ • Medium, “Neural Network Architecture”, https://towardsdatascience.com/neural-network-architectures- 156e5bad51ba 4. (p8-9) Ren, Shaoqing, et al. "Faster r-cnn: Towards real-time object detection with region proposal networks." Advances in neural information processing systems. 2015. 5. (p10) Cireşan, Dan C., et al. "Mitosis detection in breast cancer histology images with deep neural networks." International Conference on Medical Image Computing and Computer-assisted Intervention. Springer, Berlin, Heidelberg, 2013. 6. (p11, p15-16) He, Kaiming, et al. "Mask r-cnn." Computer Vision (ICCV), 2017 IEEE International Conference on. IEEE, 2017.
  • 124. 7. (p12) Ronneberger, Olaf, Philipp Fischer, and Thomas Brox. "U-net: Convolutional networks for biomedical image segmentation." International Conference on Medical image computing and computer-assisted intervention. Springer, Cham, 2015. 8. (p17) Selvaraju, Ramprasaath R., et al. "Grad-CAM: Visual Explanations from Deep Networks via Gradient-Based Localization." ICCV. 2017. 9. (p18) Lee, Hyunkwang, et al. "Fully automated deep learning system for bone age assessment." Journal of digital imaging 30.4 (2017): 427-441. 10. (p19) Medium, Deep inside: Autoencoders, https://towardsdatascience.com/deep-inside-autoencoders- 7e41f319999f 11. (p20) Al Rahhal, Mohamad M., et al. "Deep learning approach for active classification of electrocardiogram signals." Information Sciences 345 (2016): 340-354. 12. (p21) DL4J, GAN: A Beginner’s Guide to Generative Adversarial Networks, https://deeplearning4j.org/generative- adversarial-network 13. (p22) PCA Reconstruction Example, http://www.cec.uchile.cl/~jruizd/faces/reconstruction/rec.htm 14. (p23) • QUORA, https://www.quora.com/What-are-the-limitations-of-manifold-learning • NVIDIA, “https://devblogs.nvidia.com/photo-editing-generative-adversarial-networks-2/”, https://devblogs.nvidia.com/photo-editing-generative-adversarial-networks-2/ 15. (p26) Madani, Ali, et al. "Semi-supervised learning with generative adversarial networks for chest X-ray classification with ability of data domain adaptation." Biomedical Imaging (ISBI 2018), 2018 IEEE 15th International Symposium on. IEEE, 2018. 16. (p27-28) Ledig, Christian, et al. "Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Network." CVPR. Vol. 2. No. 3. 2017.
  • 125. 17. (p29) Kang, Eunhee, Junhong Min, and Jong Chul Ye. "A deep convolutional neural network using directional wavelets for low‐dose X‐ray CT reconstruction." Medical physics 44.10 (2017). 18. (p31-32) AIRI 400, “순환신경망(Recurrent Neural Networks) 응용” (서병락 박사) 19. (p33-46) Colah’s blog, Understanding LSTM Networks, http://colah.github.io/posts/2015-08-Understanding-LSTMs/ 20. (p47-66, p68, p64-67, p70-73, p76-77, p80-83, p89-94) Standford, CS231n, http://cs231n.stanford.edu/ 21. (p69) googleblogs, “Transformer: A Novel Neural Network Architecture for Language Understanding”, http://www.googblogs.com/tag/machine-translation/ 22. (p74) • Donahue, Jeffrey, et al. "Long-term recurrent convolutional networks for visual recognition and description." Proceedings of the IEEE conference on computer vision and pattern recognition. 2015. • RSIP VISION, MACHINE LEARNING – VIDEO CLASSIFICATION & OBJECT RECOGNITION, https://www.rsipvision.com/portfolio/machine-learning-video-classification/ 23. (p78) imgaug, https://github.com/aleju/imgaug 24. (p79) Machine Learning Mastery, ”8 Tactics to Combat Imbalanced Classes in Your Machine Learning Dataset”, https://machinelearningmastery.com/tactics-to-combat-imbalanced-classes-in-your-machine-learning-dataset/ 25. (p84) Medical Image Net, http://langlotzlab.stanford.edu/projects/medical-image-net/ 26. (p85) MURA, https://stanfordmlgroup.github.io/projects/mura/ 27. (p91) NVIDIA, “DEEP LEARNING SOFTWARE (SDK)”, http://www.nvidia.com/content/apac/event/kr/deep-learning- software/
  • 126. 28. (p95-96) POP it, “딥러닝 프레임워크 조사와 몇가지 홍보”, https://www.popit.kr/%EB%94%A5%EB%9F%AC%EB%8B%9D- %ED%94%84%EB%A0%88%EC%9E%84%EC%9B%8C%ED%81%AC-%EC%A1%B0%EC%82%AC%EC%99%80- %EB%AA%87%EA%B0%80%EC%A7%80-%ED%99%8D%EB%B3%B4/ 29. (p99) Alex Kandall blog, “Deep Learning Is Not Good Enough, We Need Bayesian Deep Learning for Safe AI“, https://alexgkendall.com/computer_vision/bayesian_deep_learning_for_safe_ai/ 30. (p100) OpenAI, “Attacking Machine Learning with Adversarial Examples“, https://blog.openai.com/adversarial- example-research/ 31. (p102) Litjens, Geert, et al. "A survey on deep learning in medical image analysis." Medical image analysis 42 (2017): 60-88. 32. (p103) Remarkably, A.I. "All eyes are on AI.” Nature Biomedical Engineering 33. (p104-106) Gulshan, Varun, et al. "Development and validation of a deep learning algorithm for detection of diabetic retinopathy in retinal fundus photographs." Jama 316.22 (2016): 2402-2410. 34. (p107) Voets, Mike, Kajsa Møllersen, and Lars Ailo Bongo. "Replication study: Development and validation of deep learning algorithm for detection of diabetic retinopathy in retinal fundus photographs." arXiv preprint arXiv:1803.04337 (2018). 35. (p108-110) Esteva, Andre, et al. "Dermatologist-level classification of skin cancer with deep neural networks." Nature 542.7639 (2017): 115. 36. (p111-112) Bejnordi, Babak Ehteshami, et al. "Diagnostic assessment of deep learning algorithms for detection of lymph node metastases in women with breast cancer." Jama 318.22 (2017): 2199-2210. 37. (p113-114) Rajpurkar, Pranav, et al. "Cardiologist-level arrhythmia detection with convolutional neural networks." arXiv preprint arXiv:1707.01836 (2017).
  • 127. 38. (p115-116) Ballinger, Brandon, et al. "DeepHeart: Semi-Supervised Sequence Learning for Cardiovascular Risk Prediction." arXiv preprint arXiv:1802.02511 (2018). 39. (p117-119) Shen, Guohua, et al. "Deep image reconstruction from human brain activity." bioRxiv (2017): 240317. 40. (p120-121) Shickel, Benjamin, et al. "Deep EHR: A Survey of Recent Advances in Deep Learning Techniques for Electronic Health Record (EHR) Analysis." IEEE Journal of Biomedical and Health Informatics (2017).

Editor's Notes

  1. Puberty: 사춘기 Occlusion method
  2. *32-channel EEG signals from 32 subjects * PCA 전처리 * DLN is capable of classifying three different levels of valence and arousal with accuracy of 49.52% and 46.03%, respectivel. DEAP Dataset(cls=4) Stacked Autoencoder Acc = 50%
  3. 과거의 정보 이용
  4. 각 layer마다의 파라미터 값들이 전부 다 다른 기존의 deep한 신경망 구조와 달리, RNN은 모든 시간 스텝에 대해 파라미터 값을 전부 공유하고 있다 (위 그림의 U, V, W). 이는 RNN이 각 스텝마다 입력값만 다를 뿐 거의 똑같은 계산을 하고 있다는 것을 보여준다. 이는 학습해야 하는 파라미터 수를 많이 줄여준다. *시간 스텝으로 펼쳐낸 RNN에서 backpropagation
  5. Step1: <새 정보가 셀 스테이트에 버릴지 선택할지 결정> John(성별 정보) likes pizza, So, he orderd … -> John 으로 he 예측 + 새로운 주어 표현이 나오면 성별 표현 잊음 Step2. <새 정보가 셀 스테이트에 저장 여부 결정> tanh 는 새로운 후보값
  6. Step3. ft=it 이며, 잊어버릴건 잊어버리고 새로운 후보값은 업데이트 Step4. step3에 업데이트된 정보를 -1~1 사이로 뽑아낸 값에 원본*sigmoid 곱함
  7. Label 그대로
  8. *Classification accuracy normalized by the imbalance of the classes *creating synthetic samples from the minor class instead of creating copies ; The algorithm selects two or more similar instances (using a distance measure) and perturbing an instance one attribute at a time by a random amount within the difference to the neighboring instances.
  9. NVIDIA: TensorRT는 아주 간단히 말하면 ‘가속기
  10. -Finicky (까다로움); hyperparam tuning “No uncertainty prediction = overly confident” 불확실성(1. 데이터 질/양부족 2. 설명 가능한 변수들을 관찰 가능한 능력 3. Task 따라)
  11. Illustrating the difference between aleatoric and epistemic uncertainty for semantic segmentation. You can notice that aleatoric uncertainty captures object boundaries where labels are noisy. The bottom row shows a failure case of the segmentation model, when the model is unfamiliar with the footpath, and the corresponding increased epistemic uncertainty.
  12. 2016
  13. 안과 인공지능의 장점 일관성, 즉 똑같은 데이터에 대해서 매번 같은 결과를 냄 민감도와 특이도가 모두 높음 → 사용 목적에 따라서 한쪽 수치를 극대화하여 사용할 수도 있음 후진국에서도 유용하게 활용될 수 있음. 당뇨병 환자의 많은 수가 안과 의사가 부족한 후진국에 살고 있기 때문. 안과 인공지능의 한계점 여러명의 의사가 판독한 기준을 바탕으로 학습하고, 성능을 평가하는 방식의 문제가 있음. 소수의 매우 우수한 의사가 데이터에서(다른 대부분의 의사들은 발견하지 못한) 미세한 발견을 하더라도 학습이나, 테스트 과정에서 반영되지 못함 딥러닝 방식이 블랙박스라는 근본적인 문제가 있음. 안저 사진을 잘 판독하기는 하지만, 이미지의 어떠한 부분, 예를 들어 특정 혈관이나 출혈 때문에 그러한 판독 결과를 내었는지의 과정은 알 수 없음. 그 기준은 인간과 같을 수도 있고, 아직 인간이 발견하지 못한 완전히 새로운 기준일 수도 있음
  14. Ungradable image : diabetic retinopathy or macular edema re-graded all their obtained images for diabetic retinopathy, mac- ular edema, and image gradability.
  15. 2017
  16. 2017
  17. (SINUS) : 심박동 Atrial Fibrillation (AFIB) ; Arrhythmias (부정맥) 일종
  18. *Seq f1: measure the average overlap between the prediction and the ground truth *Set f1: set of unique arrhythmias present in each 30 second record as the ground truth annotation. Precision (PPV) Recall (Sensitivity)
  19. *input: user-week u, timestep t, and input channel c (heart rage)
  20. The reconstruction algorithm starts from a random image and iteratively optimize the pixel values so that the DNN features of the input image become similar to those decoded from brain activity across multiple DNN layers.
  21. The reconstruction algorithm starts from a random image and iteratively optimize the pixel values so that the DNN features of the input image become similar to those decoded from brain activity across multiple DNN layers.