SlideShare a Scribd company logo
1 of 16
Download to read offline
Deep Learning-based Universal
Beamformer for Ultrasound Imaging
Shujaat Khan, Jaeyoung Huh
and Jong Chul Ye
BISPL - BioImaging, Signal Processing, and Learning lab.
Dept. Bio & Brain Engineering
KAIST, Korea
Motivation
Application Needs
 Reduce the number of channel
- Ultra-fast US
- Portable US
- 3 dimensional US
Acquisition Modes
Focused Imaging
Planewave Imaging
Conventional approach
Conventional delay-and-sum (DAS) Beamforming Pipeline
Rx
probe
Beam
focusing
Signal
Adder
Envelope
detection
Log
compression
B-mode image
Hilbert
Transform
IQ data
(signal before envelope detection)
Full-sampling
pattern
Our contribution
Beam
focusing
Envelope
detection
Log
compression
B-mode image
IQ data
(signal before envelope detection)
Convolutional neural network (CNN)
Universal Deep Beamformer (DeepBF)
probe
Rx
Sub-sampling
pattern 2x
Sub-sampling
pattern 4x
Review : Adaptive Beamforming
 It is difficult to calculate the inverse of covariance matrix R
Review : Deconvolution
y : RF vector at the depth n
H : Deconvolution filter matrices
W : Beamformer weight
U : [𝒚𝒚 𝒏𝒏 + 𝑸𝑸 𝑻𝑻
… 𝒚𝒚 𝒏𝒏 − 𝑸𝑸 𝑻𝑻
] 𝑻𝑻
: Deconvolution filter

Input dependent non-linear mapping
Input dependent
Point Spread Function (PSF)
CNN as a combinatorial representation
Encoder-decoder CNN
analysis basis
synthesis basis
Encoder Decoder
Similarity between two equation implies that
the deconvolution beamforming can be learned using an encoder-decoder CNN.
<J. C. Ye and W. K. Sung, “Understanding geometry of encoder-decoder CNNs,” in Proceedings of the 36th International Conference on Machine Learning, >
Application to Planar Wave Imaging
Proposed
Method
Data
Generation
Rx
Depth
Planewave1
Time of flight
Planewave2
Planewave3
Planewave
Results (Planewave / in-vivo)
<Full data>
31 plane waves
and 64 channels
3 plane waves
and 64 channels
31 plane waves
and 32 channels
31 plane waves
and 8 channels
DAS
DeepBF
255
128
0
Lateral length(mm)
0 40
30
20
10
depth(mm)
50
0
20
30
40
10
Results (Planewave / phantom)
<Full data>
31 plane waves
and 64 channels
11 plane waves
and 64 channels
3 plane waves
and 64 channels
31 plane waves
and 32 channels
31 plane waves
and 16 channels
31 plane waves
and 8 channels
255
128
0
DAS
DeepBF
depth(mm)
60
0
24
36
48
12
Lateral length(mm)
0 40
30
20
10
Note that those images are generated from one network.
Application to Focused B-Mode Imaging
…
…
…
…
Focusing
Rx
Depth
Scanline
Proposed
Method
Data
Generation
Results (focused / in-vivo)
<Full Data>
64 channels 32 channels 16 channels 8 channels 4 channels
0
-30
-60
1
0.5
0
depth(mm)
45
0
18
27
36
9
Lateral length(mm)
0 40
30
20
10
DAS BF
0
-30
-60
1
0.5
0
dB
depth(mm)
45
0
18
27
36
9
Lateral length(mm)
0 40
30
20
10
DeepBF
dB
Results (focused / phantom)
32 channels
<Full Data>
64 channels 16 channels 4 channels
depth(mm)
45
0
18
27
36
9
depth(mm)
45
0
18
27
36
9
Lateral length(mm)
0 40
30
20
10
Lateral length(mm)
0 40
30
20
10
0
-30
-60
1
0.5
0
0
-30
-60
1
0.5
0
dB
dB
DAS BF
DeepBF
Conclusion
• The proposed method exploits the redundancies in the raw RF
data.
• The proposed method can be applied to low-power US, hand-held
systems, etc
• The proposed universal DeepBF exhibits superior image quality for
all sub-sampling rates.
Thank You

More Related Content

What's hot

Digital image processing techniques
Digital image processing techniquesDigital image processing techniques
Digital image processing techniquesShab Bi
 
Word representations in vector space
Word representations in vector spaceWord representations in vector space
Word representations in vector spaceAbdullah Khan Zehady
 
Data Mining: Concepts and Techniques (3rd ed.) — Chapter 5
Data Mining:  Concepts and Techniques (3rd ed.)— Chapter 5 Data Mining:  Concepts and Techniques (3rd ed.)— Chapter 5
Data Mining: Concepts and Techniques (3rd ed.) — Chapter 5 Salah Amean
 
Scalable Recommendation Algorithms with LSH
Scalable Recommendation Algorithms with LSHScalable Recommendation Algorithms with LSH
Scalable Recommendation Algorithms with LSHMaruf Aytekin
 
2.6 support vector machines and associative classifiers revised
2.6 support vector machines and associative classifiers revised2.6 support vector machines and associative classifiers revised
2.6 support vector machines and associative classifiers revisedKrish_ver2
 
IRJET- Breast Cancer Prediction using Supervised Machine Learning Algorithms
IRJET- Breast Cancer Prediction using Supervised Machine Learning AlgorithmsIRJET- Breast Cancer Prediction using Supervised Machine Learning Algorithms
IRJET- Breast Cancer Prediction using Supervised Machine Learning AlgorithmsIRJET Journal
 
HIGH PASS FILTER IN DIGITAL IMAGE PROCESSING
HIGH PASS FILTER IN DIGITAL IMAGE PROCESSINGHIGH PASS FILTER IN DIGITAL IMAGE PROCESSING
HIGH PASS FILTER IN DIGITAL IMAGE PROCESSINGBimal2354
 
Dirty data science machine learning on non-curated data
Dirty data science machine learning on non-curated dataDirty data science machine learning on non-curated data
Dirty data science machine learning on non-curated dataGael Varoquaux
 
03 digital image fundamentals DIP
03 digital image fundamentals DIP03 digital image fundamentals DIP
03 digital image fundamentals DIPbabak danyal
 
Discrete cosine transform
Discrete cosine transform   Discrete cosine transform
Discrete cosine transform Rashmi Karkra
 
Deep Learning for Recommender Systems RecSys2017 Tutorial
Deep Learning for Recommender Systems RecSys2017 Tutorial Deep Learning for Recommender Systems RecSys2017 Tutorial
Deep Learning for Recommender Systems RecSys2017 Tutorial Alexandros Karatzoglou
 
Machine Learning Contents.pptx
Machine Learning Contents.pptxMachine Learning Contents.pptx
Machine Learning Contents.pptxNaveenkushwaha18
 
Digital Image Processing: An Introduction
Digital Image Processing: An IntroductionDigital Image Processing: An Introduction
Digital Image Processing: An IntroductionMostafa G. M. Mostafa
 
Data Mining And Data Warehousing Laboratory File Manual
Data Mining And Data Warehousing Laboratory File ManualData Mining And Data Warehousing Laboratory File Manual
Data Mining And Data Warehousing Laboratory File ManualNitin Bhasin
 
Machine Learning Tutorial Part - 1 | Machine Learning Tutorial For Beginners ...
Machine Learning Tutorial Part - 1 | Machine Learning Tutorial For Beginners ...Machine Learning Tutorial Part - 1 | Machine Learning Tutorial For Beginners ...
Machine Learning Tutorial Part - 1 | Machine Learning Tutorial For Beginners ...Simplilearn
 
Machine Learning lecture4(logistic regression)
Machine Learning lecture4(logistic regression)Machine Learning lecture4(logistic regression)
Machine Learning lecture4(logistic regression)cairo university
 

What's hot (20)

Digital image processing techniques
Digital image processing techniquesDigital image processing techniques
Digital image processing techniques
 
Word representations in vector space
Word representations in vector spaceWord representations in vector space
Word representations in vector space
 
Data Mining: Concepts and Techniques (3rd ed.) — Chapter 5
Data Mining:  Concepts and Techniques (3rd ed.)— Chapter 5 Data Mining:  Concepts and Techniques (3rd ed.)— Chapter 5
Data Mining: Concepts and Techniques (3rd ed.) — Chapter 5
 
Support Vector machine
Support Vector machineSupport Vector machine
Support Vector machine
 
Topic Models
Topic ModelsTopic Models
Topic Models
 
Medical image analysis
Medical image analysisMedical image analysis
Medical image analysis
 
Scalable Recommendation Algorithms with LSH
Scalable Recommendation Algorithms with LSHScalable Recommendation Algorithms with LSH
Scalable Recommendation Algorithms with LSH
 
2.6 support vector machines and associative classifiers revised
2.6 support vector machines and associative classifiers revised2.6 support vector machines and associative classifiers revised
2.6 support vector machines and associative classifiers revised
 
IRJET- Breast Cancer Prediction using Supervised Machine Learning Algorithms
IRJET- Breast Cancer Prediction using Supervised Machine Learning AlgorithmsIRJET- Breast Cancer Prediction using Supervised Machine Learning Algorithms
IRJET- Breast Cancer Prediction using Supervised Machine Learning Algorithms
 
HIGH PASS FILTER IN DIGITAL IMAGE PROCESSING
HIGH PASS FILTER IN DIGITAL IMAGE PROCESSINGHIGH PASS FILTER IN DIGITAL IMAGE PROCESSING
HIGH PASS FILTER IN DIGITAL IMAGE PROCESSING
 
Dirty data science machine learning on non-curated data
Dirty data science machine learning on non-curated dataDirty data science machine learning on non-curated data
Dirty data science machine learning on non-curated data
 
03 digital image fundamentals DIP
03 digital image fundamentals DIP03 digital image fundamentals DIP
03 digital image fundamentals DIP
 
Discrete cosine transform
Discrete cosine transform   Discrete cosine transform
Discrete cosine transform
 
Deep Learning for Recommender Systems RecSys2017 Tutorial
Deep Learning for Recommender Systems RecSys2017 Tutorial Deep Learning for Recommender Systems RecSys2017 Tutorial
Deep Learning for Recommender Systems RecSys2017 Tutorial
 
Machine Learning Contents.pptx
Machine Learning Contents.pptxMachine Learning Contents.pptx
Machine Learning Contents.pptx
 
Hidden markov model ppt
Hidden markov model pptHidden markov model ppt
Hidden markov model ppt
 
Digital Image Processing: An Introduction
Digital Image Processing: An IntroductionDigital Image Processing: An Introduction
Digital Image Processing: An Introduction
 
Data Mining And Data Warehousing Laboratory File Manual
Data Mining And Data Warehousing Laboratory File ManualData Mining And Data Warehousing Laboratory File Manual
Data Mining And Data Warehousing Laboratory File Manual
 
Machine Learning Tutorial Part - 1 | Machine Learning Tutorial For Beginners ...
Machine Learning Tutorial Part - 1 | Machine Learning Tutorial For Beginners ...Machine Learning Tutorial Part - 1 | Machine Learning Tutorial For Beginners ...
Machine Learning Tutorial Part - 1 | Machine Learning Tutorial For Beginners ...
 
Machine Learning lecture4(logistic regression)
Machine Learning lecture4(logistic regression)Machine Learning lecture4(logistic regression)
Machine Learning lecture4(logistic regression)
 

Similar to Deep Learning-Based Universal Beamformer for Ultrasound Imaging

Universal plane wave compounding for high quality us imaging using deep learning
Universal plane wave compounding for high quality us imaging using deep learningUniversal plane wave compounding for high quality us imaging using deep learning
Universal plane wave compounding for high quality us imaging using deep learningShujaat Khan
 
Adaptive and compressive beamforming using deep learning for medical ultrasound
Adaptive and compressive beamforming using deep learning for medical ultrasoundAdaptive and compressive beamforming using deep learning for medical ultrasound
Adaptive and compressive beamforming using deep learning for medical ultrasoundShujaat Khan
 
Switchable and tunable deep beamformer using adaptive instance normalization ...
Switchable and tunable deep beamformer using adaptive instance normalization ...Switchable and tunable deep beamformer using adaptive instance normalization ...
Switchable and tunable deep beamformer using adaptive instance normalization ...Shujaat Khan
 
Unsupervised Deconvolution Neural Network for High Quality Ultrasound Imaging
Unsupervised Deconvolution Neural Network for High Quality Ultrasound ImagingUnsupervised Deconvolution Neural Network for High Quality Ultrasound Imaging
Unsupervised Deconvolution Neural Network for High Quality Ultrasound ImagingShujaat Khan
 
"An adaptive modular approach to the mining of sensor network ...
"An adaptive modular approach to the mining of sensor network ..."An adaptive modular approach to the mining of sensor network ...
"An adaptive modular approach to the mining of sensor network ...butest
 
Deep Local Parametric Filters for Image Enhancement
Deep Local Parametric Filters for Image EnhancementDeep Local Parametric Filters for Image Enhancement
Deep Local Parametric Filters for Image EnhancementSean Moran
 
MULTI-DOMAIN UNPAIRED ULTRASOUND IMAGE ARTIFACT REMOVAL USING A SINGLE CONVOL...
MULTI-DOMAIN UNPAIRED ULTRASOUND IMAGE ARTIFACT REMOVAL USING A SINGLE CONVOL...MULTI-DOMAIN UNPAIRED ULTRASOUND IMAGE ARTIFACT REMOVAL USING A SINGLE CONVOL...
MULTI-DOMAIN UNPAIRED ULTRASOUND IMAGE ARTIFACT REMOVAL USING A SINGLE CONVOL...JaeyoungHuh2
 
Channel Models for Massive MIMO
Channel Models for Massive MIMOChannel Models for Massive MIMO
Channel Models for Massive MIMOCPqD
 
Coastal erosion management using image processing and Node Oriented Programming
Coastal erosion management using image processing and Node Oriented Programming Coastal erosion management using image processing and Node Oriented Programming
Coastal erosion management using image processing and Node Oriented Programming AbdAllah Aly
 
Interference Mitigation & Massive MIMO for 5G - A Summary of CPqDs Results
Interference Mitigation & Massive MIMO for 5G - A Summary of CPqDs ResultsInterference Mitigation & Massive MIMO for 5G - A Summary of CPqDs Results
Interference Mitigation & Massive MIMO for 5G - A Summary of CPqDs ResultsCPqD
 
Introduction to deep learning based voice activity detection
Introduction to deep learning based voice activity detectionIntroduction to deep learning based voice activity detection
Introduction to deep learning based voice activity detectionNAVER Engineering
 
ieee nss mic 2016 poster N30-21
ieee nss mic 2016 poster N30-21ieee nss mic 2016 poster N30-21
ieee nss mic 2016 poster N30-21Dae Woon Kim
 
Deep Learning Tomography
Deep Learning TomographyDeep Learning Tomography
Deep Learning TomographyAmir Adler
 
5_1555_TH4.T01.5_suwa.ppt
5_1555_TH4.T01.5_suwa.ppt5_1555_TH4.T01.5_suwa.ppt
5_1555_TH4.T01.5_suwa.pptgrssieee
 
Color flow medical cardiac ultrasound
Color flow medical cardiac ultrasoundColor flow medical cardiac ultrasound
Color flow medical cardiac ultrasoundLarry Miller PhD
 
Three dimensional particle image velocimetry
Three dimensional particle image velocimetryThree dimensional particle image velocimetry
Three dimensional particle image velocimetrypawankumar9275
 

Similar to Deep Learning-Based Universal Beamformer for Ultrasound Imaging (20)

Universal plane wave compounding for high quality us imaging using deep learning
Universal plane wave compounding for high quality us imaging using deep learningUniversal plane wave compounding for high quality us imaging using deep learning
Universal plane wave compounding for high quality us imaging using deep learning
 
Adaptive and compressive beamforming using deep learning for medical ultrasound
Adaptive and compressive beamforming using deep learning for medical ultrasoundAdaptive and compressive beamforming using deep learning for medical ultrasound
Adaptive and compressive beamforming using deep learning for medical ultrasound
 
Switchable and tunable deep beamformer using adaptive instance normalization ...
Switchable and tunable deep beamformer using adaptive instance normalization ...Switchable and tunable deep beamformer using adaptive instance normalization ...
Switchable and tunable deep beamformer using adaptive instance normalization ...
 
Unsupervised Deconvolution Neural Network for High Quality Ultrasound Imaging
Unsupervised Deconvolution Neural Network for High Quality Ultrasound ImagingUnsupervised Deconvolution Neural Network for High Quality Ultrasound Imaging
Unsupervised Deconvolution Neural Network for High Quality Ultrasound Imaging
 
"An adaptive modular approach to the mining of sensor network ...
"An adaptive modular approach to the mining of sensor network ..."An adaptive modular approach to the mining of sensor network ...
"An adaptive modular approach to the mining of sensor network ...
 
Deep Local Parametric Filters for Image Enhancement
Deep Local Parametric Filters for Image EnhancementDeep Local Parametric Filters for Image Enhancement
Deep Local Parametric Filters for Image Enhancement
 
KinPhy
KinPhyKinPhy
KinPhy
 
MULTI-DOMAIN UNPAIRED ULTRASOUND IMAGE ARTIFACT REMOVAL USING A SINGLE CONVOL...
MULTI-DOMAIN UNPAIRED ULTRASOUND IMAGE ARTIFACT REMOVAL USING A SINGLE CONVOL...MULTI-DOMAIN UNPAIRED ULTRASOUND IMAGE ARTIFACT REMOVAL USING A SINGLE CONVOL...
MULTI-DOMAIN UNPAIRED ULTRASOUND IMAGE ARTIFACT REMOVAL USING A SINGLE CONVOL...
 
Channel Models for Massive MIMO
Channel Models for Massive MIMOChannel Models for Massive MIMO
Channel Models for Massive MIMO
 
Coastal erosion management using image processing and Node Oriented Programming
Coastal erosion management using image processing and Node Oriented Programming Coastal erosion management using image processing and Node Oriented Programming
Coastal erosion management using image processing and Node Oriented Programming
 
Interference Mitigation & Massive MIMO for 5G - A Summary of CPqDs Results
Interference Mitigation & Massive MIMO for 5G - A Summary of CPqDs ResultsInterference Mitigation & Massive MIMO for 5G - A Summary of CPqDs Results
Interference Mitigation & Massive MIMO for 5G - A Summary of CPqDs Results
 
M.sc. m hassan
M.sc. m hassanM.sc. m hassan
M.sc. m hassan
 
Introduction to deep learning based voice activity detection
Introduction to deep learning based voice activity detectionIntroduction to deep learning based voice activity detection
Introduction to deep learning based voice activity detection
 
ieee nss mic 2016 poster N30-21
ieee nss mic 2016 poster N30-21ieee nss mic 2016 poster N30-21
ieee nss mic 2016 poster N30-21
 
Beamforming antennas (1)
Beamforming antennas (1)Beamforming antennas (1)
Beamforming antennas (1)
 
US_pres.pptx
US_pres.pptxUS_pres.pptx
US_pres.pptx
 
Deep Learning Tomography
Deep Learning TomographyDeep Learning Tomography
Deep Learning Tomography
 
5_1555_TH4.T01.5_suwa.ppt
5_1555_TH4.T01.5_suwa.ppt5_1555_TH4.T01.5_suwa.ppt
5_1555_TH4.T01.5_suwa.ppt
 
Color flow medical cardiac ultrasound
Color flow medical cardiac ultrasoundColor flow medical cardiac ultrasound
Color flow medical cardiac ultrasound
 
Three dimensional particle image velocimetry
Three dimensional particle image velocimetryThree dimensional particle image velocimetry
Three dimensional particle image velocimetry
 

More from Shujaat Khan

Physics informed deep learning for efficient b-mode ultrasound imaging
Physics informed deep learning for efficient b-mode ultrasound imagingPhysics informed deep learning for efficient b-mode ultrasound imaging
Physics informed deep learning for efficient b-mode ultrasound imagingShujaat Khan
 
Variational formulation of unsupervised deep learning for ultrasound image ar...
Variational formulation of unsupervised deep learning for ultrasound image ar...Variational formulation of unsupervised deep learning for ultrasound image ar...
Variational formulation of unsupervised deep learning for ultrasound image ar...Shujaat Khan
 
Contrast and resolution improvement of pocus using self consistent cycle gan
Contrast and resolution improvement of pocus using self consistent cycle ganContrast and resolution improvement of pocus using self consistent cycle gan
Contrast and resolution improvement of pocus using self consistent cycle ganShujaat Khan
 
Clutter suppressed deep beamformer for echocardiography using deep learning
Clutter suppressed deep beamformer for echocardiography using deep learningClutter suppressed deep beamformer for echocardiography using deep learning
Clutter suppressed deep beamformer for echocardiography using deep learningShujaat Khan
 
Unsupervised Deep Learning for Accelerated High Quality Echocardiography
Unsupervised Deep Learning for Accelerated High Quality EchocardiographyUnsupervised Deep Learning for Accelerated High Quality Echocardiography
Unsupervised Deep Learning for Accelerated High Quality EchocardiographyShujaat Khan
 
Switchable Deep Beamformer for Ultrasound Imaging Using ADAIN
Switchable Deep Beamformer for Ultrasound Imaging Using ADAINSwitchable Deep Beamformer for Ultrasound Imaging Using ADAIN
Switchable Deep Beamformer for Ultrasound Imaging Using ADAINShujaat Khan
 

More from Shujaat Khan (6)

Physics informed deep learning for efficient b-mode ultrasound imaging
Physics informed deep learning for efficient b-mode ultrasound imagingPhysics informed deep learning for efficient b-mode ultrasound imaging
Physics informed deep learning for efficient b-mode ultrasound imaging
 
Variational formulation of unsupervised deep learning for ultrasound image ar...
Variational formulation of unsupervised deep learning for ultrasound image ar...Variational formulation of unsupervised deep learning for ultrasound image ar...
Variational formulation of unsupervised deep learning for ultrasound image ar...
 
Contrast and resolution improvement of pocus using self consistent cycle gan
Contrast and resolution improvement of pocus using self consistent cycle ganContrast and resolution improvement of pocus using self consistent cycle gan
Contrast and resolution improvement of pocus using self consistent cycle gan
 
Clutter suppressed deep beamformer for echocardiography using deep learning
Clutter suppressed deep beamformer for echocardiography using deep learningClutter suppressed deep beamformer for echocardiography using deep learning
Clutter suppressed deep beamformer for echocardiography using deep learning
 
Unsupervised Deep Learning for Accelerated High Quality Echocardiography
Unsupervised Deep Learning for Accelerated High Quality EchocardiographyUnsupervised Deep Learning for Accelerated High Quality Echocardiography
Unsupervised Deep Learning for Accelerated High Quality Echocardiography
 
Switchable Deep Beamformer for Ultrasound Imaging Using ADAIN
Switchable Deep Beamformer for Ultrasound Imaging Using ADAINSwitchable Deep Beamformer for Ultrasound Imaging Using ADAIN
Switchable Deep Beamformer for Ultrasound Imaging Using ADAIN
 

Recently uploaded

Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024The Digital Insurer
 
Scaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationScaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationRadu Cotescu
 
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptxEIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptxEarley Information Science
 
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Miguel Araújo
 
Artificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsArtificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsJoaquim Jorge
 
Boost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityBoost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityPrincipled Technologies
 
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptxHampshireHUG
 
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdfThe Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdfEnterprise Knowledge
 
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...apidays
 
Understanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdfUnderstanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdfUK Journal
 
Data Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonData Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonAnna Loughnan Colquhoun
 
08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking MenDelhi Call girls
 
Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024The Digital Insurer
 
Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...Enterprise Knowledge
 
What Are The Drone Anti-jamming Systems Technology?
What Are The Drone Anti-jamming Systems Technology?What Are The Drone Anti-jamming Systems Technology?
What Are The Drone Anti-jamming Systems Technology?Antenna Manufacturer Coco
 
Automating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps ScriptAutomating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps Scriptwesley chun
 
[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdfhans926745
 
Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024The Digital Insurer
 
Factors to Consider When Choosing Accounts Payable Services Providers.pptx
Factors to Consider When Choosing Accounts Payable Services Providers.pptxFactors to Consider When Choosing Accounts Payable Services Providers.pptx
Factors to Consider When Choosing Accounts Payable Services Providers.pptxKatpro Technologies
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerThousandEyes
 

Recently uploaded (20)

Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024
 
Scaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationScaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organization
 
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptxEIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
 
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
 
Artificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and MythsArtificial Intelligence: Facts and Myths
Artificial Intelligence: Facts and Myths
 
Boost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityBoost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivity
 
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
 
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdfThe Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
The Role of Taxonomy and Ontology in Semantic Layers - Heather Hedden.pdf
 
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
 
Understanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdfUnderstanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdf
 
Data Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonData Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt Robison
 
08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men
 
Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024
 
Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...
 
What Are The Drone Anti-jamming Systems Technology?
What Are The Drone Anti-jamming Systems Technology?What Are The Drone Anti-jamming Systems Technology?
What Are The Drone Anti-jamming Systems Technology?
 
Automating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps ScriptAutomating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps Script
 
[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf
 
Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024
 
Factors to Consider When Choosing Accounts Payable Services Providers.pptx
Factors to Consider When Choosing Accounts Payable Services Providers.pptxFactors to Consider When Choosing Accounts Payable Services Providers.pptx
Factors to Consider When Choosing Accounts Payable Services Providers.pptx
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 

Deep Learning-Based Universal Beamformer for Ultrasound Imaging

  • 1. Deep Learning-based Universal Beamformer for Ultrasound Imaging Shujaat Khan, Jaeyoung Huh and Jong Chul Ye BISPL - BioImaging, Signal Processing, and Learning lab. Dept. Bio & Brain Engineering KAIST, Korea
  • 2. Motivation Application Needs  Reduce the number of channel - Ultra-fast US - Portable US - 3 dimensional US
  • 4. Conventional approach Conventional delay-and-sum (DAS) Beamforming Pipeline Rx probe Beam focusing Signal Adder Envelope detection Log compression B-mode image Hilbert Transform IQ data (signal before envelope detection)
  • 5. Full-sampling pattern Our contribution Beam focusing Envelope detection Log compression B-mode image IQ data (signal before envelope detection) Convolutional neural network (CNN) Universal Deep Beamformer (DeepBF) probe Rx Sub-sampling pattern 2x Sub-sampling pattern 4x
  • 6. Review : Adaptive Beamforming  It is difficult to calculate the inverse of covariance matrix R
  • 7. Review : Deconvolution y : RF vector at the depth n H : Deconvolution filter matrices W : Beamformer weight U : [𝒚𝒚 𝒏𝒏 + 𝑸𝑸 𝑻𝑻 … 𝒚𝒚 𝒏𝒏 − 𝑸𝑸 𝑻𝑻 ] 𝑻𝑻 : Deconvolution filter  Input dependent non-linear mapping Input dependent Point Spread Function (PSF)
  • 8. CNN as a combinatorial representation Encoder-decoder CNN analysis basis synthesis basis Encoder Decoder Similarity between two equation implies that the deconvolution beamforming can be learned using an encoder-decoder CNN. <J. C. Ye and W. K. Sung, “Understanding geometry of encoder-decoder CNNs,” in Proceedings of the 36th International Conference on Machine Learning, >
  • 9. Application to Planar Wave Imaging Proposed Method Data Generation Rx Depth Planewave1 Time of flight Planewave2 Planewave3 Planewave
  • 10. Results (Planewave / in-vivo) <Full data> 31 plane waves and 64 channels 3 plane waves and 64 channels 31 plane waves and 32 channels 31 plane waves and 8 channels DAS DeepBF 255 128 0 Lateral length(mm) 0 40 30 20 10 depth(mm) 50 0 20 30 40 10
  • 11. Results (Planewave / phantom) <Full data> 31 plane waves and 64 channels 11 plane waves and 64 channels 3 plane waves and 64 channels 31 plane waves and 32 channels 31 plane waves and 16 channels 31 plane waves and 8 channels 255 128 0 DAS DeepBF depth(mm) 60 0 24 36 48 12 Lateral length(mm) 0 40 30 20 10 Note that those images are generated from one network.
  • 12. Application to Focused B-Mode Imaging … … … … Focusing Rx Depth Scanline Proposed Method Data Generation
  • 13. Results (focused / in-vivo) <Full Data> 64 channels 32 channels 16 channels 8 channels 4 channels 0 -30 -60 1 0.5 0 depth(mm) 45 0 18 27 36 9 Lateral length(mm) 0 40 30 20 10 DAS BF 0 -30 -60 1 0.5 0 dB depth(mm) 45 0 18 27 36 9 Lateral length(mm) 0 40 30 20 10 DeepBF dB
  • 14. Results (focused / phantom) 32 channels <Full Data> 64 channels 16 channels 4 channels depth(mm) 45 0 18 27 36 9 depth(mm) 45 0 18 27 36 9 Lateral length(mm) 0 40 30 20 10 Lateral length(mm) 0 40 30 20 10 0 -30 -60 1 0.5 0 0 -30 -60 1 0.5 0 dB dB DAS BF DeepBF
  • 15. Conclusion • The proposed method exploits the redundancies in the raw RF data. • The proposed method can be applied to low-power US, hand-held systems, etc • The proposed universal DeepBF exhibits superior image quality for all sub-sampling rates.