SlideShare a Scribd company logo
1 of 2
Download to read offline
Complex Valued Long Short Term
Memory Based Architecture for
Frequency Domain Photoacoustic
Imaging
Abstract
Frequency domain photoacoustic (FDPA) imaging has great potential in a
clinical setting compared to time
reduced cost and small form factors. However FDPA system struggles with
lower signal to noise ratio, necessitating the need for advanced image
reconstruction methods. Most of the image reconstruction approaches in
FDPA imaging are based
emphasis has been placed on developing deep learning based approaches
for FDPA imaging. In this work, a image translation network was developed
with the ability to directly map from sinogram data (complex
initial pressure rise distribution (real
architecture was based on a Long Short Term Memory (LSTM) backbone
(with adjoined real and imaginary parts of the complex sinogram data as
Complex Valued Long Short Term
Memory Based Architecture for
Frequency Domain Photoacoustic
Frequency domain photoacoustic (FDPA) imaging has great potential in a
clinical setting compared to time-domain photoacoustic imaging due to its
reduced cost and small form factors. However FDPA system struggles with
lower signal to noise ratio, necessitating the need for advanced image
reconstruction methods. Most of the image reconstruction approaches in
FDPA imaging are based on analytical or model based schemes. Very less
emphasis has been placed on developing deep learning based approaches
for FDPA imaging. In this work, a image translation network was developed
with the ability to directly map from sinogram data (complex-va
initial pressure rise distribution (real-valued) for FD-PA imaging. This
architecture was based on a Long Short Term Memory (LSTM) backbone
(with adjoined real and imaginary parts of the complex sinogram data as
Complex Valued Long Short Term
Frequency Domain Photoacoustic
Frequency domain photoacoustic (FDPA) imaging has great potential in a
imaging due to its
reduced cost and small form factors. However FDPA system struggles with
lower signal to noise ratio, necessitating the need for advanced image
reconstruction methods. Most of the image reconstruction approaches in
on analytical or model based schemes. Very less
emphasis has been placed on developing deep learning based approaches
for FDPA imaging. In this work, a image translation network was developed
valued) to the
PA imaging. This
architecture was based on a Long Short Term Memory (LSTM) backbone
(with adjoined real and imaginary parts of the complex sinogram data as
input) followed by a fully connected layer, which is then passed through a
convolution and transposed convolution layer pair. The result of the FDPA-
LSTM architecture was compared with direct translational networks based on
ResNet, UNet and AUTOMAP and found to have an improvement of about
15% in terms of PSNR and 10% in terms of SSIM with 150∘ data acquisition
limited-view angle. Further, the FDPA-LSTM was also compared with post-
processing UNet architecture on backprojection and Tikhonov regularized
reconstruction. A 20% improvement in terms of PSNR with backprojection and
post-processing UNet was observed. Further FDPA-LSTM had similar
performance as Tikhonov and post-processing UNet (with 75 times
acceleration). The developed scheme will indeed be very useful for achieving
accelerated and accurate frequency domain photoacoustic imaging.

More Related Content

Similar to Complex Valued Long Short Term Memory Based Architecture for Frequency Domain Photoacoustic Imaging.pdf

Image Processing IEEE 2015 Projects
Image Processing IEEE 2015 ProjectsImage Processing IEEE 2015 Projects
Image Processing IEEE 2015 Projects
Vijay Karan
 

Similar to Complex Valued Long Short Term Memory Based Architecture for Frequency Domain Photoacoustic Imaging.pdf (20)

JPM1414 Progressive Image Denoising Through Hybrid Graph Laplacian Regulariz...
JPM1414  Progressive Image Denoising Through Hybrid Graph Laplacian Regulariz...JPM1414  Progressive Image Denoising Through Hybrid Graph Laplacian Regulariz...
JPM1414 Progressive Image Denoising Through Hybrid Graph Laplacian Regulariz...
 
Image Processing IEEE 2015 Projects
Image Processing IEEE 2015 ProjectsImage Processing IEEE 2015 Projects
Image Processing IEEE 2015 Projects
 
Multiplexing And Data Rate
Multiplexing And Data RateMultiplexing And Data Rate
Multiplexing And Data Rate
 
Implementation of Wide Band Frequency Synthesizer Base on DFS (Digital Frequ...
Implementation of Wide Band Frequency Synthesizer Base on  DFS (Digital Frequ...Implementation of Wide Band Frequency Synthesizer Base on  DFS (Digital Frequ...
Implementation of Wide Band Frequency Synthesizer Base on DFS (Digital Frequ...
 
Image Processing IEEE 2015 Projects
Image Processing IEEE 2015 ProjectsImage Processing IEEE 2015 Projects
Image Processing IEEE 2015 Projects
 
MIMO-OFDM PAPR Reduction by Residue Number System
MIMO-OFDM PAPR Reduction by Residue Number SystemMIMO-OFDM PAPR Reduction by Residue Number System
MIMO-OFDM PAPR Reduction by Residue Number System
 
High Speed and Area Efficient 2D DWT Processor Based Image Compression
High Speed and Area Efficient 2D DWT Processor Based Image CompressionHigh Speed and Area Efficient 2D DWT Processor Based Image Compression
High Speed and Area Efficient 2D DWT Processor Based Image Compression
 
A SURVEY ON OPTIMIZATION BASED SPECTRUM SENSING TECHNIQUES TO REDUCE ISI AND ...
A SURVEY ON OPTIMIZATION BASED SPECTRUM SENSING TECHNIQUES TO REDUCE ISI AND ...A SURVEY ON OPTIMIZATION BASED SPECTRUM SENSING TECHNIQUES TO REDUCE ISI AND ...
A SURVEY ON OPTIMIZATION BASED SPECTRUM SENSING TECHNIQUES TO REDUCE ISI AND ...
 
2010 15 vo
2010 15 vo2010 15 vo
2010 15 vo
 
A Summative Comparison of Blind Channel Estimation Techniques for Orthogonal ...
A Summative Comparison of Blind Channel Estimation Techniques for Orthogonal ...A Summative Comparison of Blind Channel Estimation Techniques for Orthogonal ...
A Summative Comparison of Blind Channel Estimation Techniques for Orthogonal ...
 
Developed approach for phase-based Eulerian video magnification
Developed approach for phase-based Eulerian video magnificationDeveloped approach for phase-based Eulerian video magnification
Developed approach for phase-based Eulerian video magnification
 
A Novel Blind SR Method to Improve the Spatial Resolution of Real Life Video ...
A Novel Blind SR Method to Improve the Spatial Resolution of Real Life Video ...A Novel Blind SR Method to Improve the Spatial Resolution of Real Life Video ...
A Novel Blind SR Method to Improve the Spatial Resolution of Real Life Video ...
 
internet applications
 internet applications internet applications
internet applications
 
Coded OFDM in Fiber-Optics Communication Systems with Optimum biasing of Laser
Coded OFDM in Fiber-Optics Communication Systems with Optimum biasing of LaserCoded OFDM in Fiber-Optics Communication Systems with Optimum biasing of Laser
Coded OFDM in Fiber-Optics Communication Systems with Optimum biasing of Laser
 
1
11
1
 
M.Phil Computer Science Remote Sensing Projects
M.Phil Computer Science Remote Sensing ProjectsM.Phil Computer Science Remote Sensing Projects
M.Phil Computer Science Remote Sensing Projects
 
M phil-computer-science-remote-sensing-projects
M phil-computer-science-remote-sensing-projectsM phil-computer-science-remote-sensing-projects
M phil-computer-science-remote-sensing-projects
 
M phil-computer-science-remote-sensing-projects
M phil-computer-science-remote-sensing-projectsM phil-computer-science-remote-sensing-projects
M phil-computer-science-remote-sensing-projects
 
Linear Phase FIR Low Pass Filter Design Based on Firefly Algorithm
Linear Phase FIR Low Pass Filter Design Based on Firefly Algorithm Linear Phase FIR Low Pass Filter Design Based on Firefly Algorithm
Linear Phase FIR Low Pass Filter Design Based on Firefly Algorithm
 
Pruning methods for person reidentification: A Survey
Pruning methods for person reidentification: A SurveyPruning methods for person reidentification: A Survey
Pruning methods for person reidentification: A Survey
 

More from OKOKPROJECTS

More from OKOKPROJECTS (20)

Distributed State Estimation With Deep Neural Networks for Uncertain Nonlinea...
Distributed State Estimation With Deep Neural Networks for Uncertain Nonlinea...Distributed State Estimation With Deep Neural Networks for Uncertain Nonlinea...
Distributed State Estimation With Deep Neural Networks for Uncertain Nonlinea...
 
Distributed Inference in Resource-Constrained IoT for Real-Time Video Surveil...
Distributed Inference in Resource-Constrained IoT for Real-Time Video Surveil...Distributed Inference in Resource-Constrained IoT for Real-Time Video Surveil...
Distributed Inference in Resource-Constrained IoT for Real-Time Video Surveil...
 
DLTIF Deep Learning-Driven Cyber Threat Intelligence Modeling and Identificat...
DLTIF Deep Learning-Driven Cyber Threat Intelligence Modeling and Identificat...DLTIF Deep Learning-Driven Cyber Threat Intelligence Modeling and Identificat...
DLTIF Deep Learning-Driven Cyber Threat Intelligence Modeling and Identificat...
 
DGSSC A Deep Generative Spectral-Spatial Classifier for Imbalanced Hyperspect...
DGSSC A Deep Generative Spectral-Spatial Classifier for Imbalanced Hyperspect...DGSSC A Deep Generative Spectral-Spatial Classifier for Imbalanced Hyperspect...
DGSSC A Deep Generative Spectral-Spatial Classifier for Imbalanced Hyperspect...
 
Digital Restoration of Cultural Heritage With Data-Driven Computing A Survey.pdf
Digital Restoration of Cultural Heritage With Data-Driven Computing A Survey.pdfDigital Restoration of Cultural Heritage With Data-Driven Computing A Survey.pdf
Digital Restoration of Cultural Heritage With Data-Driven Computing A Survey.pdf
 
Dependable Intrusion Detection System for IoT A Deep Transfer Learning Based ...
Dependable Intrusion Detection System for IoT A Deep Transfer Learning Based ...Dependable Intrusion Detection System for IoT A Deep Transfer Learning Based ...
Dependable Intrusion Detection System for IoT A Deep Transfer Learning Based ...
 
DendroMap Visual Exploration of Large-Scale Image Datasets for Machine Learni...
DendroMap Visual Exploration of Large-Scale Image Datasets for Machine Learni...DendroMap Visual Exploration of Large-Scale Image Datasets for Machine Learni...
DendroMap Visual Exploration of Large-Scale Image Datasets for Machine Learni...
 
Dense Nested Attention Network for Infrared Small Target Detection.pdf
Dense Nested Attention Network for Infrared Small Target Detection.pdfDense Nested Attention Network for Infrared Small Target Detection.pdf
Dense Nested Attention Network for Infrared Small Target Detection.pdf
 
Detection of Small Moving Targets in Cluttered Infrared Imagery.pdf
Detection of Small Moving Targets in Cluttered Infrared Imagery.pdfDetection of Small Moving Targets in Cluttered Infrared Imagery.pdf
Detection of Small Moving Targets in Cluttered Infrared Imagery.pdf
 
Depression Screening in Humans With AI and Deep Learning Techniques.pdf
Depression Screening in Humans With AI and Deep Learning Techniques.pdfDepression Screening in Humans With AI and Deep Learning Techniques.pdf
Depression Screening in Humans With AI and Deep Learning Techniques.pdf
 
DeepTx Deep Learning Beamforming With Channel Prediction.pdf
DeepTx Deep Learning Beamforming With Channel Prediction.pdfDeepTx Deep Learning Beamforming With Channel Prediction.pdf
DeepTx Deep Learning Beamforming With Channel Prediction.pdf
 
DeHIN A Decentralized Framework for Embedding Large-Scale Heterogeneous Infor...
DeHIN A Decentralized Framework for Embedding Large-Scale Heterogeneous Infor...DeHIN A Decentralized Framework for Embedding Large-Scale Heterogeneous Infor...
DeHIN A Decentralized Framework for Embedding Large-Scale Heterogeneous Infor...
 
DefQ Defensive Quantization Against Inference Slow-Down Attack for Edge Compu...
DefQ Defensive Quantization Against Inference Slow-Down Attack for Edge Compu...DefQ Defensive Quantization Against Inference Slow-Down Attack for Edge Compu...
DefQ Defensive Quantization Against Inference Slow-Down Attack for Edge Compu...
 
Deep-Learning-Driven Proactive Maintenance Management of IoT-Empowered Smart ...
Deep-Learning-Driven Proactive Maintenance Management of IoT-Empowered Smart ...Deep-Learning-Driven Proactive Maintenance Management of IoT-Empowered Smart ...
Deep-Learning-Driven Proactive Maintenance Management of IoT-Empowered Smart ...
 
Deep-Distributed-Learning-Based POI Recommendation Under Mobile-Edge Networks...
Deep-Distributed-Learning-Based POI Recommendation Under Mobile-Edge Networks...Deep-Distributed-Learning-Based POI Recommendation Under Mobile-Edge Networks...
Deep-Distributed-Learning-Based POI Recommendation Under Mobile-Edge Networks...
 
DeepCog A Trustworthy Deep Learning-Based Human Cognitive Privacy Framework i...
DeepCog A Trustworthy Deep Learning-Based Human Cognitive Privacy Framework i...DeepCog A Trustworthy Deep Learning-Based Human Cognitive Privacy Framework i...
DeepCog A Trustworthy Deep Learning-Based Human Cognitive Privacy Framework i...
 
DeepCrowd A Deep Model for Large-Scale Citywide Crowd Density and Flow Predic...
DeepCrowd A Deep Model for Large-Scale Citywide Crowd Density and Flow Predic...DeepCrowd A Deep Model for Large-Scale Citywide Crowd Density and Flow Predic...
DeepCrowd A Deep Model for Large-Scale Citywide Crowd Density and Flow Predic...
 
D2Net Deep Denoising Network in Frequency Domain for Hyperspectral Image.pdf
D2Net Deep Denoising Network in Frequency Domain for Hyperspectral Image.pdfD2Net Deep Denoising Network in Frequency Domain for Hyperspectral Image.pdf
D2Net Deep Denoising Network in Frequency Domain for Hyperspectral Image.pdf
 
Decentralized Federated Learning for Industrial IoT With Deep Echo State Netw...
Decentralized Federated Learning for Industrial IoT With Deep Echo State Netw...Decentralized Federated Learning for Industrial IoT With Deep Echo State Netw...
Decentralized Federated Learning for Industrial IoT With Deep Echo State Netw...
 
Cyber Code Intelligence for Android Malware Detection.pdf
Cyber Code Intelligence for Android Malware Detection.pdfCyber Code Intelligence for Android Malware Detection.pdf
Cyber Code Intelligence for Android Malware Detection.pdf
 

Recently uploaded

1029 - Danh muc Sach Giao Khoa 10 . pdf
1029 -  Danh muc Sach Giao Khoa 10 . pdf1029 -  Danh muc Sach Giao Khoa 10 . pdf
1029 - Danh muc Sach Giao Khoa 10 . pdf
QucHHunhnh
 
1029-Danh muc Sach Giao Khoa khoi 6.pdf
1029-Danh muc Sach Giao Khoa khoi  6.pdf1029-Danh muc Sach Giao Khoa khoi  6.pdf
1029-Danh muc Sach Giao Khoa khoi 6.pdf
QucHHunhnh
 
Beyond the EU: DORA and NIS 2 Directive's Global Impact
Beyond the EU: DORA and NIS 2 Directive's Global ImpactBeyond the EU: DORA and NIS 2 Directive's Global Impact
Beyond the EU: DORA and NIS 2 Directive's Global Impact
PECB
 
The basics of sentences session 2pptx copy.pptx
The basics of sentences session 2pptx copy.pptxThe basics of sentences session 2pptx copy.pptx
The basics of sentences session 2pptx copy.pptx
heathfieldcps1
 
Activity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdfActivity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdf
ciinovamais
 

Recently uploaded (20)

1029 - Danh muc Sach Giao Khoa 10 . pdf
1029 -  Danh muc Sach Giao Khoa 10 . pdf1029 -  Danh muc Sach Giao Khoa 10 . pdf
1029 - Danh muc Sach Giao Khoa 10 . pdf
 
PROCESS RECORDING FORMAT.docx
PROCESS      RECORDING        FORMAT.docxPROCESS      RECORDING        FORMAT.docx
PROCESS RECORDING FORMAT.docx
 
This PowerPoint helps students to consider the concept of infinity.
This PowerPoint helps students to consider the concept of infinity.This PowerPoint helps students to consider the concept of infinity.
This PowerPoint helps students to consider the concept of infinity.
 
Measures of Dispersion and Variability: Range, QD, AD and SD
Measures of Dispersion and Variability: Range, QD, AD and SDMeasures of Dispersion and Variability: Range, QD, AD and SD
Measures of Dispersion and Variability: Range, QD, AD and SD
 
1029-Danh muc Sach Giao Khoa khoi 6.pdf
1029-Danh muc Sach Giao Khoa khoi  6.pdf1029-Danh muc Sach Giao Khoa khoi  6.pdf
1029-Danh muc Sach Giao Khoa khoi 6.pdf
 
Beyond the EU: DORA and NIS 2 Directive's Global Impact
Beyond the EU: DORA and NIS 2 Directive's Global ImpactBeyond the EU: DORA and NIS 2 Directive's Global Impact
Beyond the EU: DORA and NIS 2 Directive's Global Impact
 
Ecological Succession. ( ECOSYSTEM, B. Pharmacy, 1st Year, Sem-II, Environmen...
Ecological Succession. ( ECOSYSTEM, B. Pharmacy, 1st Year, Sem-II, Environmen...Ecological Succession. ( ECOSYSTEM, B. Pharmacy, 1st Year, Sem-II, Environmen...
Ecological Succession. ( ECOSYSTEM, B. Pharmacy, 1st Year, Sem-II, Environmen...
 
Accessible design: Minimum effort, maximum impact
Accessible design: Minimum effort, maximum impactAccessible design: Minimum effort, maximum impact
Accessible design: Minimum effort, maximum impact
 
INDIA QUIZ 2024 RLAC DELHI UNIVERSITY.pptx
INDIA QUIZ 2024 RLAC DELHI UNIVERSITY.pptxINDIA QUIZ 2024 RLAC DELHI UNIVERSITY.pptx
INDIA QUIZ 2024 RLAC DELHI UNIVERSITY.pptx
 
Paris 2024 Olympic Geographies - an activity
Paris 2024 Olympic Geographies - an activityParis 2024 Olympic Geographies - an activity
Paris 2024 Olympic Geographies - an activity
 
The basics of sentences session 2pptx copy.pptx
The basics of sentences session 2pptx copy.pptxThe basics of sentences session 2pptx copy.pptx
The basics of sentences session 2pptx copy.pptx
 
Sports & Fitness Value Added Course FY..
Sports & Fitness Value Added Course FY..Sports & Fitness Value Added Course FY..
Sports & Fitness Value Added Course FY..
 
Código Creativo y Arte de Software | Unidad 1
Código Creativo y Arte de Software | Unidad 1Código Creativo y Arte de Software | Unidad 1
Código Creativo y Arte de Software | Unidad 1
 
Activity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdfActivity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdf
 
Basic Civil Engineering first year Notes- Chapter 4 Building.pptx
Basic Civil Engineering first year Notes- Chapter 4 Building.pptxBasic Civil Engineering first year Notes- Chapter 4 Building.pptx
Basic Civil Engineering first year Notes- Chapter 4 Building.pptx
 
SECOND SEMESTER TOPIC COVERAGE SY 2023-2024 Trends, Networks, and Critical Th...
SECOND SEMESTER TOPIC COVERAGE SY 2023-2024 Trends, Networks, and Critical Th...SECOND SEMESTER TOPIC COVERAGE SY 2023-2024 Trends, Networks, and Critical Th...
SECOND SEMESTER TOPIC COVERAGE SY 2023-2024 Trends, Networks, and Critical Th...
 
Explore beautiful and ugly buildings. Mathematics helps us create beautiful d...
Explore beautiful and ugly buildings. Mathematics helps us create beautiful d...Explore beautiful and ugly buildings. Mathematics helps us create beautiful d...
Explore beautiful and ugly buildings. Mathematics helps us create beautiful d...
 
Mattingly "AI & Prompt Design: The Basics of Prompt Design"
Mattingly "AI & Prompt Design: The Basics of Prompt Design"Mattingly "AI & Prompt Design: The Basics of Prompt Design"
Mattingly "AI & Prompt Design: The Basics of Prompt Design"
 
How to Give a Domain for a Field in Odoo 17
How to Give a Domain for a Field in Odoo 17How to Give a Domain for a Field in Odoo 17
How to Give a Domain for a Field in Odoo 17
 
Mattingly "AI & Prompt Design: Structured Data, Assistants, & RAG"
Mattingly "AI & Prompt Design: Structured Data, Assistants, & RAG"Mattingly "AI & Prompt Design: Structured Data, Assistants, & RAG"
Mattingly "AI & Prompt Design: Structured Data, Assistants, & RAG"
 

Complex Valued Long Short Term Memory Based Architecture for Frequency Domain Photoacoustic Imaging.pdf

  • 1. Complex Valued Long Short Term Memory Based Architecture for Frequency Domain Photoacoustic Imaging Abstract Frequency domain photoacoustic (FDPA) imaging has great potential in a clinical setting compared to time reduced cost and small form factors. However FDPA system struggles with lower signal to noise ratio, necessitating the need for advanced image reconstruction methods. Most of the image reconstruction approaches in FDPA imaging are based emphasis has been placed on developing deep learning based approaches for FDPA imaging. In this work, a image translation network was developed with the ability to directly map from sinogram data (complex initial pressure rise distribution (real architecture was based on a Long Short Term Memory (LSTM) backbone (with adjoined real and imaginary parts of the complex sinogram data as Complex Valued Long Short Term Memory Based Architecture for Frequency Domain Photoacoustic Frequency domain photoacoustic (FDPA) imaging has great potential in a clinical setting compared to time-domain photoacoustic imaging due to its reduced cost and small form factors. However FDPA system struggles with lower signal to noise ratio, necessitating the need for advanced image reconstruction methods. Most of the image reconstruction approaches in FDPA imaging are based on analytical or model based schemes. Very less emphasis has been placed on developing deep learning based approaches for FDPA imaging. In this work, a image translation network was developed with the ability to directly map from sinogram data (complex-va initial pressure rise distribution (real-valued) for FD-PA imaging. This architecture was based on a Long Short Term Memory (LSTM) backbone (with adjoined real and imaginary parts of the complex sinogram data as Complex Valued Long Short Term Frequency Domain Photoacoustic Frequency domain photoacoustic (FDPA) imaging has great potential in a imaging due to its reduced cost and small form factors. However FDPA system struggles with lower signal to noise ratio, necessitating the need for advanced image reconstruction methods. Most of the image reconstruction approaches in on analytical or model based schemes. Very less emphasis has been placed on developing deep learning based approaches for FDPA imaging. In this work, a image translation network was developed valued) to the PA imaging. This architecture was based on a Long Short Term Memory (LSTM) backbone (with adjoined real and imaginary parts of the complex sinogram data as
  • 2. input) followed by a fully connected layer, which is then passed through a convolution and transposed convolution layer pair. The result of the FDPA- LSTM architecture was compared with direct translational networks based on ResNet, UNet and AUTOMAP and found to have an improvement of about 15% in terms of PSNR and 10% in terms of SSIM with 150∘ data acquisition limited-view angle. Further, the FDPA-LSTM was also compared with post- processing UNet architecture on backprojection and Tikhonov regularized reconstruction. A 20% improvement in terms of PSNR with backprojection and post-processing UNet was observed. Further FDPA-LSTM had similar performance as Tikhonov and post-processing UNet (with 75 times acceleration). The developed scheme will indeed be very useful for achieving accelerated and accurate frequency domain photoacoustic imaging.