Blind deconvolution refers to the process of recovering the original image from the blurred image when the blur kernel is unknown. This is an ill-posed problem which requires regularization to solve. The naive MAP approach for solving the blind deconvolution problem was found to favour no-blur solution which in turn led to its failure. It is noted that the success of the further developed successful MAP based deblurring methods is due to the intermediate steps in between, which produces an image containing only salient image structures. This intermediate image is essentially called the unnatural representation of the image. L0 sparse expression can be used as the regularization term to effectively develop an efficient optimization method that generates unnatural representation of an image for kernel estimation. Further, the standard deblurring methods are affected by the presence of image noise. A directional filter incorporated as an initial step to the deblurring process makes the method efficient to be used for blurry as well as noisy images. Directional filtering along with L0 sparse regularization gives a good kernel estimate in spite of the image being noisy. In the final image restoration step, a method to give a better result with lesser artifacts is incorporated. Experimental results show that the proposed method recovers a good quality image from a blurry and noisy image.
[G4]image deblurring, seeing the invisibleNAVER D2
This document summarizes a paper on text image deblurring. It begins by noting the difficulties in deblurring text images compared to natural images due to their different statistical properties and spatially regulated text. The paper introduces a new optimization framework that exploits desired general properties of text images, such as high contrasts along text boundaries and near-uniform character colors. The deblurring algorithm estimates the latent image, computes an auxiliary reference image to reflect the text properties, then estimates the blur kernel and performs a final deconvolution. Key steps include computing the latent image using the reference image as guidance, then refining the reference image to better satisfy the text image properties. This framework incorporates domain-specific text properties to improve deblurring over
This document summarizes a research paper that proposes an improved deconvolution algorithm to estimate blood flow velocity in nailfold vessels more accurately. The paper describes limitations in existing algorithms related to blurring and proposes using deconvolution and other image enhancement techniques. Results show the new algorithm takes less time (20-21 seconds vs 42-43 seconds) and tracks particle movement more accurately, allowing more precise flow measurements. This helps diagnosis of diseases. Future work could involve additional segmentation and machine learning to further automate and improve reliability.
Multi Image Deblurring using Complementary Sets of Fluttering Patterns by Mul...IRJET Journal
This document discusses a proposed method for multi-image deblurring using complementary sets of fluttering patterns and an alternating direction multiplier method. Existing methods for coded exposure and multi-image deblurring have limitations like generating complex fluttering patterns, low signal-to-noise ratio, and loss of spectral information. The proposed method uses a multiplier algorithm to optimize a latent image and generate simple binary fluttering patterns for single or multiple input images. This helps reduce spectral loss and recover spatially consistent deblurred images with minimum noise. The method involves preprocessing the input image, setting regularization parameters, performing deconvolution iteratively using matrices, and outputting a deblurred image with sharp details and low noise.
Image deblurring based on spectral measures of whitenessijma
Image Deblurring is an ill-posed inverse problem used to reconstruct the sharp image from the unknown
blurred image. This process involves restoration of high frequency information from the blurred image. It
includes a learning technique which initially focuses on the main edges of the image and then gradually
takes details into account. As blind image deblurring is ill-posed, it has infinite number of solutions leading
to an ill-conditioned blur operator. So regularization or prior knowledge on both the unknown image and
the blur operator is needed to address this problem. The performance of this optimization problem depends
on the regularization parameter and the iteration number. In already existing methods the iterations have
to be manually stopped. In this paper, a new idea is proposed to regulate the number of iterations and the
regularization parameter automatically. The proposed criteria yields, on average, an ISNR only 0.38dB
below what is obtained by manual stopping. The results obtained with synthetically blurred images are
good and considerable, even when the blur operator is ill-conditioned and the blurred image is noisy.
Canny Edge Detection Algorithm on FPGA IOSR Journals
This document summarizes the implementation of the Canny edge detection algorithm on an FPGA. It begins with an introduction to edge detection and digital image processing. It then describes the high-level implementation of the Canny algorithm using Simulink. The design and system-level block diagram of the implementation on an FPGA is shown, including loading an input image and displaying the output. Simulation and synthesis results are presented, showing the resource utilization on a Spartan 3E FPGA board. The implementation provides real-time edge detection to interface an FPGA with a monitor.
IRJET- Pre-Denoising, Deblurring and Ringing Artifacts Removal of Natural, Te...IRJET Journal
This document presents a method for pre-processing images by performing denoising, deblurring, and removal of ringing artifacts sequentially. Denoising is done using total variation minimization to remove salt and pepper noise while preserving image details. Deblurring is performed using an iterative algorithm that estimates the point spread function and performs deconvolution with an intensity and gradient prior to remove blurring. Ringing artifacts are suppressed using Laplacian priors and bilateral filtering. The proposed method is evaluated on test images and results show it can effectively denoise, deblur, and remove artifacts from images without needing edge selection or pre-processing.
This document describes a new method for analyzing infant spontaneous motor patterns using a Kinect sensor and tracking algorithm. The Kinect is used to record 3D video of infants' limbs in motion without any body markers. Custom software then tracks limb positions over time and calculates kinematic measures like velocity and movement units. Initial results show the method can accurately capture and quantify limb movements and correlations between limbs. The goal is to use this non-invasive tracking to study developmental changes in infants' movement patterns from 2-24 weeks of age.
[G4]image deblurring, seeing the invisibleNAVER D2
This document summarizes a paper on text image deblurring. It begins by noting the difficulties in deblurring text images compared to natural images due to their different statistical properties and spatially regulated text. The paper introduces a new optimization framework that exploits desired general properties of text images, such as high contrasts along text boundaries and near-uniform character colors. The deblurring algorithm estimates the latent image, computes an auxiliary reference image to reflect the text properties, then estimates the blur kernel and performs a final deconvolution. Key steps include computing the latent image using the reference image as guidance, then refining the reference image to better satisfy the text image properties. This framework incorporates domain-specific text properties to improve deblurring over
This document summarizes a research paper that proposes an improved deconvolution algorithm to estimate blood flow velocity in nailfold vessels more accurately. The paper describes limitations in existing algorithms related to blurring and proposes using deconvolution and other image enhancement techniques. Results show the new algorithm takes less time (20-21 seconds vs 42-43 seconds) and tracks particle movement more accurately, allowing more precise flow measurements. This helps diagnosis of diseases. Future work could involve additional segmentation and machine learning to further automate and improve reliability.
Multi Image Deblurring using Complementary Sets of Fluttering Patterns by Mul...IRJET Journal
This document discusses a proposed method for multi-image deblurring using complementary sets of fluttering patterns and an alternating direction multiplier method. Existing methods for coded exposure and multi-image deblurring have limitations like generating complex fluttering patterns, low signal-to-noise ratio, and loss of spectral information. The proposed method uses a multiplier algorithm to optimize a latent image and generate simple binary fluttering patterns for single or multiple input images. This helps reduce spectral loss and recover spatially consistent deblurred images with minimum noise. The method involves preprocessing the input image, setting regularization parameters, performing deconvolution iteratively using matrices, and outputting a deblurred image with sharp details and low noise.
Image deblurring based on spectral measures of whitenessijma
Image Deblurring is an ill-posed inverse problem used to reconstruct the sharp image from the unknown
blurred image. This process involves restoration of high frequency information from the blurred image. It
includes a learning technique which initially focuses on the main edges of the image and then gradually
takes details into account. As blind image deblurring is ill-posed, it has infinite number of solutions leading
to an ill-conditioned blur operator. So regularization or prior knowledge on both the unknown image and
the blur operator is needed to address this problem. The performance of this optimization problem depends
on the regularization parameter and the iteration number. In already existing methods the iterations have
to be manually stopped. In this paper, a new idea is proposed to regulate the number of iterations and the
regularization parameter automatically. The proposed criteria yields, on average, an ISNR only 0.38dB
below what is obtained by manual stopping. The results obtained with synthetically blurred images are
good and considerable, even when the blur operator is ill-conditioned and the blurred image is noisy.
Canny Edge Detection Algorithm on FPGA IOSR Journals
This document summarizes the implementation of the Canny edge detection algorithm on an FPGA. It begins with an introduction to edge detection and digital image processing. It then describes the high-level implementation of the Canny algorithm using Simulink. The design and system-level block diagram of the implementation on an FPGA is shown, including loading an input image and displaying the output. Simulation and synthesis results are presented, showing the resource utilization on a Spartan 3E FPGA board. The implementation provides real-time edge detection to interface an FPGA with a monitor.
IRJET- Pre-Denoising, Deblurring and Ringing Artifacts Removal of Natural, Te...IRJET Journal
This document presents a method for pre-processing images by performing denoising, deblurring, and removal of ringing artifacts sequentially. Denoising is done using total variation minimization to remove salt and pepper noise while preserving image details. Deblurring is performed using an iterative algorithm that estimates the point spread function and performs deconvolution with an intensity and gradient prior to remove blurring. Ringing artifacts are suppressed using Laplacian priors and bilateral filtering. The proposed method is evaluated on test images and results show it can effectively denoise, deblur, and remove artifacts from images without needing edge selection or pre-processing.
This document describes a new method for analyzing infant spontaneous motor patterns using a Kinect sensor and tracking algorithm. The Kinect is used to record 3D video of infants' limbs in motion without any body markers. Custom software then tracks limb positions over time and calculates kinematic measures like velocity and movement units. Initial results show the method can accurately capture and quantify limb movements and correlations between limbs. The goal is to use this non-invasive tracking to study developmental changes in infants' movement patterns from 2-24 weeks of age.
This document discusses representation in low-level visual learning. It summarizes that most visual learning has used overly simplified models and representation matters. It then reviews several approaches for tasks like image segmentation, optical flow estimation, and motion modeling that use more sophisticated representations like Markov random fields, probabilistic graphical models, and layered models that explicitly model occlusion. The document argues these approaches that incorporate spatial context and multi-scale representations have achieved better performance than early simplified models on tasks like image segmentation, optical flow estimation, and motion modeling.
26.motion and feature based person trackingsajit1975
This paper proposes a method for tracking people in indoor surveillance videos with challenges like illumination changes and occlusions. It uses background subtraction to detect moving objects and extracts color features to distinguish between occluded objects. The method tracks people by matching color clusters between frames and handles occlusions by using color information to accurately assign unique tags to each tracked person. Experiments on PETS dataset demonstrate the effectiveness of using color features for occlusion handling and person tracking in challenging indoor scenes.
This document summarizes a research paper on efficient noise removal from images using a combination of non-local means filtering and wavelet packet thresholding of the method noise. It begins with an introduction to image denoising and an overview of common denoising methods. It then describes non-local means filtering and how it removes noise while preserving image details. However, at high noise levels, non-local means filtering can also blur some image details. The document proposes analyzing the method noise obtained from subtracting the non-local means filtered image from the noisy image. This method noise contains both noise and removed image details. Applying wavelet packet thresholding to the method noise can help recover some of the removed image details. The combined
Demo Videos: www.larry-lai.com/tracking.html
A real-time object tracking algorithm is proposed to cope with the variables of appearance changes like translation, zooming, rotation, panning/tilting, occlusion, luminance change, and blur. The proposed tracking scheme includes three steps. First, regional filter is employed to detect the candidate regions of targets. Next, these candidate regions are scaled to an uniform size for feature extraction. Finally, using feature matching to calculate the similarity between an instance and the target, and then store this instance if recognized as the target. We can see that the instance database would contain object's difference appearances as the tracking time going on. In other words, recognition capability will increase while the database become enlarging. To keep high computation performance, an algorithm with database reduction is proposed to limit the size of database. From our experiments, the proposed tracking system can achieve 30 FPS with resolution 1280x720 on an Intel I5 CPU 2.6GHz.
Image Resolution Enhancement by using Wavelet TransformIRJET Journal
This document presents a technique for enhancing the resolution of low resolution images using wavelet transforms. It decomposes low resolution images into sub-bands using discrete wavelet transform (DWT) and stationary wavelet transform (SWT). The high frequency sub-bands produced by DWT are interpolated and corrected using the high frequency sub-bands from SWT. An inverse DWT is then applied to combine the interpolated sub-bands and produce a higher resolution output image. The technique is compared to conventional methods like bilinear and bicubic interpolation as well as state-of-the-art resolution enhancement techniques. It is shown to produce higher quality results measured using metrics like peak signal-to-noise ratio. The technique has applications in
발표자: 전석준(KAIST 박사과정)
발표일: 2018.8.
Super-resolution은 저해상도 이미지를 고해상도 이미지로 변환시키는 기술로 오랜기간 연구되어 온 주제입니다. 최근 딥러닝 기술이 적용됨에 따라 super-resolution 성능이 비약적으로 향상되었습니다. 저희는 스테레오 이미지를 이용하여 더 높은 해상도의 이미지를 얻는 기술을 개발하였습니다. 이에 관련 내용을 발표하고자 합니다.
1. Multi-Frame Super-Resolution
2. Learning-Based Super-Resolution
3. Stereo Imaging
4. Deep-Learning Based Stereo Super-Resolution
This document discusses atmospheric turbulence degraded image restoration using back propagation neural network. It proposes using a feed-forward neural network with 20 hidden layers and one output layer trained with backpropagation to restore images degraded by atmospheric turbulence and noise. The network is trained on normalized input images and tested on blurred images. Results show the proposed method achieves higher PSNR values than other techniques like kurtosis minimization and PCA, indicating better image quality restoration. Future work may incorporate median filtering and using first order image features for network weight assignment.
AI+ Remote Sensing: Applying Deep Learning to Image Enhancement, Analytics, a...Jui-Hsin (Larry) Lai
A Keynote Speech in DigitalWorld Congress 2021.
Youtube Video https://www.youtube.com/watch?v=FdUyaUJTYLY
In this talk, we introduce our proposed AI+ Remote Sensing techniques from the Research Lab of Ping An Technology. One of the techniques is our deep learning haze removal model which can effectively remove the interference of haze in the satellite images and observe the true ground reflectance. Next, we introduce our super-resolution model which can enhance 4x image details. The SR model has been deployed to the Sentinel-2 satellite imagery and greatly improve its image quality. Last, we introduce our crop recognition system. The system includes a user interface for a user to label a few of training samples, and the proposed crop recognition model can be trained on the fly to be deployed on a broad geo-area immediately. In addition to the techniques, our AI+ Remote Sensing technologies have been supporting the carbon(CO2) emission analysis for Environment, Society, and Government(ESG) Department, flooding and disaster analysis for Smart City Department, and crop field forecast for Investment Department in Ping An Group.
In this talk, we introduce our proposed AI+ Remote Sensing techniques from the Research Lab of Ping An Technology. One of the techniques is our deep learning haze removal model which can effectively remove the interference of haze in the satellite images and observe the true ground reflectance. Next, we introduce our super-resolution model which can enhance 4x image details. The SR model has been deployed to the Sentinel-2 satellite imagery and greatly improve its image quality. Last, we introduce our crop recognition system. The system includes a user interface for a user to label a few of training samples, and the proposed crop recognition model can be trained on the fly to be deployed on a broad geo-area immediately. In addition to the techniques, our AI+ Remote Sensing technologies have been supporting the carbon(CO2) emission analysis for Environment, Society, and Government(ESG) Department, flooding and disaster analysis for Smart City Department, and crop field forecast for Investment Department in Ping An Group.
Parametric Blur Estimation Using Modified Radon Transform for Natural Images Restoration Vedhapriya Vadhana R – Associate Professor,
Department of ECE,
Maheswari E – PG scholar,
VLSI DESIGN,
Francis Xavier Engineering College, Tirunelveli,India
A NOVEL ALGORITHM FOR IMAGE DENOISING USING DT-CWT sipij
This paper addresses image enhancement system consisting of image denoising technique based on Dual Tree Complex Wavelet Transform (DT-CWT) . The proposed algorithm at the outset models the noisy remote sensing image (NRSI) statistically by aptly amalgamating the structural features and textures from it. This statistical model is decomposed using DTCWT with Tap-10 or length-10 filter banks based on
Farras wavelet implementation and sub band coefficients are suitably modeled to denoise with a method which is efficiently organized by combining the clustering techniques with soft thresholding - softclustering technique. The clustering techniques classify the noisy and image pixels based on the
neighborhood connected component analysis(CCA), connected pixel analysis and inter-pixel intensity variance (IPIV) and calculate an appropriate threshold value for noise removal. This threshold value is used with soft thresholding technique to denoise the image .Experimental results shows that that the
proposed technique outperforms the conventional and state-of-the-art techniques .It is also evaluated that the denoised images using DTCWT (Dual Tree Complex Wavelet Transform) is better balance between smoothness and accuracy than the DWT.. We used the PSNR (Peak Signal to Noise Ratio) along with
RMSE to assess the quality of denoised images.
(Paper Review) Reconstruction of Monte Carlo Image Sequences using a Recurren...MYEONGGYU LEE
review date: 2019/07/26 (by Meyong-Gyu.LEE @Soongsil Univ.)
Eng+Kor review of 'Reconstruction of Monte Carlo Image Sequences using a Recurrent Denoising Autoencoder' (Siggraph 2017)
This document provides an overview of a digital image processing lecture given by Dr. Moe Moe Myint at Technological University in Kyaukse, Myanmar. It includes information about the instructor's contact information and office hours. The document then summarizes the contents of Chapter 2, which covers topics like visual perception, light and the electromagnetic spectrum, image sensing and acquisition, and basic relationships between pixels. Examples and diagrams are provided to illustrate concepts like the structure of the human eye, image formation, brightness adaptation, and the electromagnetic spectrum. Optical illusions are also discussed as examples of how visual perception does not always match physical stimuli.
An Object Detection, Tracking And Parametric Classification– A ReviewIRJET Journal
This document summarizes object detection techniques for video processing. It discusses how object detection is the first and important step for any video analysis. It then reviews several approaches for object detection, including background subtraction, frame differencing, optical flow, and temporal differencing. The document also summarizes trends in object detection techniques presented in various research papers from 2009 to 2014, highlighting advantages and limitations of the different approaches.
[CVPR2020] Simple but effective image enhancement techniquesJaeJun Yoo
The document discusses several image enhancement techniques:
1. WCT2, which uses wavelet transforms for photorealistic style transfer, achieving faster and lighter models than previous techniques.
2. CutBlur, a new data augmentation method that improves performance on super-resolution and other low-level vision tasks by adding blur and cutting patches from images.
3. SimUSR, a simple but strong baseline for unsupervised super-resolution that achieves state-of-the-art results using only a single low-resolution image during training.
Nexgen Technology Address:
Nexgen Technology
No :66,4th cross,Venkata nagar,
Near SBI ATM,
Puducherry.
Email Id: praveen@nexgenproject.com.
www.nexgenproject.com
Mobile: 9751442511,9791938249
Telephone: 0413-2211159.
NEXGEN TECHNOLOGY as an efficient Software Training Center located at Pondicherry with IT Training on IEEE Projects in Android,IEEE IT B.Tech Student Projects, Android Projects Training with Placements Pondicherry, IEEE projects in pondicherry, final IEEE Projects in Pondicherry , MCA, BTech, BCA Projects in Pondicherry, Bulk IEEE PROJECTS IN Pondicherry.So far we have reached almost all engineering colleges located in Pondicherry and around 90km
IRJET- A Review on Various Restoration Techniques in Digital Image ProcessingIRJET Journal
The document reviews various image restoration techniques used for removing noise and blurring from digital images. It discusses techniques like median filtering, Wiener filtering, and Lucy Richardson algorithms. It provides an overview of each technique, including their advantages and limitations. The document also reviews several research papers that propose modifications to existing techniques or new methods for tasks like salt-and-pepper noise removal. The reviewed papers found that their proposed methods improved restoration quality over other techniques, achieving higher PSNR values and producing images that looked visually sharper and more distinct.
Satellite Image Resolution Enhancement Technique Using DWT and IWTEditor IJCATR
Now a days satellite images are widely used In many applications such as astronomy and
geographical information systems and geosciences studies .In this paper, We propose a new satellite image
resolution enhancement technique which generates sharper high resolution image .Based on the high
frequency sub-bands obtained from the dwt and iwt. We are not considering the LL sub-band here. In this
resolution-enhancement technique using interpolated DWT and IWT high-frequency sub band images and the
input low-resolution image. Inverse DWT (IDWT) has been applied to combine all these images to generate
the final resolution-enhanced image. The proposed technique has been tested on satellite bench mark images.
The quantitative (peak signal to noise ratio and mean square error) and visual results show the superiority of
the proposed technique over the conventional method and standard image enhancement technique WZP.
VIDEO SEGMENTATION & SUMMARIZATION USING MODIFIED GENETIC ALGORITHMijcsa
Video summarization of the segmented video is an essential process for video thumbnails, video surveillance and video downloading. Summarization deals with extracting few frames from each scene and creating a summary video which explains all course of action of full video with in short duration of time. The proposed research work discusses about the segmentation and summarization of the frames. A genetic algorithm (GA) for segmentation and summarization is required to view the highlight of an event by selecting few important frames required. The GA is modified to select only key frames for summarization and the comparison of modified GA is done with the GA.
Uniform and non uniform single image deblurring based on sparse representatio...ijma
Considering the sparseness property of images, a sparse representation based iterative deblurring method
is presented for single image deblurring under uniform and non-uniform motion blur. The approach taken
is based on sparse and redundant representations over adaptively training dictionaries from single
blurred-noisy image itself. Further, the K-SVD algorithm is used to obtain a dictionary that describes the
image contents effectively. Comprehensive experimental evaluation demonstrate that the proposed
framework integrating the sparseness property of images, adaptive dictionary training and iterative
deblurring scheme together significantly improves the deblurring performance and is comparable with the
state-of-the art deblurring algorithms and seeks a powerful solution to an ill-conditioned inverse problem.
Image Deblurring Based on Spectral Measures of Whitenessijma
Image Deblurring is an ill-posed inverse problem used to reconstruct the sharp image from the unknown
blurred image. This process involves restoration of high frequency information from the blurred image. It
includes a learning technique which initially focuses on the main edges of the image and then gradually
takes details into account. As blind image deblurring is ill-posed, it has infinite number of solutions leading
to an ill-conditioned blur operator. So regularization or prior knowledge on both the unknown image and
the blur operator is needed to address this problem. The performance of this optimization problem depends
on the regularization parameter and the iteration number. In already existing methods the iterations have
to be manually stopped. In this paper, a new idea is proposed to regulate the number of iterations and the
regularization parameter automatically. The proposed criteria yields, on average, an ISNR only 0.38dB
below what is obtained by manual stopping. The results obtained with synthetically blurred images are
good and considerable, even when the blur operator is ill-conditioned and the blurred image is noisy
Image restoration model with wavelet based fusionAlexander Decker
1. The document discusses various techniques for image restoration, which aims to recover a sharp original image from a degraded one using mathematical models of degradation and restoration.
2. It analyzes techniques like deconvolution using Lucy Richardson algorithm, Wiener filter, regularized filter, and blind image deconvolution on different image formats based on metrics like PSNR, MSE, and RMSE.
3. Previous studies have applied techniques like Wiener filtering, wavelet-based fusion, and iterative blind deconvolution for motion blur restoration and compared their performance.
This document discusses representation in low-level visual learning. It summarizes that most visual learning has used overly simplified models and representation matters. It then reviews several approaches for tasks like image segmentation, optical flow estimation, and motion modeling that use more sophisticated representations like Markov random fields, probabilistic graphical models, and layered models that explicitly model occlusion. The document argues these approaches that incorporate spatial context and multi-scale representations have achieved better performance than early simplified models on tasks like image segmentation, optical flow estimation, and motion modeling.
26.motion and feature based person trackingsajit1975
This paper proposes a method for tracking people in indoor surveillance videos with challenges like illumination changes and occlusions. It uses background subtraction to detect moving objects and extracts color features to distinguish between occluded objects. The method tracks people by matching color clusters between frames and handles occlusions by using color information to accurately assign unique tags to each tracked person. Experiments on PETS dataset demonstrate the effectiveness of using color features for occlusion handling and person tracking in challenging indoor scenes.
This document summarizes a research paper on efficient noise removal from images using a combination of non-local means filtering and wavelet packet thresholding of the method noise. It begins with an introduction to image denoising and an overview of common denoising methods. It then describes non-local means filtering and how it removes noise while preserving image details. However, at high noise levels, non-local means filtering can also blur some image details. The document proposes analyzing the method noise obtained from subtracting the non-local means filtered image from the noisy image. This method noise contains both noise and removed image details. Applying wavelet packet thresholding to the method noise can help recover some of the removed image details. The combined
Demo Videos: www.larry-lai.com/tracking.html
A real-time object tracking algorithm is proposed to cope with the variables of appearance changes like translation, zooming, rotation, panning/tilting, occlusion, luminance change, and blur. The proposed tracking scheme includes three steps. First, regional filter is employed to detect the candidate regions of targets. Next, these candidate regions are scaled to an uniform size for feature extraction. Finally, using feature matching to calculate the similarity between an instance and the target, and then store this instance if recognized as the target. We can see that the instance database would contain object's difference appearances as the tracking time going on. In other words, recognition capability will increase while the database become enlarging. To keep high computation performance, an algorithm with database reduction is proposed to limit the size of database. From our experiments, the proposed tracking system can achieve 30 FPS with resolution 1280x720 on an Intel I5 CPU 2.6GHz.
Image Resolution Enhancement by using Wavelet TransformIRJET Journal
This document presents a technique for enhancing the resolution of low resolution images using wavelet transforms. It decomposes low resolution images into sub-bands using discrete wavelet transform (DWT) and stationary wavelet transform (SWT). The high frequency sub-bands produced by DWT are interpolated and corrected using the high frequency sub-bands from SWT. An inverse DWT is then applied to combine the interpolated sub-bands and produce a higher resolution output image. The technique is compared to conventional methods like bilinear and bicubic interpolation as well as state-of-the-art resolution enhancement techniques. It is shown to produce higher quality results measured using metrics like peak signal-to-noise ratio. The technique has applications in
발표자: 전석준(KAIST 박사과정)
발표일: 2018.8.
Super-resolution은 저해상도 이미지를 고해상도 이미지로 변환시키는 기술로 오랜기간 연구되어 온 주제입니다. 최근 딥러닝 기술이 적용됨에 따라 super-resolution 성능이 비약적으로 향상되었습니다. 저희는 스테레오 이미지를 이용하여 더 높은 해상도의 이미지를 얻는 기술을 개발하였습니다. 이에 관련 내용을 발표하고자 합니다.
1. Multi-Frame Super-Resolution
2. Learning-Based Super-Resolution
3. Stereo Imaging
4. Deep-Learning Based Stereo Super-Resolution
This document discusses atmospheric turbulence degraded image restoration using back propagation neural network. It proposes using a feed-forward neural network with 20 hidden layers and one output layer trained with backpropagation to restore images degraded by atmospheric turbulence and noise. The network is trained on normalized input images and tested on blurred images. Results show the proposed method achieves higher PSNR values than other techniques like kurtosis minimization and PCA, indicating better image quality restoration. Future work may incorporate median filtering and using first order image features for network weight assignment.
AI+ Remote Sensing: Applying Deep Learning to Image Enhancement, Analytics, a...Jui-Hsin (Larry) Lai
A Keynote Speech in DigitalWorld Congress 2021.
Youtube Video https://www.youtube.com/watch?v=FdUyaUJTYLY
In this talk, we introduce our proposed AI+ Remote Sensing techniques from the Research Lab of Ping An Technology. One of the techniques is our deep learning haze removal model which can effectively remove the interference of haze in the satellite images and observe the true ground reflectance. Next, we introduce our super-resolution model which can enhance 4x image details. The SR model has been deployed to the Sentinel-2 satellite imagery and greatly improve its image quality. Last, we introduce our crop recognition system. The system includes a user interface for a user to label a few of training samples, and the proposed crop recognition model can be trained on the fly to be deployed on a broad geo-area immediately. In addition to the techniques, our AI+ Remote Sensing technologies have been supporting the carbon(CO2) emission analysis for Environment, Society, and Government(ESG) Department, flooding and disaster analysis for Smart City Department, and crop field forecast for Investment Department in Ping An Group.
In this talk, we introduce our proposed AI+ Remote Sensing techniques from the Research Lab of Ping An Technology. One of the techniques is our deep learning haze removal model which can effectively remove the interference of haze in the satellite images and observe the true ground reflectance. Next, we introduce our super-resolution model which can enhance 4x image details. The SR model has been deployed to the Sentinel-2 satellite imagery and greatly improve its image quality. Last, we introduce our crop recognition system. The system includes a user interface for a user to label a few of training samples, and the proposed crop recognition model can be trained on the fly to be deployed on a broad geo-area immediately. In addition to the techniques, our AI+ Remote Sensing technologies have been supporting the carbon(CO2) emission analysis for Environment, Society, and Government(ESG) Department, flooding and disaster analysis for Smart City Department, and crop field forecast for Investment Department in Ping An Group.
Parametric Blur Estimation Using Modified Radon Transform for Natural Images Restoration Vedhapriya Vadhana R – Associate Professor,
Department of ECE,
Maheswari E – PG scholar,
VLSI DESIGN,
Francis Xavier Engineering College, Tirunelveli,India
A NOVEL ALGORITHM FOR IMAGE DENOISING USING DT-CWT sipij
This paper addresses image enhancement system consisting of image denoising technique based on Dual Tree Complex Wavelet Transform (DT-CWT) . The proposed algorithm at the outset models the noisy remote sensing image (NRSI) statistically by aptly amalgamating the structural features and textures from it. This statistical model is decomposed using DTCWT with Tap-10 or length-10 filter banks based on
Farras wavelet implementation and sub band coefficients are suitably modeled to denoise with a method which is efficiently organized by combining the clustering techniques with soft thresholding - softclustering technique. The clustering techniques classify the noisy and image pixels based on the
neighborhood connected component analysis(CCA), connected pixel analysis and inter-pixel intensity variance (IPIV) and calculate an appropriate threshold value for noise removal. This threshold value is used with soft thresholding technique to denoise the image .Experimental results shows that that the
proposed technique outperforms the conventional and state-of-the-art techniques .It is also evaluated that the denoised images using DTCWT (Dual Tree Complex Wavelet Transform) is better balance between smoothness and accuracy than the DWT.. We used the PSNR (Peak Signal to Noise Ratio) along with
RMSE to assess the quality of denoised images.
(Paper Review) Reconstruction of Monte Carlo Image Sequences using a Recurren...MYEONGGYU LEE
review date: 2019/07/26 (by Meyong-Gyu.LEE @Soongsil Univ.)
Eng+Kor review of 'Reconstruction of Monte Carlo Image Sequences using a Recurrent Denoising Autoencoder' (Siggraph 2017)
This document provides an overview of a digital image processing lecture given by Dr. Moe Moe Myint at Technological University in Kyaukse, Myanmar. It includes information about the instructor's contact information and office hours. The document then summarizes the contents of Chapter 2, which covers topics like visual perception, light and the electromagnetic spectrum, image sensing and acquisition, and basic relationships between pixels. Examples and diagrams are provided to illustrate concepts like the structure of the human eye, image formation, brightness adaptation, and the electromagnetic spectrum. Optical illusions are also discussed as examples of how visual perception does not always match physical stimuli.
An Object Detection, Tracking And Parametric Classification– A ReviewIRJET Journal
This document summarizes object detection techniques for video processing. It discusses how object detection is the first and important step for any video analysis. It then reviews several approaches for object detection, including background subtraction, frame differencing, optical flow, and temporal differencing. The document also summarizes trends in object detection techniques presented in various research papers from 2009 to 2014, highlighting advantages and limitations of the different approaches.
[CVPR2020] Simple but effective image enhancement techniquesJaeJun Yoo
The document discusses several image enhancement techniques:
1. WCT2, which uses wavelet transforms for photorealistic style transfer, achieving faster and lighter models than previous techniques.
2. CutBlur, a new data augmentation method that improves performance on super-resolution and other low-level vision tasks by adding blur and cutting patches from images.
3. SimUSR, a simple but strong baseline for unsupervised super-resolution that achieves state-of-the-art results using only a single low-resolution image during training.
Nexgen Technology Address:
Nexgen Technology
No :66,4th cross,Venkata nagar,
Near SBI ATM,
Puducherry.
Email Id: praveen@nexgenproject.com.
www.nexgenproject.com
Mobile: 9751442511,9791938249
Telephone: 0413-2211159.
NEXGEN TECHNOLOGY as an efficient Software Training Center located at Pondicherry with IT Training on IEEE Projects in Android,IEEE IT B.Tech Student Projects, Android Projects Training with Placements Pondicherry, IEEE projects in pondicherry, final IEEE Projects in Pondicherry , MCA, BTech, BCA Projects in Pondicherry, Bulk IEEE PROJECTS IN Pondicherry.So far we have reached almost all engineering colleges located in Pondicherry and around 90km
IRJET- A Review on Various Restoration Techniques in Digital Image ProcessingIRJET Journal
The document reviews various image restoration techniques used for removing noise and blurring from digital images. It discusses techniques like median filtering, Wiener filtering, and Lucy Richardson algorithms. It provides an overview of each technique, including their advantages and limitations. The document also reviews several research papers that propose modifications to existing techniques or new methods for tasks like salt-and-pepper noise removal. The reviewed papers found that their proposed methods improved restoration quality over other techniques, achieving higher PSNR values and producing images that looked visually sharper and more distinct.
Satellite Image Resolution Enhancement Technique Using DWT and IWTEditor IJCATR
Now a days satellite images are widely used In many applications such as astronomy and
geographical information systems and geosciences studies .In this paper, We propose a new satellite image
resolution enhancement technique which generates sharper high resolution image .Based on the high
frequency sub-bands obtained from the dwt and iwt. We are not considering the LL sub-band here. In this
resolution-enhancement technique using interpolated DWT and IWT high-frequency sub band images and the
input low-resolution image. Inverse DWT (IDWT) has been applied to combine all these images to generate
the final resolution-enhanced image. The proposed technique has been tested on satellite bench mark images.
The quantitative (peak signal to noise ratio and mean square error) and visual results show the superiority of
the proposed technique over the conventional method and standard image enhancement technique WZP.
VIDEO SEGMENTATION & SUMMARIZATION USING MODIFIED GENETIC ALGORITHMijcsa
Video summarization of the segmented video is an essential process for video thumbnails, video surveillance and video downloading. Summarization deals with extracting few frames from each scene and creating a summary video which explains all course of action of full video with in short duration of time. The proposed research work discusses about the segmentation and summarization of the frames. A genetic algorithm (GA) for segmentation and summarization is required to view the highlight of an event by selecting few important frames required. The GA is modified to select only key frames for summarization and the comparison of modified GA is done with the GA.
Uniform and non uniform single image deblurring based on sparse representatio...ijma
Considering the sparseness property of images, a sparse representation based iterative deblurring method
is presented for single image deblurring under uniform and non-uniform motion blur. The approach taken
is based on sparse and redundant representations over adaptively training dictionaries from single
blurred-noisy image itself. Further, the K-SVD algorithm is used to obtain a dictionary that describes the
image contents effectively. Comprehensive experimental evaluation demonstrate that the proposed
framework integrating the sparseness property of images, adaptive dictionary training and iterative
deblurring scheme together significantly improves the deblurring performance and is comparable with the
state-of-the art deblurring algorithms and seeks a powerful solution to an ill-conditioned inverse problem.
Image Deblurring Based on Spectral Measures of Whitenessijma
Image Deblurring is an ill-posed inverse problem used to reconstruct the sharp image from the unknown
blurred image. This process involves restoration of high frequency information from the blurred image. It
includes a learning technique which initially focuses on the main edges of the image and then gradually
takes details into account. As blind image deblurring is ill-posed, it has infinite number of solutions leading
to an ill-conditioned blur operator. So regularization or prior knowledge on both the unknown image and
the blur operator is needed to address this problem. The performance of this optimization problem depends
on the regularization parameter and the iteration number. In already existing methods the iterations have
to be manually stopped. In this paper, a new idea is proposed to regulate the number of iterations and the
regularization parameter automatically. The proposed criteria yields, on average, an ISNR only 0.38dB
below what is obtained by manual stopping. The results obtained with synthetically blurred images are
good and considerable, even when the blur operator is ill-conditioned and the blurred image is noisy
Image restoration model with wavelet based fusionAlexander Decker
1. The document discusses various techniques for image restoration, which aims to recover a sharp original image from a degraded one using mathematical models of degradation and restoration.
2. It analyzes techniques like deconvolution using Lucy Richardson algorithm, Wiener filter, regularized filter, and blind image deconvolution on different image formats based on metrics like PSNR, MSE, and RMSE.
3. Previous studies have applied techniques like Wiener filtering, wavelet-based fusion, and iterative blind deconvolution for motion blur restoration and compared their performance.
Survey on Image Integration of Misaligned ImagesIRJET Journal
The document discusses methods for integrating misaligned images to improve image quality under low lighting conditions. It reviews previous works that combine images like flash/no-flash pairs to transfer details and color, but have limitations when images are misaligned. The paper proposes a new method using a long-exposure image and flash image that introduces a local linear model to transfer color while maintaining natural colors and high contrast, without deteriorating contrast for misaligned pairs. It concludes that handling misaligned images remains a challenge with existing methods and further work is needed.
SINGLE IMAGE SUPER RESOLUTION IN SPATIAL AND WAVELET DOMAINijma
This document presents a single image super resolution algorithm that uses both spatial and wavelet domains. The algorithm takes advantage of both domains by upsampling the image in the spatial domain using bicubic interpolation, then refining the high frequency subbands in the wavelet domain. It is iterative, using back projection to minimize reconstruction error between the original low resolution image and the downsampled output. Wavelet-based denoising is applied to the high frequency subband to remove noise before reconstruction. Experimental results on various test images show the proposed algorithm achieves similar or better PSNR than other compared methods.
This document summarizes a research paper that proposes a method for denoising remote sensing images using a combination of second order and fourth order partial differential equations (PDEs). It begins by explaining how noise is introduced in images and why denoising is important. It then discusses existing denoising methods using second order and fourth order PDEs individually and their limitations. The proposed method combines the two approaches to reduce both the blocky effect of second order PDEs and the speckle effect of fourth order PDEs. Simulation results show the combined method achieves better peak signal-to-noise and signal-to-noise ratios compared to the individual methods.
This document discusses image deblurring techniques. It begins by introducing image restoration and focusing on image deblurring. It then discusses challenges with image deblurring being an ill-posed problem. It reviews existing approaches to screen image deconvolution including estimating point spread functions and iteratively estimating blur kernels and sharp images. The document also discusses handling spatially variant blur and summarizes the relationship between the proposed method and previous work for different blur types. It proposes using color filters in the aperture to exploit parallax cues for segmentation and blur estimation. Finally, it proposes moving the image sensor circularly during exposure to prevent high frequency attenuation from motion blur.
Progressive Image Denoising Through Hybrid Graph Laplacian Regularization: A ...john236zaq
The document discusses a proposed unified framework for progressively recovering images from corrupted observations through hybrid graph Laplacian regularization. The framework first constructs a multiscale representation of the target image using a Laplacian pyramid. It then progressively recovers the degraded image from coarse to fine scales, allowing for recovery of sharp edges and texture. Within each scale, a graph Laplacian regularization model is learned that minimizes error while preserving image structure. Between scales, the model is extended to a high-dimensional feature space to describe interscale correlations and propagate local structure regularity from coarser to finer scales. Experimental results on impulse noise removal demonstrate better performance than state-of-the-art algorithms.
International Journal of Engineering Research and Applications (IJERA) is a team of researchers not publication services or private publications running the journals for monetary benefits, we are association of scientists and academia who focus only on supporting authors who want to publish their work. The articles published in our journal can be accessed online, all the articles will be archived for real time access.
Our journal system primarily aims to bring out the research talent and the works done by sciaentists, academia, engineers, practitioners, scholars, post graduate students of engineering and science. This journal aims to cover the scientific research in a broader sense and not publishing a niche area of research facilitating researchers from various verticals to publish their papers. It is also aimed to provide a platform for the researchers to publish in a shorter of time, enabling them to continue further All articles published are freely available to scientific researchers in the Government agencies,educators and the general public. We are taking serious efforts to promote our journal across the globe in various ways, we are sure that our journal will act as a scientific platform for all researchers to publish their works online.
Literature Survey on Image Deblurring TechniquesEditor IJCATR
Image restoration and recognition has been of great importance nowadays. Face recognition becomes difficult when it comes
to blurred and poorly illuminated images and it is here face recognition and restoration come to picture. There have been many
methods that were proposed in this regard and in this paper we will examine different methods and technologies discussed so far. The
merits and demerits of different methods are discussed in this concern
The improved hybrid model for molecular image denoising, proposed by NeST Software, can give a better SNR Molecular Image output. Read more on the proposed hybrid model.
Learning Based Single Frame Image Super-resolution Using Fast Discrete Curvel...CSCJournals
High-resolution (HR) images play a vital role in all imaging applications as they offer more details. The images captured by the camera system are of degraded quality due to the imaging system and are low-resolution (LR) images. Image super-resolution (SR) is a process, where HR image is obtained from combining one or multiple LR images of same scene. In this paper, learning based single frame image super-resolution technique is proposed by using Fast Discrete Curvelet Transform (FDCT) coefficients. FDCT is an extension to Cartesian wavelets having anisotropic scaling with many directions and positions, which forms tight wedges. Such wedges allow FDCT to capture the smooth curves and fine edges at multiresolution level. The finer scale curvelet coefficients of LR image are learnt locally from a set of high-resolution training images. The super-resolved image is reconstructed by inverse Fast Discrete Curvelet Transform (IFDCT). This technique represents fine edges of reconstructed HR image by extrapolating the FDCT coefficients from the high-resolution training images. Experimentation based results show appropriate improvements in MSE and PSNR.
Fast nas rif algorithm using iterative conjugate gradient methodsipij
This summarizes a document describing the FAST NAS-RIF algorithm using an iterative conjugate gradient method for image restoration.
1) The NAS-RIF algorithm iteratively estimates image pixels and the point spread function based on the conjugate gradient method, without assuming parametric models.
2) The paper proposes updating the conjugate gradient method's parameters and objective function to improve minimization of the cost function and reduce execution time.
3) Experimental results comparing updated and original conjugate gradient parameters show improved restoration effect and higher peak signal-to-noise ratio with the updates.
International Journal of Engineering Research and Applications (IJERA) is an open access online peer reviewed international journal that publishes research and review articles in the fields of Computer Science, Neural Networks, Electrical Engineering, Software Engineering, Information Technology, Mechanical Engineering, Chemical Engineering, Plastic Engineering, Food Technology, Textile Engineering, Nano Technology & science, Power Electronics, Electronics & Communication Engineering, Computational mathematics, Image processing, Civil Engineering, Structural Engineering, Environmental Engineering, VLSI Testing & Low Power VLSI Design etc.
This document summarizes a research paper that presents an approach to deblurring noisy or blurred images using a kernel estimation algorithm. It begins by noting the challenges of capturing satisfactory photos in low light conditions using a hand-held camera, as images are often blurred or noisy. The proposed approach uses two degraded images - a blurred image taken with a slow shutter speed and low ISO, and a noisy image taken with a fast shutter speed and high ISO. It estimates an accurate blur kernel by exploiting structures in the noisy image, allowing it to handle larger kernels than single-image approaches. It then performs a residual deconvolution to greatly reduce ringing artifacts commonly resulting from image deconvolution. Additional steps further suppress artifacts, resulting in a final image that
Improvement of Image Deblurring Through Different MethodsIOSR Journals
This document summarizes and compares different methods for improving image deblurring, including deterministic filtering, Bayesian estimation, and the proposed alpha tonal correction method. Deterministic filtering can handle various blurs but performance depends on local image features. Bayesian estimation is constrained by specific blur models and sample size. The proposed alpha tonal correction method modifies Fourier transform coefficients to compress the image range while preserving edges, outperforming other methods for large blurs and noise.
X-Ray Image Enhancement using CLAHE MethodIRJET Journal
This document presents a method for enhancing X-ray images using Contrast Limited Adaptive Histogram Equalization (CLAHE). CLAHE improves local contrast and edge definition by applying histogram equalization separately to small regions of the image rather than the entire image. It prevents overamplification of noise that can occur with adaptive histogram equalization. The proposed method uses an image processing filter chain including noise reduction, high pass filtering, and CLAHE to enhance 2D X-ray images. Key parameters of the filter chain are optimized using an interior point algorithm. The goal is to provide customized tissue contrast for each treatment location to allow for accurate patient setup and analysis in radiation therapy. The CLAHE method is shown to effectively enhance contrast in X-
A Survey on Single Image Dehazing ApproachesIRJET Journal
This document provides a survey of single image dehazing approaches. It begins with an introduction to the problem of haze in images and how it degrades quality. It then summarizes several existing single image dehazing methods, including those based on the atmospheric scattering model, dark channel prior, color attenuation prior, and deep learning approaches. The survey covers the key assumptions and limitations of each approach. Overall, the document reviews the progress that has been made in developing techniques to remove haze from a single input image.
Under the certain circumstances of the low and unacceptable accuracy on image recognition, the feature
extraction method for optical images based on the wavelet space feature spectrum entropy is recently
studied. With this method, the principle that the energy is constant before and after the wavelet
transformation is employed to construct the wavelet energy pattern matrices, and the feature spectrum
entropy of singular value is extracted as the image features by singular value decomposition of the matrix.
At the same time, BP neural network is also applied in image recognition. The experimental results show
that high image recognition accuracy can be acquired by using the feature extraction method for optical
images proposed in this paper, which proves the validity of the method.
International Journal of Engineering Research and Development (IJERD)IJERD Editor
journal publishing, how to publish research paper, Call For research paper, international journal, publishing a paper, IJERD, journal of science and technology, how to get a research paper published, publishing a paper, publishing of journal, publishing of research paper, reserach and review articles, IJERD Journal, How to publish your research paper, publish research paper, open access engineering journal, Engineering journal, Mathemetics journal, Physics journal, Chemistry journal, Computer Engineering, Computer Science journal, how to submit your paper, peer reviw journal, indexed journal, reserach and review articles, engineering journal, www.ijerd.com, research journals,
yahoo journals, bing journals, International Journal of Engineering Research and Development, google journals, hard copy of journal
Similar to Image Deblurring using L0 Sparse and Directional Filters (20)
Walmart Business+ and Spark Good for Nonprofits.pdfTechSoup
"Learn about all the ways Walmart supports nonprofit organizations.
You will hear from Liz Willett, the Head of Nonprofits, and hear about what Walmart is doing to help nonprofits, including Walmart Business and Spark Good. Walmart Business+ is a new offer for nonprofits that offers discounts and also streamlines nonprofits order and expense tracking, saving time and money.
The webinar may also give some examples on how nonprofits can best leverage Walmart Business+.
The event will cover the following::
Walmart Business + (https://business.walmart.com/plus) is a new shopping experience for nonprofits, schools, and local business customers that connects an exclusive online shopping experience to stores. Benefits include free delivery and shipping, a 'Spend Analytics” feature, special discounts, deals and tax-exempt shopping.
Special TechSoup offer for a free 180 days membership, and up to $150 in discounts on eligible orders.
Spark Good (walmart.com/sparkgood) is a charitable platform that enables nonprofits to receive donations directly from customers and associates.
Answers about how you can do more with Walmart!"
Main Java[All of the Base Concepts}.docxadhitya5119
This is part 1 of my Java Learning Journey. This Contains Custom methods, classes, constructors, packages, multithreading , try- catch block, finally block and more.
Reimagining Your Library Space: How to Increase the Vibes in Your Library No ...Diana Rendina
Librarians are leading the way in creating future-ready citizens – now we need to update our spaces to match. In this session, attendees will get inspiration for transforming their library spaces. You’ll learn how to survey students and patrons, create a focus group, and use design thinking to brainstorm ideas for your space. We’ll discuss budget friendly ways to change your space as well as how to find funding. No matter where you’re at, you’ll find ideas for reimagining your space in this session.
ISO/IEC 27001, ISO/IEC 42001, and GDPR: Best Practices for Implementation and...PECB
Denis is a dynamic and results-driven Chief Information Officer (CIO) with a distinguished career spanning information systems analysis and technical project management. With a proven track record of spearheading the design and delivery of cutting-edge Information Management solutions, he has consistently elevated business operations, streamlined reporting functions, and maximized process efficiency.
Certified as an ISO/IEC 27001: Information Security Management Systems (ISMS) Lead Implementer, Data Protection Officer, and Cyber Risks Analyst, Denis brings a heightened focus on data security, privacy, and cyber resilience to every endeavor.
His expertise extends across a diverse spectrum of reporting, database, and web development applications, underpinned by an exceptional grasp of data storage and virtualization technologies. His proficiency in application testing, database administration, and data cleansing ensures seamless execution of complex projects.
What sets Denis apart is his comprehensive understanding of Business and Systems Analysis technologies, honed through involvement in all phases of the Software Development Lifecycle (SDLC). From meticulous requirements gathering to precise analysis, innovative design, rigorous development, thorough testing, and successful implementation, he has consistently delivered exceptional results.
Throughout his career, he has taken on multifaceted roles, from leading technical project management teams to owning solutions that drive operational excellence. His conscientious and proactive approach is unwavering, whether he is working independently or collaboratively within a team. His ability to connect with colleagues on a personal level underscores his commitment to fostering a harmonious and productive workplace environment.
Date: May 29, 2024
Tags: Information Security, ISO/IEC 27001, ISO/IEC 42001, Artificial Intelligence, GDPR
-------------------------------------------------------------------------------
Find out more about ISO training and certification services
Training: ISO/IEC 27001 Information Security Management System - EN | PECB
ISO/IEC 42001 Artificial Intelligence Management System - EN | PECB
General Data Protection Regulation (GDPR) - Training Courses - EN | PECB
Webinars: https://pecb.com/webinars
Article: https://pecb.com/article
-------------------------------------------------------------------------------
For more information about PECB:
Website: https://pecb.com/
LinkedIn: https://www.linkedin.com/company/pecb/
Facebook: https://www.facebook.com/PECBInternational/
Slideshare: http://www.slideshare.net/PECBCERTIFICATION
বাংলাদেশের অর্থনৈতিক সমীক্ষা ২০২৪ [Bangladesh Economic Review 2024 Bangla.pdf] কম্পিউটার , ট্যাব ও স্মার্ট ফোন ভার্সন সহ সম্পূর্ণ বাংলা ই-বুক বা pdf বই " সুচিপত্র ...বুকমার্ক মেনু 🔖 ও হাইপার লিংক মেনু 📝👆 যুক্ত ..
আমাদের সবার জন্য খুব খুব গুরুত্বপূর্ণ একটি বই ..বিসিএস, ব্যাংক, ইউনিভার্সিটি ভর্তি ও যে কোন প্রতিযোগিতা মূলক পরীক্ষার জন্য এর খুব ইম্পরট্যান্ট একটি বিষয় ...তাছাড়া বাংলাদেশের সাম্প্রতিক যে কোন ডাটা বা তথ্য এই বইতে পাবেন ...
তাই একজন নাগরিক হিসাবে এই তথ্য গুলো আপনার জানা প্রয়োজন ...।
বিসিএস ও ব্যাংক এর লিখিত পরীক্ষা ...+এছাড়া মাধ্যমিক ও উচ্চমাধ্যমিকের স্টুডেন্টদের জন্য অনেক কাজে আসবে ...
Strategies for Effective Upskilling is a presentation by Chinwendu Peace in a Your Skill Boost Masterclass organisation by the Excellence Foundation for South Sudan on 08th and 09th June 2024 from 1 PM to 3 PM on each day.
Image Deblurring using L0 Sparse and Directional Filters
1. Aparna Ashok & Deepa P. L.
International Journal of Image Processing (IJIP), Volume (9) : Issue (4) : 2015 209
Image Deblurring using L0 Sparse and Directional Filters
Aparna Ashok aparnaashok1988@gmail.com
Department of Electronics and Communication Engineering
Mar Baselios College of Engineering and Technology
Trivandrum, India.
Deepa P. L. deeparahul2022@gmail.com
Department of Electronics and Communication Engineering
Mar Baselios College of Engineering and Technology
Trivandrum, India.
Abstract
Blind deconvolution refers to the process of recovering the original image from the blurred image
when the blur kernel is unknown. This is an ill-posed problem which requires regularization to
solve. The naive MAP approach for solving the blind deconvolution problem was found to favour
no-blur solution which in turn led to its failure. It is noted that the success of the further developed
successful MAP based deblurring methods is due to the intermediate steps in between, which
produces an image containing only salient image structures. This intermediate image is
essentially called the unnatural representation of the image. L0 sparse expression can be used as
the regularization term to effectively develop an efficient optimization method that generates
unnatural representation of an image for kernel estimation. Further, the standard deblurring
methods are affected by the presence of image noise. A directional filter incorporated as an initial
step to the deblurring process makes the method efficient to be used for blurry as well as noisy
images. Directional filtering along with L0 sparse regularization gives a good kernel estimate in
spite of the image being noisy. In the final image restoration step, a method to give a better result
with lesser artifacts is incorporated. Experimental results show that the proposed method
recovers a good quality image from a blurry and noisy image.
Keywords: Motion Blur, Blind Deconvolution, Deblurring, L0 Sparsity, Directional Filtering, Image
Restoration.
1. INTRODUCTION
Motion blur caused by camera shake is the most common artifact and one of the predominant
source of degradation in digital photography. Photos taken in low light without flash requires
higher exposure times and thereby the photos get affected by motion blur. Increasing the light
sensitivity of the camera using a higher ISO setting may help in reducing the exposure time, but
there is a trade off with noise levels. The lower exposure time comes at the cost of higher noise
levels. Even then, the exposure time still remains high for handheld photography and camera
shake is likely to happen without the use of a tripod. As a result, the photos end up being blurry
and noisy. Recovering an unblurred, sharp image from a single motion blurred image is one of
the major research areas in digital photography. This problem can be further divided into blind
and non-blind cases. If the blur kernel that has degraded the image is known, then the only
problem is the estimation of the unknown latent image by the deconvolution process. This is
referred non-blind deblurring. If there is no information available about the kernel that has
degraded the image, the original image has to be estimated from the blurred image using the
mathematical model of the blurring process. The kernel and the image has to be estimated
simultaneously and iteratively in this process. This is a much more ill-posed task and is referred
to as blind deblurring. A large number of techniques have been proposed in the recent times to
address the problem of blind image deblurring, by jointly estimating the latent deblurred image
2. Aparna Ashok & Deepa P. L.
International Journal of Image Processing (IJIP), Volume (9) : Issue (4) : 2015 210
while recovering the blur kernel which has degraded the image. Most of these methods assume
an ideal condition with little image noise and demonstrates a fair level of success in such photos.
However a significant amount of noise affect the performance of the existing standard blind
deblurring algorithms. The presence of noise causes high frequency perturbations of the image
values and this is not taken into consideration by the standard blind deblurring methods. In the
blind deblurring process, the image noise manifests itself as noise in the estimated kernel and is
further amplified by the deconvolution process. This produces artifacts in the deblurring result.
Single image blind deconvolution was extensively studied in the recent years and the field has
reached considerable success with many milestones. The basic concept of blind deconvolution
and different existing types of blind deconvolution algorithms are explained in detail by D. Kundur
and D. Hatzinakos in their paper [1]. The classifications of blind deconvolution techniques are
explained and its merits and demerits are discussed. MAP method is the most commonly used
among the blind deblurring techniques because it does not require any apriori information about
the PSF and also, it does not constrain the PSF to be of any specific parametric form. Naive MAP
approach was seen to fail on natural images as it tends to favor no blur solution. Levin et al.[2]
analyzed the source of MAP failure and demonstrated that marginalizing the process over the
image x and MAP estimation of the kernel k alone proves successful and recovers an accurate
kernel. As noted by Levin et al.[2] and Fergus et al.[3], blurry images have a lower cost compared
to sharp images in MAP approach and as a result blurry images are favored. So, a number of
more complex methods have been proposed that include marginalization over all possible
images[2,3], dynamic adaptation of the cost function used[4],determining edge positions by the
usage of shock filtering[5] and reweighting of image edges during optimization[6]. Many papers
emphasized the usage of sparse prior in derivative domain to favor sharp images. But expected
result has not been yielded by the direct application of this principle, as it required additional
processes like marginalization across all possible images as demonstrated by Fergus et al.[3]
spatially varying terms or solvers that vary optimization energy over time as shown by Shan et
al.[4].Krishnan et al.[7] used l1/l2 norm as the sparsity measure which acts as a scale invariant
regularizer. Xu et al.[8] introduced L0 sparsity as regularization term ,which relies on the
intermediate representation of image for its success. All of the mentioned deblurring methods
generally work well when the image is noise free, but their performance deteriorates in the
presence of noise, as the noise level increases[3,9,10]. It has been noticed that standard
denoising methods like Wiener filtering, NLM filtering have negative effect on the kernel
estimation process[11,12]. Zhong et al.[13] proposed an approach based on directional filtering
followed by Radon transform for accurate kernel estimation in the presence of noise.
This paper proposes a new blind deconvolution algorithm for the deblurring of blurry and noisy
images using L0 sparse prior, which is equipped with appropriate noise handling using directional
filters, and a method incorporated in final image restoration step to obtain a good quality latent
image with lesser artifacts. It has been noted that the prior MAP based approaches that are
successful can be roughly classified into two types i.e. those with explicit edge prediction steps
like using a shock filter [5,6,14,15,16,17,18,19] and those which include implicit regularization
process[7,8]. The common factor in these two is that they both include an intermediate step,
which produces an image which contains only the salient structures while suppressing others.
This intermediate image which contains only step like or high contrast structures is called the
unnatural representation of the image. These image maps are the key for making motion
deblurring process accomplishable in different successful MAP based methods. The L0 sparse
prior acts as a regularization term and enables accurate kernel estimation through the unnatural
representation of the image. Directional filters are seen to remove noise in an image effectively,
without affecting the blur kernel estimation process in a significant manner. Consequently,
directional filters can be successfully incorporated in the deblurring technique for noise handling,
without the problem of steering kernel estimation along the wrong direction. The incorporation of
an additional process for reducing the artifacts while enhancing finer details ensures a good
quality latent image.
3. Aparna Ashok & Deepa P. L.
International Journal of Image Processing (IJIP), Volume (9) : Issue (4) : 2015 211
2. PROPOSED WORK
Directional lowpass filters can be applied to an image to reduce its noise level without tampering
with the process of kernel estimation on a significant level. The application of directional lowpass
filter ℎఏ to an image ܫ can be explained theoretically by the equation
ܫሺሻ ∗ ℎఏ =
1
ݎ
න ݓሺݐሻܫሺ + ݑݐఏ
ஶ
ିஶ
ሻ ݀ݐ ሺ1ሻ
where denotes the location of each pixel, ݎ is the normalization factor given as ݎ = ݓሺݐሻ݀ݐ
ஶ
ିஶ
,
ݐ is the spatial distance from each pixel to and ݑఏ is the unit vector in the direction of application
of the filter, ߠ. We choose the directional filter to have a Gaussian profile and this is determined by
the factor w(t) which can be given by the expression ݓሺݐሻ = ݁ି௧మ ଶఙమ⁄
where ߪ is the factor which
controls the strength of the Gaussian directional filtering process[20].
The image, after the directional filtering process, is to be now advanced to the kernel estimation
step for the blind deblurring process. A regularization term which consists of a family of loss
functions, that approximates L0 cost, is incorporated into the objective function which has to be
optimized. L0 approximation enables a high sparsity pursuit regularization, which also leads to
consistent energy minimization and fast convergence during the optimization process. Since only
the salient structures of the image are retained in the unnatural representation, the method is
faster than other implicit regularization methods. This family of loss functions that approximates L0
cost implements graduate non-convexity into the optimization process and the significant edges
guides the kernel estimation process in the right direction, thus quickly improving the estimation
process in only a few iterations.
The image that has been obtained at the end of kernel estimation step is not our required latent
image due to the lack of details, as it contains just high contrast edges. A final image restoration
step has to be carried out for obtaining the latent image. An existing non-blind deconvolution can
be used for this. From the study of the existing non-blind deblurring methods, it can be seen that
non-blind deblurring using Laplacian prior shows a great preservation of finer details[21]. But at the
same time, the result is seen to have considerably significant artifacts in the case of Laplacian
prior. On the contrary, a restoration step using L0 prior produces image with very less artifacts
though the finer details are fewer[22]. Therefore, instead of simply performing non-blind
deconvolution with the obtained kernel using hyper Laplacian prior, a simple method is proposed
to get a latent image with finer details and fewer artifacts. First, latent image I1 is estimated using
the non-blind deconvolution method with hyper-Laplacian prior. After this, latent image I0 is
estimated using the L0 prior scheme introduced in our paper. The difference map of these two
estimated images is computed, followed by bilateral filtering to remove artifacts in the difference
map obtained. Subtracting the result of bilateral filtering from I1 gives the desired final image
output which contains finer details with fewer artifacts.
3. MATHEMATICAL FRAMEWORK
We denote the latent image by x, blurred and noisy image by y and the blur kernel by k. The
blurring process can be represented generally as
ݕ = ݇ ∗ ݔ + ߟ (2)
where ߟ represents the image noise. The blurred and noisy image y has to be first of all denoised,
by the application of directional low pass filters with Gaussian profile in the desired orientations.
The strength of the filtering process by directional filter ℎఏ along each orientation ߠ is denoted by
its ߪ value. This value can be decided accordingly based on the image at hand and the noise
infected along that particular direction. After deciding on the different orientations for the
application of directional filters and the strength of Gaussian profile filtering along each direction,
4. Aparna Ashok & Deepa P. L.
International Journal of Image Processing (IJIP), Volume (9) : Issue (4) : 2015 212
denoising is carried out. This gives a noise-free image without affecting the blur of the image
considerably in a way that will interfere with accurate kernel estimation.
The framework of the proposed deblurring technique includes a loss function Ф0(.) that
approximates L0 cost into the objective function during optimization process. The loss function for
an image z can be defined as
Фሺ∂∗zሻ = Фሺ߲∗ݖ ሻ
୧
ሺ3ሻ
where,
Фሺ߲∗ݖ ሻ = ൝
ଵ
ఌమ
|߲∗ݖ |ଶ
1
′
݂݅ |߲∗ݖ | ≤ ߝ
ݐℎ݁݁ݏ݅ݓݎ
ሺ4ሻ
and ∗ ߳ { ℎ, }ݒ denoting the horizontal and vertical directions respectively for each pixel i ,for taking
gradient of the image. This function is continuous when |߲∗ݖ | ≤ ߝ,which is a necessary condition
for being a loss function mathematically. This loss function is a very high sparsity pursuit one that
approximates sparse L0 function very closely.
The final objective function is obtained by incorporating the loss function Ф0(.) in our method as a
regularization term during the optimization process, which in turn seeks an intermediate sparse
representation of the image containing only salient edges, which guides the kernel estimation in
the right direction. The objective function for kernel estimation can be given as
݉݅݊
ሺݔ, ݇ሻ
{‖݇ ∗ ݔ − ‖ݕଶ
+ ߣ Фሺ∂∗ݔሻ
∗∈{,௩}
+ ߛ‖݇‖ଶ
} ሺ5ሻ
where ݔ is the unnatural representation of the image during the process of optimization of the
objective function and λ, γ are regularization weights .The first term of the objective function is the
data fidelity term which enforces blur model constraint, second term is the loss function
approximating sparse L0 and the last term helps in reducing the kernel noise. It can be seen that
the new regularization term is the key factor in guiding the kernel estimation process quickly and
accurately in the right direction. If we consider the case of explicit edge prediction methods like
employing a shock filter, it cannot be incorporated into the objective function during the
optimization process. But the advantage in the case of using the L0sparse regularization term is
that, it can be efficiently incorporated into the objective function during the optimization process,
which ensures the fact that the intermediate representation of the image contains only necessary
strong edges that satisfy the constraints, regardless of the blur kernel.
The objective function can be solved by alternatively computing the intermediate image value and
the kernel value in each iteration[23]. The computation process for (t+1)
th
iteration of optimization
process can be given by Eq. 6 and Eq. 7.
ݔ ௧ାଵ
=
ܽ݊݅݉݃ݎ
ݔ
൝‖݇௧
∗ ݔ − ‖ݕଶ
+ ߣ Фሺ∂∗ݔሻ
∗∈{,௩}
ൡ ሺ6ሻ
݇௧ାଵ
=
ܽ݊݅݉݃ݎ
݇
{‖ݔ௧ାଵ
∗ ݇ − ‖ݕଶ
+ ߛ‖݇‖ଶ} ሺ7ሻ
Equation 4 for the loss function can be rewritten as follows with ε as a parameter, for the ease of
the optimization process.
Фሺ∂∗z୧ , εሻ =
min
l∗୧
൜|l∗i|
+
1
εଶ
ሺ∂∗z୧ − l∗୧ሻଶ
ൠ ሺ8ሻ
5. Aparna Ashok & Deepa P. L.
International Journal of Image Processing (IJIP), Volume (9) : Issue (4) : 2015 213
where,∗ ϵ { h, v} and
l∗୧ = ቊ
0
∂∗x୧
, |∂∗x୧ | ≤ ε
, otherwise
ሺ9ሻ
The above function can be proved to be mathematically equivalent to the previous one. A family
of loss functions are obtained based on this equation by setting the value of ε differently. Figure 1
shows the family of loss functions for different values of ε starting from 1 to 1/8 and the plot
approaches L0 further as the value of ε keeps on decreasing.
FIGURE 1: Plots of the loss function approximating L0 for different values of ε.
Equation 6 for the optimization process computing ݔ can also be rewritten accordingly based on
Eq.8 and Eq.9 .
min
x, l
ቐ
1
λ
‖k ∗ x − y‖ଶ
+ {
୧∗{୦,୴}
|l∗i|
+
1
εଶ
ሺ∂∗x୧ − l∗୧ሻଶ
}ቑ ሺ10ሻ
We alternate the process of computing intermediate image x and updating the value of l∗୧ in the
iterations for each of the loss function obtained for different values of ε. The whole optimization
process can be speeded up by transforming the computation process into FFT domain. Using
FFTs with the quadratic form enables fast kernel estimation process. The solution in FFT domain
can be expressed by Eq.11 and Eq. 12.
x୲ାଵ
= Fିଵ
ቐ
Fሺk୲ሻതതതതതതത. Fሺyሻ +
கమ ൫Fሺ∂୦ሻതതതതതതത. Fሺl୦ሻ + Fሺ∂୴ሻതതതതതതത. Fሺl୴ሻ൯
Fሺk୲ሻതതതതതതത. Fሺk୲ሻ +
கమ
ሺ|Fሺ∂୦ሻ|ଶ + |Fሺ∂୴ሻ|ଶሻ
ቑ ሺ11ሻ
k୲ାଵ
= Fିଵ
ቊ
Fሺx୲ାଵሻ. Fሺyሻ
|Fሺx୲ାଵሻ|ଶ + γ
ቋ ሺ12ሻ
where, F(.) and F(.) are the FFT operator and its conjugate respectively, F
-1
is the inverse FFT
operation whereas and are vectors concatenating and values for each pixel. FD
2
denotes |F(∂h)|
2
+ |F(∂v)|
2
.Multiplication and division operations are performed in an element wise manner on the
complex vectors.
During the implementation process, we use a family of 4 loss functions with ε ϵ {1,1/2,1/4,1/8}.
We start from ε = 1 and then proceed to the other values as shown in Figure 1. The number of
iterations for different loss functions is set to be inversely proportional to the corresponding value
of ε. This is because of the fact that large ε values cause the loss function to be more convex like
6. Aparna Ashok & Deepa P. L.
International Journal of Image Processing (IJIP), Volume (9) : Issue (4) : 2015 214
and hence makes it more easy to optimize. So it requires only a few iterations. The results
obtained here is taken as an initialization for further refinement in loss functions with smaller ε
values, as they are of more concave nature and difficult to optimize. Also, the blur kernel
estimation process is carried out in a pyramid-like fashion, by convention. Kernels are estimated
in a coarse to fine manner in an image pyramid. The estimate obtained in one image pyramid
level is taken as the initialization of the next one. The optimization process in each iteration t+1 in
its finest level is as explained by the equations Eq.11 and Eq.12 .Computation is similar in the
coarser level for different iterations.
The algorithm for kernel estimation process in one image level can be given as follows
Input: Blurry and noisy image y
Output: Blur kernel k, deblurred image x
1 Apply N directional filters to the input image y, where each filter has a direction given by the
expression θ=(i.π/Nሻ,i=1,2,...N and N is the number of directional filters. Choose the σ value
for each direction accordingly depending on the image.
2 Initialize k from the kernel estimate of coarser scale
3 for t= 1:5
4 //update image
5 ε 1
6 for i=1:4
7 for j=1: εିଵ
8 solve for l using equation (9)
9 solve for x୲ାଵ
using equation (11)
10 end
11 ε ε/2
12 end
13 //update kernel
14 solve for k୲ାଵ
using equation (12)
15 end
Desired kernel estimate is obtained at the end of algorithm execution for each image level, in a
coarse to fine manner. Five iterations of alternative image and kernel estimation are required
generally at each level. But the computed image at the end of the algorithm is not the final
latent image because it contains only salient edges and lacks details. A non-blind deconvolution
using hyper Laplacian prior can be used for latent image restoration in general case. But here, we
go for a better method to remove artifacts and obtain a much better quality image. We take
advantage of the fact that non-blind deconvolution with hyper Laplacian prior produces an image
result with very fine details but a considerable amount of artifacts, whereas restoration using L0
prior and the estimated kernel produces a result with very less artifacts though the result may not
contain much finer details. A difference map between these two results is computed and it is
7. Aparna Ashok & Deepa P. L.
International Journal of Image Processing (IJIP), Volume (9) : Issue (4) : 2015 215
subjected to bilateral filtering. Further subtraction of the obtained filtered result from the result of
non-blind deconvolution with hyper Laplacian prior produces a latent image with finer details and
practically very less artifacts .It can be seen that this results in a much better quality result when
compared to the result that would have been produced if we had gone for a normal non-blind
deconvolution using estimated kernel obtained in the previous step. The latent image restoration
step can also be accelerated by the use of FFT.
4. EXPERIMENTAL RESULTS
We experiment with data on different natural and synthetic images blurred by a set of 8 different
blur kernels. We implemented the proposed method in Matlab on an Intel Core i7 CPU. The value
of parameters are set to λ=2e-3 and γ = 40 for all experiments. Initially, we test the algorithm for
images affected by just blurring by excluding the directional filtering part from our experimental
process i.e. we estimate the kernel by L0 prior scheme and then use the method explained in the
paper for latent image restoration along with artifacts removal. After that, we take blurry and noisy
images and carry out the entire experimental process starting with directional filtering. Gaussian
random noise with a sigma value of 7 has been used in our experiments. We applied directional
filters along 24 regularly sampled directions i.e. one sample every 15
0
.We have taken σ value
of the filter to be 1 or 2 depending on the image and we have tested with the same σ value in all
directions ,though this can be varied for different directions if the image demands so. It can be
seen that the final images in the case without noise are of excellent visual quality and shows a
high improvement in PSNR values. Further, in the case of blurry and noisy images, the process
produces a good visual quality image in spite of the presence of noise, unlike standard deblurring
algorithms that produce deteriorated results in the presence of noise. Comparative studies have
been perfomed with standard existing methods of deblurring and denoising. The results obtained
using directional filtering for noise removal process can be found superior to the one obtained
using Wiener filter, which has been the most commonly used filtering method in image processing
field in the recent times.
First of all, experimental results obtained on simulation with a blurry image is shown to
demonstrate the process. Fig. 2 shows the comparison of results between our method and the
method proposed by Xu et al. [8] which has a standard non-blind deconvolution step using hyper-
Laplacian priors [21].The intermediate step which is the unnatural representation of the image,
the estimated kernel, latent image restored in the case of non-blind deconvolution applied
directly[8],latent image restored by our method including a simple artifact removing step (and
excluding directional filtering step) are shown in the figure. It can be seen that latent image
restored by our method is of clearly of much better visual quality and even has a higher PSNR
value compared to the results produced by Xu et al.[8] Some more results of our method
(excluding directional filtering) on blurry images are shown in Fig. 3 which shows the blurry
image, restored latent image and estimated kernel. The method clearly restores an excellent
visual quality image.
8. Aparna Ashok & Deepa P. L.
International Journal of Image Processing (IJIP), Volume (9) : Issue (4) : 2015
(a)blurry input.
(c)Restored latent imag
Xu et al.[8
PSNR= 28.52
FIGURE 2: Demonstration of intermedia
our process with blurry image as input.
International Journal of Image Processing (IJIP), Volume (9) : Issue (4) : 2015
. (b)unnatural representation and estimated kernel
(c)Restored latent image for (d) our restored latent image.
Xu et al.[8].
PSNR= 28.52 PSNR=29.34
Demonstration of intermediate representation, estimated kernel and recovered
our process with blurry image as input. Restored image for Xu et al. is provided for comparison process.
216
estimated kernel.
latent image in
Restored image for Xu et al. is provided for comparison process.
9. Aparna Ashok & Deepa P. L.
International Journal of Image Processing (IJIP), Volume (9) : Issue (4) : 2015
(a) blurry input Image 1
(c) blurry input Image
(e) blurry input Image 3
FIGURE
Now, we go for the experimental results of images affected by both blur and noise
simulation based on the parameters and conditions defined in the beginning of this section
Wiener filtering has been a classic method
results by simulation of our method using directional filters for noise handling are given in Fig. 4,
along with the results using Wiener filter
can be seen that directional filtering produces
Wiener filtering in all cases. It produces images with quality that is very comparable to that of the
results obtained without noise, inspite of the presence of noise.
with ground truth kernels for two of the test images is shown in Fig. 5. It can be seen that the
estimated kernel is indeed very much closer to the ground truth. Table 1 shows the PSNR values
of the experimental results obtained for blurry images as well as blurry & n
with noise handling. The last two columns of the table shows the comparative performance
evaluation of results obtained by our method and those obtained by incorporati
proposed by Jin et al. [24] into the L
proposed by Xu et al. [8].Our
International Journal of Image Processing (IJIP), Volume (9) : Issue (4) : 2015
a) blurry input Image 1. (b) our restored latent image and estimated kernel
(c) blurry input Image 2. (d) our restored latent image and estimated kernel
Image 3. (f)our restored latent image and estimated kernel
IGURE 3: Experimental Results for Blurry Images.
Now, we go for the experimental results of images affected by both blur and noise
simulation based on the parameters and conditions defined in the beginning of this section
Wiener filtering has been a classic method used commonly in image denoising field [24
of our method using directional filters for noise handling are given in Fig. 4,
along with the results using Wiener filter proposed by Jin et al. [24], for comparison process. It
directional filtering produces much better visual quality images compared to
in all cases. It produces images with quality that is very comparable to that of the
results obtained without noise, inspite of the presence of noise. Comparison of estimated kernels
with ground truth kernels for two of the test images is shown in Fig. 5. It can be seen that the
estimated kernel is indeed very much closer to the ground truth. Table 1 shows the PSNR values
ained for blurry images as well as blurry & noisy images
The last two columns of the table shows the comparative performance
of results obtained by our method and those obtained by incorporati
] into the L0 deblurring process with a standard non-blind deconvolution
method is seen to produce good visual quality results with high
217
(b) our restored latent image and estimated kernel.
(d) our restored latent image and estimated kernel.
(f)our restored latent image and estimated kernel.
Now, we go for the experimental results of images affected by both blur and noise, obtained by
simulation based on the parameters and conditions defined in the beginning of this section.
in image denoising field [24]. The
of our method using directional filters for noise handling are given in Fig. 4,
for comparison process. It
s compared to
in all cases. It produces images with quality that is very comparable to that of the
Comparison of estimated kernels
with ground truth kernels for two of the test images is shown in Fig. 5. It can be seen that the
estimated kernel is indeed very much closer to the ground truth. Table 1 shows the PSNR values
oisy images equipped
The last two columns of the table shows the comparative performance
of results obtained by our method and those obtained by incorporating denoising
blind deconvolution
method is seen to produce good visual quality results with high
10. Aparna Ashok & Deepa P. L.
International Journal of Image Processing (IJIP), Volume (9) : Issue (4) : 2015
improvement of PSNR values even in the presence of noise. Most of the ex
produce such high PSNR values without the use of explicit edge prediction steps like shock filter,
in the presence of noise.
(a)restored latent image using Wiener filtering
for blurry and noisy Image 1
(c)restored latent image using Wiener filtering (d)restored latent image using directional
for blurry and noisy Image 2
(e)restored latent image using Wiener filtering (f)restored latent image using directional
for blurry and noisy Image 3
FIGURE 4: Experimental results of our method and Jin et al.[24
(a)Estimated kernels
FIGURE 5: Comparison of estimated kernels with ground truth
International Journal of Image Processing (IJIP), Volume (9) : Issue (4) : 2015
improvement of PSNR values even in the presence of noise. Most of the existing methods fail to
produce such high PSNR values without the use of explicit edge prediction steps like shock filter,
ge using Wiener filtering (b)restored latent image using directional
for blurry and noisy Image 1. filtering for blurry and noisy Image 1
(c)restored latent image using Wiener filtering (d)restored latent image using directional
for blurry and noisy Image 2. filtering for blurry and noisy Image 2
e)restored latent image using Wiener filtering (f)restored latent image using directional
for blurry and noisy Image 3. filtering for blurry and noisy Image 3
of our method and Jin et al.[24] for blurry and noisy images
(a)Estimated kernels. (b)Ground truths.
Comparison of estimated kernels with ground truth.
218
isting methods fail to
produce such high PSNR values without the use of explicit edge prediction steps like shock filter,
(b)restored latent image using directional
filtering for blurry and noisy Image 1.
(c)restored latent image using Wiener filtering (d)restored latent image using directional
filtering for blurry and noisy Image 2.
e)restored latent image using Wiener filtering (f)restored latent image using directional
Image 3.
- a comparison.
11. Aparna Ashok & Deepa P. L.
International Journal of Image Processing (IJIP), Volume (9) : Issue (4) : 2015 219
Image Input blurry
image
PSNR(dB)
L0 deblurred
output for
blurry image
PSNR (dB)
L0 deblurred
output for
blurry & noisy
input after noise
handling by
Wiener filter(dB)
L0 deblurred
output for blurry
& noisy input
after noise
handling by
directional
filter(dB)
Image 1 20.33 30.20 28.12 29.25
Image 2 20.255 31.47 29.07 30.91
Image 3 27.33 32.81 30.51 32.61
TABLE 1: PSNR values of experimental results of our method for blurry images as well as for blurry & noisy
images.Results of our method using directional filtering is compared to the results using Wiener filtering[24].
5. CONCLUSION
In this paper, we propose a new single image deblurring technique that is robust to noise unlike
standard deblurring methods. Our method uses directional filtering for noise handling which does
not affect the blur information and the kernel estimation process significantly in an adverse
manner. A loss function approximating L0 cost is used as a prior for regularization in the objective
function, which produces an unnatural sparse representation that benefits kernel estimation and
optimization processes. A simple method is introduced in the final latent image restoration step to
obtain a better quality image with much finer details and lesser artifacts. The method is very
effective in handling blurry & noisy images compared to the existing deblurring techniques which
deteriorates in performance when noise is present. As a future scope, the method can be
extended to handle non-uniform blur in presence of noise.
6. REFERENCES
[1] D. Kundur and D. Hatzinakos. "Blind image deconvolution", IEEE Signal Processing
Magazine, 1996.
[2] A. Levin, Y. Weiss, F. Durand and W. T. Freeman. "Understanding and evaluating blind
deconvolution algorithms." In CVPR,2009, pp.1964–1971.
[3] R. Fergus, B. Singh, A. Hertzmann, S. T. Roweis and W. T. Freeman." Removing camera
shake from a single photograph." ACM Transactions on Graphics (SIGGRAPH ASIA), vol. 28
no.5, p. article no. 787–794, 2006.
[4] Q. Shan, J. Jia, and A. Agarwala. "High-quality motion deblurring from a single image."ACM
Transactions on Graphics (SIGGRAPH ASIA),vol. 27(3),2008.
[5] J. H. Money and S. H. Kang. "Total variation minimizing blind deconvolution with shock filter
reference." Image and Vision Computing, 26(2):302–314, 2008.
12. Aparna Ashok & Deepa P. L.
International Journal of Image Processing (IJIP), Volume (9) : Issue (4) : 2015 220
[6] S. Cho and S. Lee. "Fast motion deblurring." ACM Transactions on Graphics (SIGGRAPH
ASIA), vol. 28, no. 5, p. article no. 145, Dec. 2009.
[7] D. Krishnan, T. Tay, and R. Fergus. "Blind deconvolution using a normalized sparsity
measure." In CVPR, 2011,pp. 233–240.
[8] L. Xu, S. Zheng and J. Jia. "Unnatural l0 sparse representation for natural image deblurring."
In CVPR, 2013,pp. 1107–1114.
[9] R. Koehler, M. Hirsch, S. Harmeling, B. Mohler and B.Scholkopf. "Recording and playback of
camera shake: benchmarking blind deconvolution with a real-world database." In ECCV,
2012, pp. 27–40.
[10] A. Levin, Y. Weiss, F. Durand, and W. T. Freeman. "Efficient marginal likelihood optimization
in blind deconvolution." In CVPR2011,pp. 2657–2664.
[11] A. Buades, B. coll and J. Morel." A non-local algorithm for image denoising." CVPR, 2005,pp.
60-65.
[12] L. Zhang, A. Deshpande and X. Chen. "Denoising vs. deblurring: Hdr imaging techniques
using moving cameras." In CVPR,2010 pp. 522-529.
[13] L. Zhong, S. Cho, D. Metaxas, S. Paris, and J. Wang. "Handling noise in single image
deblurring using directional filters",In CVPR,2013, pp. 612–619.
[14] L. Xu and J. Jia." Two-phase kernel estimation for robust motion deblurring”, ECCV, 2010,
pp. 157–170.
[15] L. Xu, Q. Yan, Y. Xia and J. Jia. "Structure extraction from texture via relative total
variation." ACM Transactions on Graphics (SIGGRAPH ASIA), vol. 31(6), 2012.
[16] J. Jia. "Single image motion deblurring using transparency." In CVPR, 2007, pp. 1-8.
[17] N. Joshi, R. Szeliski and D. J. Kriegman."PSF estimation using sharp edge prediction." In
CVPR, 2008, pp. 1-8.
[18] T. S. Cho, S. Paris, B. K. P. Horn and W. T. Freeman. "Blur kernel estimation using the
radon transform." In CVPR, 2011,pp. 241–248.
[19] M. Hirsch, C. J. Schuler, S. Harmeling and B. Scholkopf. "Fast removal of non-uniform
camera shake." In ICCV, 2011,pp. 463–470.
[20] A. Buades, C. B. and J.-M. Morel. "The stair casing effect in neighborhood filters and its
solution." IEEE Transaction on Image Processing,vol.15,pp. 1499-1505, 2006.
[21] D. Krishnan and R. Fergus."Fast image deconvolution using hyper-laplacian priors." In NIPS,
pp. 1033-1041,2009.
[22] Z.Hu, M.H.Yang, J.Pan and Z.Su. "Deblurring text images via L0 regularized intensity and
gradient prior." In CVPR,2014, pp. 2901-2908.
[23] L. Xu, C. Lu, Y. Xu and J. Jia. "Image smoothing via l0 gradient minimization."ACM
Transactions on Graphics (SIGGRAPH ASIA),vol. 30(6), 2011.
13. Aparna Ashok & Deepa P. L.
International Journal of Image Processing (IJIP), Volume (9) : Issue (4) : 2015 221
[24] F. Jin, P. Fieguth, L. Winger and E. Jernigan. "Adaptive Wiener filtering of noisy images and
image sequences." International Conference for Image Processing, IEEE, 2003, pp. 349-
352.