SlideShare a Scribd company logo
1 of 66
Download to read offline
Image Processing (KCS-062):
Unit-3: Image Restoration
Dr. Radhey Shyam
Professor
Department of Computer Science and Engineering
BIET Lucknow
(Affiliated to Dr. A.P.J. Abdul Kalam Technical University (APJAKTU) Lucknow)
And
Dr. Philippe Cattin
MIAC, University of Basel
Unit-3 have been compiled by Dr. Radhey Shyam, with grateful acknowledgment to Dr. Philippe Cattin
MIAC, University of Basel who made their course contents freely available. Feel free to use this study
material for your own academic purposes. For any query, the communication can be made through my
mail shyam0058@gmail.com.
Course Outcome of Unit-3, the students will be able to explain the basic concepts of Image Restoration.
Date: June 22, 2021
Image
Degradation &
Restoration Model
April 19th/26th, 2016
Introduction to Signal and Image Processing
(4)
Image Degradation &
Restoration Model
The degradation process is generally modelled as a
degradation function and the additive noise term
together they yield .
Given , some knowledge about , and it is
the objective of restoration to estimate . Of course
this estimate should be as close as possible to .
Fig 6.1 Image degradation model
6 of 70 22.02.2016 09:19
April 19th/26th, 2016
Introduction to Signal and Image Processing
Image Degradation & Restoration Model
(5)
Ph. Cattin: Image Restoration
Image Degradation &
Restoration Model (2)
If the degradation function is a linear, shift-invariant
process, then the degraded image is given in the spatial
domain by
(6.1)
where is the spatial representation of the
degradation function, and indicates convolution.
As we know from the Convolution Theorem this can be
rewritten in the frequency domain
(6.2)
where the capital letters are the Fourier transforms of the
respective function in Eq 6.1.
7 of 70 22.02.2016 09:19
Noise Models
April 19th/26th, 2016
Introduction to Signal and Image Processing
(7)
Noise Models
The principle sources of noise in digital images arise
during image acquisition and/or transmission.
The performance of imaging sensors are affected by a
variety of factors during acquisition, such as
Environmental conditions during the acquisition
Light levels (low light conditions require high gain
amplification)
Sensor temperature (higher temp implies more
amplification noise)
Images can also be corrupted during transmission due to
interference in the channel for example
Lightning or other
Atmospheric disturbances
Depending on the specific noise source, a different model
must be selected that accurately reproduces the spatial
characteristics of the noise.
8 of 70 22.02.2016 09:19
April 19th/26th, 2016
Introduction to Signal and Image Processing
Noise Models
(8)
Ph. Cattin: Image Restoration
Gaussian Noise
Because of its mathematical
tractability in both the spatial and
frequency domain, Gaussian noise
models (aka normal distribution)
are used frequently in practice.
The PDF (Probability density
function) of a Gaussian random
variable is given by
(6.3)
where represents the grey level,
the mean value and the
standard deviation.
Fig 6.2: Gaussian
probability density function
The application of the Gaussian model is so
convenient that it is often used in situations in
which they are marginally applicable at best.
9 of 70 22.02.2016 09:19
April 19th/26th, 2016
Introduction to Signal and Image Processing
Noise Models
(9)
Ph. Cattin: Image Restoration
Rayleigh Noise
The PDF of Rayleigh noise is defined by
(6.4)
the mean and variance are given by
(6.5)
Fig 6.3: Rayleigh
probability
density function
As the shape of the Rayleigh density function is skewed it
is useful for approximating skewed histograms.
10 of 70 22.02.2016 09:19
April 19th/26th, 2016
Introduction to Signal and Image Processing
Noise Models
(10)
Ph. Cattin: Image Restoration
Erlang Noise
The PDF of the Erlang noise is given
by
(6.6)
where , is a positive integer.
The mean and variance are then
given by
(6.7)
Fig 6.4: Erlang
probability density
function
11 of 70 22.02.2016 09:19
April 19th/26th, 2016
Introduction to Signal and Image Processing
Noise Models
(11)
Ph. Cattin: Image Restoration
Exponential Noise
The PDF of the exponential noise
is given by
(6.8)
where . The mean and
variance of the density function
are
(6.9)
Fig 6.5: Probability density
function of
exponential noise
The exponential noise model is a special case of the Erlang
noise model with .
12 of 70 22.02.2016 09:19
April 19th/26th, 2016
Introduction to Signal and Image Processing
Noise Models
(12)
Ph. Cattin: Image Restoration
Uniform Noise
The PDF of the uniform noise is
given by
(6.10)
The mean and variance of the
density function are given by
(6.11)
Fig 6.6: Probability density
function of uniform
noise
13 of 70 22.02.2016 09:19
April 19th/26th, 2016
Introduction to Signal and Image Processing
Noise Models
(13)
Ph. Cattin: Image Restoration
Impulse (Salt-
and-Pepper) Noise
The PDF of bipolar impulse noise
model is given by
(6.12)
Fig 6.7: Probability density
function of the bipolar
impulse noise model
If , grey-level appears as a light dot (salt) in the
image. Conversely, will appear as dark dot (pepper). If
either is zero, the PDF is called unipolar.
Because impulse corruption is generally large compared to
the signal strength, the assumption is usually that and
are digitised as saturated values thus black (pepper) and
white (salt).
14 of 70 22.02.2016 09:19
April 19th/26th, 2016
Introduction to Signal and Image Processing
Noise Models
(14)
Ph. Cattin: Image Restoration
Noise Models
The presented noise models provide a useful tool for
approximating a broad range of noise corruption situations
found in practice. For example:
Gaussian noise: arises in images due to sensor noise
caused by poor illumination and/or high temperature,
and electronic circuit noise
The Rayleigh noise model is used to characterise noise
phenomena in range images
Exponential and Erlang noise models find their
application in Laser imaging
Impulse noise takes place in situations where high
transients (faulty switching) occurs
15 of 70 22.02.2016 09:19
April 19th/26th, 2016
Introduction to Signal and Image Processing
Noise Models
(15)
Ph. Cattin: Image Restoration
Visual Comparison of
Different Noise Sources
Although the corresponding histograms show close
resemblance to the PDF of the respective noise model, it is
virtually impossible to select the type of noise causing the
degradation from the image alone.
Gaussian noise
model
Rayleigh noise
model
Erlang noise model
16 of 70 22.02.2016 09:19
April 19th/26th, 2016
Introduction to Signal and Image Processing
Exponential noise
model
Uniform noise
model
Impulse noise
model
(Salt & Pepper)
17 of 70 22.02.2016 09:19
April 19th/26th, 2016
Introduction to Signal and Image Processing
Noise Models
(16)
Ph. Cattin: Image Restoration
Periodic Noise
Periodic noise typically arises from electrical or
electromechanical interference during image acquisition
and is spatial dependent.
Fig 6.8: Periodic noise on a satellite
image of Pompeii
Fig 6.9: Spectrum of the Pompeii
image with periodic noise (peaks of
the periodic noise visually
enhanced)
18 of 70 22.02.2016 09:19
April 19th/26th, 2016
Introduction to Signal and Image Processing
Noise Models
(17)
Ph. Cattin: Image Restoration
Estimation of Noise
Parameters (1)
In rare cases the parameters of
noise PDFs may be known from
sensor specifications, but it is
often necessary to estimate them
for a particular imaging
arrangement.
If the imaging system is available,
one simple way to study noise
characteristics would be to
capture multiple images of
homogeneous environments, such
as solid grey cards.
Fig 6.10: Sample histogram
of a small patch of Erlang
noise
In many cases the noise parameters have to be estimated
from already captured images. The simplest way is to
estimate the mean and variance of the grey levels from
small patches of reasonably constant grey level.
19 of 70 22.02.2016 09:19
April 19th/26th, 2016
Introduction to Signal and Image Processing
Noise Models
(18)
Ph. Cattin: Image Restoration
Estimation of Periodic
Noise Parameters
The parameters of
periodic noise are
typically estimated
by inspection of
the Fourier
spectrum. The
frequency spikes
can often be
detected by visual
analysis.
Automatic analysis
is possible if the
noise spikes are
either
exceptionally
pronounced or a
priori knowledge
about their
location is known.
Fig. 6.11: Fig. 6.12:
20 of 70 22.02.2016 09:19
Restoration in the
Precense of Noise
Only
April 19th/26th, 2016
Introduction to Signal and Image Processing
(20)
Restoration in the
Precense of Noise Only
When noise is the only image degradation present in an
image, thus , Eqs 6.1 & 6.2 become
(6.13)
and
(6.14)
In case of periodic noise, it is usually possible to estimate
from the spectrum of and subtract it to
obtain an estimate of the original image .
But estimating the noise terms is unreasonable, so
subtracting them from is impossible. Spatial
filtering is the method of choice in situations when only
additive noise is present.
21 of 70 22.02.2016 09:19
Periodic Noise
Reduction by
Frequency Domain
Filtering
Bandreject Filter
April 19th/26th, 2016
Introduction to Signal and Image Processing
22 of 70 22.02.2016 09:19
April 19th/26th, 2016
Introduction to Signal and Image Processing
(23)
Bandreject Filter
Bandreject filters remove or attenuate a band of
frequencies around the origin in the Fourier domain.
Ideal Bandreject Filter
(6.15)
Fig 6.13: Ideal bandreject
filter
Butterworth Bandreject Filter
(6.16)
Fig 6.14: Butterworth
bandreject filter
Gaussian Bandreject Filter
(6.17)
Fig 6.15: Gaussian
bandreject filter
23 of 70 22.02.2016 09:19
April 19th/26th, 2016
Introduction to Signal and Image Processing
Bandreject Filter
(24)
Ph. Cattin: Image Restoration
Bandreject Filter
Example
Fig 6.16: Aerial image of Pompeii
with periodic noise
Fig 6.17: Ideal bandreject filter
Fig 6.18: Butterworth bandreject
filter
Fig 6.19: Gaussian bandreject filter
24 of 70 22.02.2016 09:19
Bandpass Filter
April 19th/26th, 2016
Introduction to Signal and Image Processing
(26)
Bandpass Filter
The Bandpass filter performs the opposite of a bandreject
filter and thus lets pass the frequencies in a narrow band
of width around . The transfer function can
be obtained from a corresponding bandreject filter by
using the equation
(6.18)
The perspective plots of the corresponding filters are
depicted in Fig 6.20.
(a) (b) (c)
Fig 6.20 (a) Ideal bandpass filter, (b) Butterworth bandpass filter, and
(c) Gaussian bandpass filter
25 of 70 22.02.2016 09:19
April 19th/26th, 2016
Introduction to Signal and Image Processing
Bandpass Filter
(27)
Ph. Cattin: Image Restoration
Bandpass Filter Example
Fig 6.21: Aerial image of Pompeii
with periodic noise
Fig 6.22: Ideal bandpass filter
Fig 6.23: Butterworth bandpass
filter
Fig 6.24: Gaussian bandpass filter
26 of 70 22.02.2016 09:19
Notch Filter
April 19th/26th, 2016
Introduction to Signal and Image Processing
27 of 70 22.02.2016 09:19
April 19th/26th, 2016
Introduction to Signal and Image Processing
(29)
Notch Filter
A Notch filter rejects or passes frequencies in predefined
neighbourhoods about a centre frequency. Due to the
symmetry of the Fourier transform, notch filters must
appear in symmetric pairs about the origin (except the one
at the origin).
The transfer functions of the ideal, Butterworth, and
Gaussian notch reject filter of radius (width) with
centres at and, by symmetry, at , are
Ideal Notch Filter
(6.19)
Fig 6.25: Ideal
notch filter
Butterworth Notch Filter
(6.20)
Fig 6.26:
Butterworth
notch filter
Gaussian Notch Filter
(6.21)
Fig 6.27:
Gaussian notch
filter
where
(6.22)
28 of 70 22.02.2016 09:19
April 19th/26th, 2016
Introduction to Signal and Image Processing
29 of 70 22.02.2016 09:19
April 19th/26th, 2016
Introduction to Signal and Image Processing
Notch Filter
(30)
Ph. Cattin: Image Restoration
Notch Filter (2)
Similar to the bandpass/bandreject filters, the Notch reject
filters can be turned into Notch pass filters with the
relation
(6.23)
where is the transfer function of the notch pass
filter, and the corresponding Notch reject filter.
If
the Notch reject filter becomes a highpass filter
and
the Notch pass filter becomes a lowpass filter.
30 of 70 22.02.2016 09:19
April 19th/26th, 2016
Introduction to Signal and Image Processing
Notch Filter
(31)
Ph. Cattin: Image Restoration
Ideal Notch Filter
D_0=16 Example
Fig 6.28: Pompeii aerial image with
periodic noise
Fig 6.29: Notch reject filtered
image
Fig 6.30: Notch pass filtered image
(contrast enhanced)
31 of 70 22.02.2016 09:19
April 19th/26th, 2016
Introduction to Signal and Image Processing
Notch Filter
(32)
Ph. Cattin: Image Restoration
Butterworth Notch Filter
D_0=64 Example
Fig 6.31: Pompeii aerial image with
periodic noise
Fig 6.32: Notch reject filtered
image
Fig 6.33: Notch pass filtered image
(contrast enhanced)
32 of 70 22.02.2016 09:19
April 19th/26th, 2016
Introduction to Signal and Image Processing
Notch Filter
(33)
Ph. Cattin: Image Restoration
Gaussian Notch Filter
D_0=64 Example
Fig 6.34: Pompeii aerial image with
periodic noise
Fig 6.35: Notch reject filtered
image
Fig 6.36: Notch pass filtered image
(contrast enhanced)
33 of 70 22.02.2016 09:19
April 19th/26th, 2016
Introduction to Signal and Image Processing
Notch Filter
(34)
Ph. Cattin: Image Restoration
General Notch Filter
Example
Fig 6.37: Original Mariner 6
martian image
Fig 6.38: Log Fourier spectra of the
image
Fig 6.39: Notch filtered log spectra Fig 6.40: Notch filtered image
34 of 70 22.02.2016 09:19
Optimum Notch
Filtering
April 19th/26th, 2016
Introduction to Signal and Image Processing
35 of 70 22.02.2016 09:19
April 19th/26th, 2016
Introduction to Signal and Image Processing
(36)
Optimum Notch Filtering
Images derived from electro-optical scanners, such as
those used in space and aerial imaging, are sometimes
corrupted by coupling and amplification of low-level
signals in the scanners' circuitry. The resulting images
tend to contain substantial periodic noise. The
interference pattern are, however, in practice not always
as clearly defined as in the samples shown thus far.
The first step in Optimum notch filtering is to find the
principal frequency components and placing notch pass
filters at the location of each spike, yielding . The
Fourier transform of the interference pattern is thus given
by
(6.24)
where is the Fourier transform of the corrupted
image. The corresponding interference pattern in the
spatial domain is obtained with the inverse Fourier
transform
(6.25)
As the corrupted image is assumed to be formed by
the addition of the uncorrupted image and the
interference noise
(6.26)
If the noise term were known completely,
subtracting it from would yield . The problem
is of course that the estimated interference pattern
is only an approximation. The effect of components not
present in the estimate can be minimised be
subtracting from a weighted portion of to
obtain an estimate for
36 of 70 22.02.2016 09:19
April 19th/26th, 2016
Introduction to Signal and Image Processing
(6.27)
where is the estimate of , and is to be
determined and optimises in some meaningful way.
One common approach is to select so that the
variance of is minimised over a specified
neighbourhood of size about every point
.
(6.29)
where is the average value of in the
neighbourhood; that is
(6.30)
Substituting Eq 6.27 into Eq 6.29 yields
(6.31)
Assuming that remains constant over the
neighbourhood gives the approximation
(6.32)
for and . This assumption results in
the expression
(6.33)
37 of 70 22.02.2016 09:19
April 19th/26th, 2016
Introduction to Signal and Image Processing
in the neighbourhood. With these approximations Eq 6.30
becomes
(6.34)
To minimise , we solve
(6.35)
for . The result is
(6.36)
To obtain an estimated restored image , must
be computed from Eq 6.36 and substituted into Eq 6.27 to
determine .
38 of 70 22.02.2016 09:19
April 19th/26th, 2016
Introduction to Signal and Image Processing
Optimum Notch Filtering
(37)
Ph. Cattin: Image Restoration
Optimum Notch Filtering
Principle
Fig 6.41 Principle of the optimum notch filter
39 of 70 22.02.2016 09:19
April 19th/26th, 2016
Introduction to Signal and Image Processing
Optimum Notch Filtering
(38)
Ph. Cattin: Image Restoration
Optimum Notch Filter
Example
Fig 6.42 Aerial image of Pompeii
with heavy periodic noise
distortions
Fig 6.43 Noise estimation with
Gaussian notch pass filter
Fig 6.44 Notch reject filtered
image
Fig 6.45 Result filtered with an
optimum notch filter of size
40 of 70 22.02.2016 09:19
April 19th/26th, 2016
Introduction to Signal and Image Processing
Optimum Notch Filtering
(39)
Ph. Cattin: Image Restoration
Optimum Notch Filter
Example with Pixel
Increments
Fig 6.46 Aerial image of Pompeii corrected with the optimal notch filter
of size with the window shifted pixelwise
41 of 70 22.02.2016 09:19
April 19th/26th, 2016
Introduction to Signal and Image Processing
Optimum Notch Filtering
(40)
Ph. Cattin: Image Restoration
Optimum Notch Filter
Example with Pixel
Increments (2)
Fig 6.47 of the example image in Fig 6.46
42 of 70 22.02.2016 09:19
Estimating the
Degradation
Function
April 19th/26th, 2016
Introduction to Signal and Image Processing
(42)
Estimating the
Degradation Function
So far we concentrated mainly at the additive noise term
. In the remainder of this presentation we
concentrate on ways to remove the degradation function
.
Fig 6.48 Image degradation model
43 of 70 22.02.2016 09:19
April 19th/26th, 2016
Introduction to Signal and Image Processing
Estimating the Degradation Function
(43)
Ph. Cattin: Image Restoration
Estimating the
Degradation Function (2)
There are three principle methods to estimate the
degradation function
Observation
1.
Experimentation
2.
Mathematical modelling
3.
The process of restoring a corrupted image using the
estimated degradation function is sometimes called blind
deconvolution, as the true degradation is seldom known
completely.
In recent years a forth method based on maximum-
likelihood estimation (MLE) often called blind
deconvolution has been proposed.
Beware: All multiplications/divisions in the
equations in this part of the lecture are
componentwise.
44 of 70 22.02.2016 09:19
April 19th/26th, 2016
Introduction to Signal and Image Processing
Estimating the Degradation Function
(44)
Ph. Cattin: Image Restoration
Estimating by Image
Observation
Given
A degraded image without any information about the
degradation function .
Solution
Select a subimage with strong signal content →
1.
By estimating the sample grey levels of the object and
background in we can construct an unblurred
image of the same size and characteristics as the
observed subimage →
2.
Assuming that the effect of noise is negligible (thus the
choice of a strong signal area), it follows from Eq 6.2
that
3.
Thanks to the shift invariance we can deduce
from
4.
45 of 70 22.02.2016 09:19
April 19th/26th, 2016
Introduction to Signal and Image Processing
Estimating the Degradation Function
(45)
Ph. Cattin: Image Restoration
Estimating by
Experimentation
Given
Equipment similar to the equipment used to acquire the
degraded image
Solution
Images similar to the degraded image can be acquired
with various system settings until it closely matches
the degraded image
1.
The system can then be characterised by measuring
the impulse (small bright dot of light) response. A
linear, shift invariant system can be fully described by
its impulse response.
2.
As the Fourier transform of an impulse is a constant, it
follows from Eq 6.2
where is the Fourier transform of the observed
image, and is a constant describing the strength of
the impulse.
3.
46 of 70 22.02.2016 09:19
April 19th/26th, 2016
Introduction to Signal and Image Processing
Estimating the Degradation Function
(46)
Ph. Cattin: Image Restoration
Estimating by
Mathematical Modelling
Degradation modelling has been used for many years. It,
however, requires an indepth understanding of the
involved physical phenomenon. In some cases it can even
incorporate environmental conditions that cause
degradations. Hufnagel and Stanly proposed in 1964 a
model to characterise atmospheric turbulence.
(6.37)
where is a constant that depends on the nature of the
turbulence.
Except of the 5/6 power the above equation has the same
form as a Gaussian lowpass filter.
47 of 70 22.02.2016 09:19
April 19th/26th, 2016
Introduction to Signal and Image Processing
Estimating the Degradation Function
(47)
Ph. Cattin: Image Restoration
Illustration of the
Atmospheric Turbulence
Model
Fig 6.49: Aerial image of Pompeii Fig 6.50: Pompeii with mild
turbulence
Fig 6.51: Pompeii with medium
turbulence
Fig 6.52 Pompeii with heavy
turbulence
48 of 70 22.02.2016 09:19
Inverse Filtering
Direct Inverse
Filtering
April 19th/26th, 2016
Introduction to Signal and Image Processing
49 of 70 22.02.2016 09:19
April 19th/26th, 2016
Introduction to Signal and Image Processing
(50)
Direct Inverse Filtering
The simplest approach to restore a degraded image is to
form an estimate of the form
(6.38)
and then obtain the corresponding image by inverse
Fourier transform. This method is called direct inverse
filtering. With the degradation model Equation 6.2 we get
(6.39)
This simple equation tells us that, even if we knew
exactly we could not recover the undegraded image
completely because:
the noise component is a random function whose
Fourier transform is not known, and
1.
in practice can contain numerous zeros.
2.
Direct Inverse filtering is seldom a suitable
approach in practical applications
50 of 70 22.02.2016 09:19
April 19th/26th, 2016
Introduction to Signal and Image Processing
Direct Inverse Filtering
(51)
Ph. Cattin: Image Restoration
Two Practical
Approaches for Inverse
Filtering
Low Pass Filter
(6.40)
where is a low-pass filter that should eliminiate
the very low (or even zero) values often experienced in
the high frequencies.
1.
Constrained Division
(6.41)
gives values, where is lower than a threshold
a special treatment.
2.
These appraoches are also known as Pseudo-
Inverse Filtering.
51 of 70 22.02.2016 09:19
April 19th/26th, 2016
Introduction to Signal and Image Processing
Direct Inverse Filtering
(52)
Ph. Cattin: Image Restoration
Artificial Inverse
Filtering Example
Fig 6.53: Checkerboard sample Fig 6.54: Motion blur of in
direction
Fig 6.55: Additive noise with Fig 6.56: Motion and noise
degraded checkerboard
52 of 70 22.02.2016 09:19
April 19th/26th, 2016
Introduction to Signal and Image Processing
Direct Inverse Filtering
(53)
Ph. Cattin: Image Restoration
Artificial Inverse
Filtering Example (2)
Although very tempting from its simplicity, the direct
inverse filtering approach does not work for practical
applications. Even if the degradation is known exactly.
Fig 6.57: Direct inverse filtering result
53 of 70 22.02.2016 09:19
April 19th/26th, 2016
Introduction to Signal and Image Processing
Direct Inverse Filtering
(54)
Ph. Cattin: Image Restoration
Inverse Filtering
Example (2)
Fig 6.58: Inverse filtering of Figure
6.52
Fig 6.59: Pseudo Inverse filtering
for freq. radius
Fig 6.60: Pseudo Inverse filtering
for frequencies radius
Fig 6.61: Pseudo Inverse filtering
for frequencies radius
54 of 70 22.02.2016 09:19
Wiener Filtering
April 19th/26th, 2016
Introduction to Signal and Image Processing
(56)
Wiener Filtering
The best known improvement to inverse filtering is the
Wiener Filter. The Wiener filter seeks an estimate that
minimises the statistical error function
(6.42)
where is the expected value and the undegraded
image. The solution to this equation in the frequency
domain is
(6.43)
where
is the degradation function
with the complex
conjugate of
is the power spectrum of the noise
is the power spectrum of the
undegraded image
55 of 70 22.02.2016 09:19
April 19th/26th, 2016
Introduction to Signal and Image Processing
Wiener Filtering
(57)
Ph. Cattin: Image Restoration
Wiener Filtering (2)
If the noise spectrum is zero, the noise-to-signal
power ratio
vanishes and the Wiener Filter reduces to the inverse
filter.
(6.44)
This is no problem, as the inverse filter works fine if no
noise is present.
56 of 70 22.02.2016 09:19
April 19th/26th, 2016
Introduction to Signal and Image Processing
Wiener Filtering
(58)
Ph. Cattin: Image Restoration
Parametric Wiener Filter
The main problem with the Wiener filter is that the power
spectrum of the undegraded image is seldom
known.
A frequently used approach when these quantities cannot
be estimated is to approximate Eq 6.43 by the expression
(6.45)
where is a user selected constant.
This simplification can be partly justified when dealing
with spectrally white noise, where the noise spectrum
is constant. However, the problem still
remains that the power spectrum of
the undegraded image is unknown and must be estimated.
Even if the actual ratio is not known, it becomes
a simple matter to experiment interactively varying
the constant and viewing the results.
57 of 70 22.02.2016 09:19
April 19th/26th, 2016
Introduction to Signal and Image Processing
Wiener Filtering
(59)
Ph. Cattin: Image Restoration
Artificial Wiener
Filtering Example
This example shows the performance of the Wiener filter
on the example Fig 6.56 using (1) the approximation of Eq
6.45 with in Fig 6.62 and (2) the Wiener filter
using full knowledge of the noise and undegraded image's
power spectra in Fig 6.63.
Fig 6.62: Parametric Wiener filter
using a constant ratio
Fig 6.63: Wiener filter knowing the
noise and undegraded signal power
spectra
58 of 70 22.02.2016 09:19
April 19th/26th, 2016
Introduction to Signal and Image Processing
Wiener Filtering
(60)
Ph. Cattin: Image Restoration
Wiener Filtering
Example with Little Noise
Fig 6.64: Pompeii blurred with
Gaussian kernel , and
Gaussian noise
Fig 6.65: Result of direct inverse
filtering
Fig 6.66: Result with Parametric
Wiener filtering
Fig 6.67: Result with Wiener
filtering
59 of 70 22.02.2016 09:19
April 19th/26th, 2016
Introduction to Signal and Image Processing
Wiener Filtering
(61)
Ph. Cattin: Image Restoration
Wiener Filtering
Example with Medium Noise
Fig 6.68: Pompeii blurred with
Gaussian kernel , and
Gaussian noise
Fig 6.69: Result of direct inverse
filtering
Fig 6.70: Result with Parametric
Wiener filtering
Fig 6.71: Result with Wiener
filtering
60 of 70 22.02.2016 09:19
April 19th/26th, 2016
Introduction to Signal and Image Processing
Wiener Filtering
(62)
Ph. Cattin: Image Restoration
Wiener Filtering
Example with Heavy Noise
Fig 6.72: Pompeii blurred with
Gaussian kernel , and
Gaussian noise
Fig 6.73: Result of direct inverse
filtering
Fig 6.74: Result with Parametric
Wiener filtering
Fig 6.75: Result with Wiener
filtering
61 of 70 22.02.2016 09:19
April 19th/26th, 2016
Introduction to Signal and Image Processing
Wiener Filtering
(63)
Ph. Cattin: Image Restoration
Comparison Param.
Wiener vs. Wiener Filtering
(a) (b)
Fig 6.76 Aerial image of Pompeii with Gaussian blur ( ) and noise (
) (a) restored with the Parametric Wiener ( ), (b)
same image restored with Wiener filter.
62 of 70 22.02.2016 09:19
April 19th/26th, 2016
Introduction to Signal and Image Processing
Wiener Filtering
(64)
Ph. Cattin: Image Restoration
Drawback of the Wiener
Filter
The problem of having to know something about the
degradation function is common to all methods
discussed in this part.
The Wiener filter has the additional difficulty, that
the power spectra of the undegraded image and
the power spectra of the noise
must be known.
Although an approximation by a constant is possible as in
the Parametric Wiener filter, see Fig 6.62, this approach is
not always suitable.
63 of 70 22.02.2016 09:19
Geometric Mean
Filter
April 19th/26th, 2016
Introduction to Signal and Image Processing
(66)
Geometric Mean Filter
The Geometric Mean Filter is a generalisation of inverse
filtering and the Wiener filtering. Through its parameters
it allows access to an entire family of filters.
(6.46)
Depending on the parameters the filter characteristics
can be adjusted
: inverse filtering
: spectrum equalisation filter
: parametric Wiener filter → Wiener
64 of 70 22.02.2016 09:19
Constrained Least
Squares Filtering
April 19th/26th, 2016
Introduction to Signal and Image Processing
(68)
Constrained Least
Squares (Regularised)
Filtering
The Constrained Least Squares Filtering approach only
requires knowledge of the mean and variance of the noise.
As shown in previous lectures these parameters can be
usually estimated from the degraded image.
The definition of the 2D discrete convolution is
(6.47)
Using this equation we can express the linear degradation
model in vector notation
as
(6.48)
65 of 70 22.02.2016 09:19
April 19th/26th, 2016
Introduction to Signal and Image Processing
Constrained Least Squares Filtering
(69)
Ph. Cattin: Image Restoration
Constrained Least
Squares Filtering (2)
It seems obvious that the restoration problem is now
reduced to simple matrix manipulations. Unfortunately
this is not the case. The problem with the matrix
formulation is that the matrix is very large
and that its inverse is firstly very sensitive to noise and
secondly does not necessarily exist.
One way to deal with these issues is to base optimality of
restoration on a measure of smoothness, such as the
second derivative of the image, e.g. the Laplacian.
(6.49)
subject to the constraint
(6.50)
where is the Euclidian norm, and an estimate of the
undegraded image.
66 of 70 22.02.2016 09:19
April 19th/26th, 2016
Introduction to Signal and Image Processing
Constrained Least Squares Filtering
(70)
Ph. Cattin: Image Restoration
Constrained Least
Squares Filtering (3)
The Frequency domain solution to this optimisation
problem is given by
(6.51)
where is a parameter that must be adjusted so that the
constraint in Eq 6.50 is satisfied, and is the Fourier
transform of the Laplace operator
(6.52)
Note: must be properly padded with zeros prior to
computing the Fourier transform.
It is possible to adjust the parameter
interactively until acceptable results are obtained.
67 of 70 22.02.2016 09:19
April 19th/26th, 2016
Introduction to Signal and Image Processing
Constrained Least Squares Filtering
(71)
Ph. Cattin: Image Restoration
Optimal Selection for
Gamma
If we are interested in optimality, the parameter must be
adjusted so that the constraint in Eq
6.50 is satisfied.
It turns out that
(6.53)
is the optimal selection given the above optimisation
equation where are the mean and variance of the
noise.
It is important to understand, that optimum
restoration in the sense of constrained least
squares does not necessarily imply best in the
visual sense. In general, automatic determined
restoration filters yield inferior results to manual
adjustment of filter parameters.
68 of 70 22.02.2016 09:19
April 19th/26th, 2016
Introduction to Signal and Image Processing
Constrained Least Squares Filtering
(72)
Ph. Cattin: Image Restoration
Artificial Constrained
Least Squares Filter Example
This example shows the performance of the Constrained
Least Squares Filter on the example Fig 6.56 using (1) the
theoretical optimal value for in Fig 6.77 and (2)
the constrained least squares filter with a manually
selected of 6.78.
Fig 6.77: Result with optimal Fig 6.78: Results with manually
selected
69 of 70 22.02.2016 09:19
April 19th/26th, 2016
Introduction to Signal and Image Processing
Constrained Least Squares Filtering
(73)
Ph. Cattin: Image Restoration
Constrained Least
Squares Filter Example
Fig 6.79: Pompeii blurred with
Gaussian kernel
Fig 6.80: Result with low Gaussian
noise of
Fig 6.81: Result with medium
Gaussian noise of
Fig 6.82: Result with high Gaussian
noise of
70 of 70 22.02.2016 09:19

More Related Content

What's hot

CT Image Reconstruction- Avinesh Shrestha
CT Image Reconstruction- Avinesh ShresthaCT Image Reconstruction- Avinesh Shrestha
CT Image Reconstruction- Avinesh ShresthaAvinesh Shrestha
 
Speckle noise reduction from medical ultrasound images using wavelet thresh
Speckle noise reduction from medical ultrasound images using wavelet threshSpeckle noise reduction from medical ultrasound images using wavelet thresh
Speckle noise reduction from medical ultrasound images using wavelet threshIAEME Publication
 
Wiener filter and richardson lucy using ssim
Wiener filter and richardson lucy using ssimWiener filter and richardson lucy using ssim
Wiener filter and richardson lucy using ssimSamer Shorman
 
A Novel Adaptive Denoising Method for Removal of Impulse Noise in Images usin...
A Novel Adaptive Denoising Method for Removal of Impulse Noise in Images usin...A Novel Adaptive Denoising Method for Removal of Impulse Noise in Images usin...
A Novel Adaptive Denoising Method for Removal of Impulse Noise in Images usin...iosrjce
 
Two Dimensional Image Reconstruction Algorithms
Two Dimensional Image Reconstruction AlgorithmsTwo Dimensional Image Reconstruction Algorithms
Two Dimensional Image Reconstruction Algorithmsmastersrihari
 
Image reconstruction in nuclear medicine
Image reconstruction in nuclear medicineImage reconstruction in nuclear medicine
Image reconstruction in nuclear medicineshokoofeh mousavi
 
Deblurring Image and Removing Noise from Medical Images for Cancerous Disease...
Deblurring Image and Removing Noise from Medical Images for Cancerous Disease...Deblurring Image and Removing Noise from Medical Images for Cancerous Disease...
Deblurring Image and Removing Noise from Medical Images for Cancerous Disease...IRJET Journal
 
image denoising technique using disctere wavelet transform
image denoising technique using disctere wavelet transformimage denoising technique using disctere wavelet transform
image denoising technique using disctere wavelet transformalishapb
 
Digital Image Processing Fundamental
Digital Image Processing FundamentalDigital Image Processing Fundamental
Digital Image Processing FundamentalThuong Nguyen Canh
 
Medical image fusion using curvelet transform 2-3-4-5
Medical image fusion using curvelet transform 2-3-4-5Medical image fusion using curvelet transform 2-3-4-5
Medical image fusion using curvelet transform 2-3-4-5IAEME Publication
 
Non-essentiality of Correlation between Image and Depth Map in Free Viewpoin...
Non-essentiality of Correlation between Image and Depth Map in Free Viewpoin...Non-essentiality of Correlation between Image and Depth Map in Free Viewpoin...
Non-essentiality of Correlation between Image and Depth Map in Free Viewpoin...Norishige Fukushima
 
Adaptive Noise Reduction Scheme for Salt and Pepper
Adaptive Noise Reduction Scheme for Salt and PepperAdaptive Noise Reduction Scheme for Salt and Pepper
Adaptive Noise Reduction Scheme for Salt and Peppersipij
 

What's hot (20)

CT Image Reconstruction- Avinesh Shrestha
CT Image Reconstruction- Avinesh ShresthaCT Image Reconstruction- Avinesh Shrestha
CT Image Reconstruction- Avinesh Shrestha
 
final_project
final_projectfinal_project
final_project
 
Speckle noise reduction from medical ultrasound images using wavelet thresh
Speckle noise reduction from medical ultrasound images using wavelet threshSpeckle noise reduction from medical ultrasound images using wavelet thresh
Speckle noise reduction from medical ultrasound images using wavelet thresh
 
Wiener filter and richardson lucy using ssim
Wiener filter and richardson lucy using ssimWiener filter and richardson lucy using ssim
Wiener filter and richardson lucy using ssim
 
W6P3622650776P65
W6P3622650776P65W6P3622650776P65
W6P3622650776P65
 
Image denoising using curvelet transform
Image denoising using curvelet transformImage denoising using curvelet transform
Image denoising using curvelet transform
 
A Novel Adaptive Denoising Method for Removal of Impulse Noise in Images usin...
A Novel Adaptive Denoising Method for Removal of Impulse Noise in Images usin...A Novel Adaptive Denoising Method for Removal of Impulse Noise in Images usin...
A Novel Adaptive Denoising Method for Removal of Impulse Noise in Images usin...
 
Two Dimensional Image Reconstruction Algorithms
Two Dimensional Image Reconstruction AlgorithmsTwo Dimensional Image Reconstruction Algorithms
Two Dimensional Image Reconstruction Algorithms
 
Image reconstruction in nuclear medicine
Image reconstruction in nuclear medicineImage reconstruction in nuclear medicine
Image reconstruction in nuclear medicine
 
Seema dip
Seema dipSeema dip
Seema dip
 
Noise Models
Noise ModelsNoise Models
Noise Models
 
Deblurring Image and Removing Noise from Medical Images for Cancerous Disease...
Deblurring Image and Removing Noise from Medical Images for Cancerous Disease...Deblurring Image and Removing Noise from Medical Images for Cancerous Disease...
Deblurring Image and Removing Noise from Medical Images for Cancerous Disease...
 
DIP - Image Restoration
DIP - Image RestorationDIP - Image Restoration
DIP - Image Restoration
 
image denoising technique using disctere wavelet transform
image denoising technique using disctere wavelet transformimage denoising technique using disctere wavelet transform
image denoising technique using disctere wavelet transform
 
Digital Image Processing Fundamental
Digital Image Processing FundamentalDigital Image Processing Fundamental
Digital Image Processing Fundamental
 
Medical image fusion using curvelet transform 2-3-4-5
Medical image fusion using curvelet transform 2-3-4-5Medical image fusion using curvelet transform 2-3-4-5
Medical image fusion using curvelet transform 2-3-4-5
 
Image denoising
Image denoisingImage denoising
Image denoising
 
Digital image processing
Digital image processing  Digital image processing
Digital image processing
 
Non-essentiality of Correlation between Image and Depth Map in Free Viewpoin...
Non-essentiality of Correlation between Image and Depth Map in Free Viewpoin...Non-essentiality of Correlation between Image and Depth Map in Free Viewpoin...
Non-essentiality of Correlation between Image and Depth Map in Free Viewpoin...
 
Adaptive Noise Reduction Scheme for Salt and Pepper
Adaptive Noise Reduction Scheme for Salt and PepperAdaptive Noise Reduction Scheme for Salt and Pepper
Adaptive Noise Reduction Scheme for Salt and Pepper
 

Similar to Ip unit 3 modified of 26.06.2021

A R EVIEW P APER : N OISE M ODELS IN D IGITAL I MAGE P ROCESSING
A R EVIEW P APER : N OISE M ODELS IN D IGITAL I MAGE P ROCESSINGA R EVIEW P APER : N OISE M ODELS IN D IGITAL I MAGE P ROCESSING
A R EVIEW P APER : N OISE M ODELS IN D IGITAL I MAGE P ROCESSINGsipij
 
An Efficient Image Denoising Approach for the Recovery of Impulse Noise
An Efficient Image Denoising Approach for the Recovery of Impulse NoiseAn Efficient Image Denoising Approach for the Recovery of Impulse Noise
An Efficient Image Denoising Approach for the Recovery of Impulse NoisejournalBEEI
 
Pattern Approximation Based Generalized Image Noise Reduction Using Adaptive ...
Pattern Approximation Based Generalized Image Noise Reduction Using Adaptive ...Pattern Approximation Based Generalized Image Noise Reduction Using Adaptive ...
Pattern Approximation Based Generalized Image Noise Reduction Using Adaptive ...IJECEIAES
 
Performance Assessment of Several Filters for Removing Salt and Pepper Noise,...
Performance Assessment of Several Filters for Removing Salt and Pepper Noise,...Performance Assessment of Several Filters for Removing Salt and Pepper Noise,...
Performance Assessment of Several Filters for Removing Salt and Pepper Noise,...IJEACS
 
IRJET- Removal of Gaussian Impulsive Noise from Computed Tomography
IRJET- Removal of Gaussian Impulsive Noise from Computed TomographyIRJET- Removal of Gaussian Impulsive Noise from Computed Tomography
IRJET- Removal of Gaussian Impulsive Noise from Computed TomographyIRJET Journal
 
An Application of Second Generation Wavelets for Image Denoising using Dual T...
An Application of Second Generation Wavelets for Image Denoising using Dual T...An Application of Second Generation Wavelets for Image Denoising using Dual T...
An Application of Second Generation Wavelets for Image Denoising using Dual T...IDES Editor
 
Review of Linear Image Degradation and Image Restoration Technique
Review of Linear Image Degradation and Image Restoration TechniqueReview of Linear Image Degradation and Image Restoration Technique
Review of Linear Image Degradation and Image Restoration TechniqueBRNSSPublicationHubI
 
Adaptive non-linear-filtering-technique-for-image-restoration
Adaptive non-linear-filtering-technique-for-image-restorationAdaptive non-linear-filtering-technique-for-image-restoration
Adaptive non-linear-filtering-technique-for-image-restorationCemal Ardil
 
An Image Restoration Practical Method
An Image Restoration Practical MethodAn Image Restoration Practical Method
An Image Restoration Practical MethodIDES Editor
 
Review of Use of Nonlocal Spectral – Spatial Structured Sparse Representation...
Review of Use of Nonlocal Spectral – Spatial Structured Sparse Representation...Review of Use of Nonlocal Spectral – Spatial Structured Sparse Representation...
Review of Use of Nonlocal Spectral – Spatial Structured Sparse Representation...IJERA Editor
 
survey paper for image denoising
survey paper for image denoisingsurvey paper for image denoising
survey paper for image denoisingArti Singh
 
Noise Level Estimation for Digital Images Using Local Statistics and Its Appl...
Noise Level Estimation for Digital Images Using Local Statistics and Its Appl...Noise Level Estimation for Digital Images Using Local Statistics and Its Appl...
Noise Level Estimation for Digital Images Using Local Statistics and Its Appl...TELKOMNIKA JOURNAL
 
All optical image processing using third harmonic generation for image correl...
All optical image processing using third harmonic generation for image correl...All optical image processing using third harmonic generation for image correl...
All optical image processing using third harmonic generation for image correl...M. Faisal Halim
 
Comparison of Denoising Filters on Greyscale TEM Image for Different Noise
Comparison of Denoising Filters on Greyscale TEM Image for  Different NoiseComparison of Denoising Filters on Greyscale TEM Image for  Different Noise
Comparison of Denoising Filters on Greyscale TEM Image for Different NoiseIOSR Journals
 
Satellite image compression algorithm based on the fft
Satellite image compression algorithm based on the fftSatellite image compression algorithm based on the fft
Satellite image compression algorithm based on the fftijma
 
Satellite Image Compression Algorithm Based on the FFT
Satellite Image Compression Algorithm Based on the FFTSatellite Image Compression Algorithm Based on the FFT
Satellite Image Compression Algorithm Based on the FFTijma
 

Similar to Ip unit 3 modified of 26.06.2021 (20)

A R EVIEW P APER : N OISE M ODELS IN D IGITAL I MAGE P ROCESSING
A R EVIEW P APER : N OISE M ODELS IN D IGITAL I MAGE P ROCESSINGA R EVIEW P APER : N OISE M ODELS IN D IGITAL I MAGE P ROCESSING
A R EVIEW P APER : N OISE M ODELS IN D IGITAL I MAGE P ROCESSING
 
An Efficient Image Denoising Approach for the Recovery of Impulse Noise
An Efficient Image Denoising Approach for the Recovery of Impulse NoiseAn Efficient Image Denoising Approach for the Recovery of Impulse Noise
An Efficient Image Denoising Approach for the Recovery of Impulse Noise
 
Pattern Approximation Based Generalized Image Noise Reduction Using Adaptive ...
Pattern Approximation Based Generalized Image Noise Reduction Using Adaptive ...Pattern Approximation Based Generalized Image Noise Reduction Using Adaptive ...
Pattern Approximation Based Generalized Image Noise Reduction Using Adaptive ...
 
Performance Assessment of Several Filters for Removing Salt and Pepper Noise,...
Performance Assessment of Several Filters for Removing Salt and Pepper Noise,...Performance Assessment of Several Filters for Removing Salt and Pepper Noise,...
Performance Assessment of Several Filters for Removing Salt and Pepper Noise,...
 
IRJET- Removal of Gaussian Impulsive Noise from Computed Tomography
IRJET- Removal of Gaussian Impulsive Noise from Computed TomographyIRJET- Removal of Gaussian Impulsive Noise from Computed Tomography
IRJET- Removal of Gaussian Impulsive Noise from Computed Tomography
 
An Application of Second Generation Wavelets for Image Denoising using Dual T...
An Application of Second Generation Wavelets for Image Denoising using Dual T...An Application of Second Generation Wavelets for Image Denoising using Dual T...
An Application of Second Generation Wavelets for Image Denoising using Dual T...
 
PID3474431
PID3474431PID3474431
PID3474431
 
Noise
NoiseNoise
Noise
 
Review of Linear Image Degradation and Image Restoration Technique
Review of Linear Image Degradation and Image Restoration TechniqueReview of Linear Image Degradation and Image Restoration Technique
Review of Linear Image Degradation and Image Restoration Technique
 
Adaptive non-linear-filtering-technique-for-image-restoration
Adaptive non-linear-filtering-technique-for-image-restorationAdaptive non-linear-filtering-technique-for-image-restoration
Adaptive non-linear-filtering-technique-for-image-restoration
 
50120130406029
5012013040602950120130406029
50120130406029
 
An Image Restoration Practical Method
An Image Restoration Practical MethodAn Image Restoration Practical Method
An Image Restoration Practical Method
 
Review of Use of Nonlocal Spectral – Spatial Structured Sparse Representation...
Review of Use of Nonlocal Spectral – Spatial Structured Sparse Representation...Review of Use of Nonlocal Spectral – Spatial Structured Sparse Representation...
Review of Use of Nonlocal Spectral – Spatial Structured Sparse Representation...
 
survey paper for image denoising
survey paper for image denoisingsurvey paper for image denoising
survey paper for image denoising
 
R01725115118
R01725115118R01725115118
R01725115118
 
Noise Level Estimation for Digital Images Using Local Statistics and Its Appl...
Noise Level Estimation for Digital Images Using Local Statistics and Its Appl...Noise Level Estimation for Digital Images Using Local Statistics and Its Appl...
Noise Level Estimation for Digital Images Using Local Statistics and Its Appl...
 
All optical image processing using third harmonic generation for image correl...
All optical image processing using third harmonic generation for image correl...All optical image processing using third harmonic generation for image correl...
All optical image processing using third harmonic generation for image correl...
 
Comparison of Denoising Filters on Greyscale TEM Image for Different Noise
Comparison of Denoising Filters on Greyscale TEM Image for  Different NoiseComparison of Denoising Filters on Greyscale TEM Image for  Different Noise
Comparison of Denoising Filters on Greyscale TEM Image for Different Noise
 
Satellite image compression algorithm based on the fft
Satellite image compression algorithm based on the fftSatellite image compression algorithm based on the fft
Satellite image compression algorithm based on the fft
 
Satellite Image Compression Algorithm Based on the FFT
Satellite Image Compression Algorithm Based on the FFTSatellite Image Compression Algorithm Based on the FFT
Satellite Image Compression Algorithm Based on the FFT
 

More from Dr. Radhey Shyam

KIT-601-L-UNIT-1 (Revised) Introduction to Data Analytcs.pdf
KIT-601-L-UNIT-1 (Revised) Introduction to Data Analytcs.pdfKIT-601-L-UNIT-1 (Revised) Introduction to Data Analytcs.pdf
KIT-601-L-UNIT-1 (Revised) Introduction to Data Analytcs.pdfDr. Radhey Shyam
 
SE-UNIT-3-II-Software metrics, numerical and their solutions.pdf
SE-UNIT-3-II-Software metrics, numerical and their solutions.pdfSE-UNIT-3-II-Software metrics, numerical and their solutions.pdf
SE-UNIT-3-II-Software metrics, numerical and their solutions.pdfDr. Radhey Shyam
 
Introduction to Data Analytics and data analytics life cycle
Introduction to Data Analytics and data analytics life cycleIntroduction to Data Analytics and data analytics life cycle
Introduction to Data Analytics and data analytics life cycleDr. Radhey Shyam
 
KIT-601 Lecture Notes-UNIT-2.pdf
KIT-601 Lecture Notes-UNIT-2.pdfKIT-601 Lecture Notes-UNIT-2.pdf
KIT-601 Lecture Notes-UNIT-2.pdfDr. Radhey Shyam
 
KIT-601 Lecture Notes-UNIT-1.pdf
KIT-601 Lecture Notes-UNIT-1.pdfKIT-601 Lecture Notes-UNIT-1.pdf
KIT-601 Lecture Notes-UNIT-1.pdfDr. Radhey Shyam
 
Deep-Learning-2017-Lecture5CNN.pptx
Deep-Learning-2017-Lecture5CNN.pptxDeep-Learning-2017-Lecture5CNN.pptx
Deep-Learning-2017-Lecture5CNN.pptxDr. Radhey Shyam
 
SE UNIT-3 (Software metrics).pdf
SE UNIT-3 (Software metrics).pdfSE UNIT-3 (Software metrics).pdf
SE UNIT-3 (Software metrics).pdfDr. Radhey Shyam
 
Ip unit 4 modified on 22.06.21
Ip unit 4 modified on 22.06.21Ip unit 4 modified on 22.06.21
Ip unit 4 modified on 22.06.21Dr. Radhey Shyam
 
Ip unit 2 modified on 8.6.2021
Ip unit 2 modified on 8.6.2021Ip unit 2 modified on 8.6.2021
Ip unit 2 modified on 8.6.2021Dr. Radhey Shyam
 

More from Dr. Radhey Shyam (20)

KIT-601-L-UNIT-1 (Revised) Introduction to Data Analytcs.pdf
KIT-601-L-UNIT-1 (Revised) Introduction to Data Analytcs.pdfKIT-601-L-UNIT-1 (Revised) Introduction to Data Analytcs.pdf
KIT-601-L-UNIT-1 (Revised) Introduction to Data Analytcs.pdf
 
SE-UNIT-3-II-Software metrics, numerical and their solutions.pdf
SE-UNIT-3-II-Software metrics, numerical and their solutions.pdfSE-UNIT-3-II-Software metrics, numerical and their solutions.pdf
SE-UNIT-3-II-Software metrics, numerical and their solutions.pdf
 
Introduction to Data Analytics and data analytics life cycle
Introduction to Data Analytics and data analytics life cycleIntroduction to Data Analytics and data analytics life cycle
Introduction to Data Analytics and data analytics life cycle
 
KCS-501-3.pdf
KCS-501-3.pdfKCS-501-3.pdf
KCS-501-3.pdf
 
KIT-601 Lecture Notes-UNIT-2.pdf
KIT-601 Lecture Notes-UNIT-2.pdfKIT-601 Lecture Notes-UNIT-2.pdf
KIT-601 Lecture Notes-UNIT-2.pdf
 
KIT-601 Lecture Notes-UNIT-1.pdf
KIT-601 Lecture Notes-UNIT-1.pdfKIT-601 Lecture Notes-UNIT-1.pdf
KIT-601 Lecture Notes-UNIT-1.pdf
 
KCS-055 U5.pdf
KCS-055 U5.pdfKCS-055 U5.pdf
KCS-055 U5.pdf
 
KCS-055 MLT U4.pdf
KCS-055 MLT U4.pdfKCS-055 MLT U4.pdf
KCS-055 MLT U4.pdf
 
Deep-Learning-2017-Lecture5CNN.pptx
Deep-Learning-2017-Lecture5CNN.pptxDeep-Learning-2017-Lecture5CNN.pptx
Deep-Learning-2017-Lecture5CNN.pptx
 
SE UNIT-3 (Software metrics).pdf
SE UNIT-3 (Software metrics).pdfSE UNIT-3 (Software metrics).pdf
SE UNIT-3 (Software metrics).pdf
 
SE UNIT-2.pdf
SE UNIT-2.pdfSE UNIT-2.pdf
SE UNIT-2.pdf
 
SE UNIT-1 Revised.pdf
SE UNIT-1 Revised.pdfSE UNIT-1 Revised.pdf
SE UNIT-1 Revised.pdf
 
SE UNIT-3.pdf
SE UNIT-3.pdfSE UNIT-3.pdf
SE UNIT-3.pdf
 
Ip unit 5
Ip unit 5Ip unit 5
Ip unit 5
 
Ip unit 4 modified on 22.06.21
Ip unit 4 modified on 22.06.21Ip unit 4 modified on 22.06.21
Ip unit 4 modified on 22.06.21
 
Ip unit 2 modified on 8.6.2021
Ip unit 2 modified on 8.6.2021Ip unit 2 modified on 8.6.2021
Ip unit 2 modified on 8.6.2021
 
Ip unit 1
Ip unit 1Ip unit 1
Ip unit 1
 
Cc unit 5
Cc unit 5Cc unit 5
Cc unit 5
 
Cc unit 4 updated version
Cc unit 4 updated versionCc unit 4 updated version
Cc unit 4 updated version
 
Cc unit 3 updated version
Cc unit 3 updated versionCc unit 3 updated version
Cc unit 3 updated version
 

Recently uploaded

UNIT - IV - Air Compressors and its Performance
UNIT - IV - Air Compressors and its PerformanceUNIT - IV - Air Compressors and its Performance
UNIT - IV - Air Compressors and its Performancesivaprakash250
 
(PRIYA) Rajgurunagar Call Girls Just Call 7001035870 [ Cash on Delivery ] Pun...
(PRIYA) Rajgurunagar Call Girls Just Call 7001035870 [ Cash on Delivery ] Pun...(PRIYA) Rajgurunagar Call Girls Just Call 7001035870 [ Cash on Delivery ] Pun...
(PRIYA) Rajgurunagar Call Girls Just Call 7001035870 [ Cash on Delivery ] Pun...ranjana rawat
 
Call Girls Service Nashik Vaishnavi 7001305949 Independent Escort Service Nashik
Call Girls Service Nashik Vaishnavi 7001305949 Independent Escort Service NashikCall Girls Service Nashik Vaishnavi 7001305949 Independent Escort Service Nashik
Call Girls Service Nashik Vaishnavi 7001305949 Independent Escort Service NashikCall Girls in Nagpur High Profile
 
High Profile Call Girls Nagpur Meera Call 7001035870 Meet With Nagpur Escorts
High Profile Call Girls Nagpur Meera Call 7001035870 Meet With Nagpur EscortsHigh Profile Call Girls Nagpur Meera Call 7001035870 Meet With Nagpur Escorts
High Profile Call Girls Nagpur Meera Call 7001035870 Meet With Nagpur EscortsCall Girls in Nagpur High Profile
 
(ANVI) Koregaon Park Call Girls Just Call 7001035870 [ Cash on Delivery ] Pun...
(ANVI) Koregaon Park Call Girls Just Call 7001035870 [ Cash on Delivery ] Pun...(ANVI) Koregaon Park Call Girls Just Call 7001035870 [ Cash on Delivery ] Pun...
(ANVI) Koregaon Park Call Girls Just Call 7001035870 [ Cash on Delivery ] Pun...ranjana rawat
 
VIP Call Girls Service Hitech City Hyderabad Call +91-8250192130
VIP Call Girls Service Hitech City Hyderabad Call +91-8250192130VIP Call Girls Service Hitech City Hyderabad Call +91-8250192130
VIP Call Girls Service Hitech City Hyderabad Call +91-8250192130Suhani Kapoor
 
Call Girls Pimpri Chinchwad Call Me 7737669865 Budget Friendly No Advance Boo...
Call Girls Pimpri Chinchwad Call Me 7737669865 Budget Friendly No Advance Boo...Call Girls Pimpri Chinchwad Call Me 7737669865 Budget Friendly No Advance Boo...
Call Girls Pimpri Chinchwad Call Me 7737669865 Budget Friendly No Advance Boo...roncy bisnoi
 
Call for Papers - Educational Administration: Theory and Practice, E-ISSN: 21...
Call for Papers - Educational Administration: Theory and Practice, E-ISSN: 21...Call for Papers - Educational Administration: Theory and Practice, E-ISSN: 21...
Call for Papers - Educational Administration: Theory and Practice, E-ISSN: 21...Christo Ananth
 
AKTU Computer Networks notes --- Unit 3.pdf
AKTU Computer Networks notes ---  Unit 3.pdfAKTU Computer Networks notes ---  Unit 3.pdf
AKTU Computer Networks notes --- Unit 3.pdfankushspencer015
 
247267395-1-Symmetric-and-distributed-shared-memory-architectures-ppt (1).ppt
247267395-1-Symmetric-and-distributed-shared-memory-architectures-ppt (1).ppt247267395-1-Symmetric-and-distributed-shared-memory-architectures-ppt (1).ppt
247267395-1-Symmetric-and-distributed-shared-memory-architectures-ppt (1).pptssuser5c9d4b1
 
Coefficient of Thermal Expansion and their Importance.pptx
Coefficient of Thermal Expansion and their Importance.pptxCoefficient of Thermal Expansion and their Importance.pptx
Coefficient of Thermal Expansion and their Importance.pptxAsutosh Ranjan
 
Call Girls Service Nagpur Tanvi Call 7001035870 Meet With Nagpur Escorts
Call Girls Service Nagpur Tanvi Call 7001035870 Meet With Nagpur EscortsCall Girls Service Nagpur Tanvi Call 7001035870 Meet With Nagpur Escorts
Call Girls Service Nagpur Tanvi Call 7001035870 Meet With Nagpur EscortsCall Girls in Nagpur High Profile
 
result management system report for college project
result management system report for college projectresult management system report for college project
result management system report for college projectTonystark477637
 
(RIA) Call Girls Bhosari ( 7001035870 ) HI-Fi Pune Escorts Service
(RIA) Call Girls Bhosari ( 7001035870 ) HI-Fi Pune Escorts Service(RIA) Call Girls Bhosari ( 7001035870 ) HI-Fi Pune Escorts Service
(RIA) Call Girls Bhosari ( 7001035870 ) HI-Fi Pune Escorts Serviceranjana rawat
 
Processing & Properties of Floor and Wall Tiles.pptx
Processing & Properties of Floor and Wall Tiles.pptxProcessing & Properties of Floor and Wall Tiles.pptx
Processing & Properties of Floor and Wall Tiles.pptxpranjaldaimarysona
 
Sheet Pile Wall Design and Construction: A Practical Guide for Civil Engineer...
Sheet Pile Wall Design and Construction: A Practical Guide for Civil Engineer...Sheet Pile Wall Design and Construction: A Practical Guide for Civil Engineer...
Sheet Pile Wall Design and Construction: A Practical Guide for Civil Engineer...Dr.Costas Sachpazis
 
Extrusion Processes and Their Limitations
Extrusion Processes and Their LimitationsExtrusion Processes and Their Limitations
Extrusion Processes and Their Limitations120cr0395
 
College Call Girls Nashik Nehal 7001305949 Independent Escort Service Nashik
College Call Girls Nashik Nehal 7001305949 Independent Escort Service NashikCollege Call Girls Nashik Nehal 7001305949 Independent Escort Service Nashik
College Call Girls Nashik Nehal 7001305949 Independent Escort Service NashikCall Girls in Nagpur High Profile
 

Recently uploaded (20)

UNIT - IV - Air Compressors and its Performance
UNIT - IV - Air Compressors and its PerformanceUNIT - IV - Air Compressors and its Performance
UNIT - IV - Air Compressors and its Performance
 
(PRIYA) Rajgurunagar Call Girls Just Call 7001035870 [ Cash on Delivery ] Pun...
(PRIYA) Rajgurunagar Call Girls Just Call 7001035870 [ Cash on Delivery ] Pun...(PRIYA) Rajgurunagar Call Girls Just Call 7001035870 [ Cash on Delivery ] Pun...
(PRIYA) Rajgurunagar Call Girls Just Call 7001035870 [ Cash on Delivery ] Pun...
 
Call Girls Service Nashik Vaishnavi 7001305949 Independent Escort Service Nashik
Call Girls Service Nashik Vaishnavi 7001305949 Independent Escort Service NashikCall Girls Service Nashik Vaishnavi 7001305949 Independent Escort Service Nashik
Call Girls Service Nashik Vaishnavi 7001305949 Independent Escort Service Nashik
 
DJARUM4D - SLOT GACOR ONLINE | SLOT DEMO ONLINE
DJARUM4D - SLOT GACOR ONLINE | SLOT DEMO ONLINEDJARUM4D - SLOT GACOR ONLINE | SLOT DEMO ONLINE
DJARUM4D - SLOT GACOR ONLINE | SLOT DEMO ONLINE
 
High Profile Call Girls Nagpur Meera Call 7001035870 Meet With Nagpur Escorts
High Profile Call Girls Nagpur Meera Call 7001035870 Meet With Nagpur EscortsHigh Profile Call Girls Nagpur Meera Call 7001035870 Meet With Nagpur Escorts
High Profile Call Girls Nagpur Meera Call 7001035870 Meet With Nagpur Escorts
 
(ANVI) Koregaon Park Call Girls Just Call 7001035870 [ Cash on Delivery ] Pun...
(ANVI) Koregaon Park Call Girls Just Call 7001035870 [ Cash on Delivery ] Pun...(ANVI) Koregaon Park Call Girls Just Call 7001035870 [ Cash on Delivery ] Pun...
(ANVI) Koregaon Park Call Girls Just Call 7001035870 [ Cash on Delivery ] Pun...
 
VIP Call Girls Service Hitech City Hyderabad Call +91-8250192130
VIP Call Girls Service Hitech City Hyderabad Call +91-8250192130VIP Call Girls Service Hitech City Hyderabad Call +91-8250192130
VIP Call Girls Service Hitech City Hyderabad Call +91-8250192130
 
Call Girls Pimpri Chinchwad Call Me 7737669865 Budget Friendly No Advance Boo...
Call Girls Pimpri Chinchwad Call Me 7737669865 Budget Friendly No Advance Boo...Call Girls Pimpri Chinchwad Call Me 7737669865 Budget Friendly No Advance Boo...
Call Girls Pimpri Chinchwad Call Me 7737669865 Budget Friendly No Advance Boo...
 
Call for Papers - Educational Administration: Theory and Practice, E-ISSN: 21...
Call for Papers - Educational Administration: Theory and Practice, E-ISSN: 21...Call for Papers - Educational Administration: Theory and Practice, E-ISSN: 21...
Call for Papers - Educational Administration: Theory and Practice, E-ISSN: 21...
 
AKTU Computer Networks notes --- Unit 3.pdf
AKTU Computer Networks notes ---  Unit 3.pdfAKTU Computer Networks notes ---  Unit 3.pdf
AKTU Computer Networks notes --- Unit 3.pdf
 
247267395-1-Symmetric-and-distributed-shared-memory-architectures-ppt (1).ppt
247267395-1-Symmetric-and-distributed-shared-memory-architectures-ppt (1).ppt247267395-1-Symmetric-and-distributed-shared-memory-architectures-ppt (1).ppt
247267395-1-Symmetric-and-distributed-shared-memory-architectures-ppt (1).ppt
 
Coefficient of Thermal Expansion and their Importance.pptx
Coefficient of Thermal Expansion and their Importance.pptxCoefficient of Thermal Expansion and their Importance.pptx
Coefficient of Thermal Expansion and their Importance.pptx
 
Call Girls Service Nagpur Tanvi Call 7001035870 Meet With Nagpur Escorts
Call Girls Service Nagpur Tanvi Call 7001035870 Meet With Nagpur EscortsCall Girls Service Nagpur Tanvi Call 7001035870 Meet With Nagpur Escorts
Call Girls Service Nagpur Tanvi Call 7001035870 Meet With Nagpur Escorts
 
Water Industry Process Automation & Control Monthly - April 2024
Water Industry Process Automation & Control Monthly - April 2024Water Industry Process Automation & Control Monthly - April 2024
Water Industry Process Automation & Control Monthly - April 2024
 
result management system report for college project
result management system report for college projectresult management system report for college project
result management system report for college project
 
(RIA) Call Girls Bhosari ( 7001035870 ) HI-Fi Pune Escorts Service
(RIA) Call Girls Bhosari ( 7001035870 ) HI-Fi Pune Escorts Service(RIA) Call Girls Bhosari ( 7001035870 ) HI-Fi Pune Escorts Service
(RIA) Call Girls Bhosari ( 7001035870 ) HI-Fi Pune Escorts Service
 
Processing & Properties of Floor and Wall Tiles.pptx
Processing & Properties of Floor and Wall Tiles.pptxProcessing & Properties of Floor and Wall Tiles.pptx
Processing & Properties of Floor and Wall Tiles.pptx
 
Sheet Pile Wall Design and Construction: A Practical Guide for Civil Engineer...
Sheet Pile Wall Design and Construction: A Practical Guide for Civil Engineer...Sheet Pile Wall Design and Construction: A Practical Guide for Civil Engineer...
Sheet Pile Wall Design and Construction: A Practical Guide for Civil Engineer...
 
Extrusion Processes and Their Limitations
Extrusion Processes and Their LimitationsExtrusion Processes and Their Limitations
Extrusion Processes and Their Limitations
 
College Call Girls Nashik Nehal 7001305949 Independent Escort Service Nashik
College Call Girls Nashik Nehal 7001305949 Independent Escort Service NashikCollege Call Girls Nashik Nehal 7001305949 Independent Escort Service Nashik
College Call Girls Nashik Nehal 7001305949 Independent Escort Service Nashik
 

Ip unit 3 modified of 26.06.2021

  • 1. Image Processing (KCS-062): Unit-3: Image Restoration Dr. Radhey Shyam Professor Department of Computer Science and Engineering BIET Lucknow (Affiliated to Dr. A.P.J. Abdul Kalam Technical University (APJAKTU) Lucknow) And Dr. Philippe Cattin MIAC, University of Basel Unit-3 have been compiled by Dr. Radhey Shyam, with grateful acknowledgment to Dr. Philippe Cattin MIAC, University of Basel who made their course contents freely available. Feel free to use this study material for your own academic purposes. For any query, the communication can be made through my mail shyam0058@gmail.com. Course Outcome of Unit-3, the students will be able to explain the basic concepts of Image Restoration. Date: June 22, 2021
  • 2. Image Degradation & Restoration Model April 19th/26th, 2016 Introduction to Signal and Image Processing (4) Image Degradation & Restoration Model The degradation process is generally modelled as a degradation function and the additive noise term together they yield . Given , some knowledge about , and it is the objective of restoration to estimate . Of course this estimate should be as close as possible to . Fig 6.1 Image degradation model 6 of 70 22.02.2016 09:19
  • 3. April 19th/26th, 2016 Introduction to Signal and Image Processing Image Degradation & Restoration Model (5) Ph. Cattin: Image Restoration Image Degradation & Restoration Model (2) If the degradation function is a linear, shift-invariant process, then the degraded image is given in the spatial domain by (6.1) where is the spatial representation of the degradation function, and indicates convolution. As we know from the Convolution Theorem this can be rewritten in the frequency domain (6.2) where the capital letters are the Fourier transforms of the respective function in Eq 6.1. 7 of 70 22.02.2016 09:19
  • 4. Noise Models April 19th/26th, 2016 Introduction to Signal and Image Processing (7) Noise Models The principle sources of noise in digital images arise during image acquisition and/or transmission. The performance of imaging sensors are affected by a variety of factors during acquisition, such as Environmental conditions during the acquisition Light levels (low light conditions require high gain amplification) Sensor temperature (higher temp implies more amplification noise) Images can also be corrupted during transmission due to interference in the channel for example Lightning or other Atmospheric disturbances Depending on the specific noise source, a different model must be selected that accurately reproduces the spatial characteristics of the noise. 8 of 70 22.02.2016 09:19
  • 5. April 19th/26th, 2016 Introduction to Signal and Image Processing Noise Models (8) Ph. Cattin: Image Restoration Gaussian Noise Because of its mathematical tractability in both the spatial and frequency domain, Gaussian noise models (aka normal distribution) are used frequently in practice. The PDF (Probability density function) of a Gaussian random variable is given by (6.3) where represents the grey level, the mean value and the standard deviation. Fig 6.2: Gaussian probability density function The application of the Gaussian model is so convenient that it is often used in situations in which they are marginally applicable at best. 9 of 70 22.02.2016 09:19
  • 6. April 19th/26th, 2016 Introduction to Signal and Image Processing Noise Models (9) Ph. Cattin: Image Restoration Rayleigh Noise The PDF of Rayleigh noise is defined by (6.4) the mean and variance are given by (6.5) Fig 6.3: Rayleigh probability density function As the shape of the Rayleigh density function is skewed it is useful for approximating skewed histograms. 10 of 70 22.02.2016 09:19
  • 7. April 19th/26th, 2016 Introduction to Signal and Image Processing Noise Models (10) Ph. Cattin: Image Restoration Erlang Noise The PDF of the Erlang noise is given by (6.6) where , is a positive integer. The mean and variance are then given by (6.7) Fig 6.4: Erlang probability density function 11 of 70 22.02.2016 09:19
  • 8. April 19th/26th, 2016 Introduction to Signal and Image Processing Noise Models (11) Ph. Cattin: Image Restoration Exponential Noise The PDF of the exponential noise is given by (6.8) where . The mean and variance of the density function are (6.9) Fig 6.5: Probability density function of exponential noise The exponential noise model is a special case of the Erlang noise model with . 12 of 70 22.02.2016 09:19
  • 9. April 19th/26th, 2016 Introduction to Signal and Image Processing Noise Models (12) Ph. Cattin: Image Restoration Uniform Noise The PDF of the uniform noise is given by (6.10) The mean and variance of the density function are given by (6.11) Fig 6.6: Probability density function of uniform noise 13 of 70 22.02.2016 09:19
  • 10. April 19th/26th, 2016 Introduction to Signal and Image Processing Noise Models (13) Ph. Cattin: Image Restoration Impulse (Salt- and-Pepper) Noise The PDF of bipolar impulse noise model is given by (6.12) Fig 6.7: Probability density function of the bipolar impulse noise model If , grey-level appears as a light dot (salt) in the image. Conversely, will appear as dark dot (pepper). If either is zero, the PDF is called unipolar. Because impulse corruption is generally large compared to the signal strength, the assumption is usually that and are digitised as saturated values thus black (pepper) and white (salt). 14 of 70 22.02.2016 09:19
  • 11. April 19th/26th, 2016 Introduction to Signal and Image Processing Noise Models (14) Ph. Cattin: Image Restoration Noise Models The presented noise models provide a useful tool for approximating a broad range of noise corruption situations found in practice. For example: Gaussian noise: arises in images due to sensor noise caused by poor illumination and/or high temperature, and electronic circuit noise The Rayleigh noise model is used to characterise noise phenomena in range images Exponential and Erlang noise models find their application in Laser imaging Impulse noise takes place in situations where high transients (faulty switching) occurs 15 of 70 22.02.2016 09:19
  • 12. April 19th/26th, 2016 Introduction to Signal and Image Processing Noise Models (15) Ph. Cattin: Image Restoration Visual Comparison of Different Noise Sources Although the corresponding histograms show close resemblance to the PDF of the respective noise model, it is virtually impossible to select the type of noise causing the degradation from the image alone. Gaussian noise model Rayleigh noise model Erlang noise model 16 of 70 22.02.2016 09:19
  • 13. April 19th/26th, 2016 Introduction to Signal and Image Processing Exponential noise model Uniform noise model Impulse noise model (Salt & Pepper) 17 of 70 22.02.2016 09:19
  • 14. April 19th/26th, 2016 Introduction to Signal and Image Processing Noise Models (16) Ph. Cattin: Image Restoration Periodic Noise Periodic noise typically arises from electrical or electromechanical interference during image acquisition and is spatial dependent. Fig 6.8: Periodic noise on a satellite image of Pompeii Fig 6.9: Spectrum of the Pompeii image with periodic noise (peaks of the periodic noise visually enhanced) 18 of 70 22.02.2016 09:19
  • 15. April 19th/26th, 2016 Introduction to Signal and Image Processing Noise Models (17) Ph. Cattin: Image Restoration Estimation of Noise Parameters (1) In rare cases the parameters of noise PDFs may be known from sensor specifications, but it is often necessary to estimate them for a particular imaging arrangement. If the imaging system is available, one simple way to study noise characteristics would be to capture multiple images of homogeneous environments, such as solid grey cards. Fig 6.10: Sample histogram of a small patch of Erlang noise In many cases the noise parameters have to be estimated from already captured images. The simplest way is to estimate the mean and variance of the grey levels from small patches of reasonably constant grey level. 19 of 70 22.02.2016 09:19
  • 16. April 19th/26th, 2016 Introduction to Signal and Image Processing Noise Models (18) Ph. Cattin: Image Restoration Estimation of Periodic Noise Parameters The parameters of periodic noise are typically estimated by inspection of the Fourier spectrum. The frequency spikes can often be detected by visual analysis. Automatic analysis is possible if the noise spikes are either exceptionally pronounced or a priori knowledge about their location is known. Fig. 6.11: Fig. 6.12: 20 of 70 22.02.2016 09:19
  • 17. Restoration in the Precense of Noise Only April 19th/26th, 2016 Introduction to Signal and Image Processing (20) Restoration in the Precense of Noise Only When noise is the only image degradation present in an image, thus , Eqs 6.1 & 6.2 become (6.13) and (6.14) In case of periodic noise, it is usually possible to estimate from the spectrum of and subtract it to obtain an estimate of the original image . But estimating the noise terms is unreasonable, so subtracting them from is impossible. Spatial filtering is the method of choice in situations when only additive noise is present. 21 of 70 22.02.2016 09:19
  • 18. Periodic Noise Reduction by Frequency Domain Filtering Bandreject Filter April 19th/26th, 2016 Introduction to Signal and Image Processing 22 of 70 22.02.2016 09:19
  • 19. April 19th/26th, 2016 Introduction to Signal and Image Processing (23) Bandreject Filter Bandreject filters remove or attenuate a band of frequencies around the origin in the Fourier domain. Ideal Bandreject Filter (6.15) Fig 6.13: Ideal bandreject filter Butterworth Bandreject Filter (6.16) Fig 6.14: Butterworth bandreject filter Gaussian Bandreject Filter (6.17) Fig 6.15: Gaussian bandreject filter 23 of 70 22.02.2016 09:19
  • 20. April 19th/26th, 2016 Introduction to Signal and Image Processing Bandreject Filter (24) Ph. Cattin: Image Restoration Bandreject Filter Example Fig 6.16: Aerial image of Pompeii with periodic noise Fig 6.17: Ideal bandreject filter Fig 6.18: Butterworth bandreject filter Fig 6.19: Gaussian bandreject filter 24 of 70 22.02.2016 09:19
  • 21. Bandpass Filter April 19th/26th, 2016 Introduction to Signal and Image Processing (26) Bandpass Filter The Bandpass filter performs the opposite of a bandreject filter and thus lets pass the frequencies in a narrow band of width around . The transfer function can be obtained from a corresponding bandreject filter by using the equation (6.18) The perspective plots of the corresponding filters are depicted in Fig 6.20. (a) (b) (c) Fig 6.20 (a) Ideal bandpass filter, (b) Butterworth bandpass filter, and (c) Gaussian bandpass filter 25 of 70 22.02.2016 09:19
  • 22. April 19th/26th, 2016 Introduction to Signal and Image Processing Bandpass Filter (27) Ph. Cattin: Image Restoration Bandpass Filter Example Fig 6.21: Aerial image of Pompeii with periodic noise Fig 6.22: Ideal bandpass filter Fig 6.23: Butterworth bandpass filter Fig 6.24: Gaussian bandpass filter 26 of 70 22.02.2016 09:19
  • 23. Notch Filter April 19th/26th, 2016 Introduction to Signal and Image Processing 27 of 70 22.02.2016 09:19
  • 24. April 19th/26th, 2016 Introduction to Signal and Image Processing (29) Notch Filter A Notch filter rejects or passes frequencies in predefined neighbourhoods about a centre frequency. Due to the symmetry of the Fourier transform, notch filters must appear in symmetric pairs about the origin (except the one at the origin). The transfer functions of the ideal, Butterworth, and Gaussian notch reject filter of radius (width) with centres at and, by symmetry, at , are Ideal Notch Filter (6.19) Fig 6.25: Ideal notch filter Butterworth Notch Filter (6.20) Fig 6.26: Butterworth notch filter Gaussian Notch Filter (6.21) Fig 6.27: Gaussian notch filter where (6.22) 28 of 70 22.02.2016 09:19
  • 25. April 19th/26th, 2016 Introduction to Signal and Image Processing 29 of 70 22.02.2016 09:19
  • 26. April 19th/26th, 2016 Introduction to Signal and Image Processing Notch Filter (30) Ph. Cattin: Image Restoration Notch Filter (2) Similar to the bandpass/bandreject filters, the Notch reject filters can be turned into Notch pass filters with the relation (6.23) where is the transfer function of the notch pass filter, and the corresponding Notch reject filter. If the Notch reject filter becomes a highpass filter and the Notch pass filter becomes a lowpass filter. 30 of 70 22.02.2016 09:19
  • 27. April 19th/26th, 2016 Introduction to Signal and Image Processing Notch Filter (31) Ph. Cattin: Image Restoration Ideal Notch Filter D_0=16 Example Fig 6.28: Pompeii aerial image with periodic noise Fig 6.29: Notch reject filtered image Fig 6.30: Notch pass filtered image (contrast enhanced) 31 of 70 22.02.2016 09:19
  • 28. April 19th/26th, 2016 Introduction to Signal and Image Processing Notch Filter (32) Ph. Cattin: Image Restoration Butterworth Notch Filter D_0=64 Example Fig 6.31: Pompeii aerial image with periodic noise Fig 6.32: Notch reject filtered image Fig 6.33: Notch pass filtered image (contrast enhanced) 32 of 70 22.02.2016 09:19
  • 29. April 19th/26th, 2016 Introduction to Signal and Image Processing Notch Filter (33) Ph. Cattin: Image Restoration Gaussian Notch Filter D_0=64 Example Fig 6.34: Pompeii aerial image with periodic noise Fig 6.35: Notch reject filtered image Fig 6.36: Notch pass filtered image (contrast enhanced) 33 of 70 22.02.2016 09:19
  • 30. April 19th/26th, 2016 Introduction to Signal and Image Processing Notch Filter (34) Ph. Cattin: Image Restoration General Notch Filter Example Fig 6.37: Original Mariner 6 martian image Fig 6.38: Log Fourier spectra of the image Fig 6.39: Notch filtered log spectra Fig 6.40: Notch filtered image 34 of 70 22.02.2016 09:19
  • 31. Optimum Notch Filtering April 19th/26th, 2016 Introduction to Signal and Image Processing 35 of 70 22.02.2016 09:19
  • 32. April 19th/26th, 2016 Introduction to Signal and Image Processing (36) Optimum Notch Filtering Images derived from electro-optical scanners, such as those used in space and aerial imaging, are sometimes corrupted by coupling and amplification of low-level signals in the scanners' circuitry. The resulting images tend to contain substantial periodic noise. The interference pattern are, however, in practice not always as clearly defined as in the samples shown thus far. The first step in Optimum notch filtering is to find the principal frequency components and placing notch pass filters at the location of each spike, yielding . The Fourier transform of the interference pattern is thus given by (6.24) where is the Fourier transform of the corrupted image. The corresponding interference pattern in the spatial domain is obtained with the inverse Fourier transform (6.25) As the corrupted image is assumed to be formed by the addition of the uncorrupted image and the interference noise (6.26) If the noise term were known completely, subtracting it from would yield . The problem is of course that the estimated interference pattern is only an approximation. The effect of components not present in the estimate can be minimised be subtracting from a weighted portion of to obtain an estimate for 36 of 70 22.02.2016 09:19
  • 33. April 19th/26th, 2016 Introduction to Signal and Image Processing (6.27) where is the estimate of , and is to be determined and optimises in some meaningful way. One common approach is to select so that the variance of is minimised over a specified neighbourhood of size about every point . (6.29) where is the average value of in the neighbourhood; that is (6.30) Substituting Eq 6.27 into Eq 6.29 yields (6.31) Assuming that remains constant over the neighbourhood gives the approximation (6.32) for and . This assumption results in the expression (6.33) 37 of 70 22.02.2016 09:19
  • 34. April 19th/26th, 2016 Introduction to Signal and Image Processing in the neighbourhood. With these approximations Eq 6.30 becomes (6.34) To minimise , we solve (6.35) for . The result is (6.36) To obtain an estimated restored image , must be computed from Eq 6.36 and substituted into Eq 6.27 to determine . 38 of 70 22.02.2016 09:19
  • 35. April 19th/26th, 2016 Introduction to Signal and Image Processing Optimum Notch Filtering (37) Ph. Cattin: Image Restoration Optimum Notch Filtering Principle Fig 6.41 Principle of the optimum notch filter 39 of 70 22.02.2016 09:19
  • 36. April 19th/26th, 2016 Introduction to Signal and Image Processing Optimum Notch Filtering (38) Ph. Cattin: Image Restoration Optimum Notch Filter Example Fig 6.42 Aerial image of Pompeii with heavy periodic noise distortions Fig 6.43 Noise estimation with Gaussian notch pass filter Fig 6.44 Notch reject filtered image Fig 6.45 Result filtered with an optimum notch filter of size 40 of 70 22.02.2016 09:19
  • 37. April 19th/26th, 2016 Introduction to Signal and Image Processing Optimum Notch Filtering (39) Ph. Cattin: Image Restoration Optimum Notch Filter Example with Pixel Increments Fig 6.46 Aerial image of Pompeii corrected with the optimal notch filter of size with the window shifted pixelwise 41 of 70 22.02.2016 09:19
  • 38. April 19th/26th, 2016 Introduction to Signal and Image Processing Optimum Notch Filtering (40) Ph. Cattin: Image Restoration Optimum Notch Filter Example with Pixel Increments (2) Fig 6.47 of the example image in Fig 6.46 42 of 70 22.02.2016 09:19
  • 39. Estimating the Degradation Function April 19th/26th, 2016 Introduction to Signal and Image Processing (42) Estimating the Degradation Function So far we concentrated mainly at the additive noise term . In the remainder of this presentation we concentrate on ways to remove the degradation function . Fig 6.48 Image degradation model 43 of 70 22.02.2016 09:19
  • 40. April 19th/26th, 2016 Introduction to Signal and Image Processing Estimating the Degradation Function (43) Ph. Cattin: Image Restoration Estimating the Degradation Function (2) There are three principle methods to estimate the degradation function Observation 1. Experimentation 2. Mathematical modelling 3. The process of restoring a corrupted image using the estimated degradation function is sometimes called blind deconvolution, as the true degradation is seldom known completely. In recent years a forth method based on maximum- likelihood estimation (MLE) often called blind deconvolution has been proposed. Beware: All multiplications/divisions in the equations in this part of the lecture are componentwise. 44 of 70 22.02.2016 09:19
  • 41. April 19th/26th, 2016 Introduction to Signal and Image Processing Estimating the Degradation Function (44) Ph. Cattin: Image Restoration Estimating by Image Observation Given A degraded image without any information about the degradation function . Solution Select a subimage with strong signal content → 1. By estimating the sample grey levels of the object and background in we can construct an unblurred image of the same size and characteristics as the observed subimage → 2. Assuming that the effect of noise is negligible (thus the choice of a strong signal area), it follows from Eq 6.2 that 3. Thanks to the shift invariance we can deduce from 4. 45 of 70 22.02.2016 09:19
  • 42. April 19th/26th, 2016 Introduction to Signal and Image Processing Estimating the Degradation Function (45) Ph. Cattin: Image Restoration Estimating by Experimentation Given Equipment similar to the equipment used to acquire the degraded image Solution Images similar to the degraded image can be acquired with various system settings until it closely matches the degraded image 1. The system can then be characterised by measuring the impulse (small bright dot of light) response. A linear, shift invariant system can be fully described by its impulse response. 2. As the Fourier transform of an impulse is a constant, it follows from Eq 6.2 where is the Fourier transform of the observed image, and is a constant describing the strength of the impulse. 3. 46 of 70 22.02.2016 09:19
  • 43. April 19th/26th, 2016 Introduction to Signal and Image Processing Estimating the Degradation Function (46) Ph. Cattin: Image Restoration Estimating by Mathematical Modelling Degradation modelling has been used for many years. It, however, requires an indepth understanding of the involved physical phenomenon. In some cases it can even incorporate environmental conditions that cause degradations. Hufnagel and Stanly proposed in 1964 a model to characterise atmospheric turbulence. (6.37) where is a constant that depends on the nature of the turbulence. Except of the 5/6 power the above equation has the same form as a Gaussian lowpass filter. 47 of 70 22.02.2016 09:19
  • 44. April 19th/26th, 2016 Introduction to Signal and Image Processing Estimating the Degradation Function (47) Ph. Cattin: Image Restoration Illustration of the Atmospheric Turbulence Model Fig 6.49: Aerial image of Pompeii Fig 6.50: Pompeii with mild turbulence Fig 6.51: Pompeii with medium turbulence Fig 6.52 Pompeii with heavy turbulence 48 of 70 22.02.2016 09:19
  • 45. Inverse Filtering Direct Inverse Filtering April 19th/26th, 2016 Introduction to Signal and Image Processing 49 of 70 22.02.2016 09:19
  • 46. April 19th/26th, 2016 Introduction to Signal and Image Processing (50) Direct Inverse Filtering The simplest approach to restore a degraded image is to form an estimate of the form (6.38) and then obtain the corresponding image by inverse Fourier transform. This method is called direct inverse filtering. With the degradation model Equation 6.2 we get (6.39) This simple equation tells us that, even if we knew exactly we could not recover the undegraded image completely because: the noise component is a random function whose Fourier transform is not known, and 1. in practice can contain numerous zeros. 2. Direct Inverse filtering is seldom a suitable approach in practical applications 50 of 70 22.02.2016 09:19
  • 47. April 19th/26th, 2016 Introduction to Signal and Image Processing Direct Inverse Filtering (51) Ph. Cattin: Image Restoration Two Practical Approaches for Inverse Filtering Low Pass Filter (6.40) where is a low-pass filter that should eliminiate the very low (or even zero) values often experienced in the high frequencies. 1. Constrained Division (6.41) gives values, where is lower than a threshold a special treatment. 2. These appraoches are also known as Pseudo- Inverse Filtering. 51 of 70 22.02.2016 09:19
  • 48. April 19th/26th, 2016 Introduction to Signal and Image Processing Direct Inverse Filtering (52) Ph. Cattin: Image Restoration Artificial Inverse Filtering Example Fig 6.53: Checkerboard sample Fig 6.54: Motion blur of in direction Fig 6.55: Additive noise with Fig 6.56: Motion and noise degraded checkerboard 52 of 70 22.02.2016 09:19
  • 49. April 19th/26th, 2016 Introduction to Signal and Image Processing Direct Inverse Filtering (53) Ph. Cattin: Image Restoration Artificial Inverse Filtering Example (2) Although very tempting from its simplicity, the direct inverse filtering approach does not work for practical applications. Even if the degradation is known exactly. Fig 6.57: Direct inverse filtering result 53 of 70 22.02.2016 09:19
  • 50. April 19th/26th, 2016 Introduction to Signal and Image Processing Direct Inverse Filtering (54) Ph. Cattin: Image Restoration Inverse Filtering Example (2) Fig 6.58: Inverse filtering of Figure 6.52 Fig 6.59: Pseudo Inverse filtering for freq. radius Fig 6.60: Pseudo Inverse filtering for frequencies radius Fig 6.61: Pseudo Inverse filtering for frequencies radius 54 of 70 22.02.2016 09:19
  • 51. Wiener Filtering April 19th/26th, 2016 Introduction to Signal and Image Processing (56) Wiener Filtering The best known improvement to inverse filtering is the Wiener Filter. The Wiener filter seeks an estimate that minimises the statistical error function (6.42) where is the expected value and the undegraded image. The solution to this equation in the frequency domain is (6.43) where is the degradation function with the complex conjugate of is the power spectrum of the noise is the power spectrum of the undegraded image 55 of 70 22.02.2016 09:19
  • 52. April 19th/26th, 2016 Introduction to Signal and Image Processing Wiener Filtering (57) Ph. Cattin: Image Restoration Wiener Filtering (2) If the noise spectrum is zero, the noise-to-signal power ratio vanishes and the Wiener Filter reduces to the inverse filter. (6.44) This is no problem, as the inverse filter works fine if no noise is present. 56 of 70 22.02.2016 09:19
  • 53. April 19th/26th, 2016 Introduction to Signal and Image Processing Wiener Filtering (58) Ph. Cattin: Image Restoration Parametric Wiener Filter The main problem with the Wiener filter is that the power spectrum of the undegraded image is seldom known. A frequently used approach when these quantities cannot be estimated is to approximate Eq 6.43 by the expression (6.45) where is a user selected constant. This simplification can be partly justified when dealing with spectrally white noise, where the noise spectrum is constant. However, the problem still remains that the power spectrum of the undegraded image is unknown and must be estimated. Even if the actual ratio is not known, it becomes a simple matter to experiment interactively varying the constant and viewing the results. 57 of 70 22.02.2016 09:19
  • 54. April 19th/26th, 2016 Introduction to Signal and Image Processing Wiener Filtering (59) Ph. Cattin: Image Restoration Artificial Wiener Filtering Example This example shows the performance of the Wiener filter on the example Fig 6.56 using (1) the approximation of Eq 6.45 with in Fig 6.62 and (2) the Wiener filter using full knowledge of the noise and undegraded image's power spectra in Fig 6.63. Fig 6.62: Parametric Wiener filter using a constant ratio Fig 6.63: Wiener filter knowing the noise and undegraded signal power spectra 58 of 70 22.02.2016 09:19
  • 55. April 19th/26th, 2016 Introduction to Signal and Image Processing Wiener Filtering (60) Ph. Cattin: Image Restoration Wiener Filtering Example with Little Noise Fig 6.64: Pompeii blurred with Gaussian kernel , and Gaussian noise Fig 6.65: Result of direct inverse filtering Fig 6.66: Result with Parametric Wiener filtering Fig 6.67: Result with Wiener filtering 59 of 70 22.02.2016 09:19
  • 56. April 19th/26th, 2016 Introduction to Signal and Image Processing Wiener Filtering (61) Ph. Cattin: Image Restoration Wiener Filtering Example with Medium Noise Fig 6.68: Pompeii blurred with Gaussian kernel , and Gaussian noise Fig 6.69: Result of direct inverse filtering Fig 6.70: Result with Parametric Wiener filtering Fig 6.71: Result with Wiener filtering 60 of 70 22.02.2016 09:19
  • 57. April 19th/26th, 2016 Introduction to Signal and Image Processing Wiener Filtering (62) Ph. Cattin: Image Restoration Wiener Filtering Example with Heavy Noise Fig 6.72: Pompeii blurred with Gaussian kernel , and Gaussian noise Fig 6.73: Result of direct inverse filtering Fig 6.74: Result with Parametric Wiener filtering Fig 6.75: Result with Wiener filtering 61 of 70 22.02.2016 09:19
  • 58. April 19th/26th, 2016 Introduction to Signal and Image Processing Wiener Filtering (63) Ph. Cattin: Image Restoration Comparison Param. Wiener vs. Wiener Filtering (a) (b) Fig 6.76 Aerial image of Pompeii with Gaussian blur ( ) and noise ( ) (a) restored with the Parametric Wiener ( ), (b) same image restored with Wiener filter. 62 of 70 22.02.2016 09:19
  • 59. April 19th/26th, 2016 Introduction to Signal and Image Processing Wiener Filtering (64) Ph. Cattin: Image Restoration Drawback of the Wiener Filter The problem of having to know something about the degradation function is common to all methods discussed in this part. The Wiener filter has the additional difficulty, that the power spectra of the undegraded image and the power spectra of the noise must be known. Although an approximation by a constant is possible as in the Parametric Wiener filter, see Fig 6.62, this approach is not always suitable. 63 of 70 22.02.2016 09:19
  • 60. Geometric Mean Filter April 19th/26th, 2016 Introduction to Signal and Image Processing (66) Geometric Mean Filter The Geometric Mean Filter is a generalisation of inverse filtering and the Wiener filtering. Through its parameters it allows access to an entire family of filters. (6.46) Depending on the parameters the filter characteristics can be adjusted : inverse filtering : spectrum equalisation filter : parametric Wiener filter → Wiener 64 of 70 22.02.2016 09:19
  • 61. Constrained Least Squares Filtering April 19th/26th, 2016 Introduction to Signal and Image Processing (68) Constrained Least Squares (Regularised) Filtering The Constrained Least Squares Filtering approach only requires knowledge of the mean and variance of the noise. As shown in previous lectures these parameters can be usually estimated from the degraded image. The definition of the 2D discrete convolution is (6.47) Using this equation we can express the linear degradation model in vector notation as (6.48) 65 of 70 22.02.2016 09:19
  • 62. April 19th/26th, 2016 Introduction to Signal and Image Processing Constrained Least Squares Filtering (69) Ph. Cattin: Image Restoration Constrained Least Squares Filtering (2) It seems obvious that the restoration problem is now reduced to simple matrix manipulations. Unfortunately this is not the case. The problem with the matrix formulation is that the matrix is very large and that its inverse is firstly very sensitive to noise and secondly does not necessarily exist. One way to deal with these issues is to base optimality of restoration on a measure of smoothness, such as the second derivative of the image, e.g. the Laplacian. (6.49) subject to the constraint (6.50) where is the Euclidian norm, and an estimate of the undegraded image. 66 of 70 22.02.2016 09:19
  • 63. April 19th/26th, 2016 Introduction to Signal and Image Processing Constrained Least Squares Filtering (70) Ph. Cattin: Image Restoration Constrained Least Squares Filtering (3) The Frequency domain solution to this optimisation problem is given by (6.51) where is a parameter that must be adjusted so that the constraint in Eq 6.50 is satisfied, and is the Fourier transform of the Laplace operator (6.52) Note: must be properly padded with zeros prior to computing the Fourier transform. It is possible to adjust the parameter interactively until acceptable results are obtained. 67 of 70 22.02.2016 09:19
  • 64. April 19th/26th, 2016 Introduction to Signal and Image Processing Constrained Least Squares Filtering (71) Ph. Cattin: Image Restoration Optimal Selection for Gamma If we are interested in optimality, the parameter must be adjusted so that the constraint in Eq 6.50 is satisfied. It turns out that (6.53) is the optimal selection given the above optimisation equation where are the mean and variance of the noise. It is important to understand, that optimum restoration in the sense of constrained least squares does not necessarily imply best in the visual sense. In general, automatic determined restoration filters yield inferior results to manual adjustment of filter parameters. 68 of 70 22.02.2016 09:19
  • 65. April 19th/26th, 2016 Introduction to Signal and Image Processing Constrained Least Squares Filtering (72) Ph. Cattin: Image Restoration Artificial Constrained Least Squares Filter Example This example shows the performance of the Constrained Least Squares Filter on the example Fig 6.56 using (1) the theoretical optimal value for in Fig 6.77 and (2) the constrained least squares filter with a manually selected of 6.78. Fig 6.77: Result with optimal Fig 6.78: Results with manually selected 69 of 70 22.02.2016 09:19
  • 66. April 19th/26th, 2016 Introduction to Signal and Image Processing Constrained Least Squares Filtering (73) Ph. Cattin: Image Restoration Constrained Least Squares Filter Example Fig 6.79: Pompeii blurred with Gaussian kernel Fig 6.80: Result with low Gaussian noise of Fig 6.81: Result with medium Gaussian noise of Fig 6.82: Result with high Gaussian noise of 70 of 70 22.02.2016 09:19