SlideShare a Scribd company logo
1 of 11
Download to read offline
IOSR Journal of Electronics and Communication Engineering (IOSR-JECE)
e-ISSN: 2278-2834,p- ISSN: 2278-8735.Volume 5, Issue 5 (Mar. - Apr. 2013), PP 23-33
www.iosrjournals.org
www.iosrjournals.org 23 | Page
Survey on Single image Super Resolution Techniques
Rujul R. Makwana 1
, Nita D. Mehta2
1
(PG Student, EC Department,Government Engineering College, Surat, India)
2
(Associate Professor, EC Department,Government Engineering College, Surat, India)
Abstract:Super-resolution is the process of recovering a high-resolution image from multiple low-
resolutionimages of the same scene. The key objective of super-resolution (SR) imaging is to reconstruct a
higher-resolution image based on a set of images, acquired from the same scene and denoted as ‘low-
resolution’ images, to overcome the limitation and/or ill-posed conditions of the image acquisition process for
facilitating better content visualization and scene recognition. In this paper, we provide a comprehensive review
of existing super-resolution techniques and highlight the future research challenges. This includes the
formulation of an observation model and coverage of the dominant algorithm – Iterative back projection.We
critique these methods and identify areas which promise performance improvements. In this paper, future
directions for super-resolution algorithms are discussed. Finally results of available methods are given.
Keywords: Super-resolution, POCS, IBP, Canny Edge Detection
I. Introduction
Super resolution is a method for reconstructing a high resolution image from several overlapping low-
resolution images[1]. The low resolution input images are the result of re-sampling a high resolution image. The
goal is to find the high resolutionimage which, when re-sampled in the lattice of the input images according to
the imaging model, predicts well the low resolution input images.
The success of super resolution algorithm is highly dependent on the accuracy of the model of the
imaging process.If, for example, the motion computed for some of the images is not correct, the algorithm may
degrade the image rather than enhance it.One solution proposed to handle local model inaccuracies and noise is
regularization [2].In most cases the enforced smoothness results in the suppression of high-frequency
information, and the results are blurred. Regularization may be successful when the scene is strongly restricted,
e.g. a binary text image[2].
Applications for super-resolution abound. NASA has been using super-resolution techniques for years
to obtain more detailed images of planets and other celestial objects. Closer to home, super-resolution can be
used to enhance surveillance videos to more accurately identify objects in the scene. One particular example of
this are systems capable of automatically reading license plate numbers from severely pixelated video streams.
Another application is the conversion of standard NTSC television recordings to the newer HDTV format which
is of a higher resolution.
A variety of approaches for solving the super-resolution problem have been proposed. Initial attempts
worked in the frequency domain, typically recovering higher frequency components by taking advantage of the
shifting and aliasing properties of the Fourier transform. Deterministic regularization approaches, which work in
the spatial domain, enable easier inclusion of a priori constraints on the solution space (typically with a
smoothness prior). Stochastic methods have received the most attention lately as they generalize the
deterministic regularization approaches and enable more natural inclusion of prior knowledge. Other approaches
include nonuniform interpolation, projection onto convex sets, iterative back projection, and adaptive filtering.
With the increased emphasis on stochastic techniques has also come increased emphasis on learning priors from
from example data rather than relying on more heuristicallyderived information.
The paper is organized as follows. Section 2 presents Super Resolution Processing and a description of
the general model of imaging systems (observation model) that provides the SR image formulations. Section 3
presents the SR image reconstruction approaches that reconstruct a single high-resolution image from a set of
given low-resolution images acquired from the same scene. Section 4 presents Results and Discussion. Section 5
discusses several research challenges that remain open in this area for future investigation. Finally, Section.6
concludes this paper.
II. Super-Resolution Processing
Given a set of low resolution images that result from the observation of the same scene from slightly
different views, super resolution algorithm produce a single high resolution image by fusing the input LR
images such that the final HR image reproduces the scene with a better fidelity than any of the LR images[11].
Survey on Single image Super Resolution Techniques
www.iosrjournals.org 24 | Page
The central idea in super resolution processing is to convert the temporal resolution in to spatial resolution. In
broad sense, this approach can be used to perform any combination of the following image processing tasks:
- Registration
- Interpolation
- De-bluriring
Fig.1 Phases of Super-Resolution[3]
First, the SRR algorithm receive several low-resolution corrupted images as the inputs then the registration or
Motion Estimation process estimate the relative shifts between LR images compared to the reference LR image
with fractional pixel accuracy. Obviously, accurate sub-pixel motion estimation is a very important factor in the
success of the SRR algorithm. Since the shifts between LR images are arbitrary, the registered HR image will
not always match up to a uniformly spaced HR grid. Thus, non-uniform interpolation is necessary to obtain a
uniformly spaced HR image from a composite of non-uniformly spaced LR images. Finally, image
restoration(De-blurring) is applied to the up-sampled image to remove blurring and noise.Before presenting the
review of existing SR algorithms, we first model the LR image acquisition process.
1.1 Observation Model
Based on the most common observation model (Fig.2) it is considered that the available low-resolution
input images are obtained from the high-resolution original scene by warping, blurring and down sampling the
scene. Consider the desired HR image of size 1 1 2 2L N L N written in lexicographical notation as the vector
1 2[ , ,..., ]T
Nx x x x where 1 1 2 2N L N L N  . Namely,x is the ideal un-degraded image that is sampled at
orabove the Nyquist rate from a continuous scene which isassumed to be bandlimited. Now, let the parameters
L1and L2 represent the down-sampling factors in the observationmodel for the horizontal and vertical directions,
respectively.Thus, each observed LR image is of size 1 1 2 2L N L N . Let the kth LR image be denoted in
lexicographicnotation as ,1 ,2 ,[ , ,...., ]T
k k k k My y y y for 1,2,..,k p and 1 1 2 2M L N L N  . Now, it is
assumed that xremains constant during the acquisition of the multipleLR images, except for any motion and
degradation allowedby the model. Therefore, the observed LR imagesresult from warping, blurring, and
subsampling operatorsperformed on the HR image x. Assuming that eachLRimage is corrupted by additive
noise, we can then represent the observation model as [3],
k k k ky DB M X n  for 1≤ k ≤ p (1)
Where kM is awarpmatrix of size 1 1 2 2 1 1 2 2L N L N L N L N , kB represents a 1 1 2 2 1 1 2 2L N L N L N L N blur
matrix, D is a
2
1 2 1 1 2 2( )N N L N L N subsampling matrix, and kn represents a lexicographically ordered noise
vector. Ablock diagram for the observation model is illustrated in Fig.2.
Fig.2 Observation Model
Survey on Single image Super Resolution Techniques
www.iosrjournals.org 25 | Page
III. Super-resolution techniques
Image super resolution techniques can be mainly categorized as reconstruction based techniques and
learning based techniques.
Table 1 Comparison between Frequency Domain and Spatial Domain Super Resolution Techniques
Frequency Domain Spatial Domain
Observation model Frequency domain Spatial domain
Motion Model Global Translation Almost Unlimited
Degradation model Global translation Almost unlimited
Noise model Limited Almost unlimited
A-priori information Limited Almost unlimited
Simplicity Very Simple Generally Complex
Computational Cost Low High
Regularization Limited Excellent
Extensibility Poor Excellent
Applicability Limited Wide
Performance Good for Specific Application Good
In learning based approach, the relationship between an LR image and its corresponding high resolution (HR)
image is examined via a pair of LR and HR patches. The training data is used to predict the higher-resolution
image[4]. Reconstruction based approach can be employed in the frequency domain or spatial domain.
Reconstruction based approach require either single image or multiple low resolution image.Simplicity in theory
is a major advantage of the frequency domain approach. In addition, the frequency approach is also convenient
for parallel implementation. However, this approach allows low flexibility to add priori constraints, noise
models, and spatially varying degradation models. Thus, the development in practical use is limited. On the
other hand, spatial domain techniques are more flexible in incorporating priori constraints and have better
performance in reconstructed images. Nevertheless, these methods also have drawbacks such as complicated
theoretical work and relatively large amount of computation load. A comparison of the two main classes of
super-resolution techniques, frequency domain and spatial domain, is found in Table 1[5-9].
1.2 Frequency Domain Approach
The super-resolution problem was posed, along with a frequency domain solution, by Tsai and
Huang[10]. Prior to their paper, interpolation was the best technique for increasing the resolution of images.The
frequency domain approach makes explicit use of the aliasing that exists in each LR image to reconstruct an HR
image. Tsai and Huang [10] first derived a system equation that describes the relationship between LR images
and a desired HR image by using the relative motion between LR images. The frequency domain approach is
based on the following three principles: i) the shifting property of the Fourier transform, ii) the aliasing
relationship between the continuous Fourier transform (CFT) of an original HR image and the discrete Fourier
transform (DFT) of observed LR images, iii) and the assumption that an original HR image is band limited.
These properties make it possible to formulate the system equation relating the aliased DFT coefficients of the
observed LR images to a sample of the CFT of an unknown image. For example, let us assume that there are
two 1-D LR signals sampled below the Nyquist sampling rate. From the above three principles, the aliased LR
signals can be decomposed into the de-aliased HR signal as shown in Fig. 3.
Fig.3. Aliasing relationship between LR image and HR image
Survey on Single image Super Resolution Techniques
www.iosrjournals.org 26 | Page
Frequency-domain super resolution method typically rely on familiar Fourier transform properties, specifically
the shifting and sampling theorems. Since these properties are generally very well known and understood, the
frequency domain approaches are easy to grasp and are intuitively appealing. Many of the frequency-domain
approaches are based on assumptions which enable the use of efficient procedures for computing the restoration,
the most important of which is the Fast Fourier Transform (FFT).
Let 1 2( , )x t t denote a continuous HR image and 1 2( , )X w w be its CFT. The global translations, which are the
only motion considered in the frequency domain approach, yield the th
k shifted image of
1 2 1 1 2 2( , ) ( , )k k kx t t x t t    , where 1k and 2k are arbitrary but known values, and k =1,2,.., p. By the
shifting property of the CFT, the CFT of the shifted image, 1 2( , )kX w w , can be written as
1 2 1 1 2 2 1 2( , ) exp[ 2 ( )] ( , )k k kX w w j w w X w w    (2)
The shifted image 1 2( , )kx t t is sampled with the sampling period T1 and T2 to generate the observed LR image
1 2( , )ky n n . Fromthe aliasing relationship and the assumption of bandlimitedness of 1 2( , )X w w
1 2(| ( , ) |) 0X w w  for 1 1 1| | ( / )w L T , 2 2 2| | ( / ))w L T , the relationship between the CFT of
theHRimage and the DFT of the th
k observed LR image can be written as [11]
1 2
1 2
1 1
1 2
1 2 1 2
0 01 2 1 1 2 2
1 2 2
( , ) ,
L L
k k
n n
X n n
TT T N T N
 

 
 
     
         
    
  (3)
By using lexicographic ordering for the indices n1 ,n2 on the right-hand side and k on the left-hand side, a
matrix
vector form is obtained as:
Y X  (4)
whereY is a p ×1 column vector with the th
k element of the DFT coefficients of 1 2[ , ]ky n n , X is a 1 2 1L L 
column vector with the samples of the unknown CFT of 1 2( , )x t t , and Φ is a 1 2p L L matrix which relates the
DFT of the observed LR images to samples of the continuous HR image. Therefore, the reconstruction of a
desired HR image requires us to determine Φ and solve this inverse problem. An extension of this approach for
a blurred and noisy image was provided by Kim et al. [12], resulting in a weighted least squares formulation. In
their approach, it is assumed that all LR images have the same blur and the same noise characteristics. This
method was further refined by Kim and Su [13] to consider different blurs for each LR image. Here, the
Tikhonov regularization
method is adopted to overcome the ill-posed problem resulting from blur operator. Bose et al. [14] proposed the
recursive total least squares method for SR reconstruction to reduce effects of registration errors (errors in Φ). A
discrete cosine transform (DCT)-based method was proposed by Rhee and Kang [15]. They reduce memory
requirements and computational costs by using DCT instead of DFT. They also apply multichannel adaptive
regularization parameters to overcome ill-posedness such as underdetermined cases or insufficient motion
information cases. Theoretical simplicity is a major advantage of the frequency domain approach. That is, the
relationship between LR images and the HR image is clearly demonstrated in the frequency domain. The
frequencymethod is also convenient for parallel implementation capable of reducing hardware complexity.
1.3 Spatial Domain Approach
In this class of SR reconstruction methods, the observation model is formulated, and reconstruction is
effected in the spatial domain. The linear spatial domain observation model can accommodate global and non-
global motion, optical blur, motion blur, spatially varying PSF, non-ideal sampling, compression artifacts and
more. Spatial domainreconstruction allows natural inclusion of (possibly nonlinear) spatial domain a-priori
constraints (e.g. Markov random fields or convex sets) which result in bandwidth extrapolation in
reconstruction. Consider estimating a SR image z from multiple LR images , {1,2,..., }ry r R . Images are
written as lexicographically ordered vectors. ry and z are related as r ry H z . The matrix rH , which must be
estimated, incorporates motion compensation, degradation effects and subsampling. The observation equation
may be generalized to Y = Hz + N where 1[ ... ]T T T
RY y y and 1[ ... ]T T T
RH H H with N representing
observation noise.
Survey on Single image Super Resolution Techniques
www.iosrjournals.org 27 | Page
Since the superresolution problem is fundamentally ill-posed, incorporation of prior knowledge is
essential to achieve good results. A variety of techniques exist for the super-resolution problem in the spatial
domain. These solutions include interpolation, deterministic regularized techniques, stochastic methods,
iterative back projection, and projection onto convex sets among others. The primary advantages to working in
the spatial domain are support for unconstrained motion between frames and ease of incorporating prior
knowledge into the solution.
3.2.1 Interpolation of Non Uniformly Spaced Samples
Registering a set of LR images using motion compensation results in a single, dense composite image
of non uniformly spaced samples. A SR image may be reconstructed from this composite using techniques for
reconstruction from non-uniformly spaced samples. Unfortunately, this technique generally works very poorly
because of some inherent assumptions; the main problem being that camera sensors do not act as impulse
functions. Since the observed data result from severely under sampled, spatially averaged areas, the
reconstruction step (which typically assumes impulse sampling) is incapable of reconstructing significantly
more frequency content than is present in a single LR frame. Degradation models are limited, and no a-priori
constraints are used. There is also question as to the optimality of separate merging and restoration steps.
3.2.2 Deterministic Regularization
The deterministic regularized SR approach solves the inverse problem by using the prior information
about the solution which can be used to make the problem well posed. For example, CLS can be formulated by
choosing an x to minimize the Lagrangian [16]
2 2
1
[ || || || || ]
p
k k
k
X Xy W C

  (5)
where the operator C is generally a high-pass filter, and||.|| represents a l2 -norm. In eq(5), a priori knowledge
concerning a desirable solution is represented by a smoothness constraint, suggesting that most images are
naturally
smooth with limited high-frequency activity, and therefore it is appropriate to minimize the amount of high-pass
energy in the restored image. In eq(5), α represents the Lagrange multiplier, commonly referred to as the
regularization parameter, that controls the tradeoff between fidelity to the data (as expressed by
2
1
|| ||
p
k k
k
Xy W

 ) andsmoothness of the solution (as expressed by
2
|| ||XC ). TheLarger values of α will
generally lead to a smoothersolution.This is useful when only a small number of LR imagesare available (the
problem is underdetermined) orthe fidelity of the observed data is low due to registrationerror and noise. On the
other hand, if a large number ofLR images are available and the amount of noise is small,smallαwill lead to a
good solution. The cost functional ineq(6) is convex and differentiable with the use of a quadraticregularization
term. Therefore, we can find a unique estimateimage
^
X which minimizes the cost functional in eq(5).
One of the most basic deterministic iterative techniquesconsiders solving
^
1 1
p p
T T T
k k k k
k k
W W C C X W y
 
 
  
 
  (6)
and this leads to the following iteration for
^
X :
( 1) ( ) ( ) ( )^ ^ ^ ^
1
n n n np
T T
k k k
k
X X W y W X C C X 


  
     
   
 (7)
where β represents the convergence parameter and
T
kW contains an up-sampling operator and a type of blur
andwarping operator.
3.2.3 Projection Onto Convex Sets(POCS)
Another method for reducing the space of possible reconstructions is projection onto convex sets
(POCS). The POCS method describes an alternative iterative approach to incorporating prior knowledge about
the solution into the reconstruction process. With the estimates of registration parameters, this algorithm
simultaneously solves the restoration and interpolation problem to estimate the SR image. This is a set-theoretic
approach where each piece of a priori knowledge is formulated as a constraining convex set. Once the group of
Survey on Single image Super Resolution Techniques
www.iosrjournals.org 28 | Page
convex sets is formed, an iterative algorithm is employedto recover a point on the intersection of the convex
sets,
1 1 2 1..... { }i M M ig P P P P g  (8)
where jP is the projection of a given point onto the
th
j convex set and M is the number of convex sets. In
essence, we are restricting the final restored image to lie on the intersection of the constrainingsets, 1{ }M
j jP  . The
reason we require convex sets is that convergenceis guaranteed for the case where each set is convex.
One potential group of convex sets is based on the l2 distance measure,
2
{ || || 1}k k kG g W g y   ,1 k K  (9)
This defines a set of ellipsoids (one for each input image) and restrictsthe final solution to lie inside the
ellipsoids. Other possibleconvex sets include ones based on the l¥ norm, those imposingsmoothness, and those
constraining the image intensity to be positive.Two problems with the POCS approach are that uniqueness isnot
guaranteed for the final recovered image and that defining theprojections jP can be difficult.
3.2.4 Iterative Back Projection(IBP)
Super resolution of the image is model as an inverse problem. That is the goal of super resolution is to
reverse the effect of the down sampling, blurring and warping that relate the LR image to desired HR image.
Mathematically it
is written as
( * )y X W S  (10)
Where, X is original HR image; y is LR image; W is degeneration function; ↓ s is down sampling process.
In IBP approach HR image is estimated by back projecting the difference between the simulated LR image and
captured LR on interpolated image. This iterative process of SR does iterations until the minimization of the
cost function is achieved. Block diagram of IBP algorithm is given in Fig. 4. Mathematically the SR step
according to IBP is written as
(0)
eX X X  (11)
Where, X is interpolated image; eX is error correction.
Fig. 4 Simple IBP Algorithm[17]
Given only one LR input image, the updating procedure can be summarized as doing the following two steps
iteratively:
1) Compute the LR error as
( ) ( )
( )n n
eX y y S  
(12)
Estimation of the simulated LR image is given as
( ) ( )
( * )n n
y X W S  (13)
2) Update the HR image by back-projecting the error as equation (11).
3.2.4.1 Proposed IBP using Canny Edge Detection
Survey on Single image Super Resolution Techniques
www.iosrjournals.org 29 | Page
Though IBP method can minimize the restoration error significantly in iterative manner and gives good
effect, it projected the error back without edge guidance. In proposed algorithm, extra high frequency
information is added by Canny edge detection and difference error of up-sampled images from initial and
simulated LR images and so that it works as edge preserving algorithm. Block diagram of proposed algorithm is
shown in Fig. 5. Steps for proposedalgorithm are given in Table II.
Fig. 5 Canny Edge Detection Algorithm
Mathematically SR according to proposed algorithm is written as
(0)
e HX X X X   (14)
Where,
(0)
X is initial interpolated image; eX is error correction; HX is high frequency estimation given by
( * )H CannyX X H
(15)
Where HX is the estimated HR image, CannyH is the Canny Edge High Pass filter.
In Summary, proposed algorithm in mathematical form is expressed as below. The estimated HR image after n
iterations is given by
( 1) ( ) ( )n n n
e HX X X X
   (16)
The estimation of the high frequency is given as
( ) (0) ( )
{(( ) )* }n n
H H CannyX X y S H  
(17)
Where
(0)
HX is high frequency component of image
(0)
X . The formula for
(0)
HX is given as
(0) (0)
( * )H CannyX X H
(18)
So, the final iterations process given in (13) is rewritten for the combination of IBP and Canny Edge as
( 1) ( ) ( ) (0) ( )
( ) { {(( )* }}n n n n
H CannyX X y y S X y S H
      
(19)
Table II Steps of Canny Edge Detection Algorithm
NO STEPS
1 Read ground truth image
2 Apply Gaussian blurring and down sampling to generate observed LR image
3 Apply initial interpolation on observed LR image for initial estimation of HR image
4 Apply Canny Edge on initial estimated HR image to obtain high frequency component
5 Apply degradation on initial estimated HR image to generate simulated LR image
6 Apply Canny Edge on simulated LR image
7 Subtract simulated LR from Observed LR image that gives error correction
8
9
10
11
Subtract step 6 output from step 4 output to get lost high frequency component
Take summation of step 3 output with step 8 output. This will give improvement in quality of initial
estimated HR image
Now, this improved HR becomes our initial estimated HR image for the second iteration
Repeat step 5 to step 10 until some predefined iteration
Survey on Single image Super Resolution Techniques
www.iosrjournals.org 30 | Page
IV. Result and Discussion
To evaluate the SR systems effectively, this work assumes that the original HR images exist and the
image qualitydegradation is resulted from Gaussian blurring, and such Gaussian blurring function is known.
To present the performance of this algorithms, several images are tested and results are compared with Nearest
Neighbourhood interpolation(NN), Bilinear interpolation (BI), bicubic interpolation (BC), POCS, IBP and IBP
+ Canny Edge Detection.The image quality is determined based on PSNR evaluation.
As performance criteria, Peak Signal to Noise Ratio (PSNR) is calculated. The mathematical equations for M×N
image analysis are as given bellow[18].
( ) 2
[ ( , ) ( , )]n
i j
X i j X i j
MSE
M N




(20)
10
255 255
10logPSNR
MSE
 
  
  (21)
Where, ( , )X i j is the original HR image and
( )
( , )n
X i j is the estimated HR image through this algorithm.
The image quality is determined based on PSNR evaluation. A good reconstruction algorithm generally provides
low value of MSE and high value of MSSIM and PSNR. The resultant images are shown in figure 6 and 7 .
PSNR is obtained using various techniques are given in Table III.
Table III PSNR Comparison
Test
Image
Single Frame Algorithms
NN BI Bicubic POCS IBP IBP
+Canny
Edge
Apple 26.6500 29.1617 31.6337 30.7417 28.7719 42.3146
Football 26.9158 29.3864 30.4000 30.3136 29.2219 42.8838
Greens 19.9802 22.1634 24.6540 28.2204 22.1575 34.4326
Monkey 29.6891 31.2404 33.4968 32.7840 31.0809 43.6170
Flower 29.1997 32.0320 33.9559 32.4331 31.7295 46.0387
Fruits 28.4520 31.0726 34.1511 32.9744 30.9810 43.7963
(a)Original Image (b) LR Image
(c) NN Interpolation (d) Bilinear Interpolation
Survey on Single image Super Resolution Techniques
www.iosrjournals.org 31 | Page
(e) Bicubic Interpolation (f) POCS
(g) IBP (h) IBP + Canny Edge
Fig.6. Resultant football Image using different Algorithms
(a)Original Image (b) LR Image
(c) NN Interpolation (d) Bilinear Interpolation
(e) Bicubic Interpolation (f) POCS
Survey on Single image Super Resolution Techniques
www.iosrjournals.org 32 | Page
(g) IBP (h) IBP + Canny Edge
Fig.7. Resultant Greens Image using different Algorithms
V. Future Research Directions
we have identified some new directions for future research. The first asks the question “Can we design
camera sensors that are optimal for super-resolution algorithms?”.Current CCDs act like box functions, spatially
integrating over a uniform rectangular region for each pixel. It is likely that other types of sampling, such as
integration over a Gaussian function, would yield better results.
Another direction is to combine super-resolution with dense stereo reconstruction. Dense stereo
reconstruction is the process of estimating the depth of every point in the scene from two or more input images
taken from different poses. Current techniques typically estimate depths for every pixel in one of the images, but
it should be possible to obtain depths on a finer grid by combining super-resolution techniques with dense
stereo.
A third potential problem is to combine high dynamic range imaging with super-resolution. High
dynamic range imaging involves taking multiple images from the same viewpoint at different exposures and
then combining the images to obtain an image of higher dynamic range. By taking multiple images at different
exposures and with slight translational offsets it might be possible to obtain a super-resolved high dynamic
range image more efficiently than if the two stages are done independently.
VI. Conclusion
The SR imaging has been one of the fundamental image processing research areas. It can overcome or
compensate the inherent hardware limitations of the imaging system to provide amore clear image with a richer
and informative content. We have provided a review of the current state of super-resolution research, covering
the past, present, and future of the problem. A standard image formation model was first introduced, followed
by summaries of the major classes of algorithms including frequency domain approaches, deterministic
regularization, projection onto convex sets, Iterative Back Projection and Proposed IBP with Canny Edge
Detection. In this survey paper, our goal is to offer new perspectives and outlooks of SR imaging research,
besides giving an updated overview of existing SR algorithms. It is our hope that this work could inspire more
image processing researchers endeavoring on this fascinating topic and developing more novel SR techniques
along the way. Finally we discussed potential future directions for research.
References
[1] Assaf Zomet, Alex Rav-Acha, Shmuel Peleg, ”Robust Super-Resolution” ,ISBN 0-7695-1272-0/01 $10.00 (C) 2001 IEEE.
[2] D. Capel and A. Zisserman. Super-resolution enhancement of text image sequences. In Int. Conf. Pattern Recognition, pages Vol I:
600.605, 2000.
[3] Sung Cheol Park, Min Kyu Park,and Moon Gi Kang“Super Resolution:A Technical Overview,”IEEE SIGNAL PROCESSING
MAGAZINE 1053-5888/03/$17.00©2003IEEE.
[4] C. V. Jiji and Subhasis Chaudhuri, 2006, “Single-Frame Image Super-resolution through Contourlet Learning”, EURASIP Journal
on Applied Signal Processing, VOL.2006, Article ID 73767, pp 1-11.
[5] David Capel and Andrew Zisserman, 2000, “Super-resolution Enhancement of Text Image Sequences”, IEEE Comput. Soc,
Proceedings 15th International Conference on Pattern Recognition ICPR, VOL. 1, No. 1, pp-600-605.
[6] Sina Farsiu, M. Dirk Robinson, Michael Elad, and Peyman Milanfar, 2004, “Fast and Robust Multiframe Super Resolution”, IEEE
transactions on image processing, VOL. 13, NO. 10, pp 1327-1344.
[7] Xueting Liu, Daojin Song, Chuandai Dong and Hongkui Li, 2008, “MAP-Based Image Super-resolution Reconstruction”, World
Academy of Science, Engineering and Technology 37, pp 208-211.
[8] Kamal Nasrollahi, “ A Computer Vision Story On Video Sequences: From Face Detection to Face Super Resolution using Face
Quality Assessment”, Faculty of engineering and science, IEEE Member, AALBORG UNIVERSITY 2011.
[9] BORMAN, S., AND STEVENSON, R. 1998. Super-resolution from image sequences – A review. In Proceedings of the 1998
Midwest Symposium on Circuits and Systems, IEEE, Notre Dame, IN, USA, 374–378.
[10] TSAI, R. Y., AND HUANG, T. S. 1984. Multi-frame image restoration and registration. In in Advances in Computer Vision and
Image Processing, 317–339.
[11] A.M. Tekalp, Digital Video Processing. Englewood Cliffs, NJ: Prentice Hall, 1995.
[12] S.P. Kim, N.K. Bose, and H.M. Valenzuela, “Recursive reconstruction of high resolution image from noisy under sampled multi
frames,” IEEE Trans. Acoust., Speech, Signal Processing, vol. 38, pp. 1013-1027, June 1990.
Survey on Single image Super Resolution Techniques
www.iosrjournals.org 33 | Page
[13] S.P. Kim and W.Y. Su, “Recursive high-resolution reconstruction of blurred multiframe images,” IEEE Trans. Image Processing,
vol. 2, pp. 534-539, Oct. 1993.
[14] N.K. Bose, H.C. Kim, and H.M. Valenzuela, “Recursive implementation of total least squares algorithm for image reconstruction
from noisy, under sampled multi frames,” in Proc. IEEE Conf. Acoustics, Speech and Signal Processing, Minneapolis, MN, Apr.
1993, vol. 5, pp. 269-272.
[15] S.H. Rhee and M.G. Kang, “Discrete cosine transform based regularized high-resolution image reconstruction algorithm,” Opt.
Eng., vol. 38, no. 8, pp. 1348-1356, Aug. 1999.
[16] A.K. Katsaggelos, Ed. Digital Image Restoration. Heidelberg, Germany: Springer-Verlag. Springer. vol. 23, 1991.
[17] V. B. Patel, Chintan K. Modi, C. N. Paunwala and S. Patnaik, “Hybrid Approach for Single Image Super Resolution using ISEF and
IBP”, in IEEE Conference on Communication System and Network Technology (CSNT), 03-05 june, 2011.
[18] Liyakathunisa and C.N .Ravi Kumar,” A NOVEL SUPER RESOLUTION RECONSTRUCTION OF LOW REOSLUTION
IMAGESPROGRESSIVELY USING DCT AND ZONAL FILTER BASED DENOISING”, International Journal of Computer
Science & Information Technology (IJCSIT), Vol 3, No 1, Feb 2011.

More Related Content

What's hot

Wavelet based image fusion
Wavelet based image fusionWavelet based image fusion
Wavelet based image fusionUmed Paliwal
 
Single Image Super-Resolution Using Analytical Solution for L2-L2 Algorithm
Single Image Super-Resolution Using Analytical Solution for L2-L2 AlgorithmSingle Image Super-Resolution Using Analytical Solution for L2-L2 Algorithm
Single Image Super-Resolution Using Analytical Solution for L2-L2 Algorithmijtsrd
 
IMAGE FUSION IN IMAGE PROCESSING
IMAGE FUSION IN IMAGE PROCESSINGIMAGE FUSION IN IMAGE PROCESSING
IMAGE FUSION IN IMAGE PROCESSINGgarima0690
 
Filtering Based Illumination Normalization Techniques for Face Recognition
Filtering Based Illumination Normalization Techniques for Face RecognitionFiltering Based Illumination Normalization Techniques for Face Recognition
Filtering Based Illumination Normalization Techniques for Face RecognitionRadita Apriana
 
Analysis of Various Single Frame Super Resolution Techniques for better PSNR
Analysis of Various Single Frame Super Resolution Techniques for better PSNRAnalysis of Various Single Frame Super Resolution Techniques for better PSNR
Analysis of Various Single Frame Super Resolution Techniques for better PSNRIRJET Journal
 
Wavelet based image fusion
Wavelet based image fusionWavelet based image fusion
Wavelet based image fusionUmed Paliwal
 
Image segmentation by modified map ml estimations
Image segmentation by modified map ml estimationsImage segmentation by modified map ml estimations
Image segmentation by modified map ml estimationsijesajournal
 
Single Image Super Resolution Overview
Single Image Super Resolution OverviewSingle Image Super Resolution Overview
Single Image Super Resolution OverviewLEE HOSEONG
 
Fpga implementation of fusion technique for fingerprint application
Fpga implementation of fusion technique for fingerprint applicationFpga implementation of fusion technique for fingerprint application
Fpga implementation of fusion technique for fingerprint applicationIAEME Publication
 
Image Resolution Enhancement using DWT and Spatial Domain Interpolation Techn...
Image Resolution Enhancement using DWT and Spatial Domain Interpolation Techn...Image Resolution Enhancement using DWT and Spatial Domain Interpolation Techn...
Image Resolution Enhancement using DWT and Spatial Domain Interpolation Techn...IJERA Editor
 
A New Approach of Medical Image Fusion using Discrete Wavelet Transform
A New Approach of Medical Image Fusion using Discrete Wavelet TransformA New Approach of Medical Image Fusion using Discrete Wavelet Transform
A New Approach of Medical Image Fusion using Discrete Wavelet TransformIDES Editor
 
An Approach for Image Deblurring: Based on Sparse Representation and Regulari...
An Approach for Image Deblurring: Based on Sparse Representation and Regulari...An Approach for Image Deblurring: Based on Sparse Representation and Regulari...
An Approach for Image Deblurring: Based on Sparse Representation and Regulari...IRJET Journal
 
Asilomar09 compressive superres
Asilomar09 compressive superresAsilomar09 compressive superres
Asilomar09 compressive superresHoàng Sơn
 

What's hot (17)

Wavelet based image fusion
Wavelet based image fusionWavelet based image fusion
Wavelet based image fusion
 
557 480-486
557 480-486557 480-486
557 480-486
 
Single Image Super-Resolution Using Analytical Solution for L2-L2 Algorithm
Single Image Super-Resolution Using Analytical Solution for L2-L2 AlgorithmSingle Image Super-Resolution Using Analytical Solution for L2-L2 Algorithm
Single Image Super-Resolution Using Analytical Solution for L2-L2 Algorithm
 
IMAGE FUSION IN IMAGE PROCESSING
IMAGE FUSION IN IMAGE PROCESSINGIMAGE FUSION IN IMAGE PROCESSING
IMAGE FUSION IN IMAGE PROCESSING
 
Filtering Based Illumination Normalization Techniques for Face Recognition
Filtering Based Illumination Normalization Techniques for Face RecognitionFiltering Based Illumination Normalization Techniques for Face Recognition
Filtering Based Illumination Normalization Techniques for Face Recognition
 
Image Fusion
Image FusionImage Fusion
Image Fusion
 
Depth estimation using deep learning
Depth estimation using deep learningDepth estimation using deep learning
Depth estimation using deep learning
 
Analysis of Various Single Frame Super Resolution Techniques for better PSNR
Analysis of Various Single Frame Super Resolution Techniques for better PSNRAnalysis of Various Single Frame Super Resolution Techniques for better PSNR
Analysis of Various Single Frame Super Resolution Techniques for better PSNR
 
Wavelet based image fusion
Wavelet based image fusionWavelet based image fusion
Wavelet based image fusion
 
Image segmentation by modified map ml estimations
Image segmentation by modified map ml estimationsImage segmentation by modified map ml estimations
Image segmentation by modified map ml estimations
 
Single Image Super Resolution Overview
Single Image Super Resolution OverviewSingle Image Super Resolution Overview
Single Image Super Resolution Overview
 
Fpga implementation of fusion technique for fingerprint application
Fpga implementation of fusion technique for fingerprint applicationFpga implementation of fusion technique for fingerprint application
Fpga implementation of fusion technique for fingerprint application
 
Image Resolution Enhancement using DWT and Spatial Domain Interpolation Techn...
Image Resolution Enhancement using DWT and Spatial Domain Interpolation Techn...Image Resolution Enhancement using DWT and Spatial Domain Interpolation Techn...
Image Resolution Enhancement using DWT and Spatial Domain Interpolation Techn...
 
A New Approach of Medical Image Fusion using Discrete Wavelet Transform
A New Approach of Medical Image Fusion using Discrete Wavelet TransformA New Approach of Medical Image Fusion using Discrete Wavelet Transform
A New Approach of Medical Image Fusion using Discrete Wavelet Transform
 
An Approach for Image Deblurring: Based on Sparse Representation and Regulari...
An Approach for Image Deblurring: Based on Sparse Representation and Regulari...An Approach for Image Deblurring: Based on Sparse Representation and Regulari...
An Approach for Image Deblurring: Based on Sparse Representation and Regulari...
 
I017425763
I017425763I017425763
I017425763
 
Asilomar09 compressive superres
Asilomar09 compressive superresAsilomar09 compressive superres
Asilomar09 compressive superres
 

Viewers also liked

Cfd Simulation and Experimentalverification of Air Flow through Heated Pipe
Cfd Simulation and Experimentalverification of Air Flow through Heated PipeCfd Simulation and Experimentalverification of Air Flow through Heated Pipe
Cfd Simulation and Experimentalverification of Air Flow through Heated PipeIOSR Journals
 
Transformational Leadership at Muhammadiyah Primary Schoolson Emotional Intel...
Transformational Leadership at Muhammadiyah Primary Schoolson Emotional Intel...Transformational Leadership at Muhammadiyah Primary Schoolson Emotional Intel...
Transformational Leadership at Muhammadiyah Primary Schoolson Emotional Intel...IOSR Journals
 
Speciation And Physicochemical Studies of Some Biospecific Compounds
Speciation And Physicochemical Studies of Some Biospecific CompoundsSpeciation And Physicochemical Studies of Some Biospecific Compounds
Speciation And Physicochemical Studies of Some Biospecific CompoundsIOSR Journals
 
Synthesis and Characterization O-, M- and Para-Toluyl Thiourea Substituted Pa...
Synthesis and Characterization O-, M- and Para-Toluyl Thiourea Substituted Pa...Synthesis and Characterization O-, M- and Para-Toluyl Thiourea Substituted Pa...
Synthesis and Characterization O-, M- and Para-Toluyl Thiourea Substituted Pa...IOSR Journals
 
Techniques for Face Detection & Recognition Systema Comprehensive Review
Techniques for Face Detection & Recognition Systema Comprehensive ReviewTechniques for Face Detection & Recognition Systema Comprehensive Review
Techniques for Face Detection & Recognition Systema Comprehensive ReviewIOSR Journals
 
Removal of lead (II) and copper (II) ions from aqueous solution by baobab (Ad...
Removal of lead (II) and copper (II) ions from aqueous solution by baobab (Ad...Removal of lead (II) and copper (II) ions from aqueous solution by baobab (Ad...
Removal of lead (II) and copper (II) ions from aqueous solution by baobab (Ad...IOSR Journals
 
An Inquiry on the Effect of Knowledge Management and Strategic Leadership on ...
An Inquiry on the Effect of Knowledge Management and Strategic Leadership on ...An Inquiry on the Effect of Knowledge Management and Strategic Leadership on ...
An Inquiry on the Effect of Knowledge Management and Strategic Leadership on ...IOSR Journals
 
Evaluation of Level of Precursors of N-Nitrosamine in Vitro in Wistar Rats Fe...
Evaluation of Level of Precursors of N-Nitrosamine in Vitro in Wistar Rats Fe...Evaluation of Level of Precursors of N-Nitrosamine in Vitro in Wistar Rats Fe...
Evaluation of Level of Precursors of N-Nitrosamine in Vitro in Wistar Rats Fe...IOSR Journals
 
Lipid oxidation and perceived exertion level during exercise in obese: effect...
Lipid oxidation and perceived exertion level during exercise in obese: effect...Lipid oxidation and perceived exertion level during exercise in obese: effect...
Lipid oxidation and perceived exertion level during exercise in obese: effect...IOSR Journals
 
Complexation, Spectroscopic, Thermal, Magnetic And Conductimetric Studies On ...
Complexation, Spectroscopic, Thermal, Magnetic And Conductimetric Studies On ...Complexation, Spectroscopic, Thermal, Magnetic And Conductimetric Studies On ...
Complexation, Spectroscopic, Thermal, Magnetic And Conductimetric Studies On ...IOSR Journals
 
Effect of Fermentation on the Nutritional and Antinutritional Composition of ...
Effect of Fermentation on the Nutritional and Antinutritional Composition of ...Effect of Fermentation on the Nutritional and Antinutritional Composition of ...
Effect of Fermentation on the Nutritional and Antinutritional Composition of ...IOSR Journals
 
A New Lupan type Triterpene Butilinol from Viburnum grandiflorum
A New Lupan type Triterpene Butilinol from Viburnum grandiflorumA New Lupan type Triterpene Butilinol from Viburnum grandiflorum
A New Lupan type Triterpene Butilinol from Viburnum grandiflorumIOSR Journals
 
Biomimetic Materials in Our World: A Review.
Biomimetic Materials in Our World: A Review.Biomimetic Materials in Our World: A Review.
Biomimetic Materials in Our World: A Review.IOSR Journals
 
Application of Artificial Neural Network (Ann) In Operation of Reservoirs
Application of Artificial Neural Network (Ann) In Operation of ReservoirsApplication of Artificial Neural Network (Ann) In Operation of Reservoirs
Application of Artificial Neural Network (Ann) In Operation of ReservoirsIOSR Journals
 
Performance Comparison of Uncoded OFDM & Uncoded Adaptive OFDM System Over AW...
Performance Comparison of Uncoded OFDM & Uncoded Adaptive OFDM System Over AW...Performance Comparison of Uncoded OFDM & Uncoded Adaptive OFDM System Over AW...
Performance Comparison of Uncoded OFDM & Uncoded Adaptive OFDM System Over AW...IOSR Journals
 
Antibacterial Property of Essential Oil and its vibrational analysis
Antibacterial Property of Essential Oil and its vibrational analysisAntibacterial Property of Essential Oil and its vibrational analysis
Antibacterial Property of Essential Oil and its vibrational analysisIOSR Journals
 
Herbal Cures Practised By Rural Populace In Varanasi Region Of Eastern U.P.(I...
Herbal Cures Practised By Rural Populace In Varanasi Region Of Eastern U.P.(I...Herbal Cures Practised By Rural Populace In Varanasi Region Of Eastern U.P.(I...
Herbal Cures Practised By Rural Populace In Varanasi Region Of Eastern U.P.(I...IOSR Journals
 
"Study of Java Access Control Mechanism”
"Study of Java Access Control Mechanism”"Study of Java Access Control Mechanism”
"Study of Java Access Control Mechanism”IOSR Journals
 

Viewers also liked (20)

Cfd Simulation and Experimentalverification of Air Flow through Heated Pipe
Cfd Simulation and Experimentalverification of Air Flow through Heated PipeCfd Simulation and Experimentalverification of Air Flow through Heated Pipe
Cfd Simulation and Experimentalverification of Air Flow through Heated Pipe
 
Transformational Leadership at Muhammadiyah Primary Schoolson Emotional Intel...
Transformational Leadership at Muhammadiyah Primary Schoolson Emotional Intel...Transformational Leadership at Muhammadiyah Primary Schoolson Emotional Intel...
Transformational Leadership at Muhammadiyah Primary Schoolson Emotional Intel...
 
Speciation And Physicochemical Studies of Some Biospecific Compounds
Speciation And Physicochemical Studies of Some Biospecific CompoundsSpeciation And Physicochemical Studies of Some Biospecific Compounds
Speciation And Physicochemical Studies of Some Biospecific Compounds
 
Synthesis and Characterization O-, M- and Para-Toluyl Thiourea Substituted Pa...
Synthesis and Characterization O-, M- and Para-Toluyl Thiourea Substituted Pa...Synthesis and Characterization O-, M- and Para-Toluyl Thiourea Substituted Pa...
Synthesis and Characterization O-, M- and Para-Toluyl Thiourea Substituted Pa...
 
Techniques for Face Detection & Recognition Systema Comprehensive Review
Techniques for Face Detection & Recognition Systema Comprehensive ReviewTechniques for Face Detection & Recognition Systema Comprehensive Review
Techniques for Face Detection & Recognition Systema Comprehensive Review
 
L0816166
L0816166L0816166
L0816166
 
Removal of lead (II) and copper (II) ions from aqueous solution by baobab (Ad...
Removal of lead (II) and copper (II) ions from aqueous solution by baobab (Ad...Removal of lead (II) and copper (II) ions from aqueous solution by baobab (Ad...
Removal of lead (II) and copper (II) ions from aqueous solution by baobab (Ad...
 
An Inquiry on the Effect of Knowledge Management and Strategic Leadership on ...
An Inquiry on the Effect of Knowledge Management and Strategic Leadership on ...An Inquiry on the Effect of Knowledge Management and Strategic Leadership on ...
An Inquiry on the Effect of Knowledge Management and Strategic Leadership on ...
 
Evaluation of Level of Precursors of N-Nitrosamine in Vitro in Wistar Rats Fe...
Evaluation of Level of Precursors of N-Nitrosamine in Vitro in Wistar Rats Fe...Evaluation of Level of Precursors of N-Nitrosamine in Vitro in Wistar Rats Fe...
Evaluation of Level of Precursors of N-Nitrosamine in Vitro in Wistar Rats Fe...
 
Lipid oxidation and perceived exertion level during exercise in obese: effect...
Lipid oxidation and perceived exertion level during exercise in obese: effect...Lipid oxidation and perceived exertion level during exercise in obese: effect...
Lipid oxidation and perceived exertion level during exercise in obese: effect...
 
Complexation, Spectroscopic, Thermal, Magnetic And Conductimetric Studies On ...
Complexation, Spectroscopic, Thermal, Magnetic And Conductimetric Studies On ...Complexation, Spectroscopic, Thermal, Magnetic And Conductimetric Studies On ...
Complexation, Spectroscopic, Thermal, Magnetic And Conductimetric Studies On ...
 
Effect of Fermentation on the Nutritional and Antinutritional Composition of ...
Effect of Fermentation on the Nutritional and Antinutritional Composition of ...Effect of Fermentation on the Nutritional and Antinutritional Composition of ...
Effect of Fermentation on the Nutritional and Antinutritional Composition of ...
 
A New Lupan type Triterpene Butilinol from Viburnum grandiflorum
A New Lupan type Triterpene Butilinol from Viburnum grandiflorumA New Lupan type Triterpene Butilinol from Viburnum grandiflorum
A New Lupan type Triterpene Butilinol from Viburnum grandiflorum
 
Biomimetic Materials in Our World: A Review.
Biomimetic Materials in Our World: A Review.Biomimetic Materials in Our World: A Review.
Biomimetic Materials in Our World: A Review.
 
Application of Artificial Neural Network (Ann) In Operation of Reservoirs
Application of Artificial Neural Network (Ann) In Operation of ReservoirsApplication of Artificial Neural Network (Ann) In Operation of Reservoirs
Application of Artificial Neural Network (Ann) In Operation of Reservoirs
 
H0734651
H0734651H0734651
H0734651
 
Performance Comparison of Uncoded OFDM & Uncoded Adaptive OFDM System Over AW...
Performance Comparison of Uncoded OFDM & Uncoded Adaptive OFDM System Over AW...Performance Comparison of Uncoded OFDM & Uncoded Adaptive OFDM System Over AW...
Performance Comparison of Uncoded OFDM & Uncoded Adaptive OFDM System Over AW...
 
Antibacterial Property of Essential Oil and its vibrational analysis
Antibacterial Property of Essential Oil and its vibrational analysisAntibacterial Property of Essential Oil and its vibrational analysis
Antibacterial Property of Essential Oil and its vibrational analysis
 
Herbal Cures Practised By Rural Populace In Varanasi Region Of Eastern U.P.(I...
Herbal Cures Practised By Rural Populace In Varanasi Region Of Eastern U.P.(I...Herbal Cures Practised By Rural Populace In Varanasi Region Of Eastern U.P.(I...
Herbal Cures Practised By Rural Populace In Varanasi Region Of Eastern U.P.(I...
 
"Study of Java Access Control Mechanism”
"Study of Java Access Control Mechanism”"Study of Java Access Control Mechanism”
"Study of Java Access Control Mechanism”
 

Similar to Survey Single Image Super Resolution Techniques

A REGULARIZED ROBUST SUPER-RESOLUTION APPROACH FORALIASED IMAGES AND LOW RESO...
A REGULARIZED ROBUST SUPER-RESOLUTION APPROACH FORALIASED IMAGES AND LOW RESO...A REGULARIZED ROBUST SUPER-RESOLUTION APPROACH FORALIASED IMAGES AND LOW RESO...
A REGULARIZED ROBUST SUPER-RESOLUTION APPROACH FORALIASED IMAGES AND LOW RESO...cscpconf
 
Enhance Example-Based Super Resolution to Achieve Fine Magnification of Low ...
Enhance Example-Based Super Resolution to Achieve Fine  Magnification of Low ...Enhance Example-Based Super Resolution to Achieve Fine  Magnification of Low ...
Enhance Example-Based Super Resolution to Achieve Fine Magnification of Low ...IJMER
 
Robust High Resolution Image from the Low Resolution Satellite Image
Robust High Resolution Image from the Low Resolution Satellite ImageRobust High Resolution Image from the Low Resolution Satellite Image
Robust High Resolution Image from the Low Resolution Satellite Imageidescitation
 
A Novel and Robust Wavelet based Super Resolution Reconstruction of Low Resol...
A Novel and Robust Wavelet based Super Resolution Reconstruction of Low Resol...A Novel and Robust Wavelet based Super Resolution Reconstruction of Low Resol...
A Novel and Robust Wavelet based Super Resolution Reconstruction of Low Resol...CSCJournals
 
SINGLE IMAGE SUPER RESOLUTION: A COMPARATIVE STUDY
SINGLE IMAGE SUPER RESOLUTION: A COMPARATIVE STUDYSINGLE IMAGE SUPER RESOLUTION: A COMPARATIVE STUDY
SINGLE IMAGE SUPER RESOLUTION: A COMPARATIVE STUDYcsandit
 
A Novel Blind SR Method to Improve the Spatial Resolution of Real Life Video ...
A Novel Blind SR Method to Improve the Spatial Resolution of Real Life Video ...A Novel Blind SR Method to Improve the Spatial Resolution of Real Life Video ...
A Novel Blind SR Method to Improve the Spatial Resolution of Real Life Video ...IRJET Journal
 
IMAGE QUALITY OPTIMIZATION USING RSATV
IMAGE QUALITY OPTIMIZATION USING RSATVIMAGE QUALITY OPTIMIZATION USING RSATV
IMAGE QUALITY OPTIMIZATION USING RSATVpaperpublications3
 
Analysis of Image Super-Resolution via Reconstruction Filters for Pure Transl...
Analysis of Image Super-Resolution via Reconstruction Filters for Pure Transl...Analysis of Image Super-Resolution via Reconstruction Filters for Pure Transl...
Analysis of Image Super-Resolution via Reconstruction Filters for Pure Transl...CSCJournals
 
OBTAINING SUPER-RESOLUTION IMAGES BY COMBINING LOW-RESOLUTION IMAGES WITH HIG...
OBTAINING SUPER-RESOLUTION IMAGES BY COMBINING LOW-RESOLUTION IMAGES WITH HIG...OBTAINING SUPER-RESOLUTION IMAGES BY COMBINING LOW-RESOLUTION IMAGES WITH HIG...
OBTAINING SUPER-RESOLUTION IMAGES BY COMBINING LOW-RESOLUTION IMAGES WITH HIG...ijcsit
 
Effective Pixel Interpolation for Image Super Resolution
Effective Pixel Interpolation for Image Super ResolutionEffective Pixel Interpolation for Image Super Resolution
Effective Pixel Interpolation for Image Super ResolutionIOSR Journals
 
Effective Pixel Interpolation for Image Super Resolution
Effective Pixel Interpolation for Image Super ResolutionEffective Pixel Interpolation for Image Super Resolution
Effective Pixel Interpolation for Image Super ResolutionIOSR Journals
 
Enhancement of SAR Imagery using DWT
Enhancement of SAR Imagery using DWTEnhancement of SAR Imagery using DWT
Enhancement of SAR Imagery using DWTIJLT EMAS
 
Single Image Super Resolution using Interpolation and Discrete Wavelet Transform
Single Image Super Resolution using Interpolation and Discrete Wavelet TransformSingle Image Super Resolution using Interpolation and Discrete Wavelet Transform
Single Image Super Resolution using Interpolation and Discrete Wavelet Transformijtsrd
 
Learning Based Single Frame Image Super-resolution Using Fast Discrete Curvel...
Learning Based Single Frame Image Super-resolution Using Fast Discrete Curvel...Learning Based Single Frame Image Super-resolution Using Fast Discrete Curvel...
Learning Based Single Frame Image Super-resolution Using Fast Discrete Curvel...CSCJournals
 
Super resolution image reconstruction via dual dictionary learning in sparse...
Super resolution image reconstruction via dual dictionary  learning in sparse...Super resolution image reconstruction via dual dictionary  learning in sparse...
Super resolution image reconstruction via dual dictionary learning in sparse...IJECEIAES
 
Literature Review on Single Image Super Resolution
Literature Review on Single Image Super ResolutionLiterature Review on Single Image Super Resolution
Literature Review on Single Image Super Resolutionijtsrd
 
Content Based Image Retrieval Using 2-D Discrete Wavelet Transform
Content Based Image Retrieval Using 2-D Discrete Wavelet TransformContent Based Image Retrieval Using 2-D Discrete Wavelet Transform
Content Based Image Retrieval Using 2-D Discrete Wavelet TransformIOSR Journals
 
Sparse Sampling in Digital Image Processing
Sparse Sampling in Digital Image ProcessingSparse Sampling in Digital Image Processing
Sparse Sampling in Digital Image ProcessingEswar Publications
 
Image resolution enhancement using blind technique
Image resolution enhancement using blind techniqueImage resolution enhancement using blind technique
Image resolution enhancement using blind techniqueeSAT Journals
 

Similar to Survey Single Image Super Resolution Techniques (20)

A REGULARIZED ROBUST SUPER-RESOLUTION APPROACH FORALIASED IMAGES AND LOW RESO...
A REGULARIZED ROBUST SUPER-RESOLUTION APPROACH FORALIASED IMAGES AND LOW RESO...A REGULARIZED ROBUST SUPER-RESOLUTION APPROACH FORALIASED IMAGES AND LOW RESO...
A REGULARIZED ROBUST SUPER-RESOLUTION APPROACH FORALIASED IMAGES AND LOW RESO...
 
Enhance Example-Based Super Resolution to Achieve Fine Magnification of Low ...
Enhance Example-Based Super Resolution to Achieve Fine  Magnification of Low ...Enhance Example-Based Super Resolution to Achieve Fine  Magnification of Low ...
Enhance Example-Based Super Resolution to Achieve Fine Magnification of Low ...
 
Robust High Resolution Image from the Low Resolution Satellite Image
Robust High Resolution Image from the Low Resolution Satellite ImageRobust High Resolution Image from the Low Resolution Satellite Image
Robust High Resolution Image from the Low Resolution Satellite Image
 
A Novel and Robust Wavelet based Super Resolution Reconstruction of Low Resol...
A Novel and Robust Wavelet based Super Resolution Reconstruction of Low Resol...A Novel and Robust Wavelet based Super Resolution Reconstruction of Low Resol...
A Novel and Robust Wavelet based Super Resolution Reconstruction of Low Resol...
 
SINGLE IMAGE SUPER RESOLUTION: A COMPARATIVE STUDY
SINGLE IMAGE SUPER RESOLUTION: A COMPARATIVE STUDYSINGLE IMAGE SUPER RESOLUTION: A COMPARATIVE STUDY
SINGLE IMAGE SUPER RESOLUTION: A COMPARATIVE STUDY
 
A Novel Blind SR Method to Improve the Spatial Resolution of Real Life Video ...
A Novel Blind SR Method to Improve the Spatial Resolution of Real Life Video ...A Novel Blind SR Method to Improve the Spatial Resolution of Real Life Video ...
A Novel Blind SR Method to Improve the Spatial Resolution of Real Life Video ...
 
IMAGE QUALITY OPTIMIZATION USING RSATV
IMAGE QUALITY OPTIMIZATION USING RSATVIMAGE QUALITY OPTIMIZATION USING RSATV
IMAGE QUALITY OPTIMIZATION USING RSATV
 
Analysis of Image Super-Resolution via Reconstruction Filters for Pure Transl...
Analysis of Image Super-Resolution via Reconstruction Filters for Pure Transl...Analysis of Image Super-Resolution via Reconstruction Filters for Pure Transl...
Analysis of Image Super-Resolution via Reconstruction Filters for Pure Transl...
 
OBTAINING SUPER-RESOLUTION IMAGES BY COMBINING LOW-RESOLUTION IMAGES WITH HIG...
OBTAINING SUPER-RESOLUTION IMAGES BY COMBINING LOW-RESOLUTION IMAGES WITH HIG...OBTAINING SUPER-RESOLUTION IMAGES BY COMBINING LOW-RESOLUTION IMAGES WITH HIG...
OBTAINING SUPER-RESOLUTION IMAGES BY COMBINING LOW-RESOLUTION IMAGES WITH HIG...
 
Effective Pixel Interpolation for Image Super Resolution
Effective Pixel Interpolation for Image Super ResolutionEffective Pixel Interpolation for Image Super Resolution
Effective Pixel Interpolation for Image Super Resolution
 
Effective Pixel Interpolation for Image Super Resolution
Effective Pixel Interpolation for Image Super ResolutionEffective Pixel Interpolation for Image Super Resolution
Effective Pixel Interpolation for Image Super Resolution
 
Enhancement of SAR Imagery using DWT
Enhancement of SAR Imagery using DWTEnhancement of SAR Imagery using DWT
Enhancement of SAR Imagery using DWT
 
Single Image Super Resolution using Interpolation and Discrete Wavelet Transform
Single Image Super Resolution using Interpolation and Discrete Wavelet TransformSingle Image Super Resolution using Interpolation and Discrete Wavelet Transform
Single Image Super Resolution using Interpolation and Discrete Wavelet Transform
 
Learning Based Single Frame Image Super-resolution Using Fast Discrete Curvel...
Learning Based Single Frame Image Super-resolution Using Fast Discrete Curvel...Learning Based Single Frame Image Super-resolution Using Fast Discrete Curvel...
Learning Based Single Frame Image Super-resolution Using Fast Discrete Curvel...
 
Super resolution image reconstruction via dual dictionary learning in sparse...
Super resolution image reconstruction via dual dictionary  learning in sparse...Super resolution image reconstruction via dual dictionary  learning in sparse...
Super resolution image reconstruction via dual dictionary learning in sparse...
 
Literature Review on Single Image Super Resolution
Literature Review on Single Image Super ResolutionLiterature Review on Single Image Super Resolution
Literature Review on Single Image Super Resolution
 
I010135760
I010135760I010135760
I010135760
 
Content Based Image Retrieval Using 2-D Discrete Wavelet Transform
Content Based Image Retrieval Using 2-D Discrete Wavelet TransformContent Based Image Retrieval Using 2-D Discrete Wavelet Transform
Content Based Image Retrieval Using 2-D Discrete Wavelet Transform
 
Sparse Sampling in Digital Image Processing
Sparse Sampling in Digital Image ProcessingSparse Sampling in Digital Image Processing
Sparse Sampling in Digital Image Processing
 
Image resolution enhancement using blind technique
Image resolution enhancement using blind techniqueImage resolution enhancement using blind technique
Image resolution enhancement using blind technique
 

More from IOSR Journals (20)

A011140104
A011140104A011140104
A011140104
 
M0111397100
M0111397100M0111397100
M0111397100
 
L011138596
L011138596L011138596
L011138596
 
K011138084
K011138084K011138084
K011138084
 
J011137479
J011137479J011137479
J011137479
 
I011136673
I011136673I011136673
I011136673
 
G011134454
G011134454G011134454
G011134454
 
H011135565
H011135565H011135565
H011135565
 
F011134043
F011134043F011134043
F011134043
 
E011133639
E011133639E011133639
E011133639
 
D011132635
D011132635D011132635
D011132635
 
C011131925
C011131925C011131925
C011131925
 
B011130918
B011130918B011130918
B011130918
 
A011130108
A011130108A011130108
A011130108
 
I011125160
I011125160I011125160
I011125160
 
H011124050
H011124050H011124050
H011124050
 
G011123539
G011123539G011123539
G011123539
 
F011123134
F011123134F011123134
F011123134
 
E011122530
E011122530E011122530
E011122530
 
D011121524
D011121524D011121524
D011121524
 

Recently uploaded

Heart Disease Prediction using machine learning.pptx
Heart Disease Prediction using machine learning.pptxHeart Disease Prediction using machine learning.pptx
Heart Disease Prediction using machine learning.pptxPoojaBan
 
Oxy acetylene welding presentation note.
Oxy acetylene welding presentation note.Oxy acetylene welding presentation note.
Oxy acetylene welding presentation note.eptoze12
 
IVE Industry Focused Event - Defence Sector 2024
IVE Industry Focused Event - Defence Sector 2024IVE Industry Focused Event - Defence Sector 2024
IVE Industry Focused Event - Defence Sector 2024Mark Billinghurst
 
Introduction to Microprocesso programming and interfacing.pptx
Introduction to Microprocesso programming and interfacing.pptxIntroduction to Microprocesso programming and interfacing.pptx
Introduction to Microprocesso programming and interfacing.pptxvipinkmenon1
 
VIP Call Girls Service Kondapur Hyderabad Call +91-8250192130
VIP Call Girls Service Kondapur Hyderabad Call +91-8250192130VIP Call Girls Service Kondapur Hyderabad Call +91-8250192130
VIP Call Girls Service Kondapur Hyderabad Call +91-8250192130Suhani Kapoor
 
High Profile Call Girls Nagpur Meera Call 7001035870 Meet With Nagpur Escorts
High Profile Call Girls Nagpur Meera Call 7001035870 Meet With Nagpur EscortsHigh Profile Call Girls Nagpur Meera Call 7001035870 Meet With Nagpur Escorts
High Profile Call Girls Nagpur Meera Call 7001035870 Meet With Nagpur EscortsCall Girls in Nagpur High Profile
 
Sachpazis Costas: Geotechnical Engineering: A student's Perspective Introduction
Sachpazis Costas: Geotechnical Engineering: A student's Perspective IntroductionSachpazis Costas: Geotechnical Engineering: A student's Perspective Introduction
Sachpazis Costas: Geotechnical Engineering: A student's Perspective IntroductionDr.Costas Sachpazis
 
Software and Systems Engineering Standards: Verification and Validation of Sy...
Software and Systems Engineering Standards: Verification and Validation of Sy...Software and Systems Engineering Standards: Verification and Validation of Sy...
Software and Systems Engineering Standards: Verification and Validation of Sy...VICTOR MAESTRE RAMIREZ
 
Application of Residue Theorem to evaluate real integrations.pptx
Application of Residue Theorem to evaluate real integrations.pptxApplication of Residue Theorem to evaluate real integrations.pptx
Application of Residue Theorem to evaluate real integrations.pptx959SahilShah
 
Current Transformer Drawing and GTP for MSETCL
Current Transformer Drawing and GTP for MSETCLCurrent Transformer Drawing and GTP for MSETCL
Current Transformer Drawing and GTP for MSETCLDeelipZope
 
VIP Call Girls Service Hitech City Hyderabad Call +91-8250192130
VIP Call Girls Service Hitech City Hyderabad Call +91-8250192130VIP Call Girls Service Hitech City Hyderabad Call +91-8250192130
VIP Call Girls Service Hitech City Hyderabad Call +91-8250192130Suhani Kapoor
 
VICTOR MAESTRE RAMIREZ - Planetary Defender on NASA's Double Asteroid Redirec...
VICTOR MAESTRE RAMIREZ - Planetary Defender on NASA's Double Asteroid Redirec...VICTOR MAESTRE RAMIREZ - Planetary Defender on NASA's Double Asteroid Redirec...
VICTOR MAESTRE RAMIREZ - Planetary Defender on NASA's Double Asteroid Redirec...VICTOR MAESTRE RAMIREZ
 
SPICE PARK APR2024 ( 6,793 SPICE Models )
SPICE PARK APR2024 ( 6,793 SPICE Models )SPICE PARK APR2024 ( 6,793 SPICE Models )
SPICE PARK APR2024 ( 6,793 SPICE Models )Tsuyoshi Horigome
 
chaitra-1.pptx fake news detection using machine learning
chaitra-1.pptx  fake news detection using machine learningchaitra-1.pptx  fake news detection using machine learning
chaitra-1.pptx fake news detection using machine learningmisbanausheenparvam
 
OSVC_Meta-Data based Simulation Automation to overcome Verification Challenge...
OSVC_Meta-Data based Simulation Automation to overcome Verification Challenge...OSVC_Meta-Data based Simulation Automation to overcome Verification Challenge...
OSVC_Meta-Data based Simulation Automation to overcome Verification Challenge...Soham Mondal
 
Sheet Pile Wall Design and Construction: A Practical Guide for Civil Engineer...
Sheet Pile Wall Design and Construction: A Practical Guide for Civil Engineer...Sheet Pile Wall Design and Construction: A Practical Guide for Civil Engineer...
Sheet Pile Wall Design and Construction: A Practical Guide for Civil Engineer...Dr.Costas Sachpazis
 
Artificial-Intelligence-in-Electronics (K).pptx
Artificial-Intelligence-in-Electronics (K).pptxArtificial-Intelligence-in-Electronics (K).pptx
Artificial-Intelligence-in-Electronics (K).pptxbritheesh05
 

Recently uploaded (20)

Heart Disease Prediction using machine learning.pptx
Heart Disease Prediction using machine learning.pptxHeart Disease Prediction using machine learning.pptx
Heart Disease Prediction using machine learning.pptx
 
Oxy acetylene welding presentation note.
Oxy acetylene welding presentation note.Oxy acetylene welding presentation note.
Oxy acetylene welding presentation note.
 
IVE Industry Focused Event - Defence Sector 2024
IVE Industry Focused Event - Defence Sector 2024IVE Industry Focused Event - Defence Sector 2024
IVE Industry Focused Event - Defence Sector 2024
 
Introduction to Microprocesso programming and interfacing.pptx
Introduction to Microprocesso programming and interfacing.pptxIntroduction to Microprocesso programming and interfacing.pptx
Introduction to Microprocesso programming and interfacing.pptx
 
VIP Call Girls Service Kondapur Hyderabad Call +91-8250192130
VIP Call Girls Service Kondapur Hyderabad Call +91-8250192130VIP Call Girls Service Kondapur Hyderabad Call +91-8250192130
VIP Call Girls Service Kondapur Hyderabad Call +91-8250192130
 
High Profile Call Girls Nagpur Meera Call 7001035870 Meet With Nagpur Escorts
High Profile Call Girls Nagpur Meera Call 7001035870 Meet With Nagpur EscortsHigh Profile Call Girls Nagpur Meera Call 7001035870 Meet With Nagpur Escorts
High Profile Call Girls Nagpur Meera Call 7001035870 Meet With Nagpur Escorts
 
Sachpazis Costas: Geotechnical Engineering: A student's Perspective Introduction
Sachpazis Costas: Geotechnical Engineering: A student's Perspective IntroductionSachpazis Costas: Geotechnical Engineering: A student's Perspective Introduction
Sachpazis Costas: Geotechnical Engineering: A student's Perspective Introduction
 
🔝9953056974🔝!!-YOUNG call girls in Rajendra Nagar Escort rvice Shot 2000 nigh...
🔝9953056974🔝!!-YOUNG call girls in Rajendra Nagar Escort rvice Shot 2000 nigh...🔝9953056974🔝!!-YOUNG call girls in Rajendra Nagar Escort rvice Shot 2000 nigh...
🔝9953056974🔝!!-YOUNG call girls in Rajendra Nagar Escort rvice Shot 2000 nigh...
 
Software and Systems Engineering Standards: Verification and Validation of Sy...
Software and Systems Engineering Standards: Verification and Validation of Sy...Software and Systems Engineering Standards: Verification and Validation of Sy...
Software and Systems Engineering Standards: Verification and Validation of Sy...
 
Application of Residue Theorem to evaluate real integrations.pptx
Application of Residue Theorem to evaluate real integrations.pptxApplication of Residue Theorem to evaluate real integrations.pptx
Application of Residue Theorem to evaluate real integrations.pptx
 
Current Transformer Drawing and GTP for MSETCL
Current Transformer Drawing and GTP for MSETCLCurrent Transformer Drawing and GTP for MSETCL
Current Transformer Drawing and GTP for MSETCL
 
VIP Call Girls Service Hitech City Hyderabad Call +91-8250192130
VIP Call Girls Service Hitech City Hyderabad Call +91-8250192130VIP Call Girls Service Hitech City Hyderabad Call +91-8250192130
VIP Call Girls Service Hitech City Hyderabad Call +91-8250192130
 
9953056974 Call Girls In South Ex, Escorts (Delhi) NCR.pdf
9953056974 Call Girls In South Ex, Escorts (Delhi) NCR.pdf9953056974 Call Girls In South Ex, Escorts (Delhi) NCR.pdf
9953056974 Call Girls In South Ex, Escorts (Delhi) NCR.pdf
 
VICTOR MAESTRE RAMIREZ - Planetary Defender on NASA's Double Asteroid Redirec...
VICTOR MAESTRE RAMIREZ - Planetary Defender on NASA's Double Asteroid Redirec...VICTOR MAESTRE RAMIREZ - Planetary Defender on NASA's Double Asteroid Redirec...
VICTOR MAESTRE RAMIREZ - Planetary Defender on NASA's Double Asteroid Redirec...
 
SPICE PARK APR2024 ( 6,793 SPICE Models )
SPICE PARK APR2024 ( 6,793 SPICE Models )SPICE PARK APR2024 ( 6,793 SPICE Models )
SPICE PARK APR2024 ( 6,793 SPICE Models )
 
chaitra-1.pptx fake news detection using machine learning
chaitra-1.pptx  fake news detection using machine learningchaitra-1.pptx  fake news detection using machine learning
chaitra-1.pptx fake news detection using machine learning
 
OSVC_Meta-Data based Simulation Automation to overcome Verification Challenge...
OSVC_Meta-Data based Simulation Automation to overcome Verification Challenge...OSVC_Meta-Data based Simulation Automation to overcome Verification Challenge...
OSVC_Meta-Data based Simulation Automation to overcome Verification Challenge...
 
Sheet Pile Wall Design and Construction: A Practical Guide for Civil Engineer...
Sheet Pile Wall Design and Construction: A Practical Guide for Civil Engineer...Sheet Pile Wall Design and Construction: A Practical Guide for Civil Engineer...
Sheet Pile Wall Design and Construction: A Practical Guide for Civil Engineer...
 
Call Us -/9953056974- Call Girls In Vikaspuri-/- Delhi NCR
Call Us -/9953056974- Call Girls In Vikaspuri-/- Delhi NCRCall Us -/9953056974- Call Girls In Vikaspuri-/- Delhi NCR
Call Us -/9953056974- Call Girls In Vikaspuri-/- Delhi NCR
 
Artificial-Intelligence-in-Electronics (K).pptx
Artificial-Intelligence-in-Electronics (K).pptxArtificial-Intelligence-in-Electronics (K).pptx
Artificial-Intelligence-in-Electronics (K).pptx
 

Survey Single Image Super Resolution Techniques

  • 1. IOSR Journal of Electronics and Communication Engineering (IOSR-JECE) e-ISSN: 2278-2834,p- ISSN: 2278-8735.Volume 5, Issue 5 (Mar. - Apr. 2013), PP 23-33 www.iosrjournals.org www.iosrjournals.org 23 | Page Survey on Single image Super Resolution Techniques Rujul R. Makwana 1 , Nita D. Mehta2 1 (PG Student, EC Department,Government Engineering College, Surat, India) 2 (Associate Professor, EC Department,Government Engineering College, Surat, India) Abstract:Super-resolution is the process of recovering a high-resolution image from multiple low- resolutionimages of the same scene. The key objective of super-resolution (SR) imaging is to reconstruct a higher-resolution image based on a set of images, acquired from the same scene and denoted as ‘low- resolution’ images, to overcome the limitation and/or ill-posed conditions of the image acquisition process for facilitating better content visualization and scene recognition. In this paper, we provide a comprehensive review of existing super-resolution techniques and highlight the future research challenges. This includes the formulation of an observation model and coverage of the dominant algorithm – Iterative back projection.We critique these methods and identify areas which promise performance improvements. In this paper, future directions for super-resolution algorithms are discussed. Finally results of available methods are given. Keywords: Super-resolution, POCS, IBP, Canny Edge Detection I. Introduction Super resolution is a method for reconstructing a high resolution image from several overlapping low- resolution images[1]. The low resolution input images are the result of re-sampling a high resolution image. The goal is to find the high resolutionimage which, when re-sampled in the lattice of the input images according to the imaging model, predicts well the low resolution input images. The success of super resolution algorithm is highly dependent on the accuracy of the model of the imaging process.If, for example, the motion computed for some of the images is not correct, the algorithm may degrade the image rather than enhance it.One solution proposed to handle local model inaccuracies and noise is regularization [2].In most cases the enforced smoothness results in the suppression of high-frequency information, and the results are blurred. Regularization may be successful when the scene is strongly restricted, e.g. a binary text image[2]. Applications for super-resolution abound. NASA has been using super-resolution techniques for years to obtain more detailed images of planets and other celestial objects. Closer to home, super-resolution can be used to enhance surveillance videos to more accurately identify objects in the scene. One particular example of this are systems capable of automatically reading license plate numbers from severely pixelated video streams. Another application is the conversion of standard NTSC television recordings to the newer HDTV format which is of a higher resolution. A variety of approaches for solving the super-resolution problem have been proposed. Initial attempts worked in the frequency domain, typically recovering higher frequency components by taking advantage of the shifting and aliasing properties of the Fourier transform. Deterministic regularization approaches, which work in the spatial domain, enable easier inclusion of a priori constraints on the solution space (typically with a smoothness prior). Stochastic methods have received the most attention lately as they generalize the deterministic regularization approaches and enable more natural inclusion of prior knowledge. Other approaches include nonuniform interpolation, projection onto convex sets, iterative back projection, and adaptive filtering. With the increased emphasis on stochastic techniques has also come increased emphasis on learning priors from from example data rather than relying on more heuristicallyderived information. The paper is organized as follows. Section 2 presents Super Resolution Processing and a description of the general model of imaging systems (observation model) that provides the SR image formulations. Section 3 presents the SR image reconstruction approaches that reconstruct a single high-resolution image from a set of given low-resolution images acquired from the same scene. Section 4 presents Results and Discussion. Section 5 discusses several research challenges that remain open in this area for future investigation. Finally, Section.6 concludes this paper. II. Super-Resolution Processing Given a set of low resolution images that result from the observation of the same scene from slightly different views, super resolution algorithm produce a single high resolution image by fusing the input LR images such that the final HR image reproduces the scene with a better fidelity than any of the LR images[11].
  • 2. Survey on Single image Super Resolution Techniques www.iosrjournals.org 24 | Page The central idea in super resolution processing is to convert the temporal resolution in to spatial resolution. In broad sense, this approach can be used to perform any combination of the following image processing tasks: - Registration - Interpolation - De-bluriring Fig.1 Phases of Super-Resolution[3] First, the SRR algorithm receive several low-resolution corrupted images as the inputs then the registration or Motion Estimation process estimate the relative shifts between LR images compared to the reference LR image with fractional pixel accuracy. Obviously, accurate sub-pixel motion estimation is a very important factor in the success of the SRR algorithm. Since the shifts between LR images are arbitrary, the registered HR image will not always match up to a uniformly spaced HR grid. Thus, non-uniform interpolation is necessary to obtain a uniformly spaced HR image from a composite of non-uniformly spaced LR images. Finally, image restoration(De-blurring) is applied to the up-sampled image to remove blurring and noise.Before presenting the review of existing SR algorithms, we first model the LR image acquisition process. 1.1 Observation Model Based on the most common observation model (Fig.2) it is considered that the available low-resolution input images are obtained from the high-resolution original scene by warping, blurring and down sampling the scene. Consider the desired HR image of size 1 1 2 2L N L N written in lexicographical notation as the vector 1 2[ , ,..., ]T Nx x x x where 1 1 2 2N L N L N  . Namely,x is the ideal un-degraded image that is sampled at orabove the Nyquist rate from a continuous scene which isassumed to be bandlimited. Now, let the parameters L1and L2 represent the down-sampling factors in the observationmodel for the horizontal and vertical directions, respectively.Thus, each observed LR image is of size 1 1 2 2L N L N . Let the kth LR image be denoted in lexicographicnotation as ,1 ,2 ,[ , ,...., ]T k k k k My y y y for 1,2,..,k p and 1 1 2 2M L N L N  . Now, it is assumed that xremains constant during the acquisition of the multipleLR images, except for any motion and degradation allowedby the model. Therefore, the observed LR imagesresult from warping, blurring, and subsampling operatorsperformed on the HR image x. Assuming that eachLRimage is corrupted by additive noise, we can then represent the observation model as [3], k k k ky DB M X n  for 1≤ k ≤ p (1) Where kM is awarpmatrix of size 1 1 2 2 1 1 2 2L N L N L N L N , kB represents a 1 1 2 2 1 1 2 2L N L N L N L N blur matrix, D is a 2 1 2 1 1 2 2( )N N L N L N subsampling matrix, and kn represents a lexicographically ordered noise vector. Ablock diagram for the observation model is illustrated in Fig.2. Fig.2 Observation Model
  • 3. Survey on Single image Super Resolution Techniques www.iosrjournals.org 25 | Page III. Super-resolution techniques Image super resolution techniques can be mainly categorized as reconstruction based techniques and learning based techniques. Table 1 Comparison between Frequency Domain and Spatial Domain Super Resolution Techniques Frequency Domain Spatial Domain Observation model Frequency domain Spatial domain Motion Model Global Translation Almost Unlimited Degradation model Global translation Almost unlimited Noise model Limited Almost unlimited A-priori information Limited Almost unlimited Simplicity Very Simple Generally Complex Computational Cost Low High Regularization Limited Excellent Extensibility Poor Excellent Applicability Limited Wide Performance Good for Specific Application Good In learning based approach, the relationship between an LR image and its corresponding high resolution (HR) image is examined via a pair of LR and HR patches. The training data is used to predict the higher-resolution image[4]. Reconstruction based approach can be employed in the frequency domain or spatial domain. Reconstruction based approach require either single image or multiple low resolution image.Simplicity in theory is a major advantage of the frequency domain approach. In addition, the frequency approach is also convenient for parallel implementation. However, this approach allows low flexibility to add priori constraints, noise models, and spatially varying degradation models. Thus, the development in practical use is limited. On the other hand, spatial domain techniques are more flexible in incorporating priori constraints and have better performance in reconstructed images. Nevertheless, these methods also have drawbacks such as complicated theoretical work and relatively large amount of computation load. A comparison of the two main classes of super-resolution techniques, frequency domain and spatial domain, is found in Table 1[5-9]. 1.2 Frequency Domain Approach The super-resolution problem was posed, along with a frequency domain solution, by Tsai and Huang[10]. Prior to their paper, interpolation was the best technique for increasing the resolution of images.The frequency domain approach makes explicit use of the aliasing that exists in each LR image to reconstruct an HR image. Tsai and Huang [10] first derived a system equation that describes the relationship between LR images and a desired HR image by using the relative motion between LR images. The frequency domain approach is based on the following three principles: i) the shifting property of the Fourier transform, ii) the aliasing relationship between the continuous Fourier transform (CFT) of an original HR image and the discrete Fourier transform (DFT) of observed LR images, iii) and the assumption that an original HR image is band limited. These properties make it possible to formulate the system equation relating the aliased DFT coefficients of the observed LR images to a sample of the CFT of an unknown image. For example, let us assume that there are two 1-D LR signals sampled below the Nyquist sampling rate. From the above three principles, the aliased LR signals can be decomposed into the de-aliased HR signal as shown in Fig. 3. Fig.3. Aliasing relationship between LR image and HR image
  • 4. Survey on Single image Super Resolution Techniques www.iosrjournals.org 26 | Page Frequency-domain super resolution method typically rely on familiar Fourier transform properties, specifically the shifting and sampling theorems. Since these properties are generally very well known and understood, the frequency domain approaches are easy to grasp and are intuitively appealing. Many of the frequency-domain approaches are based on assumptions which enable the use of efficient procedures for computing the restoration, the most important of which is the Fast Fourier Transform (FFT). Let 1 2( , )x t t denote a continuous HR image and 1 2( , )X w w be its CFT. The global translations, which are the only motion considered in the frequency domain approach, yield the th k shifted image of 1 2 1 1 2 2( , ) ( , )k k kx t t x t t    , where 1k and 2k are arbitrary but known values, and k =1,2,.., p. By the shifting property of the CFT, the CFT of the shifted image, 1 2( , )kX w w , can be written as 1 2 1 1 2 2 1 2( , ) exp[ 2 ( )] ( , )k k kX w w j w w X w w    (2) The shifted image 1 2( , )kx t t is sampled with the sampling period T1 and T2 to generate the observed LR image 1 2( , )ky n n . Fromthe aliasing relationship and the assumption of bandlimitedness of 1 2( , )X w w 1 2(| ( , ) |) 0X w w  for 1 1 1| | ( / )w L T , 2 2 2| | ( / ))w L T , the relationship between the CFT of theHRimage and the DFT of the th k observed LR image can be written as [11] 1 2 1 2 1 1 1 2 1 2 1 2 0 01 2 1 1 2 2 1 2 2 ( , ) , L L k k n n X n n TT T N T N                               (3) By using lexicographic ordering for the indices n1 ,n2 on the right-hand side and k on the left-hand side, a matrix vector form is obtained as: Y X  (4) whereY is a p ×1 column vector with the th k element of the DFT coefficients of 1 2[ , ]ky n n , X is a 1 2 1L L  column vector with the samples of the unknown CFT of 1 2( , )x t t , and Φ is a 1 2p L L matrix which relates the DFT of the observed LR images to samples of the continuous HR image. Therefore, the reconstruction of a desired HR image requires us to determine Φ and solve this inverse problem. An extension of this approach for a blurred and noisy image was provided by Kim et al. [12], resulting in a weighted least squares formulation. In their approach, it is assumed that all LR images have the same blur and the same noise characteristics. This method was further refined by Kim and Su [13] to consider different blurs for each LR image. Here, the Tikhonov regularization method is adopted to overcome the ill-posed problem resulting from blur operator. Bose et al. [14] proposed the recursive total least squares method for SR reconstruction to reduce effects of registration errors (errors in Φ). A discrete cosine transform (DCT)-based method was proposed by Rhee and Kang [15]. They reduce memory requirements and computational costs by using DCT instead of DFT. They also apply multichannel adaptive regularization parameters to overcome ill-posedness such as underdetermined cases or insufficient motion information cases. Theoretical simplicity is a major advantage of the frequency domain approach. That is, the relationship between LR images and the HR image is clearly demonstrated in the frequency domain. The frequencymethod is also convenient for parallel implementation capable of reducing hardware complexity. 1.3 Spatial Domain Approach In this class of SR reconstruction methods, the observation model is formulated, and reconstruction is effected in the spatial domain. The linear spatial domain observation model can accommodate global and non- global motion, optical blur, motion blur, spatially varying PSF, non-ideal sampling, compression artifacts and more. Spatial domainreconstruction allows natural inclusion of (possibly nonlinear) spatial domain a-priori constraints (e.g. Markov random fields or convex sets) which result in bandwidth extrapolation in reconstruction. Consider estimating a SR image z from multiple LR images , {1,2,..., }ry r R . Images are written as lexicographically ordered vectors. ry and z are related as r ry H z . The matrix rH , which must be estimated, incorporates motion compensation, degradation effects and subsampling. The observation equation may be generalized to Y = Hz + N where 1[ ... ]T T T RY y y and 1[ ... ]T T T RH H H with N representing observation noise.
  • 5. Survey on Single image Super Resolution Techniques www.iosrjournals.org 27 | Page Since the superresolution problem is fundamentally ill-posed, incorporation of prior knowledge is essential to achieve good results. A variety of techniques exist for the super-resolution problem in the spatial domain. These solutions include interpolation, deterministic regularized techniques, stochastic methods, iterative back projection, and projection onto convex sets among others. The primary advantages to working in the spatial domain are support for unconstrained motion between frames and ease of incorporating prior knowledge into the solution. 3.2.1 Interpolation of Non Uniformly Spaced Samples Registering a set of LR images using motion compensation results in a single, dense composite image of non uniformly spaced samples. A SR image may be reconstructed from this composite using techniques for reconstruction from non-uniformly spaced samples. Unfortunately, this technique generally works very poorly because of some inherent assumptions; the main problem being that camera sensors do not act as impulse functions. Since the observed data result from severely under sampled, spatially averaged areas, the reconstruction step (which typically assumes impulse sampling) is incapable of reconstructing significantly more frequency content than is present in a single LR frame. Degradation models are limited, and no a-priori constraints are used. There is also question as to the optimality of separate merging and restoration steps. 3.2.2 Deterministic Regularization The deterministic regularized SR approach solves the inverse problem by using the prior information about the solution which can be used to make the problem well posed. For example, CLS can be formulated by choosing an x to minimize the Lagrangian [16] 2 2 1 [ || || || || ] p k k k X Xy W C    (5) where the operator C is generally a high-pass filter, and||.|| represents a l2 -norm. In eq(5), a priori knowledge concerning a desirable solution is represented by a smoothness constraint, suggesting that most images are naturally smooth with limited high-frequency activity, and therefore it is appropriate to minimize the amount of high-pass energy in the restored image. In eq(5), α represents the Lagrange multiplier, commonly referred to as the regularization parameter, that controls the tradeoff between fidelity to the data (as expressed by 2 1 || || p k k k Xy W   ) andsmoothness of the solution (as expressed by 2 || ||XC ). TheLarger values of α will generally lead to a smoothersolution.This is useful when only a small number of LR imagesare available (the problem is underdetermined) orthe fidelity of the observed data is low due to registrationerror and noise. On the other hand, if a large number ofLR images are available and the amount of noise is small,smallαwill lead to a good solution. The cost functional ineq(6) is convex and differentiable with the use of a quadraticregularization term. Therefore, we can find a unique estimateimage ^ X which minimizes the cost functional in eq(5). One of the most basic deterministic iterative techniquesconsiders solving ^ 1 1 p p T T T k k k k k k W W C C X W y            (6) and this leads to the following iteration for ^ X : ( 1) ( ) ( ) ( )^ ^ ^ ^ 1 n n n np T T k k k k X X W y W X C C X                  (7) where β represents the convergence parameter and T kW contains an up-sampling operator and a type of blur andwarping operator. 3.2.3 Projection Onto Convex Sets(POCS) Another method for reducing the space of possible reconstructions is projection onto convex sets (POCS). The POCS method describes an alternative iterative approach to incorporating prior knowledge about the solution into the reconstruction process. With the estimates of registration parameters, this algorithm simultaneously solves the restoration and interpolation problem to estimate the SR image. This is a set-theoretic approach where each piece of a priori knowledge is formulated as a constraining convex set. Once the group of
  • 6. Survey on Single image Super Resolution Techniques www.iosrjournals.org 28 | Page convex sets is formed, an iterative algorithm is employedto recover a point on the intersection of the convex sets, 1 1 2 1..... { }i M M ig P P P P g  (8) where jP is the projection of a given point onto the th j convex set and M is the number of convex sets. In essence, we are restricting the final restored image to lie on the intersection of the constrainingsets, 1{ }M j jP  . The reason we require convex sets is that convergenceis guaranteed for the case where each set is convex. One potential group of convex sets is based on the l2 distance measure, 2 { || || 1}k k kG g W g y   ,1 k K  (9) This defines a set of ellipsoids (one for each input image) and restrictsthe final solution to lie inside the ellipsoids. Other possibleconvex sets include ones based on the l¥ norm, those imposingsmoothness, and those constraining the image intensity to be positive.Two problems with the POCS approach are that uniqueness isnot guaranteed for the final recovered image and that defining theprojections jP can be difficult. 3.2.4 Iterative Back Projection(IBP) Super resolution of the image is model as an inverse problem. That is the goal of super resolution is to reverse the effect of the down sampling, blurring and warping that relate the LR image to desired HR image. Mathematically it is written as ( * )y X W S  (10) Where, X is original HR image; y is LR image; W is degeneration function; ↓ s is down sampling process. In IBP approach HR image is estimated by back projecting the difference between the simulated LR image and captured LR on interpolated image. This iterative process of SR does iterations until the minimization of the cost function is achieved. Block diagram of IBP algorithm is given in Fig. 4. Mathematically the SR step according to IBP is written as (0) eX X X  (11) Where, X is interpolated image; eX is error correction. Fig. 4 Simple IBP Algorithm[17] Given only one LR input image, the updating procedure can be summarized as doing the following two steps iteratively: 1) Compute the LR error as ( ) ( ) ( )n n eX y y S   (12) Estimation of the simulated LR image is given as ( ) ( ) ( * )n n y X W S  (13) 2) Update the HR image by back-projecting the error as equation (11). 3.2.4.1 Proposed IBP using Canny Edge Detection
  • 7. Survey on Single image Super Resolution Techniques www.iosrjournals.org 29 | Page Though IBP method can minimize the restoration error significantly in iterative manner and gives good effect, it projected the error back without edge guidance. In proposed algorithm, extra high frequency information is added by Canny edge detection and difference error of up-sampled images from initial and simulated LR images and so that it works as edge preserving algorithm. Block diagram of proposed algorithm is shown in Fig. 5. Steps for proposedalgorithm are given in Table II. Fig. 5 Canny Edge Detection Algorithm Mathematically SR according to proposed algorithm is written as (0) e HX X X X   (14) Where, (0) X is initial interpolated image; eX is error correction; HX is high frequency estimation given by ( * )H CannyX X H (15) Where HX is the estimated HR image, CannyH is the Canny Edge High Pass filter. In Summary, proposed algorithm in mathematical form is expressed as below. The estimated HR image after n iterations is given by ( 1) ( ) ( )n n n e HX X X X    (16) The estimation of the high frequency is given as ( ) (0) ( ) {(( ) )* }n n H H CannyX X y S H   (17) Where (0) HX is high frequency component of image (0) X . The formula for (0) HX is given as (0) (0) ( * )H CannyX X H (18) So, the final iterations process given in (13) is rewritten for the combination of IBP and Canny Edge as ( 1) ( ) ( ) (0) ( ) ( ) { {(( )* }}n n n n H CannyX X y y S X y S H        (19) Table II Steps of Canny Edge Detection Algorithm NO STEPS 1 Read ground truth image 2 Apply Gaussian blurring and down sampling to generate observed LR image 3 Apply initial interpolation on observed LR image for initial estimation of HR image 4 Apply Canny Edge on initial estimated HR image to obtain high frequency component 5 Apply degradation on initial estimated HR image to generate simulated LR image 6 Apply Canny Edge on simulated LR image 7 Subtract simulated LR from Observed LR image that gives error correction 8 9 10 11 Subtract step 6 output from step 4 output to get lost high frequency component Take summation of step 3 output with step 8 output. This will give improvement in quality of initial estimated HR image Now, this improved HR becomes our initial estimated HR image for the second iteration Repeat step 5 to step 10 until some predefined iteration
  • 8. Survey on Single image Super Resolution Techniques www.iosrjournals.org 30 | Page IV. Result and Discussion To evaluate the SR systems effectively, this work assumes that the original HR images exist and the image qualitydegradation is resulted from Gaussian blurring, and such Gaussian blurring function is known. To present the performance of this algorithms, several images are tested and results are compared with Nearest Neighbourhood interpolation(NN), Bilinear interpolation (BI), bicubic interpolation (BC), POCS, IBP and IBP + Canny Edge Detection.The image quality is determined based on PSNR evaluation. As performance criteria, Peak Signal to Noise Ratio (PSNR) is calculated. The mathematical equations for M×N image analysis are as given bellow[18]. ( ) 2 [ ( , ) ( , )]n i j X i j X i j MSE M N     (20) 10 255 255 10logPSNR MSE        (21) Where, ( , )X i j is the original HR image and ( ) ( , )n X i j is the estimated HR image through this algorithm. The image quality is determined based on PSNR evaluation. A good reconstruction algorithm generally provides low value of MSE and high value of MSSIM and PSNR. The resultant images are shown in figure 6 and 7 . PSNR is obtained using various techniques are given in Table III. Table III PSNR Comparison Test Image Single Frame Algorithms NN BI Bicubic POCS IBP IBP +Canny Edge Apple 26.6500 29.1617 31.6337 30.7417 28.7719 42.3146 Football 26.9158 29.3864 30.4000 30.3136 29.2219 42.8838 Greens 19.9802 22.1634 24.6540 28.2204 22.1575 34.4326 Monkey 29.6891 31.2404 33.4968 32.7840 31.0809 43.6170 Flower 29.1997 32.0320 33.9559 32.4331 31.7295 46.0387 Fruits 28.4520 31.0726 34.1511 32.9744 30.9810 43.7963 (a)Original Image (b) LR Image (c) NN Interpolation (d) Bilinear Interpolation
  • 9. Survey on Single image Super Resolution Techniques www.iosrjournals.org 31 | Page (e) Bicubic Interpolation (f) POCS (g) IBP (h) IBP + Canny Edge Fig.6. Resultant football Image using different Algorithms (a)Original Image (b) LR Image (c) NN Interpolation (d) Bilinear Interpolation (e) Bicubic Interpolation (f) POCS
  • 10. Survey on Single image Super Resolution Techniques www.iosrjournals.org 32 | Page (g) IBP (h) IBP + Canny Edge Fig.7. Resultant Greens Image using different Algorithms V. Future Research Directions we have identified some new directions for future research. The first asks the question “Can we design camera sensors that are optimal for super-resolution algorithms?”.Current CCDs act like box functions, spatially integrating over a uniform rectangular region for each pixel. It is likely that other types of sampling, such as integration over a Gaussian function, would yield better results. Another direction is to combine super-resolution with dense stereo reconstruction. Dense stereo reconstruction is the process of estimating the depth of every point in the scene from two or more input images taken from different poses. Current techniques typically estimate depths for every pixel in one of the images, but it should be possible to obtain depths on a finer grid by combining super-resolution techniques with dense stereo. A third potential problem is to combine high dynamic range imaging with super-resolution. High dynamic range imaging involves taking multiple images from the same viewpoint at different exposures and then combining the images to obtain an image of higher dynamic range. By taking multiple images at different exposures and with slight translational offsets it might be possible to obtain a super-resolved high dynamic range image more efficiently than if the two stages are done independently. VI. Conclusion The SR imaging has been one of the fundamental image processing research areas. It can overcome or compensate the inherent hardware limitations of the imaging system to provide amore clear image with a richer and informative content. We have provided a review of the current state of super-resolution research, covering the past, present, and future of the problem. A standard image formation model was first introduced, followed by summaries of the major classes of algorithms including frequency domain approaches, deterministic regularization, projection onto convex sets, Iterative Back Projection and Proposed IBP with Canny Edge Detection. In this survey paper, our goal is to offer new perspectives and outlooks of SR imaging research, besides giving an updated overview of existing SR algorithms. It is our hope that this work could inspire more image processing researchers endeavoring on this fascinating topic and developing more novel SR techniques along the way. Finally we discussed potential future directions for research. References [1] Assaf Zomet, Alex Rav-Acha, Shmuel Peleg, ”Robust Super-Resolution” ,ISBN 0-7695-1272-0/01 $10.00 (C) 2001 IEEE. [2] D. Capel and A. Zisserman. Super-resolution enhancement of text image sequences. In Int. Conf. Pattern Recognition, pages Vol I: 600.605, 2000. [3] Sung Cheol Park, Min Kyu Park,and Moon Gi Kang“Super Resolution:A Technical Overview,”IEEE SIGNAL PROCESSING MAGAZINE 1053-5888/03/$17.00©2003IEEE. [4] C. V. Jiji and Subhasis Chaudhuri, 2006, “Single-Frame Image Super-resolution through Contourlet Learning”, EURASIP Journal on Applied Signal Processing, VOL.2006, Article ID 73767, pp 1-11. [5] David Capel and Andrew Zisserman, 2000, “Super-resolution Enhancement of Text Image Sequences”, IEEE Comput. Soc, Proceedings 15th International Conference on Pattern Recognition ICPR, VOL. 1, No. 1, pp-600-605. [6] Sina Farsiu, M. Dirk Robinson, Michael Elad, and Peyman Milanfar, 2004, “Fast and Robust Multiframe Super Resolution”, IEEE transactions on image processing, VOL. 13, NO. 10, pp 1327-1344. [7] Xueting Liu, Daojin Song, Chuandai Dong and Hongkui Li, 2008, “MAP-Based Image Super-resolution Reconstruction”, World Academy of Science, Engineering and Technology 37, pp 208-211. [8] Kamal Nasrollahi, “ A Computer Vision Story On Video Sequences: From Face Detection to Face Super Resolution using Face Quality Assessment”, Faculty of engineering and science, IEEE Member, AALBORG UNIVERSITY 2011. [9] BORMAN, S., AND STEVENSON, R. 1998. Super-resolution from image sequences – A review. In Proceedings of the 1998 Midwest Symposium on Circuits and Systems, IEEE, Notre Dame, IN, USA, 374–378. [10] TSAI, R. Y., AND HUANG, T. S. 1984. Multi-frame image restoration and registration. In in Advances in Computer Vision and Image Processing, 317–339. [11] A.M. Tekalp, Digital Video Processing. Englewood Cliffs, NJ: Prentice Hall, 1995. [12] S.P. Kim, N.K. Bose, and H.M. Valenzuela, “Recursive reconstruction of high resolution image from noisy under sampled multi frames,” IEEE Trans. Acoust., Speech, Signal Processing, vol. 38, pp. 1013-1027, June 1990.
  • 11. Survey on Single image Super Resolution Techniques www.iosrjournals.org 33 | Page [13] S.P. Kim and W.Y. Su, “Recursive high-resolution reconstruction of blurred multiframe images,” IEEE Trans. Image Processing, vol. 2, pp. 534-539, Oct. 1993. [14] N.K. Bose, H.C. Kim, and H.M. Valenzuela, “Recursive implementation of total least squares algorithm for image reconstruction from noisy, under sampled multi frames,” in Proc. IEEE Conf. Acoustics, Speech and Signal Processing, Minneapolis, MN, Apr. 1993, vol. 5, pp. 269-272. [15] S.H. Rhee and M.G. Kang, “Discrete cosine transform based regularized high-resolution image reconstruction algorithm,” Opt. Eng., vol. 38, no. 8, pp. 1348-1356, Aug. 1999. [16] A.K. Katsaggelos, Ed. Digital Image Restoration. Heidelberg, Germany: Springer-Verlag. Springer. vol. 23, 1991. [17] V. B. Patel, Chintan K. Modi, C. N. Paunwala and S. Patnaik, “Hybrid Approach for Single Image Super Resolution using ISEF and IBP”, in IEEE Conference on Communication System and Network Technology (CSNT), 03-05 june, 2011. [18] Liyakathunisa and C.N .Ravi Kumar,” A NOVEL SUPER RESOLUTION RECONSTRUCTION OF LOW REOSLUTION IMAGESPROGRESSIVELY USING DCT AND ZONAL FILTER BASED DENOISING”, International Journal of Computer Science & Information Technology (IJCSIT), Vol 3, No 1, Feb 2011.