METHOD AND APPARATUS FOR PERFORMING HIERARCHICAL SUPER-RESOLUTION OF AN INPUT IMAGE
4 Assignments
0 Petitions
Accused Products
Abstract
Super-resolution refers to a process of recovering the missing high-frequency details of a given low-resolution image. Known single image SR algorithms are often computationally intractable or unusable for most of the practical applications. The invention relates to a method for performing hierarchical super-resolution based on self content neighboring patches information is based on pyramidal decomposition. The intrinsic geometric property of an input LR patch neighborhood is obtained from the input LR patch and its K nearest neighbors taken from different down-scaled versions of the LR image.
15 Citations
29 Claims
-
1-15. -15. (canceled)
-
16. A method for performing hierarchical super-resolution of an input image, comprising steps of
dividing the input image into patches; -
performing spatial decomposition of the input image to at least two lower decomposition levels, wherein at least two lower decomposition level images are obtained; generating an empty upsampled frame, wherein for each patch of the input image a corresponding upsampled patch in the upsampled frame is generated; and for each current patch of the input image, performing the steps of searching in the lower decomposition level images one or more similar patches of same size as the current patch; for each of the similar patches found in the searching step, determining its respective parent patch in the next higher decomposition level, wherein the parent patches are larger than the current patch; weighting the determined parent patches, wherein a weight used for weighting a patch is determined from a sparsity of the patch, wherein the sparsity corresponds to a number of non-zero DCT coefficients in the patch, and wherein weighted determined parent patches are obtained; accumulating the weighted determined parent patches, wherein an upsampled high-resolution patch is obtained; and replacing, in the up-sampled frame, an upsampled patch corresponding to the current patch with the upsampled high-resolution patch. - View Dependent Claims (17, 18, 19, 20, 21, 22, 23, 24, 29)
-
-
25. A method for averaging of pixels in performing super-resolution by using block-based predictions, wherein Local Linear Embedding is used and wherein the pixels are from source blocks that are overlapping, the method comprising steps of
determining sparsity factors of the source blocks; combining the pixels from the source blocks according to weighting factors, wherein the sparsity factor of each source block is used as a weighting factor for its pixels.
-
26. An apparatus for performing hierarchical super-resolution of an input image, wherein the input image is divided into patches, the apparatus comprising
spatial decomposition unit for performing spatial decomposition of the input image to at least two lower decomposition levels, wherein at least two lower decomposition level images are obtained; -
upsampling unit for generating an empty upsampled frame, wherein for each patch of the input image a corresponding upsampled patch in the upsampled frame is generated; and processing unit for performing for each current patch of the input image the steps of in a search unit, searching in the lower decomposition level images one or more similar patches of same size as the current patch; for each of the similar patches found in the searching step, determining in a parent patch determining unit its respective parent patch in the next higher decomposition level, wherein the parent patches are larger than the current patch; in a weighting unit, weighting the determined parent patches, wherein a weight used for weighting a patch is determined from a sparsity of the patch, wherein the sparsity corresponds to a number of non-zero DCT coefficients in the patch, and wherein weighted determined parent patches are obtained; in an accumulation unit, accumulating the weighted determined parent patches, wherein an upsampled high-resolution patch is obtained; and replacing in an insertion unit, in the up-sampled frame, an upsampled patch corresponding to the current patch with the upsampled high-resolution patch. - View Dependent Claims (27)
-
-
28. An apparatus for averaging of pixels in performing super-resolution by using block-based predictions, wherein Local Linear Embedding is used and wherein the pixels are from source blocks that are overlapping, the apparatus comprising
a first processing unit for determining sparsity factors of the source blocks; - and
a second processing unit for combining the pixels from the source blocks according to weighting factors, wherein the sparsity factor of each source block is used as a weighting factor for its pixels.
- and
Specification