Apparatus and method for image interpolation using anisotropic gaussian filter

• US 20110176744A1
• Filed: 01/27/2010
• Published: 07/21/2011
• Est. Priority Date: 01/20/2010
• Status: Abandoned Application

• Current Assignee: Korea University Research and Business Foundation
• Original Assignee: Korea University Research and Business Foundation
• Inventors: Han, Jong-Woo, Ko, Sung-Jea, Wang, Tae-Shick, Cheon, Sung-Hyun
• Application Number:
  US12/657,753
• Publication Number:
  US 20110176744A1
• Time in Patent Office: Days
• US Class Current: 382/264
• CPC Class Codes: G06T 3/4007 based on interpolation, e.g. bilinear interpolation image demosaicing G06T3/4015; edge-driven or edge-based scaling G06T3/403

Abstract

An apparatus and method for image interpolation using an anisotropic Gaussian filter, the image interpolation apparatus including: an edge information calculator calculating a first edge orientation that is an orientation of an edge of each of a plurality of pixels that constitute an input low resolution image, and first edge orientation energy that is a maximal strength of the edge corresponding to the first edge orientation; an image enlarging unit calculating a second edge orientation and second edge orientation energy of each of pixels to be interpolated, which are obtained by subtracting reference pixels corresponding to each of the pixels of the low resolution image among a plurality of pixels that constitute the high resolution image that is obtained by enlarging the low resolution image, based on the first edge orientation and the first edge orientation energy of the adjacent reference pixels; and a pixel value calculator calculating a value of each of the pixels to be interpolated, by using an interpolation filter having a direction and a width determined according to the second edge orientation and the second edge orientation energy of each of the pixels to be interpolated. The Gaussian filter having a direction and a width that are adaptively adjusted according to an orientation and strength of an edge is used to interpolate values of pixels of a high resolution image that is obtained by image enlargement so that deterioration of image quality can be minimized with a small amount of calculation and an image with high quality and high resolution can be generated.

Claims

1. An image interpolation apparatus comprising:

an edge information calculator calculating a first edge orientation that is an orientation of an edge of each of a plurality of pixels that constitute an input low resolution image, and first edge orientation energy that is a maximal strength of the edge corresponding to the first edge orientation;

an image enlarging unit calculating a second edge orientation and second edge orientation energy of each of pixels to be interpolated, which are obtained by subtracting reference pixels corresponding to each of the pixels of the low resolution image among a plurality of pixels that constitute the high resolution image that is obtained by enlarging the low resolution image, based on the first edge orientation and the first edge orientation energy of the adjacent reference pixels; and

a pixel value calculator calculating a value of each of the pixels to be interpolated, by using an interpolation filter having a direction and a width determined according to the second edge orientation and the second edge orientation energy of each of the pixels to be interpolated.

2. The image interpolation apparatus of claim 1, further comprising an edge region detector detecting an edge region that is a region including pixels having the first edge orientation energy that is equal to or greater than predetermined reference energy, among a plurality of pixels that constitute the low resolution image, wherein the image enlarging unit calculates the second edge orientation of each of the pixels to be interpolated, based on a first edge orientation and first edge orientation energy of a reference pixel included in the edge region, among the reference pixels that are disposed in the vertices of the unit cells to which each of the pixels to be interpolated belongs.

3. The image interpolation apparatus of claim 1, wherein the edge information calculator determines an orientation corresponding to a maximal value as the first edge orientation, among energy values according to an orientation and a scale that are calculated by convolution of an edge detection filter including a plurality of filter banks determined according to an orientation and a scale of an edge with each of the pixels that constitute the low resolution image, and determines a maximal value among energy values according to the first edge orientation and the scale as the first edge orientation energy.

4. The image interpolation apparatus of claim 2, wherein the edge information calculator determines an orientation corresponding to a maximal value as the first edge orientation, among energy values according to an orientation and a scale that are calculated by convolution of an edge detection filter including a plurality of filter banks determined according to an orientation and a scale of an edge with each of the pixels that constitute the low resolution image, and determines a maximal value among energy values according to the first edge orientation and the scale as the first edge orientation energy.

5. The image interpolation apparatus of claim 1, wherein the edge enlarging unit generates a plurality of unit cells so that the reference pixels are disposed in vertices of the high resolution image, and calculates a second edge orientation of each of the pixels to be interpolated, based on a first edge orientation and first edge orientation energy of the reference pixels that are disposed in the vertices of the unit cells to which each of the pixels to be interpolated belongs.

6. The image interpolation apparatus of claim 2, wherein the edge enlarging unit generates a plurality of unit cells so that the reference pixels are disposed in vertices of the high resolution image, and calculates a second edge orientation of each of the pixels to be interpolated, based on a first edge orientation and first edge orientation energy of the reference pixels that are disposed in the vertices of the unit cells to which each of the pixels to be interpolated belongs.

7. The image interpolation apparatus of claim 5, wherein, when the pixels to be interpolated are disposed at a boundary of adjacent unit cells, the second edge orientation and the second edge orientation energy are calculated based on a first edge orientation and first edge orientation energy of the reference pixels that are adjacent to each of the pixels to be interpolated along the boundary at which each of the pixels to be interpolated is disposed.

8. The image interpolation apparatus of claim 1, wherein the interpolation filter is a Gaussian filter, and the Gaussian filter has the same direction as the second edge orientation of the pixels to be interpolated, and has a width in the second edge orientation that is greater than a width in a direction perpendicular to the second edge orientation.

9. The image interpolation apparatus of claim 8, wherein, if the second edge orientation energy of the pixels to be interpolated is greater than an average of edge orientation energy of all of pixels that constitute the high resolution image, the width of the Gaussian filter in the direction perpendicular to the second edge orientation is determined as a reduced value due to a ratio of the averages of the edge orientation energy with respect to the second edge orientation energy.

10. An image interpolation method comprising:

calculating a first edge orientation that is an orientation of an edge of each of a plurality of pixels that constitute an input low resolution image, and first edge orientation energy that is a maximal strength of the edge corresponding to the first edge orientation;

calculating a second edge orientation and second edge orientation energy of each of pixels to be interpolated, which are obtained by subtracting reference pixels corresponding to each of the pixels of the low resolution image among a plurality of pixels that constitute the high resolution image that is obtained by enlarging the low resolution image, based on the first edge orientation and the first edge orientation energy of the adjacent reference pixels; and

calculating a value of each of the pixels to be interpolated, by using an interpolation filter having a direction and a width determined according to the second edge orientation and the second edge orientation energy of each of the pixels to be interpolated.

11. The image interpolation method of claim 10, further comprising detecting an edge region that is a region including pixels having the first edge orientation energy that is equal to or greater than predetermined reference energy, among a plurality of pixels that constitute the low resolution image, wherein the calculating of the second edge orientation and the second edge orientation energy of each of pixels to be interpolated comprises calculating the second edge orientation of each of the pixels to be interpolated, based on a first edge orientation and first edge orientation energy of a reference pixel included in the edge region, among the reference pixels that are disposed in the vertices of the unit cells to which each of the pixels to be interpolated belongs.

12. The image interpolation method of claim 10, wherein the calculating of the first edge orientation and the first edge orientation energy comprises determining an orientation corresponding to a maximal value as the first edge orientation, among energy values according to an orientation and a scale that are calculated by convolution of an edge detection filter including a plurality of filter banks determined according to an orientation and a scale of an edge with each of the pixels that constitute the low resolution image, and determining a maximal value among energy values according to the first edge orientation and the scale as the first edge orientation energy.

13. The image interpolation method of claim 11, wherein the calculating of the first edge orientation and the first edge orientation energy comprises determining an orientation corresponding to a maximal value as the first edge orientation, among energy values according to an orientation and a scale that are calculated by convolution of an edge detection filter including a plurality of filter banks determined according to an orientation and a scale of an edge with each of the pixels that constitute the low resolution image, and determining a maximal value among energy values according to the first edge orientation and the scale as the first edge orientation energy.

14. The image interpolation method of claim 10, wherein the calculating of the second edge orientation and the second edge orientation energy of each of pixels to be interpolated comprises generating a plurality of unit cells so that the reference pixels are disposed in vertices of the high resolution image, and calculating a second edge orientation of each of the pixels to be interpolated, based on a first edge orientation and first edge orientation energy of the reference pixels that are disposed in the vertices of the unit cells to which each of the pixels to be interpolated belongs.

15. The image interpolation method of claim 11, wherein the calculating of the second edge orientation and the second edge orientation energy of each of pixels to be interpolated comprises generating a plurality of unit cells so that the reference pixels are disposed in vertices of the high resolution image, and calculating a second edge orientation of each of the pixels to be interpolated, based on a first edge orientation and first edge orientation energy of the reference pixels that are disposed in the vertices of the unit cells to which each of the pixels to be interpolated belongs.

16. The image interpolation method of claim 14, wherein, when the pixels to be interpolated are disposed at a boundary of adjacent unit cells, the second edge orientation and the second edge orientation energy are calculated based on a first edge orientation and first edge orientation energy of the reference pixels that are adjacent to each of the pixels to be interpolated along the boundary at which each of the pixels to be interpolated is disposed.

17. The image interpolation method of claim 10, wherein a Gaussian filter used in each of the pixels to be interpolated has the same direction as the second edge orientation of the pixels to be interpolated, and has a width in the second edge orientation that is greater than a width in a direction perpendicular to the second edge orientation.

18. The image interpolation method of claim 17, wherein, if the second edge orientation energy of the pixels to be interpolated is greater than an average of edge orientation energy of all of pixels that constitute the high resolution image, the width of the Gaussian filter in the direction perpendicular to the second edge orientation is determined as a reduced value due to a ratio of the averages of the edge orientation energy with respect to the second edge orientation energy.

19. A computer readable recording medium having recorded thereon a program for executing the image interpolation method of claim 10.