IMAGE PROCESSING DEVICE, IMAGE PROCESSING METHOD, PROGRAM, AND IMAGING DEVICE

• US 20100177982A1
• Filed: 12/16/2009
• Published: 07/15/2010
• Est. Priority Date: 01/09/2009
• Status: Active Grant

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: HAMADA, Takehiro, Tsunashima, Nobuhiro
• Granted Patent: US 8,411,992 B2
• Time in Patent Office: Days
• US Class Current: 382/264
• CPC Class Codes: G06T 2207/20201 Motion blur correction
• CPC Class Codes: G06T 5/75 Unsharp masking
• CPC Class Codes: H04N 25/60 Noise processing, e.g. detecting, correcting, reducing or removing noise

Abstract

An image processing device includes: an estimated plane calculation portion calculating, for inputted image data, estimated planes defined by luminance values in blocks each containing a predetermined number of pixels including a reference pixel; an optimal estimated plane selection portion selecting an optimal estimated plane having a least summation of errors between luminance values of respective pixels in a block and an estimated plane among the estimated planes; a weighting factor calculation portion calculating a weighting factor for the reference pixel base on luminance values of the reference pixel and in the optimal estimated plane; and a weighted smoothing portion computing a sum of products of relative luminance differences between the luminance values of the respective pixels in the block and in the optimal estimated plane and the weighting factor for the reference pixel and adding a luminance value in the optimal estimated plane at a reference pixel position to a result of computation.

Claims

1. An image processing device comprising:

an estimated plane calculation portion that calculates, for inputted image data, a plurality of estimated planes defined by luminance values on a block-by-block basis, each block containing a predetermined number of pixels including a reference pixel to be subjected to filter processing;

an optimal estimated plane selection portion that selects an optimal estimated plane having a least summation of errors between luminance values of respective pixels in a block and luminance values in an estimated plane among the plurality of estimated planes;

a weighting factor calculation portion that calculates a weighting factor for the reference pixel on the basis of a luminance value of the reference pixel and a luminance value in the optimal estimated plane; and

a weighted smoothing portion that computes a sum of products of relative luminance differences between the luminance values of the respective pixels in the block and luminance values in the optimal estimated plane and the weighting factor for the reference pixel and adds a luminance value in the optimal estimated plane at a reference pixel position to a result of computation.

2. The image processing device according to claim 1,

wherein the weighting factor calculation portion calculates the weighting factor for the reference pixel using relative luminance differences between luminance values of respective pixels in a block having the reference pixel at a center and the luminance values in the optimal estimated plane.

3. The image processing device according to claim 1,

wherein the weighting factor calculation portion uses a square value of a luminance difference between the luminance value of the reference pixel and the luminance value in the optimal estimated plane.

4. The image processing device according to claim 1,

wherein

the estimated plane calculation portion calculates the estimated planes by a method of least squares;

and

the optimal plane selection portion selects an estimated plane having a least square sum of errors found by the method of least squares among the plurality of estimated planes as the optimal estimated plane.

5. An image processing method comprising the steps of:

calculating, for input image data, a plurality of estimated planes defined by luminance values on a block-by-block basis, each block containing a predetermined number of pixels including a reference pixel to be subjected to filter processing;

selecting an optimal estimated plane having a least summation of errors between luminance values of respective pixels in a block and luminance values in an estimated plane among the plurality of estimated planes;

calculating a weighting factor for the reference pixel on the basis of a luminance value of the reference pixel and a luminance value in the optimal estimated plane; and

computing a sum of products of relative luminance differences between the luminance values of the respective pixels in the block and luminance values in the optimal estimated plane and the weighting factor for the reference pixel and adding a luminance value in the optimal estimated plane at a reference pixel position to a result of computation.

6. A program causing an information processing device to perform the following steps:

calculating, for input image data, a plurality of estimated planes defined by luminance values on a block-by-block basis, each block containing a predetermined number of pixels including a reference pixel to be subjected to filter processing;

selecting an optimal estimated plane having a least summation of errors between luminance values of respective pixels in a block and luminance values in an estimated plane among the plurality of estimated planes;

calculating a weighting factor for the reference pixel on the basis of a luminance value of the reference pixel and a luminance value in the optimal estimated plane; and

computing a sum of products of relative luminance differences between the luminance values of the respective pixels in the block and luminance values in the optimal estimated plane and the weighting factor for the reference pixel and adding a luminance value in the optimal estimated plane at a reference pixel position to a result of computation.

7. An imaging device comprising:

an imaging portion;

an estimated plane calculation portion that calculates, for image data obtained by the imaging portion, a plurality of estimated planes defined by luminance values on a block-by-block basis, each block containing a predetermined number of pixels including a reference pixel to be subjected to filter processing;

an optimal estimated plane selection portion that selects an optimal estimated plane having a least summation of errors between luminance values of respective pixels in a block and luminance values in an estimated plane among the plurality of estimated planes;

a weighting factor calculation portion that calculates a weighting factor for the reference pixel on the basis of a luminance value of the reference pixel and a luminance value in the optimal estimated plane; and

a weighted smoothing portion that computes a sum of products of relative luminance differences between the luminance values of the respective pixels in the block and luminance values in the optimal estimated plane and the weighting factor for the reference pixel and adds a luminance value in the optimal estimated plane at a reference pixel position to a result of computation.