IMAGE PROCESSING APPARATUS AND METHOD OF PROCESSING IMAGE

• US 20100066868A1
• Filed: 09/11/2009
• Published: 03/18/2010
• Est. Priority Date: 09/12/2008
• Status: Active Grant

• Current Assignee: Canon Kabushiki Kaisha (Canon Inc.)
• Original Assignee: Canon Kabushiki Kaisha (Canon Inc.)
• Inventors: Shohara, Makoto
• Granted Patent: US 8,300,120 B2
• Time in Patent Office: Days
• US Class Current: 348/241
• CPC Class Codes: G06T 2207/10024 Color image
• CPC Class Codes: G06T 2207/20012 Locally adaptive
• CPC Class Codes: G06T 2207/20192 Edge enhancement; Edge preservation
• CPC Class Codes: G06T 5/20 using local operators
• CPC Class Codes: G06T 5/70 Denoising; Smoothing
• CPC Class Codes: G06V 10/30 Noise filtering
• CPC Class Codes: H04N 2209/045 using mosaic colour filter
• CPC Class Codes: H04N 23/81 for suppressing or minimising disturbance in the image signal generation

Abstract

An image processing apparatus calculates a smoothed value obtained by smoothing signal levels of a plurality of pixels including a processing target pixel in a local area of an input image and a feature amount representing an edge degree of the processing target pixel using a pre-noise reduction image obtained by reducing an impulse noise of the input image. The image processing apparatus weighted-adds a signal level of the processing target pixel and the smoothed value at a ratio corresponding to the feature amount and outputs the weighted-addition result as a signal level after noise reduction processing.

Claims

1. An image processing apparatus comprising:

a noise reduction unit configured to generate a pre-noise reduction image obtained by reducing an impulse noise of an input image;

a smoothing unit configured to calculate a smoothed value obtained by smoothing signal levels of a plurality of pixels including a processing target pixel in a local area of the input image;

a feature amount calculation unit configured to calculate a feature amount representing an edge degree of the processing target pixel using the pre-noise reduction image; and

an addition unit configured to weighted-add a signal level of the processing target pixel and the smoothed value at a ratio corresponding to the feature amount and to output the weighted addition result as a signal level after noise reduction processing of the input image,

wherein the addition unit performs the weighted addition such that as a pixel has a feature amount that represents a higher edge degree, a ratio of the smoothed value decreases.

2. The image processing apparatus according to claim 1, wherein the feature amount calculation unit calculates the feature amount using a variance value of signal levels of a plurality of pixels including a processing target pixel in a local area of the pre-noise reduction image and a variance value of noises of the pre-noise reduction image, and

wherein as a ratio of the variance value of the signal levels to the variance value of noises increases, the edge degree represented by the feature amount increases.

3. The image processing apparatus according to claim 1, further comprising:

a reduced image generation unit configured to generate a reduced image of the input image; and

a selection unit configured to select one of a plurality of signal levels output from the addition unit,

wherein the noise reduction unit generates a pre-noise reduction image obtained by reducing an impulse noise of the reduced image,

wherein the smoothing unit calculates a smoothed value obtained by smoothing signal levels of a plurality of pixels including a processing target pixel in a local area of the reduced image,

wherein the feature amount calculation unit calculates a feature amount representing an edge degree of the processing target pixel using the pre-noise reduction image of the reduced image,

wherein the addition unit weighted-adds a signal level of the processing target pixel of the reduced image and the smoothed value of the reduced image at a ratio corresponding to the feature amount calculated using the pre-noise reduction image of the reduced image and outputs the weighted addition result as a signal level after noise reduction processing of the reduced image, and

wherein the selection unit selects and outputs one of the signal level after noise reduction processing of the input image and the signal level after noise reduction processing of the reduced image according to a variance value of signal levels of the input image or a variance of signal levels of the pre-noise reduction image of the input image.

4. The image processing apparatus according to claim 3, wherein the selection unit selects and outputs the signal level after noise reduction processing of the input image when the variance value of signal levels of the input image is a threshold value or more, and selects and outputs the signal level after noise reduction processing of the reduced image when the variance value of signal levels of the input image is smaller than the threshold value or selects and outputs the signal level after noise reduction processing of the input image when the variance value of the pre-noise reduction image of the input image is a threshold value or more, and selects and outputs the signal level after noise reduction processing of the reduced image when the variance value of the pre-noise reduction image of the input image is smaller than the threshold value.

5. The image processing apparatus according to claim 4, wherein the threshold value is a variance value of noises included in the signal level of the reduced image.

6. The image processing apparatus according to claim 3, further comprising a mixing processing unit configured to weighted-add the signal level output from the selection unit and a signal level of the input image and to output a signal level of the weighted-addition result.

7. The image processing apparatus according to claim 6, wherein the mixing processing unit performs a weighted addition such that as a sensitivity set in an imaging apparatus when the input image is captured is higher, a ratio of the signal level output from the selection unit is higher.

8. The image processing apparatus according to claim 1, wherein the addition unit performs a weighted addition such that a sensitivity set in an imaging apparatus when the input image is captured is higher, a ratio of the smoothed value is higher.

9. An image processing method comprising:

generating a pre-noise reduction image obtained by reducing an impulse noise of an input image;

calculating a smoothed value obtained by smoothing signal levels of a plurality of pixels including a processing target pixel in a local area of the input image;

calculating a feature amount representing an edge degree of the processing target pixel using the pre-noise reduction image; and

weighted-adding a signal level of the processing target pixel and the smoothed value at a ratio corresponding to the feature amount and outputting the weighted addition result as a signal level after noise reduction processing of the input image,

wherein in weighted-adding the signal level, as a pixel has a feature amount that represents a higher edge degree, a ratio of the smoothed value decreases.

10. The image processing method according to claim 9, further comprising calculating the feature amount using a variance value of signal levels of a plurality of pixels including a processing target pixel in a local area of the pre-noise reduction image and a variance value of noises of the pre-noise reduction image,

wherein as a ratio of the variance value of the signal levels to the variance value of noises increases, the edge degree represented by the feature amount increases.

11. The image processing method according to claim 9, further comprising:

generating a reduced image of the input image;

selecting one of a plurality of signal levels output as the weighted-addition result;

generating a pre-noise reduction image obtained by reducing an impulse noise of the reduced image;

calculating a smoothed value obtained by smoothing signal levels of a plurality of pixels including a processing target pixel in a local area of the reduced image;

calculating a feature amount representing an edge degree of the processing target pixel using the pre-noise reduction image of the reduced image;

weighted-adding a signal level of the processing target pixel of the reduced image and the smoothed value of the reduced image at a ratio corresponding to the feature amount calculated using the pre-noise reduction image of the reduced image and outputting the weighted addition result as a signal level after noise reduction processing of the reduced image; and

selecting and outputting one of the signal level after noise reduction processing of the input image and the signal level after noise reduction processing of the reduced image according to a variance value of signal levels of the input image or a variance of signal levels of the pre-noise reduction image of the input image.