ANISOTROPIC DENOISING METHOD

• US 20120224784A1
• Filed: 03/01/2011
• Published: 09/06/2012
• Est. Priority Date: 03/01/2011
• Status: Active Grant

• Current Assignee: FotoNation Limited (Adeia Inc.)
• Original Assignee: Tessera Technologies Ireland Limited (Adeia Inc.)
• Inventors: Cohen, Noy, Danowitz, Jeffrey, Liba, Orly
• Granted Patent: US 8,879,841 B2
• Time in Patent Office: Days
• US Class Current: 382/260
• CPC Class Codes: G06T 2207/20192 Edge enhancement; Edge preservation
• CPC Class Codes: G06T 5/70 Denoising; Smoothing

Abstract

In accordance with an embodiment of the invention, an anisotropic denoising method is provided that removes sensor noise from a digital image while retaining edges, lines, and details in the image. In one embodiment, the method removes noise from a pixel of interest based on the detected type of image environment in which the pixel is situated. If the pixel is situated in an edge/line image environment, then denoising of the pixel is increased such that relatively stronger denoising of the pixel occurs along the edge or line feature. If the pixel is situated in a detail image environment, then denoising of the pixel is decreased such that relatively less denoising of the pixel occurs so as to preserve the details in the image. In one embodiment, detection of the type of image environment is accomplished by performing simple arithmetic operations using only pixels in a 9 pixel by 9 pixel matrix of pixels in which the pixel of interest is situated. As a result, improved image environment sensitive noise reduction is achieved that requires a relatively low gate count in hardware implementations.

Claims

16. A device comprising one or more logic elements configured for:

determining an initial denoised pixel value for a particular pixel based at least in part upon a value of the particular pixel and values of a set of other pixels, wherein the particular pixel and the set of other pixels are each of the same color;

determining a type of image environment in which the particular pixel is situated, the type of image environment being one of a set comprising (a) edge/line and (b) detail;

based at least in part upon the type of image environment, determining an adjusted denoising power value; and

based at least in part upon the initial denoised pixel value and the adjusted denoising power value, determining a final denoised pixel value for the particular pixel.

19. The device of claim 16, wherein determining the initial denoised pixel value for the particular pixel comprises:

for at least a first pixel in the set of other pixels, determining whether the first pixel is to be used in denoising the particular pixel;

in response to a determination that the first pixel is to be used to denoise the particular pixel, determining a weight value to be assigned to the first pixel; and

determining the initial denoised pixel value for the particular pixel based at least in part upon the weight value and a value for the first pixel.

20. The device of claim 19, wherein determining whether the first pixel is to be used in denoising the particular pixel comprises:

determining a difference indicator value that indicates how different the first pixel is to the particular pixel; and

determining whether the difference indicator value is within a range of values that indicates that the first pixel is sufficiently similar to the particular pixel to be used in denoising the particular pixel.

21. The device of claim 20, wherein the range of values is determined based at least in part upon a difference threshold value, and wherein the difference threshold value is determined based at least in part upon the value of the particular pixel.

22. The device of claim 20, wherein determining a weight value to be assigned to the first pixel comprises:

determining which sub range of the range of values the difference indicator value falls within;

assigning a first weight value to the first pixel if the difference indicator value falls within a first sub range; and

assigning a second and different weight value to the first pixel if the difference indicator value falls within a second and different sub range.

23. The device of claim 16, wherein the set of other pixels consists of four pixels, two vertically aligned with the particular pixel, and two horizontally aligned with the particular pixel.

24. The device of claim 16, wherein determining the type of image environment in which the particular pixel is situated comprises determining a score value that indicates a likelihood that the particular pixel is situated on an edge or line feature of an image.

25. The device of claim 16, wherein determining the type of image environment in which the particular pixel is situated comprises determining a score value that indicates an amount of detail surrounding the particular pixel in an image.

26. The device of claim 16, wherein determining the adjusted denoising power value comprises:

determining an initial denoising power value; and

determining the adjusted denoising power value based at least in part upon the initial denoising power value.

27. The device of claim 26, wherein determining the initial denoising power value comprises:

determining a first denoising power value; and

based at least in part a radial distance between the particular pixel and a center of an image to which the particular pixel belongs, adjusting the first denoising power value as a function of the radial distance to produce the initial denoising power value.

28. The device of claim 26, wherein determining the initial denoising power value comprises:

determining a signal level estimate based at least in part upon the value of the particular pixel and one or more values of one or more pixels neighboring the particular pixel; and

determining the initial denoising power value based at least in part upon the signal level estimate.

29. The device of claim 16, wherein determining the adjusted denoising power value comprises:

if the type of image environment is (a) edge/line, determining the adjusted denoising power value based at least in part upon a score value that indicates a likelihood that the particular pixel is situated on an edge or line feature of an image;

if the type of image environment is (b) detail, determining the adjusted denoising power value based at least in part upon a score value that indicates an amount of detail surrounding the particular pixel in an image.

17-1. The device of claim 17, wherein the particular pixel and the additional pixels above and below the particular pixel are all part of a matrix of pixels, and wherein the final denoised pixel value for the particular pixel and the final denoised pixel values for the additional pixels above and below the particular pixel are all determined by processing pixel values in the same matrix of pixels.