Dynamic range compensation-dependent noise reduction

• US 7,889,942 B2
• Filed: 05/25/2007
• Issued: 02/15/2011
• Est. Priority Date: 05/25/2007
• Status: Active Grant

• Current Assignee: Qualcomm, Inc.
• Original Assignee: Zoran Corporation (Qualcomm, Inc.)
• Inventors: Vakrat, Dudi
• Primary Examiner(s): Ahmed; Samir A
• Assistant Examiner(s): Liu; Li
• Application Number:
  US11/754,170
• Publication Number:
  US 20080292202A1
• Time in Patent Office: 1,362 Days
• Field of Search: None
• US Class Current: 382/261
• CPC Class Codes: G06T 5/70 Denoising; Smoothing
• CPC Class Codes: G06T 5/92 based on global image properties
• CPC Class Codes: H04N 23/76 by influencing the image signals
• CPC Class Codes: H04N 25/60 Noise processing, e.g. detecting, correcting, reducing or removing noise

Abstract

Methods and corresponding apparatus are presented that perform dynamic range compensation (DRC) and noise reduction (NR) together on a pixel-by-pixel basis, adjusting the noise reduction parameters in response to the dynamic range compensation decisions. By such a modification of image noise reduction parameters based on the dynamic range compensation gain or, more generally, other such factors, these techniques make it possible to perform DRC on noisy images, achieving an image with low and uniform noise levels.

Claims

1. A method of processing image data, comprising:

performing a dynamic range compensation process on the image data for a set of one or more pixels; and

concurrently with the dynamic range compensation process, performing a noise reduction operation on the image data for the set of pixels, wherein a noise reduction factor used by the noise reduction operation on the pixels of the set of pixels is responsive to a gain factor for the set of pixels determined by the dynamic range compensation process.

2. The method of claim 1, wherein the dynamic range compensation process and the noise reduction operation are performed on pixel by pixel bases, the noise reduction factor being used on a given pixel being responsive to the gain factor for the given pixel.

3. The method of claim 1, wherein said set of one or more pixels is an N by N block of pixels, where N is an integer greater than one, the dynamic range compensation process and the noise reduction operation being performed on blocks of N by N pixels at a time.

4. The method of claim 1, wherein the noise reduction operation on the set of pixels provides an output value formed from a combination of the received value of the set of pixels and a measure of the value of pixels in the neighborhood of the set of pixels, the combination being responsive to the gain factor.

5. The method of claim 4, wherein the combination is responsive to the uniformity of the neighborhood of the set of pixels.

6. The method of claim 4, wherein the combination is a linear combination of the received value of the set of pixels and the measure of the value of pixels in the neighborhood of set of pixels.

7. A method of processing image data, comprising:

performing a dynamic range compensation process with a non-trivial result on the image data for a set of one or more pixels; and

concurrently with the dynamic range compensation process, performing a noise reduction operation with a non-trivial result on the image data for the set of one or more pixels, wherein a noise variance of the combined noise reduced and dynamic range compensated image data is independent of the amount of dynamic range compensation.

8. The method of claim 7, wherein the dynamic range compensation process and the noise reduction operation are performed on pixel by pixel bases.

9. The method of claim 7, wherein said set of one or more pixels is an N by N block of pixels, where N is an integer greater than one, the dynamic range compensation process and the noise reduction operation being performed on blocks of N by N pixels at a time.

10. The method of claim 7, wherein the noise reduction operation on the set of pixels provides an output value formed from a combination of the received value of the set of pixels and a measure of the value of pixels in the neighborhood of the set of pixels, the combination being responsive to the gain factor.

11. The method of claim 10, wherein the combination is responsive to the uniformity of the neighborhood of the set of pixels.

12. The method of claim 10, wherein the combination is a linear combination of the received value of the set of pixels and the measure of the value of pixels in the neighborhood of set of pixels.

13. A method of processing image data, comprising:

receiving, in a noise reduction process, a measure of the image strength at a first pixel set of the image data;

receiving, in the noise reduction process, a measure of the image strength of a plurality of pixels of the image data in a neighborhood of the first pixel set;

receiving, in the noise reduction process, from a dynamic range compensation process, a factor specifically determined for the first pixel set;

forming, in the noise reduction process, an average image strength level for the neighborhood of the first pixel set from the strength levels of the first pixel set and the plurality of pixels in the neighborhood of the first pixel set; and

forming an output signal for the first pixel set, the output signal being a combination of the image strength at the first pixel set and the average image strength level for the neighborhood of the first pixel set, wherein the combination is responsive to said factor.

14. The method of claim 13, wherein the first pixel set is a single pixel.

15. The method of claim 13, wherein the first pixel set is an N by N block of pixels.

16. The method of claim 13, further comprising:

performing a dynamic range compensation process for said first pixel set, including determining said factor, said factor being a gain factor.

17. The method of claim 13, wherein the combination is responsive to the uniformity of the set image data in the neighborhood of the first pixel set.

18. The method of claim 13, wherein the combination is a linear combination of the image strength at the first pixel set and the average image strength level for the neighborhood of the first pixel set.

19. An image processing unit, comprising:

a dynamic range compensation module connectable to receive image data and perform a dynamic range compensation process thereon for a set of one or more pixels; and

a noise reduction circuit to receive the image data and connectable to the dynamic range compensation module to receive a gain factor determined by the dynamic range compensation process for the set of pixels, wherein the noise reduction circuit performs a noise reduction operation on the image data for the set of pixels concurrently with the dynamic range compensation process, the noise reduction circuit uses a noise reduction factor on the pixels of the set of pixels, and the noise reduction factor is responsive to the gain factor.

20. The image processing unit of claim 19, wherein the dynamic range compensation process and the noise reduction operation are performed on pixel by pixel bases, the noise reduction factor being used on a given pixel being responsive to the gain factor for the given pixel.

21. The image processing unit of claim 19, wherein said set of one or more pixels is an N by N block of pixels, where N is an integer greater than one, the dynamic range compensation process and the noise reduction operation being performed on blocks of N by N pixels at a time.

22. The image processing unit of claim 19, wherein the noise reduction operation on the set of pixels provides an output value formed from a combination of the received value of the set of pixels and a measure of the value of pixels in the neighborhood of the set of pixels, the combination being responsive to the gain factor.

23. The image processing unit of claim 22, wherein the combination is responsive to the uniformity of the neighborhood of the set of pixels.

24. The image processing unit of claim 22, wherein the combination is a linear combination of the received value of the set of pixels and the measure of the value of pixels in the neighborhood of set of pixels.

25. An image processing unit, comprising:

a noise reduction circuit having as inputs a measure of the image strength at a first pixel set of image data, a measure of the image strength of a plurality of pixels of the image data in a neighborhood of the first pixel set, and a factor specifically determined for the first pixel set, the noise reduction circuit having;

an averaging section which determines an average image strength level for the neighborhood of the first pixel set from the strength levels of the first pixel set and the plurality of pixels in the neighborhood of the first pixel set;

a coefficient determination section which provides a coefficient derived from the factor; and

a blending section to provide an output signal which is a combination of the image strength at the first pixel set and the average image strength level for the neighborhood of the first pixel set, wherein the combination is responsive to said coefficient.

26. The image processing unit of claim 25, wherein the first pixel set is a single pixel.

27. The image processing unit of claim 25, wherein the first pixel set is an N by N block of pixels.

28. The image processing unit of claim 25, further including:

a dynamic range compensation module connected to receive said measure of the image strength at the first pixel set and determine therefrom said factor, said factor being a gain factor.

29. The image processing unit of claim 25, wherein said coefficient is responsive to the uniformity of the set image data in the neighborhood of the first pixel.

30. The image processing unit of claim 25, wherein the combination is a linear combination of the image strength at the first pixel set and the average image strength level for the neighborhood of the first pixel set.