Techniques for modifying image field data obtained using illumination sources

• US 8,203,622 B2
• Filed: 05/18/2010
• Issued: 06/19/2012
• Est. Priority Date: 05/15/2006
• Status: Expired due to Fees

• Current Assignee: Qualcomm, Inc.
• Original Assignee: CSR Technology Incorporated (Qualcomm, Inc.)
• Inventors: Pertsel, Shimon
• Primary Examiner(s): Ye, Lin
• Assistant Examiner(s): Cowan, Euel
• Application Number:
  US12/782,502
• Publication Number:
  US 20100225797A1
• Time in Patent Office: 763 Days
• Field of Search: 348/370, 348/371, 348/364, 348/362, 348/221.1, 348/224.1, 382/274, 382/275
• US Class Current: 348/224.1
• CPC Class Codes: H04N 23/74 by influencing the scene brightness using illuminating means
• CPC Class Codes: H04N 23/76 by influencing the image signals

Abstract

Techniques for modifying data of an image that can be implemented in a digital camera, video image capturing device and other optical systems are provided to correct for non-uniform illumination and/or effects of saturation appearing in data obtained using one or more artificial illumination sources. In an implementation, correction factors are derived using data from at least two images that have been captured with different illumination levels of the object scene and close in time to the capture of the image of interest. Typically, the image of interest is of higher resolution than at least one of the at least two images.

Claims

1. A method for correcting image data of a scene by a digital camera, the method comprising the acts of:

capturing a first image of the scene corresponding to a first illumination level;

capturing a second image of the scene corresponding to a second illumination level, different from the first illumination level and having a resolution that is relatively lower than the first image;

determining correction factors, for a non-uniform illumination area of the first image based on image data of the first and second images, wherein the correction factors are determined for one or more representative pixels, wherein the correction factors are determined by the formula;

IC[x,y]=Y/X(a[x,y]−

b[x,y]), where IC[x,y] is an illumination correction as a function of a position (x,y) within an object field, b[x,y] is an intensity as a function of the position (x,y) of an image data point of interest in an image data set captured at illumination level X, where X is a first artificial illumination level, a[x,y] is an intensity as a function of the position (x,y) of an image data point in an image data set of interest captured at illumination level Y, where Y is a second artificial illumination level, and wherein Y is greater than X; and

applying the correction factors to the non-uniform illumination area of the first image to obtain an illumination corrected image, wherein the correction factors are applied to one or more pixels associated with the non-uniform illumination area of the first image based on position of a pixel relative to at least one of the representative pixels.

2. The method of claim 1, wherein the first illumination level corresponds to natural lighting, and the second illumination level corresponds to an artificial illumination level generated by the digital camera.

3. The method of claim 1, wherein the first illumination level corresponds to an artificial illumination level generated by the digital camera, and the second illumination level corresponds to a second artificial illumination level generated by the digital camera, wherein the second artificial illumination level is greater than the first.

4. The method of claim 1, wherein the correction factors for the one or more pixels associated with the non-uniform illumination area of the first image are predicted based on distance to a representative pixel.

5. The method of claim 1, wherein the correction factors are determined for one or more representative pixels of each grid block of an image sensor.

6. The method of claim 1, wherein the correction factors are determined based on an illumination difference between pixels associated with the first and second illumination levels.

7. The method of claim 1, wherein applying the correction factors includes multiplying each pixel of the first image by a non-uniform image correction factor.

8. The method of claim 1, wherein applying the correction factors includes applying the correction factors to one of a portion of the image, and the entire image.

9. The method of claim 1, wherein the correction factors are determined to correct for saturation of the one or more pixels associated with the non-uniform illumination area of the first image.

10. The method of claim 1, wherein determining correction factors is further based on detection of a third image corresponding to a third illumination level.

11. The method of claim 1, wherein the correction factors are determined according to the formula:

IC[x,y]=(a[x,y]−

b[x,y]), where IC[x,y] is an illumination correction as a function of a position (x,y) of an image data point of interest, b[x,y] is an intensity as a function of the position (x,y) of a data point in an image data set captured with zero artificial illumination, and a[x,y] is the intensity as a function of the position (x,y) of a data point in an image data set captured at non-zero artificial illumination.

12. The method of claim 1, further comprising acquiring an image data set of interest to determine the non-uniform illumination area, and receiving at least one normalization threshold level from a user.

13. The method of claim 12, further comprising normalizing the acquired image data set of interest, wherein normalizing comprises:

defining at least one of an upper normalization threshold level I.sub.U and a lower normalization threshold I.sub.L, wherein I.sub.U and I.sub.L each are no less than zero and no greater than a set maximum number;

if U has been obtained, determining an upper normalization level I.sub.U, such that U % of data points in the image of interest are less than I.sub.U; and

if L has been obtained, determining a lower normalization level I.sub.L, such that L % of data points in the image of interest are greater than I.sub.L.

14. A digital camera comprising:

a sensor configured to capture image data;

a flash illumination device configured to illuminate a scene with at least one level of illumination; and

a processor coupled to the sensor and the flash illumination device, the processor configured to

receive a first image of the scene corresponding to a first illumination level;

receive a second image of the scene corresponding to a second illumination level, different from the first illumination level and having a resolution that is relatively lower than the first image;

determine correction factors for a non-uniform illumination area of the first image based on image data of the first and second images, wherein the correction factors are determined for one or more representative pixels, wherein the correction factors are determined by the formula;

IC[x,y]=Y/X(a[x,y]−

b[x,y]), where IC[x,y] is an illumination correction as a function of a position (x,y) within an object field, b[x,y] is an intensity as a function of the position (x,y) of an image data point of interest in an image data set captured at illumination level X, where X is a first artificial illumination level, a[x,y] is an intensity as a function of the position (x,y) of an image data point in an image data set of interest captured at illumination level Y, where Y is a second artificial illumination level, and wherein Y is greater than X; and

apply the correction factors to the non-uniform illumination area of the first image to obtain an illumination corrected image, wherein the correction factors are applied to one or more pixels associated with the non-uniform illumination area of the first image based on position of a pixel relative to at least one of the representative pixels.

15. The digital camera of claim 14, wherein the first illumination level corresponds to natural lighting, and the second illumination level corresponds to an artificial illumination level generated by the flash illumination device.

16. The digital camera of claim 14, wherein the first illumination level corresponds to an artificial illumination level generated by the flash illumination device, and the second illumination level corresponds to a second artificial illumination level generated by the flash illumination device, wherein the second artificial illumination level is greater than the first.

17. The digital camera of claim 14, wherein the correction factors for the one or more pixels associated with the non-uniform illumination area of the first image are predicted based on distance to a representative pixel.

18. The digital camera of claim 14, wherein the correction factors are determined for one or more representative pixels of each grid block of the sensor.

19. The digital camera of claim 14, wherein the correction factors are determined based on an illumination difference between pixels associated with the first and second illumination levels.

20. The digital camera of claim 14, wherein applying the correction factors by the processor includes multiplying each pixel of the first image by a non-uniform image correction factor.

21. The digital camera of claim 14, wherein applying the correction factors by the processor includes applying the correction factors to one of a portion of the image, and the entire image.

22. The digital camera of claim 14, wherein the processor determines correction factors to correct for saturation of the one or more pixels associated with the non-uniform illumination area of the first image.

23. The digital camera of claim 14, wherein the processor determines the correction factors based on detection of a third image corresponding to a third illumination level.

24. The digital camera of claim 14, wherein the correction factors are determined by the processor according to the formula:

IC[x,y]=(a[x,y]−

b[x,y]), where IC[x,y] is an illumination correction as a function of a position (x,y) of an image data point of interest, b[x,y] is an intensity as a function of the position (x,y) of a data point in an image data set captured with zero artificial illumination, and a[x,y] is an intensity as a function of the position (x,y) of a data point in an image data set captured at non-zero artificial illumination.

25. The digital camera of claim 14, wherein the processor is further configured to acquire an image data set of interest to determine the non-uniform illumination area, and receive at least one normalization threshold level from a user.

26. The digital camera of claim 25, wherein the processor is further configured to normalize the acquired image data set of interest by:

defining at least one of an upper normalization threshold level I.sub.U and a lower normalization threshold I.sub.L, wherein I.sub.U and I.sub.L each are no less than zero and no greater than a set maximum number;

if U has been obtained, determining an upper normalization level I.sub.U, such that U % of data points in the image of interest are less than I.sub.U; and

if L has been obtained, determining a lower normalization level I.sub.L, such that L % of data points in the image of interest are greater than I.sub.L.

27. A method for correcting image data of a scene by a digital camera, the method comprising the acts of:

capturing a first image of the scene corresponding to a first illumination level;

capturing a second image of the scene corresponding to a second illumination level different from the first illumination level and having a resolution that is relatively lower than the first image;

acquiring an image data set of interest based on the first and second illumination levels, the image data set of interest associated with a non-uniform illumination area of the first image;

determining correction factors for the image data set of interest based on image data of the first and second images, wherein the correction factors are determined for one or more representative pixels, wherein the correction factors are determined by the formula;

IC[x,y]=Y/X (a[x,y]−

b[x,y]), where IC[x,y] is an illumination correction as a function of a position (x,y) within an object field, b[x,y] is an intensity as a function of the position (x,y) of an image data point of interest in an image data set captured at illumination level X, where X is a first artificial illumination level, a[x,y] is an intensity as a function of the position (x,y) of an image data point in an image data set of interest captured at illumination level Y, where Y is a second artificial illumination level, and wherein Y is greater than X; and

applying the correction factors to the image data set of interest to obtain an′

illumination corrected image, wherein the correction factors are applied to one or more pixels associated with the non-uniform illumination area of the first image based on the position of a pixel relative to at least one of the representative pixels.