Illumination estimation for images

• US 8,867,859 B1
• Filed: 09/11/2012
• Issued: 10/21/2014
• Est. Priority Date: 04/28/2009
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google Inc. (Alphabet Inc.)
• Inventors: Kwatra, Vivek, Han, Mei, Dai, Shengyang
• Primary Examiner(s): Thirugnanam, Gandhi
• Application Number:
  US13/610,479
• Time in Patent Office: 770 Days
• Field of Search: 382144-145, 382/151
• US Class Current: 382/274
• CPC Class Codes: G06T 5/008 Local, e.g. shadow enhancement
• CPC Class Codes: G06T 5/94 based on local image properties, e.g. for local contrast enhancement
• CPC Class Codes: G06V 10/145 Illumination specially adapted for pattern recognition, e.g. using gratings
• CPC Class Codes: G06V 10/60 relating to illumination properties, e.g. using a reflectance or lighting model

Abstract

An image comprising varying illumination is selected. Instances of a repeating pattern in the image is determined. Illumination values for pixels at locations within instances of the repeating pattern are calculated responsive to pixel intensities of pixels at corresponding locations in other instances of the repeating pattern. The varying illumination is removed form the image responsive to the illumination values.

Claims

1. A computer-implemented method of removing illumination variation from images comprising:

selecting, by a computer system, an image containing varying illumination, wherein the varying illumination comprises a shadow in the image;

determining, by the computer system, a plurality of instances of a pattern of pixel values in the image;

calculating, by the computer system, illumination values for pixels at locations within the plurality of instances of the pattern, an illumination value for a pixel within an instance of the pattern calculated based on a difference between a pixel intensity of the pixel within the instance of the pattern and a pixel intensity of another pixel at a corresponding location in an adjacent instance of the pattern; and

removing, by the computer system, the illumination variation from the image responsive to the calculation of the illumination values.

2. The computer-implemented method of claim 1, wherein the shadow in the image is caused by an object occluding a light source.

3. The computer-implemented method of claim 1, wherein the varying illumination further comprises a reflection in the image caused from light being reflected by an object.

4. The computer-implemented method of claim 1, wherein determining the plurality of instances of the pattern comprises:

determining a period of the pattern in a dimension based on differences in pixel intensities among the image and versions of the image shifted in the dimension.

5. The computer-implemented method of claim 1, further comprising:

determining dimensions of the pattern in the image;

defining regions of pixels of the image based on the dimensions of the pattern; and

determining mean pixel intensities of pixels within the defined regions of pixels;

wherein the illumination values for the pixels are determined based on the mean pixel intensities.

6. The computer-implemented method of claim 1, wherein the illumination value for the pixel within the instance of the pattern is further calculated based on illumination values of neighboring pixels of the pixel.

7. The computer-implemented method of claim 1, wherein the calculation is performed as an optimization problem and wherein a mean pixel value for a defined region of the image is used as an initial value for the optimization problem.

8. A computer program product comprising a non-transitory computer-readable storage medium storing computer-executable code for removing illumination variation from images, the code when executed performs steps comprising:

selecting an image containing varying illumination, wherein the varying illumination comprises a shadow in the image;

determining a plurality of instances of a pattern of pixel values in the image;

calculating illumination values for pixels at locations within the plurality of instances of the pattern, an illumination value for a pixel within an instance of the pattern calculated based on a difference between a pixel intensity of the pixel within the instance of the pattern and a pixel intensity of another pixel at a corresponding location in an adjacent instance of the pattern; and

removing the illumination variation from the image responsive to the calculation of the illumination values.

9. The computer program product of claim 8, wherein the shadow in the image is caused by an object occluding a light source.

10. The computer program product of claim 8, wherein the varying illumination further comprises a reflection in the image caused from light being reflected by an object.

11. The computer program product of claim 8, wherein determining the plurality of instances of the pattern comprises:

determining dimensions of the pattern in the image; and

defining regions of pixels of the image based on the dimensions of the pattern;

determining mean pixel intensities of pixels within the defined regions of pixels; and

wherein the illumination values for the pixels are determined based on the mean pixel intensities.

12. The computer program product of claim 8, wherein the illumination value for the pixel within the instance of the pattern is further calculated based on illumination values of neighboring pixels of the pixel.

13. The computer program product of claim 8, wherein the calculation is performed as an optimization problem and wherein a mean pixel value for a defined region of the image is used as an initial value for the optimization problem.

14. A computer system for removing illumination variation from images, the system comprising:

a computer processor; and

a computer-readable storage medium storing computer executable code configured to execute on the computer processor, the code when executed performs steps comprising;

selecting an image containing varying illumination, wherein the varying illumination comprises a shadow in the image;

determining a plurality of instances of a pattern of pixel values in the image;

calculating illumination values for pixels at locations within the plurality of instances of the pattern, an illumination value for a pixel within an instance of the pattern calculated based on a difference between a pixel intensity of the pixel within the instance of the pattern and a pixel intensity of another pixel at a corresponding location in an adjacent instance of the pattern; and

removing the illumination variation from the image responsive to the calculation of the illumination values.

15. The system of claim 14, wherein the shadow in the image is caused by an object occluding a light source.

16. The computer system of claim 14, wherein the varying illumination further comprises a reflection in the image caused from light being reflected by an object.

17. The computer system of claim 14, wherein determining the plurality of instances of the pattern comprises:

determining dimensions of the pattern in the image; and

defining regions of pixels of the image based on the dimensions of the pattern;

determining mean pixel intensities of pixels within the defined regions of pixels; and

wherein the illumination values for the pixels are determined based on the mean pixel intensities.