Sampling images for color balance information

• US 7,486,819 B2
• Filed: 12/23/2003
• Issued: 02/03/2009
• Est. Priority Date: 12/23/2003
• Status: Active Grant

• Current Assignee: Aptina Imaging Corporation (ON Semiconductor Corporation)
• Original Assignee: Aptina Imaging Corporation (ON Semiconductor Corporation)
• Inventors: Subbotin, Igor
• Primary Examiner(s): Ahmed; Samir A
• Assistant Examiner(s): Newman; Michael A
• Application Number:
  US10/742,902
• Publication Number:
  US 20050134702A1
• Time in Patent Office: 1,869 Days
• Field of Search: 348/223.1, 348/655, 358/516, 358/518, 382/162, 382/167
• US Class Current: 382/167
• CPC Class Codes: H04N 23/88 for colour balance, e.g. white-balance circuits or colour temperature control
• CPC Class Codes: H04N 9/73 Colour balance circuits, e.g. white balance circuits or colour temperature control camera processing pipelines for colour balance H04N23/88

Abstract

Pixels from an image are sampled for auto white balance (AWB) statistics. To avoid the effects of monochromatic regions, only pixels located at or near edges between monochromatic regions and neighboring regions are sampled for computation of the AWB gains. A sampling criteria is applied to each pixel that automatically excludes pixels in monochromatic regions of any size. As a result, white balancing is based only on portions at or near edges of substantially monochromatic regions.

Claims

1. A method for performing a white balance operation on an image, comprising:

comparing a value of each pixel in the image against a value of every pixel for detecting the same color within a Chebyshev distance of at least one pixel to determine whether each pixel is substantially at or near the edge of a monochromatic region;

selecting only pixels that are in either multichromatic or monochromatic regions and substantially at or near the edge of a monochromatic region; and

using the selected pixels to obtain color balance information on the image.

15. The method of claim 1, wherein the act of comparing further comprises comparing the value of each pixel in the image against a value of all pixels within a Chebyshev distance of at least one pixel.

16. The method of claim 1, wherein the image is a raw image.

2. A method for performing a white balance operation on an image, comprising:

using a value of each pixel in the image to determine whether the pixel is substantially at or near the edge of a monochromatic region;

selecting only pixels that are in either multichromatic or monochromatic regions and substantially at or near the edge of a monochromatic region; and

performing a white balance operation on the image to obtain color balance information using the selected pixels,

wherein the determination of whether or not a pixel is at or near the edge of a substantially monochromatic region comprises measuring the differences in pixel values between the pixel and every pixel for detecting the same color within a Chebyshev distance of at least one pixel and comparing a maximum measured difference with a threshold.

9. The method according to claim 2, wherein performing the white balance operation comprises:

calculating a respective sum of all luminance values for each color component in the selected pixels;

determining a weight for each respective sum so that the color components are equal; and

adjusting the luminance values for each pixel in the image according to the determined weight for each color component.

3. A method for selecting a set of pixels in a Bayer pattern image, the method comprising:

applying a sampling criterion to a plurality of pixels in the image, a pixel being likely to meet the sampling criterion only if the pixel is in either a multichromatic or monochromatic region and substantially at or near the edge of a monochromatic region; and

using values for the selected set of pixels to obtain color balance information for the image,

wherein the sampling criterion is whether a maximum difference value exceeds a given threshold value, the maximum difference value being obtained by calculating the highest measured difference between each pixel'"'"'s value and the value of every pixel for detecting the same color within a Chebyshev distance of at least one pixel.

4. The method of claim 3, wherein the sampling criterion is applied to all pixels in the image.

5. The method of claim 3, wherein the color balance information includes luminance of each of a set of colors.

6. The method of claim 3, further comprising using the color balance information to perform white balancing on the image.

7. A computer readable storage medium storing software product code for causing a processor to perform a white balancing operation, comprising:

a first set of stored instructions for causing a processor to compare a value of each pixel in the image against a value of every pixel for detecting the same color within a Chebyshev distance of at least one pixel to determine whether each pixel is substantially at or near the edge of monochromatic region in the image, and to select only pixels that are in either multichromatic or monochromatic regions and substantially at or near the edge of a monochromatic region; and

a second set of stored instructions for causing the processor to use the values for the selected set of pixels to obtain color balance information for the image.

17. The computer readable storage medium of claim 7, wherein the stored instructions cause the processor to compare the value of each pixel in the image against every pixel within a Chebyshev distance of at least one pixel.

8. An apparatus for performing a white balancing operation, comprising:

a first means for selecting a set of pixels in an image by applying a sampling criterion, a pixel being likely to meet the sampling criterion only if the pixel is in either a multichromatic or monochromatic region and substantially at or near the edge of a monochromatic region; and

a second means for using values for the selected set of pixels to obtain color balance information for the image,

wherein the sampling criterion is applied to a pixel by determining whether a maximum difference value exceeds a given threshold value, the maximum difference value being obtained by calculating the highest measured difference between the pixel'"'"'s value and the value of every pixel for detecting the same color within a Chebyshev distance of at least one pixel.

10. A method for performing a white balance operation on a raw image, comprising:

comparing a signal value of each pixel from an image with signal values of every pixel for detecting the same color within a Chebyshev distance of at least one pixel;

determining whether or not each pixel is substantially at or near the edge of a monochromatic region based on the comparison of signal values;

eliminating each pixel determined not to be in either a multichromatic or monochromatic region and substantially at or near the edge of a monochromatic region from consideration for white balancing the image; and

performing a white balance operation using the remaining edge pixels.

18. The method of claim 10, wherein the Chebyshev distance is two pixels.

11. An image processor comprising a white balancing circuit configured to compare a value of each pixel in the image against the value of every pixel for detecting the same color within a Chebyshev distance of at least one pixel to determine whether each pixel is substantially at or near the edge of monochromatic region in the image and use only pixels that are in either multichromatic or monochromatic regions and substantially at or near the edge of a monochromatic region in the image to obtain color balance information on the image.

19. The image processor of claim 11, wherein the white balancing circuit is configured to compare the value of each pixel in the image against every pixel within a Chebyshev distance of at least one pixel.

12. An image processing apparatus comprising:

an image sensing unit for receiving an image and outputting an image signal that includes pixel data for each pixel of the image; and

an image processor for processing the image signal, the image processor configured to compare a value for each pixel of the image against the value of every pixel for detecting the same color within a Chebyshev distance of at least one pixel to determine whether each pixel is substantially at or near the edge of monochromatic region in the image and use only pixels that are in either multichromatic or monochromatic regions and substantially at or near the edge of a monochromatic region in the image to obtain color balance information on the image.

20. The image processing apparatus of claim 12, wherein the image processor compares the value of each pixel in the image with every pixel within a Chebyshev distance of at least one pixel.

13. An image processing apparatus comprising:

an image sensing unit for receiving an image and outputting an image signal which includes pixel image data for each line of the image;

an image processor for processing the image signal; and

a controller for controlling the image sensing unit and the image processor,

wherein the image processor includes;

a monochrome detection circuit for determining differences between values of each pixel in the image and every pixel for detecting the same color within a Chebyshev distance of at least one pixel; and

a white balancing circuit for calculating a white balance of an image based only on selected pixels, wherein pixel selection is based on pixels that are in either multichromatic or monochromatic regions and substantially at or near the edge of a monochromatic region.

14. A processing system, comprising:

a processor; and

an imaging apparatus that provides image data to the processor, the imaging apparatus comprising

an image sensing unit for receiving an image and outputting an image signal that includes pixel data for each pixel of the image; and

an image processor for performing a white balancing process based only on pixels that are in either multichromatic or monochromatic regions and substantially at or near the edge of monochromatic regions, the pixels being identified by a comparison of values of each pixel in the image and every pixel within a Chebyshev distance of at least one pixel.