System and method for estimating an ambient light condition using an image sensor

• US 9,232,150 B2
• Filed: 03/12/2014
• Issued: 01/05/2016
• Est. Priority Date: 03/12/2014
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: Kleekajai, Suppawan, Kalscheur, Micah P.
• Primary Examiner(s): Peterson, Christopher K
• Application Number:
  US14/207,150
• Publication Number:
  US 20150264241A1
• Time in Patent Office: 664 Days
• US Class Current: 1/1
• CPC Class Codes: H04N 23/667 Camera operation mode switching, e.g. between still and video, sport and normal or high- and low-resolution modes
• CPC Class Codes: H04N 23/71 Circuitry for evaluating the brightness variation
• CPC Class Codes: H04N 25/00 Circuitry of solid-state image sensors [SSIS]; Control thereof

Abstract

A system and method for calculating an ambient light estimate using an image sensor in a camera of a device. An array of pixels is obtained using the image sensor. A matrix of grid elements is defined. Each grid element is comprised of multiple adjacent pixels of the array of pixels. A first measurement value is generated for a grid element of the matrix of grid elements based on the pixels associated with a respective grid element. A set of grid elements are identified having a first measurement value that satisfies a brightness criteria. A weighted measurement value is calculated using the identified set of grid elements. The ambient light estimate is calculated based on the weighted measurement value and the first measurement value.

Claims

1. A computer-implemented method of calculating an ambient light estimate using an image sensor in a camera of a device, the method comprising:

obtaining a digital image using the image sensor operating in at least one of;

a light-sensor mode, a camera mode;

storing the digital image in a computer memory storage element;

obtaining an array of pixels from the digital image;

defining a matrix of grid elements, each grid element comprised of multiple adjacent pixels of the array of pixels;

generating a set of measurement values for the matrix of grid elements based on the pixels associated with a respective grid element;

calculating a mean intensity value using the set of measurement values;

defining a threshold based on a multiple of a standard deviation from the mean intensity value;

identifying a set of grid elements having a first measurement value that satisfies a brightness criteria defined at least in part by the threshold;

calculating a weighted measurement value using the identified set of grid elements; and

calculating the ambient light estimate based on the weighted measurement value and the first measurement value.

2. The computer-implemented method of claim 1,

wherein generating the first measurement value includes calculating a mean brightness value using the pixels associated with the grid element.

3. The computer-implemented method of claim 1,

wherein:

the threshold is a first threshold; and

the brightness criteria includes defining a range of brightness values that fall between the first threshold and the second threshold.

4. The computer-implemented method of claim 3,

wherein:

the first threshold value is a first multiple of the standard deviation;

and the second threshold is a second multiple of the standard deviation.

5. The computer-implemented method of claim 3,

wherein the first threshold corresponds to a high-intensity threshold.

6. The computer-implemented method of claim 1,

wherein the weighted measurement value is generated by multiplying the first measurement value by a weight factor.

7. The computer-implemented method of claim 1,

wherein the estimate of the ambient light condition is an illuminance value that represents a luminous flux of light incident on the image sensor.

8. The computer-implemented method of claim 1,

wherein an area of the grid element is approximately 0.5% of a total area of the array of pixels.

9. The computer-implemented method of claim 1, wherein the array of pixels are generated using a subset of sensor cells of the image sensor while the image sensor is operating in a light-sensor mode.

10. The computer-implemented method of claim 9, further comprising:

generating a digital image using a full set of sensor cells of the image sensor operating in a camera mode; and

storing the digital image in computer memory.

11. The computer-implemented method of claim 1, further comprising:

setting the brightness of a display of the device based on the ambient light estimate.

12. The computer-implemented method of claim 1, further comprising:

calculating a first ambient light estimate using a first array of pixels obtained using the image sensor;

calculating a second ambient light estimate using a second array of pixels obtained using the image sensor;

determining a difference between the first ambient light estimate and the second ambient light estimate; and

setting the brightness of a display of the device based on the difference.

13. The computer-implemented method of claim 12, wherein the brightness of the display is increased if the second ambient light estimate is greater than the first ambient light estimate, and wherein the brightness of the display is decreased if the second ambient light estimate is less than the first ambient light estimate.

14. A portable electronic device configured to calculate an ambient light estimate using a digital image, the portable electronic device comprising:

a digital camera comprising an image sensor formed from an array of sensor cells, the image sensor configured to operate in a light-sensor mode and a camera mode;

a computer memory for storing a digital image produced by the image sensor in at least one of;

the light-sensor mode, the camera mode;

a computer processor for executing computer-readable instructions;

the instructions for;

obtaining an array of pixels from the digital image;

defining a matrix of grid elements, each grid element comprised of multiple adjacent pixels of the array of pixels;

generating a set of measurement values for the matrix of grid elements based on the pixels associated with a respective grid element;

calculating a mean intensity value using the set of measurement values;

defining a threshold based on a multiple of a standard deviation from the mean intensity value;

identifying a set of grid elements having a first measurement value that satisfies a brightness criteria based in part on the threshold;

calculating a weighted measurement value using the identified set of grid elements;

calculating the ambient light estimate based on the weighted measurement value and the first measurement value.

15. The portable electronic device of claim 14, further comprising:

a display having an adjustable brightness, wherein the digital camera is located proximate to the display, the instructions also for;

setting the brightness of the display of the device based on the ambient light estimate.

16. The portable electronic device of claim 15, the instructions also for:

calculating a first ambient light estimate using a first array of pixels obtained using the image sensor;

calculating a second ambient light estimate using a second array of pixels obtained using the image sensor;

determining a difference between the first ambient light estimate and the second ambient light estimate; and

setting the brightness of the display of the device based on the difference.

17. The portable electronic device of claim 16, wherein the brightness of the display is increased if the second ambient light estimate is greater than the first ambient light estimate, and wherein the brightness of the display is decreased if the second ambient light estimate is less than the first ambient light estimate.

18. The portable electronic device of claim 14, wherein the image sensor is a charge coupled device (CCD) sensor array.

19. The portable electronic device of claim 14, wherein the image sensor is a complementary metal-oxide-semiconductor (CMOS) image sensor array.

20. The portable electronic device of claim 14, further comprising:

a second digital camera having a second image sensor, wherein the second image sensor is formed from a second array of sensor cells.