System and method for estimating an ambient light condition using an image sensor and field-of-view compensation

• US 9,277,144 B2
• Filed: 03/12/2014
• Issued: 03/01/2016
• Est. Priority Date: 03/12/2014
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: Kleekajai, Suppawan, Kalscheur, Micah P., Malone, Michael R.
• Primary Examiner(s): Daniels, Anthony J
• Application Number:
  US14/207,176
• Publication Number:
  US 20150264278A1
• Time in Patent Office: 720 Days
• Field of Search: 348/221.7, 348/366
• US Class Current: 1/1
• CPC Class Codes: H04N 23/667 Camera operation mode switching, e.g. between still and video, sport and normal or high- and low-resolution modes
• CPC Class Codes: H04N 23/71 Circuitry for evaluating the brightness variation
• CPC Class Codes: H04N 25/00 Circuitry of solid-state image sensors [SSIS]; Control thereof

Abstract

A system and method for estimating an ambient light condition is using an image sensor of a digital camera. An array of pixels is obtained using the image sensor. A matrix of grid elements is defined. Each grid element comprises multiple adjacent pixels of the array of pixels. A first measurement value is generated for a grid element of the matrix of grid elements based on the pixels associated with the grid element. A set of grid elements are identified having a first measurement value that satisfies a brightness criteria. A second measurement is generated using the identified set of grid elements. A simulated-light-sensor array is generated using the second measurement value. An estimate of the ambient light condition is calculated using the simulated-light-sensor array.

Claims

1. A computer-implemented method of calculating an ambient light estimate using an image sensor in a camera of a device, the method comprising:

obtaining an array of pixels using the image sensor;

defining a matrix of grid elements, each grid element comprised of multiple adjacent pixels of the array of pixels;

generating a first measurement value for a grid element of the matrix of grid elements based on the pixels associated with a respective grid element;

identifying a set of grid elements having first measurement values that satisfy a brightness criteria;

generating a second measurement using the identified set of grid elements;

generating a simulated-light-sensor array, having a larger field of view than the field of view of the image sensor, using the second measurement value; and

calculating the ambient light estimate using the simulated-light-sensor array.

2. The computer-implemented method of claim 1,

wherein generating the first measurement value includes calculating a mean brightness value using the pixels associated with the grid element.

3. The computer-implemented method of claim 1,

wherein generating the second measurement value includes calculating an overall brightness value using first measurement values associated with the matrix of grid elements.

4. The computer-implemented method of claim 1,

wherein the brightness criteria is a threshold value and the identified set of grid elements have first measurement values that exceed the brightness criteria.

5. The computer-implemented method of claim 4,

wherein the threshold value is a multiple of a standard deviation from a mean intensity value.

6. The computer-implemented method of claim 4,

wherein the threshold value is a fixed offset from a mean intensity value.

7. The computer-implemented method of claim 1,

wherein the estimate of the ambient light condition is an illuminance value that represents a luminous flux of light incident on the image sensor.

8. The computer-implemented method of claim 1,

wherein an area of the grid element is approximately 0.5% of a total area of the array of pixels.

9. The computer-implemented method of claim 1, wherein the array of pixels are generated using a subset of sensor cells of the image sensor while the image sensor is operating in a light-sensor mode.

10. The computer-implemented method of claim 9, further comprising:

generating a digital image using a full set of sensor cells of the image sensor operating in a camera mode; and

storing the digital image in computer memory.

11. The computer-implemented method of claim 1, further comprising:

setting the brightness of a display of the device based on the ambient light estimate.

12. The computer-implemented method of claim 1, further comprising:

calculating a first ambient light estimate using a first array of pixels obtained using the image sensor;

calculating a second ambient light estimate using a second array of pixels obtained using the image sensor;

determining a difference between the first ambient light estimate and the second ambient light estimate; and

setting the brightness of a display of the device based on the difference.

13. The computer-implemented method of claim 12, wherein the brightness of the display is increased if the second ambient light estimate is greater than the first ambient light estimate, and wherein the brightness of the display is decreased if the second ambient light estimate is less than the first ambient light estimate.

14. A portable electronic device configured to calculate an ambient light estimate, the portable electronic device comprising:

a digital camera having an image sensor, wherein the image sensor is formed from an array of sensor cells;

a computer processor for executing computer-readable instructions;

a computer memory for storing the computer-readable instructions, the instructions for;

obtaining an array of pixels using the image sensor;

defining a matrix of grid elements, each grid element comprised of multiple adjacent pixels of the array of pixels;

generating a first measurement value for a grid element of the matrix of grid elements based on the pixels associated with a respective grid element;

identifying a set of grid elements having a first measurement value that satisfies a brightness criteria;

generating a second measurement using the identified set of grid elements;

generating a simulated-light-sensor array, having a larger field of view than the field of view of the image sensor, using the second measurement value; and

calculating the ambient light estimate using the simulated-light-sensor array.

15. The portable electronic device of claim 14, further comprising:

a display having an adjustable brightness, wherein the digital camera is located proximate to the display, the instructions also for;

setting the brightness of the display of the device based on the ambient light estimate.

16. The portable electronic device of claim 15, the instructions also for:

calculating a first ambient light estimate using a first array of pixels obtained using the image sensor;

calculating a second ambient light estimate using a second array of pixels obtained using the image sensor;

determining a difference between the first ambient light estimate and the second ambient light estimate; and

setting the brightness of the display of the device based on the difference.

17. The portable electronic device of claim 16, wherein the brightness of the display is increased if the second ambient light estimate is greater than the first ambient light estimate, and wherein the brightness of the display is decreased if the second ambient light estimate is less than the first ambient light estimate.

18. The portable electronic device of claim 14, wherein the image sensor is a charge coupled device (CCD) sensor array.

19. The portable electronic device of claim 14, wherein the image sensor is a complementary metal-oxide-semiconductor (CMOS) image sensor array.

20. The portable electronic device of claim 14, further comprising:

a second digital camera having a second image sensor, wherein the second image sensor is formed from a second array of sensor cells.