Scene Adaptive Auto Exposure

• US 20110293259A1
• Filed: 05/25/2010
• Published: 12/01/2011
• Est. Priority Date: 05/25/2010
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: Doepke, Frank, Brunner, Ralph
• Granted Patent: US 8,488,958 B2
• Time in Patent Office: Days
• US Class Current: 396/236
• CPC Class Codes: G03B 7/08 Control effected solely on the basis of the response, to the intensity of the light received by the camera, of a built-in light-sensitive device
• CPC Class Codes: G03B 7/091 Digital circuits
• CPC Class Codes: H04N 23/62 Control of parameters via user interfaces
• CPC Class Codes: H04N 23/71 Circuitry for evaluating the brightness variation

Abstract

Systems, methods, and a computer readable medium for an improved automatic exposure algorithm attempt to classify an image into a particular “scene category,” and, based on the determined scene category, meter the scene according to a generated metering weighting matrix. In one embodiment, the average luminance is calculated for a central exposure metering region of the image and a plurality of peripheral exposure metering regions surrounding the central exposure metering region. Based on comparisons of the average luminance values of the peripheral exposure regions to the average luminance of the central exposure region, a target metering weighting matrix may be generated. In another embodiment, the scene category corresponds to a predetermined metering weighting matrix. In video applications, it may be desirable to reduce oscillations in metering parameter values to limit any visually jarring effects on the camera'"'"'s preview screen by only adjusting metering parameter values when predetermined criteria are met.

Claims

1. A scene adaptive auto exposure system comprising:

an image sensor for capturing an image representative of a scene;

a memory coupled to the image sensor; and

a programmable control device communicatively coupled to the image sensor and the memory, wherein the memory includes instructions for causing the programmable control device to perform a scene adaptive auto exposure method on image information received from the image sensor, the method comprising;

defining a first exposure metering region over a desired area of the image;

defining a plurality of second exposure metering regions, wherein each second exposure metering region covers a desired area of the image;

comparing a value for each of the second exposure metering regions to a value for the first exposure metering region;

determining a scene identifier based on the compared values;

determining a metering value for the scene based at least in part on the determined scene identifier; and

setting an exposure parameter for the image sensor based at least in part on the determined metering value.

2. The scene adaptive auto exposure system of claim 1, wherein the programmed act of determining a metering value for the scene further comprises determining a scene category corresponding to the scene determined scene identifier.

3. The scene adaptive auto exposure system of claim 2, wherein the programmed act of determining a metering value for the scene further comprises selecting a predetermined metering weighting matrix corresponding to the determined scene category.

4. The scene adaptive auto exposure system of claim 1, wherein the programmed act of determining a metering value for the scene further comprises calculating a weighted average value for the scene.

5. The scene adaptive auto exposure system of claim 1, wherein the programmed act of setting an exposure parameter for the image sensor based at least in part on the determined metering value comprises comparing the determined metering value to a predetermined metering target value.

6. The scene adaptive auto exposure system of claim 1, wherein the value that is compared for each of the second exposure metering regions and the first exposure metering region comprises an average luminance value over the exposure metering region.

7. The scene adaptive auto exposure system of claim 1, wherein the programmed act of determining a scene identifier comprises:

generating a binary value for each comparison of a value for a second exposure metering region to a value for the first exposure metering region; and

concatenating each of the generated binary values into a single binary value sequence, wherein the sequence of binary values comprises the scene identifier.

8. The scene adaptive auto exposure system of claim 1, wherein the first exposure metering region comprises a central exposure metering region, and wherein the plurality of second exposure metering regions comprise a ring of peripheral exposure metering regions surrounding the first exposure metering region.

9. The scene adaptive auto exposure system of claim 1, wherein the programmed act of setting an exposure parameter for the image sensor is configured to occur only when a predetermined oscillation criterion is satisfied.

10. A scene adaptive auto exposure system comprising:

an image sensor for capturing an image representative of a scene;

a memory coupled to the image sensor; and

a programmable control device communicatively coupled to the image sensor and the memory, wherein the memory includes instructions for causing the programmable control device to perform a scene adaptive auto exposure method on image information received from the image sensor, the method comprising;

defining a first exposure metering region over a desired area of the image;

defining a plurality of second exposure metering regions, wherein each second exposure metering region covers a desired area of the image;

comparing a value for each of the second exposure metering regions to a value for the first exposure metering region;

assigning a target weight value to each of the plurality of second exposure metering regions based on the outcome of the comparison of the value for the second exposure metering region to the value for the first exposure metering region;

determining a metering value for the scene based at least in part on a calculated weighted average value for the scene; and

setting an exposure parameter for the image sensor based at least in part on the determined metering value.

11. The scene adaptive auto exposure system of claim 10, wherein the programmed act of determining a metering value for the scene further comprises assigning a target weight value to the first exposure metering region based on comparisons of the value for the first exposure metering region to the value for the second exposure metering regions.

12. The scene adaptive auto exposure system of claim 11, wherein the programmed act of determining a metering value for the scene further comprises assigning a target weight value to areas of the image that are not part of either the first exposure metering region or the second exposure metering regions.

13. The scene adaptive auto exposure system of claim 11, wherein the programmed act of determining a metering value for the scene further comprises adjusting the target weight value of the first exposure metering region based on the number of second exposure metering regions having a value that is greater than the value of the first exposure metering region.

14. The scene adaptive auto exposure system of claim 11, wherein the programmed act of determining a metering value for the scene further comprises adjusting the target weight values of the second exposure metering regions according to a weighting mapping function.

15. The scene adaptive auto exposure system of claim 12, wherein the calculated weighted average value comprises an average of the values for each of the exposure metering regions, wherein the value for each exposure metering region is weighted according to the region'"'"'s assigned target weight value.

16. The scene adaptive auto exposure system of claim 10, wherein the programmed act of setting an exposure parameter for the image sensor is configured to occur only when a predetermined oscillation criterion is satisfied.

17. A method of auto exposing a physical scene comprising:

receiving from an image sensor image information representative of the physical scene and comprising a plurality of pixels;

defining exposure metering regions over two or more desired areas within the physical scene, wherein each region comprises a subset of the plurality of pixels;

determining a metering value for the physical scene based at least in part on a comparison of luminance values of pixels in a first exposure metering region to luminance values of pixels in a second exposure metering region; and

setting an exposure parameter for the image sensor based at least in part on the determined metering value.

18. The method of claim 17, wherein the act of determining a metering value comprises assigning a target weight value to at least one of the defined exposure metering region.

19. The method of claim 18, wherein the value of the target weight value assigned to a defined exposure metering region comprises:

a first target weight value if the first exposure metering region is lighter than the second exposure metering region,

a second target weight value if the first exposure metering region is within a threshold value of the luminance of the second exposure metering region, and

a third target weight value if the first exposure metering region is darker than the second exposure metering region.

20. The method of claim 19, wherein the first target weight value is smaller than the second target weight value.

21. The method of claim 18, further comprising the act of adjusting the value of at least one of the assigned target weight values, wherein the act of adjustment comprises applying a weighting mapping function.

22. The method of claim 17, wherein the defined exposure metering regions comprise a ring of peripheral exposure metering regions around a central exposure metering region.

23. The method of claim 22, wherein the first exposure metering region comprises one of the ring of peripheral exposure metering regions and the second exposure metering region comprises the central exposure metering region.

25. A computer usable medium having a computer readable program code embodied therein, wherein the computer readable program code is adapted to be executed to implement the method of claim 17.

24. A method of auto exposing a physical scene comprising:

receiving from an image sensor image information representative of the physical scene and comprising a plurality of pixels;

defining a pattern of exposure metering regions over two or more desired areas within the physical scene, wherein each area comprises a subset of the plurality of pixels;

comparing an average luminance value of pixels in a first exposure metering region to an average luminance value of pixels in a second exposure metering region;

determining a scene category based on the outcome of the compared average luminance values;

selecting a predetermined metering weighting matrix corresponding to the determined scene category, wherein the metering weighting matrix comprises a target weight value for each exposure metering region; and

setting an exposure parameter for the image sensor based at least in part on the target weight values in the selected predetermined metering weighting matrix.