Dynamic exposure metering based on face detection

• US 8,233,789 B2
• Filed: 04/07/2010
• Issued: 07/31/2012
• Est. Priority Date: 04/07/2010
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: Brunner, Ralph
• Primary Examiner(s): BLACKMAN, ROCHELLE ANN J
• Application Number:
  US12/755,542
• Publication Number:
  US 20110249961A1
• Time in Patent Office: 846 Days
• Field of Search: 396/213, 396121-123, 396/233, 396/234, 348/345, 348/350, 348/362
• US Class Current: 396/213
• CPC Class Codes: H04N 23/611 where the recognised objects include parts of the human body
• CPC Class Codes: H04N 23/62 Control of parameters via user interfaces
• CPC Class Codes: H04N 23/71 Circuitry for evaluating the brightness variation

Abstract

A system, computer readable medium, and method for dynamically setting a camera'"'"'s exposure parameters based on face detection are disclosed. When taking a picture or video of a person in front of a bright background, standard exposure algorithms tend to overexpose the background. In one embodiment disclosed herein, a face detection algorithm is run on the current picture or video frame, and the exposure metering region is inset over the detected face. Exposure time, gain, or other exposure parameters may be set based on the pixels within the exposure metering region. In another embodiment, the exposure metering region tracks a moving face according to lag parameters so that the exposure metering region remains substantially over the face. In yet another embodiment, a plurality of faces may be tracked, with the exposure parameters set based on a weighted average of the pixels within the plurality of face-containing exposure metering regions.

Claims

1. A dynamic auto exposure system comprising:

an image sensor for capturing an image representative of a scene;

a memory coupled to the image sensor; and

a programmable control device communicatively coupled to the image sensor and the memory, wherein the memory includes instructions for causing the programmable control device to perform a dynamic auto exposure method on image information received from the image sensor, the method comprising;

detecting one or more faces in the image information;

determining that one or more of the detected faces meet a predetermined criterion;

creating an exposure metering region over the one or more detected faces meeting the predetermined criterion;

determining a first metering value for the scene based at least in part on a weighted average of each created exposure metering region;

setting first exposure parameter for the image sensor based at least in part on the determined first metering value;

exposing the scene based at least in part on the set first exposure parameter;

moving a first one of the created exposure metering regions over a detected face towards a new location of the detected face in the scene, wherein the moving of the first one of the created exposure metering regions occurs according to according to predetermined lag parameters;

determining a second metering value for the scene based at least in part on the new location of first one of the created exposure metering region;

setting a second exposure parameter for the image sensor based at least in part on the determined second metering value; and

exposing the scene based at least in part on the set second exposure parameter.

2. The dynamic auto exposure system of claim 1, wherein the predetermined criterion comprises one or more of:

a minimum face size, a minimum duration of a face in the scene, a minimum number of facial features, and whether a face is recognized.

3. The dynamic auto exposure system of claim 1, wherein the first exposure parameter comprises one or more of:

exposure time, gain, flash duration, and f-number.

4. The dynamic auto exposure system of claim 1, further comprising instructions in the memory for causing the programmable control device to remove an exposure metering region over a detected face when the detected face no longer meets the predetermined criterion.

5. The dynamic auto exposure system of claim 1, further comprising instructions in the memory for causing the programmable control device to remove an exposure metering region over a detected face if the detected face has been gone from the scene for a predetermined amount of time.

6. The dynamic auto exposure system of claim 1, further comprising instructions in the memory for causing the programmable control device to resize an exposure metering region over a detected face that has changed sizes, wherein the instructions in the memory for causing the programmable control device to resize the exposure metering region are executed according to predetermined lag parameters.

7. The dynamic auto exposure system of claim 1, further comprising instructions in the memory for causing the programmable control device to limit the number of detected faces meeting the predetermined criterion to a maximum number of faces.

8. The dynamic auto exposure system of claim 1, further comprising instructions in the memory for causing the programmable control device to further limit the detected faces meeting the predetermined criterion to faces with a height that is at least one sixteenth of the image'"'"'s height.

9. The dynamic auto exposure system of claim 1, wherein the weighted average calculation is based at least in part of the size of each of the detected faces meeting the predetermined criterion.

10. The dynamic auto exposure system of claim 1, further comprising instructions in the memory for causing the programmable control device to:

override the creation of the exposure metering region over one or more of the detected faces meeting the predetermined criterion in response to receiving an input from a user of the system specifying a desired location for the exposure metering region; and

create an exposure metering region over the desired location.

11. A dynamic auto exposure system comprising:

an image sensor for capturing an image representative of a scene;

a memory coupled to the image sensor; and

a programmable control device communicatively coupled to the image sensor and the memory, wherein the memory includes instructions for causing the programmable control device to perform a dynamic auto exposure method on image information received from the image sensor, the method comprising;

detecting one or more faces in the image information;

determining a primary face based at least in part on a predetermined criterion;

creating an exposure metering region over the primary face;

determining a metering value for the scene based at least in part on the created exposure metering region;

setting an exposure parameter for the image sensor based at least in part on the determined metering value;

exposing the scene based at least in part on the set exposure parameter; and

removing the exposure metering region over the primary face when the primary face no longer meets the predetermined criterion.

12. The dynamic auto exposure system of claim 11, wherein the predetermined criterion comprises one or more of:

face size, duration of a face in the scene, number of facial features, and whether a face is recognized.

13. The dynamic auto exposure system of claim 11, wherein the exposure parameter comprises one or more of:

exposure time, gain, flash duration, and f-number.

14. The dynamic auto exposure system of claim 11, further comprising instructions in the memory for causing the programmable control device to maintain the exposure metering region over the primary face until the primary face has been gone from the scene for a predetermined amount of time, regardless of whether the primary face continues to meet the predetermined criterion.

15. The dynamic auto exposure system of claim 11, further comprising instructions in the memory for causing the programmable control device to move the exposure metering region over the primary face towards a new location of the primary face, wherein the instructions for causing the programmable control device to move the exposure metering region are executed according to predetermined lag parameters.

16. The dynamic auto exposure system of claim 11, further comprising instructions in the memory for causing the programmable control device to resize the exposure metering region over the primary face in response to the primary face changing in size, wherein the resizing of the exposure metering region occurs according to predetermined lag parameters.

17. The dynamic auto exposure system of claim 11, further comprising instructions in the memory for causing the programmable control device to:

override the creation of the exposure metering region in response to receiving an input from a user of the system specifying a desired location for the exposure metering region; and

create an exposure metering region over the desired location.

18. A method of dynamically auto exposing a physical scene comprising:

receiving from an image sensor image information representative of the physical scene and comprising a plurality of pixels;

detecting one or more faces in the image information;

determining that one or more of the detected faces meet a predetermined criterion;

creating an exposure metering region over the one or more detected faces meeting the predetermined criterion;

determining a metering value for the physical scene based at least in part on a weighted average of the pixels within each created exposure metering region; and

setting an exposure parameter for the image sensor based at least in part on the determined metering value,

wherein the act of creating an exposure metering region over the one or more detected faces meeting the predetermined criterion further comprises moving each created exposure metering region that is over a face that has moved since the face was previously detected towards the face'"'"'s current location, and

wherein the act of moving occurs according to predetermined lag parameters.

19. The method of claim 18, wherein the act of creating an exposure metering region over the one or more detected faces meeting the predetermined criterion further comprises resizing each exposure metering region that is over a face that has changed in size since the face was previously detected, wherein the act of resizing occurs according to predetermined lag parameters.

20. The method of claim 18, further comprising:

overriding the act of creating an exposure metering region over the one or more detected faces meeting the predetermined criterion in response to receiving an input from a user specifying a desired location for the exposure metering region; and

creating an exposure metering region over the desired location.

21. A computer usable medium having a computer readable program code embodied therein, wherein the computer readable program code is adapted to be executed to implement the method of claim 18.

22. A method of dynamically auto exposing a physical scene comprising:

receiving image information representative of the physical scene and comprising a plurality of pixels from an image sensor;

detecting one or more faces in the image information;

determining a primary face based at least in part on a predetermined criterion;

creating an exposure metering region over the primary face;

determining a metering value for the scene based at least in part on the created exposure metering region;

setting an exposure parameter for the image sensor based at least in part on the determined metering value; and

updating the location of the exposure metering region as needed to remain over the primary face, wherein the act of updating the location of the exposure metering region comprises moving the exposure metering region towards the current location of the primary face according to predetermined lag parameters.