System for auto-HDR capture decision making

• US 9,357,127 B2
• Filed: 03/18/2014
• Issued: 05/31/2016
• Est. Priority Date: 03/18/2014
• Status: Active Grant

• Current Assignee: Google Technology Holdings LLC (Alphabet Inc.)
• Original Assignee: Google Technology Holdings LLC (Alphabet Inc.)
• Inventors: Lameer, Lorne J., Bloom, Daniel M., Richards, By-Her W., Satraitis, Elena
• Primary Examiner(s): AGGARWAL, YOGESH K
• Application Number:
  US14/218,194
• Publication Number:
  US 20150271405A1
• Time in Patent Office: 805 Days
• Field of Search: 348153-155, 3482231-2291, 348/362
• US Class Current: 1/1
• CPC Class Codes: H04N 2209/042 having a single pick-up sensor
• CPC Class Codes: H04N 23/13 with multiple sensors
• CPC Class Codes: H04N 23/60 Control of cameras or camera modules
• CPC Class Codes: H04N 23/64 Computer-aided capture of images, e.g. transfer from script file into camera, check of taken image quality, advice or proposal for image composition or decision on when to take image
• CPC Class Codes: H04N 23/667 Camera operation mode switching, e.g. between still and video, sport and normal or high- and low-resolution modes
• CPC Class Codes: H04N 23/73 by influencing the exposure time
• CPC Class Codes: H04N 23/741 by increasing the dynamic range of the image compared to the dynamic range of the electronic image sensors
• CPC Class Codes: H04N 23/743 Bracketing, i.e. taking a series of images with varying exposure conditions

Abstract

A method and apparatus for invoking a High Dynamic Range (“HDR”) mode in a camera are disclosed. The method comprises detecting that the camera is operating in a preview mode. The method further comprises determining a dynamic range, Auto Exposure (“AE”) metadata, and a motion level associated with a plurality of frames captured in the preview mode. Finally, the method comprises invoking the HDR mode when each of the determined dynamic range, the AE metadata, and the motion level is above a first threshold value, a second threshold value, and a third threshold value, respectively.

Claims

1. A method for invoking a high dynamic range (“

HDR”

) mode in a camera, the method comprising;

detecting that the camera is operating in a preview mode;

determining a dynamic range, auto exposure (“

AE”

) metadata, and a motion level associated with a plurality of frames captured in the preview mode, the determining of at least one of the dynamic range, the AE metadata, or the motion level by measuring the dynamic range, the AE metadata, or the motion level, respectively, of the plurality of frames captured in the preview mode;

determining, based on the measuring, a stability value of at least one of the dynamic range, the AE metadata, or the motion level; and

invoking the HDR mode when each of the determined dynamic range, the AE metadata, and the motion level is above a first threshold value, a second threshold value, and a third threshold value, respectively.

2. The method of claim 1 wherein detecting that the camera is operating in a preview mode comprises:

receiving the plurality of frames.

3. The method of claim 1 wherein the determining the stability value of the dynamic range, the AE metadata, or the motion level determines the stability value of the dynamic range.

4. The method of claim 3 wherein the determining the stability value of the dynamic range predicts a future stability of the measured dynamic range.

5. The method of claim 1 wherein determining AE metadata comprises measuring the AE metadata associated with each frame of the plurality of frames captured in the preview mode.

6. The method of claim 5 further comprising:

wherein the determining the stability value of the dynamic range, the AE metadata, or the motion level determines the stability value of the AE metadata, the stability value predicting the future stability of the determined AE metadata.

7. The method of claim 1 further comprising invoking a non-HDR mode when at least one of the determined dynamic range, the AE metadata, and the motion level is below the first threshold value, the second threshold value, and the third threshold value, respectively.

8. An apparatus for invoking a high dynamic range (“

HDR”

) mode, the apparatus comprising;

an image sensor configured to detect that the apparatus is in a preview mode;

an image-processing engine configured to determine a dynamic range, auto-exposure (“

AE”

) metadata, and a motion level associated with a plurality of frames captured in the preview mode;

a filter configured to;

determine, based on the measured dynamic range, a stability value of the dynamic range for the plurality of frames captured in a specified time period, the stability value predicting a future stability of the measured dynamic range;

determine, based on the measured AE metadata, a stability value of the AE metadata for the plurality of frames captured in a specified time period, the stability value predicting a future stability of the measured AE metadata;

or

determine, based on the determined motion level, a stability value of the motion level for the plurality of frames captured in a specified time period, the stability value predicting a future stability of the measured motion level; and

processing circuitry configured to invoke the HDR mode when each of the determined dynamic range, the AE metadata, and the motion level is above a first threshold value, a second threshold value, and a third threshold value, respectively.

9. The apparatus of claim 8 wherein the image sensor is configured to receive the plurality of frames in the preview mode.

10. The apparatus of claim 8 wherein the image-processing engine is configured to determine a dynamic range by measuring the dynamic range associated with each frame of the plurality of frames captured in the preview mode.

11. The apparatus of claim 10 wherein the filter is configured to determine the stability value of the dynamic range.

12. The apparatus of claim 8 wherein the image-processing engine is configured to determine AE metadata by measuring the AE metadata associated with each frame of the plurality of frames captured in the preview mode.

13. The apparatus of claim 12 wherein the filter is configured to determine the stability value of the AE metadata.

14. The apparatus of claim 8 wherein the filter is configured to determine the stability value of the motion level.

15. The apparatus of claim 8 wherein the processing circuitry further invokes a non-HDR mode when at least one of the determined dynamic range, the AE metadata, and the motion level is below the first threshold value, the second threshold value, and the third threshold value, respectively.

16. The apparatus of claim 8 further comprising:

a memory configured to store the determined dynamic range, the AE metadata, and the motion level.