Depth from defocus calibration

• US 8,542,313 B2
• Filed: 08/16/2010
• Issued: 09/24/2013
• Est. Priority Date: 01/27/2010
• Status: Expired due to Fees

• Current Assignee: Qualcomm, Inc.
• Original Assignee: CSR Technology Incorporated (Qualcomm, Inc.)
• Inventors: Rapaport, Guy, Tzur, Meir, Baxansky, Artemy
• Primary Examiner(s): Ye, Lin
• Assistant Examiner(s): COWAN, EUEL K
• Application Number:
  US12/857,343
• Publication Number:
  US 20110181770A1
• Time in Patent Office: 1,135 Days
• Field of Search: 348/220.1, 348/345, 348/349, 348/356, 356 403- 407, 356/624, 250/201.2, 250/201.4, 382/255, 382/274, 382168-172, 382/283, 382/298
• US Class Current: 348/345
• CPC Class Codes: H04N 23/676 Bracketing for image capture at varying focusing conditions
• CPC Class Codes: H04N 23/743 Bracketing, i.e. taking a series of images with varying exposure conditions
• CPC Class Codes: H04N 23/959 by adjusting depth of field during image capture, e.g. maximising or setting range based on scene characteristics

Abstract

A device and methods are provided for calculating depth estimation for a digital imaging device are disclosed and claimed. In one embodiment, a method includes detecting a first image associated with a first focus parameter, detecting a second image associated with a second focus parameter, calculating a statistical representation of a region of interest in the first and second images, and determining a ratio for the region of interest based on the statistical representation. The method may further include determining one or more focus characteristics using a memory table based on the determined ratio for the region of interest, and calculating a focus depth for capture of image data based on the determined one or more focus characteristics associated with the memory table.

Claims

1. A method for calculating depth estimation for a digital imaging device, the method comprising the acts of:

detecting a first image, by the digital imaging device, associated with a first focus parameter;

detecting a second image, by the digital imaging device, associated with a second focus parameter;

calculating a statistical representation of a region of interest in the first and second images, wherein the statistical representation is based at least on convoluting at least one filter with the image data for the first and second images;

determining a ratio for the region of interest based on the statistical representation;

determining one or more focus characteristics using a memory table based on the determined ratio for the region of interest; and

calculating a focus depth, by the digital imaging device, for capture of image data based on the determined one or more focus characteristics associated with the memory table.

2. The method of claim 1, wherein the first and second images are associated with different focus positions and are detected to determine one or more automatic focus parameters for the imaging device.

3. The method of claim 1, wherein the statistical representation for the region of interest indicates a relation between object depth and a blur ratio for the regions of interest.

4. The method of claim 1, wherein the ratio relates to one or more of a blur ratio and a generalized ratio for a region of interest.

5. The method of claim 1, wherein the memory table relates to a predetermined look-up-table (LUT) for a plurality of focus positions in a scene.

6. The method of claim 1, wherein focus depth relates to a depth estimation providing a focus depth for focusing the imaging device to capture a scene, and wherein the memory table represents object distance as a function of the ratio.

7. The method of claim 1, wherein a plurality of focus depths are determined for capturing image data for the scene.

8. The method of claim 7, further comprising determining a confidence level for each focus depth, and selecting a focus depth for automatic focus of the imaging device.

9. The method of claim 8, further comprising calculating calibration values for a confidence table based on the confidence levels and an estimated depth probability distribution for the confidence levels.

10. The method of claim 1, further comprising calculating calibration values for the memory table based on the focus parameters and a generalized ratio probability distribution for the focus parameters.

11. The method of claim 1, further comprising determining an alignment parameter for the first image relative to the second image, wherein the alignment parameter relates to an alignment transformation applied to image data associated with the region of interest.

12. The method of claim 1, further comprising adjusting an image sensor based on the calculated focus depth for capture of image data.

13. A device configured to estimate focus depth for a scene, the device comprising:

an image sensor configured to capture image data of the scene; and

a processor coupled to the image sensor, the processor configured to receive a first image from the image sensor associated with a first focus parameter;

receive a second image the image sensor associated with a second focus parameter;

calculate a statistical representation of a region of interest in the first and second images, wherein the statistical representation is based at least on convoluting at least one filter with the image data for the first and second images;

determine a ratio for the region of interest based on the statistical representation;

determine one or more focus characteristics using a memory table based on the determined ratio for the region of interest; and

calculate a focus depth for capture of image data based on the determined one or more focus characteristics associated with the memory table.

14. The device of claim 13, wherein the first and second images are associated with different focus positions and are detected to determine one or more automatic focus parameters for the imaging device.

15. The device of claim 13, Wherein the statistical representation for the region of interest indicates a relation between object depth and a blur ratio for the regions of interest.

16. The device of claim 13, wherein the ratio relates to one or more of a blur ratio and a generalized ratio for a region of interest.

17. The device of claim 13, wherein the memory table relates to a predetermined look-up-table (LUT) for a plurality of focus positions in a scene.

18. The device of claim 13, wherein focus depth relates to a depth estimation providing a focus depth for focusing the imaging device to capture a scene, and wherein the memory table represents object distance as a function of the ratio.

19. The device of claim 13, wherein a plurality of focus depths are determined for capturing image data for the scene.

20. The device of claim 19, wherein the processor is configured to determine a confidence level for each focus depth, and select a focus depth for automatic focus of the imaging device.

21. The device of claim 20, wherein the processor is configured to calculate calibration values for a confidence table based on the confidence levels and an estimated depth probability distribution for the confidence levels.

22. The device of claim 13, wherein the processor is configured to calculate calibration values for the memory table based on the focus parameters and a generalized ratio probability distribution for the focus parameters.

23. The device of claim 13, wherein the processor is further configured to determine an alignment parameter for the first image relative to the second image, wherein the alignment parameter relates to an alignment transformation applied to image data associated with the region of interest.

24. The device of claim 13, wherein the processor is configured to adjust the image sensor based on the calculated focus depth for capture of image data.