Methods, systems, and computer-readable storage media for identifying a rough depth map in a scene and for determining a stereo-base distance for three-dimensional (3D) content creation

• US 9,344,701 B2
• Filed: 12/27/2011
• Issued: 05/17/2016
• Est. Priority Date: 07/23/2010
• Status: Expired due to Fees

• Current Assignee: 3D Media Ltd.
• Original Assignee: 3DMedia Corporation
• Inventors: Robers, Marshall, Markas, Tassos, McNamer, Michael
• Primary Examiner(s): JONES, HEATHER RAE
• Application Number:
  US13/337,676
• Publication Number:
  US 20120162374A1
• Time in Patent Office: 1,603 Days
• Field of Search: None
• US Class Current: 1/1
• CPC Class Codes: H04N 13/128 Adjusting depth or disparity
• CPC Class Codes: H04N 13/221 using the relative movement between cameras and objects

Abstract

Methods, systems, and computer program products for determining a depth map in a scene are disclosed herein. According to one aspect, a method includes collecting focus statistical information for a plurality of focus windows. The method may also include determining a focal distance for each window. Further, the method may include determining near, far, and target focus distances. The method may also include calculating a stereo-base and screen plane using the focus distances.

Claims

1. Apparatus for determining image capture positions for creating a stereoscopic image of a scene, the apparatus comprising:

at least one processor and memory configured to;

receive image data of a scene captured at a first position by the image capture device;

determine distances of predefined areas of the scene by use of focus information of image data corresponding to one or more predetermined areas of the scene;

determine one of;

a near distance defined as a distance with the smallest value, a far distance defined as a distance with the highest value, and a target distance defined as a focus distance of a target object in the scene;

calculate the stereo-base of the scene using one of near distance, far distance, and target distances;

determine a second position defined by adding the calculated stereo-base to the first position laterally to the scene;

receive image data of a scene captured when image capture device is at the second position;

utilize the image data captured at the first position and the second position to create a stereoscopic image; and

utilize one of the near distance, the far distance, and the target distance to adjust at least one stereoscopic parameter of the stereoscopic image.

2. The apparatus of claim 1, wherein the at least one processor and memory are configured to control a motor lens of an image capture device to scan a focus area including the set of predetermined windows.

3. The apparatus of claim 1, wherein the at least one processor and memory configured to collect all focus data corresponding to at least one of the predetermined windows.

4. The apparatus of claim 1, wherein the at least one processor and memory are configured to determine the focal distance based on an applied focus pulse on a motor of an image capture device.

5. The apparatus of claim 1, wherein the at least one processor and memory are configured to determine the depth of a far object by identifying a similar object at a known, near distance and the dimensions of the far and near objects.

6. The apparatus of claim 1, wherein the at least one processor and memory are configured to use an image capture device for implementing the steps of computing focus information, determining a focal distance, determining focus distances, and calculating a stereo-base and screen plane.

7. The apparatus of claim 1, wherein the at least one processor and memory are configured to:

identify at least one first object within a captured image of a scene that has a known fixed dimension at a location where depth is known;

identify at least one second object within the captured image that has a substantially similar characteristics to the first object;

determine the distance of the second object using the relative sizes of the first and second objects; and

calculate a stereo-base and screen plane using focus and far-depth distances of the objects.

8. A non-transitory computer-readable medium comprising one or more computer-readable instructions that, when executed by at least one processor of a computing device, cause the computing device to:

receive image data of a scene;

determine distances of predefined areas of the scene by use of focus information of image data corresponding to one or more predetermined areas of the scene;

determine one of;

a near distance defined as a distance with the smallest value,

a far distance defined as a distance with the highest value,

a target distance defined as a focus distance of a target object in the scene;

calculate the stereo-base of the scene using one of near distance, far distance, and target distance;

determine a second position defined by adding the calculated stereo-base to the first position laterally to the scene;

receive image data of a scene captured when image capture device is at the second position;

utilize the image data captured at the first position and the second position to create a stereoscopic image; and

utilize one of the near distance, the far distance, and the target distance to adjust at least one stereoscopic parameter of the stereoscopic image.

9. The non-transitory computer-readable medium of claim 8, wherein computing focus information comprises controlling a motor lens of an image capture device to scan a focus area including the set of predetermined windows.

10. The non-transitory computer-readable medium of claim 8, further comprising collecting all focus data corresponding to at least one of the predetermined windows.

11. The non-transitory computer-readable medium of claim 8, wherein determining a focal distance comprises determining the focal distance based on an applied focus pulse on a motor of an image capture device.

12. The non-transitory computer-readable medium of claim 8, further comprising determining the depth of a far object by identifying a similar object at a known, near distance and the dimensions of the far and near objects.

13. The non-transitory computer-readable medium of claim 8, further comprising using an image capture device for implementing the steps of computing focus information, determining a focal distance, determining focus distances, and calculating a stereo-base and screen plane.

14. The non-transitory computer-readable medium of claim 8, further comprising:

identifying at least one first object within a captured image of a scene that has a known fixed dimension at a location where depth is known;

identifying at least one second object within the captured image that has a substantially similar characteristics to the first object;

determining the distance of the second object using the relative sizes of the first and second objects; and

calculating a stereo-base and screen plane using focus and far-depth distances of the objects.

15. A system for determining image capture positions for creating a stereoscopic image of a scene, the system comprising:

at least one capture device;

at least one processor and memory configured to;

receive image data of a scene;

determine distances of predefined areas of the scene by use of focus information of image data corresponding to one or more predetermined areas of the scene;

determine one of;

a near distance defined as a distance with the smallest value, a far distance defined as a distance with the highest value, and a target distance defined as a focus distance of a target object in the scene;

calculate the stereo-base of the scene using one of near distance, far distance, and target distance;

determine a second position defined by adding the calculated stereo-base to the first position laterally to the scene;

receive image data of a scene captured when image capture device is at the second position;

utilize the image data captured at the first position and the second position to create a stereoscopic image; and

utilize one of the near distance, the far distance, and the target distance to adjust at least one stereoscopic parameter of the stereoscopic image.

16. The system of claim 15, wherein the at least one processor and memory are configured to control a motor lens of the at least one capture device to scan a focus area including the set of predetermined windows.

17. The system of claim 15, wherein the at least one processor and memory are configured to collect all focus data corresponding to at least one of the predetermined windows.

18. The system of claim 15, wherein the at least one processor and memory are configured to determine the focal distance based on an applied focus pulse on a motor of an image capture device.

19. The system of claim 15, wherein the at least one processor and memory are configured to determine the depth of a far object by identifying a similar object at a known, near distance and the dimensions of the far and near objects.

20. The system of claim 15, wherein the at least one processor and memory are configured to use the at least one capture device for implementing the steps of computing focus information, determining a focal distance, determining focus distances, and calculating a stereo-base and screen plane.

21. The system of claim 15, wherein the at least one processor and memory are configured to:

identify at least one first object within a captured image of a scene that has a known fixed dimension at a location where depth is known;

identify at least one second object within the captured image that has a substantially similar characteristics to the first object;

determine the distance of the second object using the relative sizes of the first and second objects; and

calculate a stereo-base and screen plane using focus and far-depth distances of the objects.