Autofocus system for a conventional camera that uses depth information from an array camera
First Claim
1. An array camera system, comprising:
- an array camera comprising a plurality of cameras that capture images of a scene from different viewpoints;
a separate camera having a fixed geometric relationship with each of the plurality of cameras in the array camera, where the separate camera captures an image of the scene from a different viewpoint to the viewpoints of the other cameras in the array camera;
a processor; and
memory in communication with the processor storing software;
wherein the software directs the processor to;
obtain a focus window of the separate camera which includes a partial selection of image data from the separate camera,determine a focus window of the array camera which includes a partial selection of image data from the array camera based upon the focus window of the separate camera, using measurements of the fixed geometric relationship between the separate camera and each of the plurality of cameras in the array camera, wherein a baseline distance between the separate camera and each of the plurality of cameras in the array camera is larger than a baseline distance between cameras within the plurality of cameras of the array camera, such that disparities between objects in images captured by the separate camera and each of the plurality of cameras in the array camera are greater than disparities between objects in images captured by cameras within the plurality of cameras of the array camera,obtain image data pertaining to the focus window of the array camera from at least two cameras in the plurality of cameras,determine depth information for the focus window of the array camera from the image data from the at least two cameras,colocate the depth information from the focus window of the array camera to the focus window of the separate camera to generate depth information for the focus window of the separate camera, anddetermine a focus depth for the separate camera based upon the depth information for the focus window of the separate camera.
1 Assignment
0 Petitions
Accused Products
Abstract
Systems with an array camera augmented with a conventional camera in accordance with embodiments of the invention are disclosed. In some embodiments, the array camera is used to capture a first set of image data of a scene and a conventional camera is used to capture a second set of image data for the scene. An object of interest is identified in the first set of image data. A first depth measurement for the object of interest is determined and compared to a predetermined threshold. If the first depth measurement is above the threshold, a second set of image data captured using the conventional camera is obtained. The object of interest is identified in the second set of image data and a second depth measurement for the object of interest is determined using at least a portion of the first set of image data and at least a portion of the second set of image data.
1126 Citations
20 Claims
-
1. An array camera system, comprising:
-
an array camera comprising a plurality of cameras that capture images of a scene from different viewpoints; a separate camera having a fixed geometric relationship with each of the plurality of cameras in the array camera, where the separate camera captures an image of the scene from a different viewpoint to the viewpoints of the other cameras in the array camera; a processor; and memory in communication with the processor storing software; wherein the software directs the processor to; obtain a focus window of the separate camera which includes a partial selection of image data from the separate camera, determine a focus window of the array camera which includes a partial selection of image data from the array camera based upon the focus window of the separate camera, using measurements of the fixed geometric relationship between the separate camera and each of the plurality of cameras in the array camera, wherein a baseline distance between the separate camera and each of the plurality of cameras in the array camera is larger than a baseline distance between cameras within the plurality of cameras of the array camera, such that disparities between objects in images captured by the separate camera and each of the plurality of cameras in the array camera are greater than disparities between objects in images captured by cameras within the plurality of cameras of the array camera, obtain image data pertaining to the focus window of the array camera from at least two cameras in the plurality of cameras, determine depth information for the focus window of the array camera from the image data from the at least two cameras, colocate the depth information from the focus window of the array camera to the focus window of the separate camera to generate depth information for the focus window of the separate camera, and determine a focus depth for the separate camera based upon the depth information for the focus window of the separate camera. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11)
-
-
12. A method for autofocusing a separate camera in an array camera system including an array camera comprising a plurality of cameras that capture images of a scene from different viewpoints, a separate camera in a fixed geometric relationship with respect to each of the plurality of cameras in the array camera, where the separate camera captures an image of the scene from a different viewpoint to the viewpoints of the other cameras in the array camera;
a processor, and memory in communication with the processor storing software, comprising; obtaining a focus window of the separate camera which includes a partial selection of image data from the separate camera using the processor, determining a focus window of the array camera which includes a partial selection of image data from the array camera based upon the focus window of the separate camera and a relative parallax between the array camera and the separate camera using the processor, using measurements of the fixed geometric relationship between the separate camera and each of the plurality of cameras in the array camera, wherein a baseline distance between the separate camera and each of the plurality of cameras in the array camera is larger than a baseline distance between cameras within the plurality of cameras of the array camera, such that disparities between objects in images captured by the separate camera and each of the plurality of cameras in the array camera are greater than disparities between objects in images captured by cameras within the plurality of cameras of the array camera, obtaining image data pertaining to the focus window of the array camera from at least two cameras in the plurality of cameras using the processor, determining depth information for the focus window of the array camera from the image data from the at least two cameras using the processor, colocating the depth information from the focus window of the array camera to the focus window of the separate camera to generate depth information for the focus window of the separate camera using the processor, and determining a focus depth for the separate camera based upon the depth information for the focus window of the separate camera using the processor. - View Dependent Claims (13, 14, 15, 16, 17, 18, 19, 20)
Specification