Array camera configurations incorporating constituent array cameras and constituent cameras
First Claim
Patent Images
1. An array camera configuration, comprising:
- a constituent array camera comprising a plurality of cameras, where each camera comprises;
optics that form an image on a focal plane defined by an array of pixels that capture image data; and
have fields of view that form a combined field of view in a first viewing direction;
a separate camera comprising;
optics that form an image on a focal plane defined by an array of pixels that capture image data; and
having a field of view in a second viewing direction;
a processor;
memory containing an image processing application and calibrated warp data;
wherein the image processing application directs the processor to;
obtain image data from the cameras in the constituent array camera;
capture an image using the separate camera from a viewpoint;
generate a depth map using the image data captured by the constituent array camera;
synthesize an image using the image data captured by the constituent array camera and the depth map; and
construct an enhanced image using the image captured by the separate camera, the synthesized image, and the depth map used to synthesize the synthesized image by;
warping the synthesized image into the viewpoint of the image captured by the separate camera using the calibrated warp data and the depth map; and
blending the synthesized image warped into the viewpoint of the image captured by the separate camera and the image captured by the separate camera to create the enhanced image.
13 Assignments
0 Petitions
Accused Products
Abstract
Systems and methods for implementing array camera configurations that include a plurality of constituent array cameras, where each constituent array camera provides a distinct field of view and/or a distinct viewing direction, are described. In several embodiments, image data captured by the constituent array cameras is used to synthesize multiple images that are subsequently blended. In a number of embodiments, the blended images include a foveated region. In certain embodiments, the blended images possess a wider field of view than the fields of view of the multiple images.
-
Citations
23 Claims
-
1. An array camera configuration, comprising:
-
a constituent array camera comprising a plurality of cameras, where each camera comprises;
optics that form an image on a focal plane defined by an array of pixels that capture image data; and
have fields of view that form a combined field of view in a first viewing direction;a separate camera comprising;
optics that form an image on a focal plane defined by an array of pixels that capture image data; and
having a field of view in a second viewing direction;a processor; memory containing an image processing application and calibrated warp data; wherein the image processing application directs the processor to; obtain image data from the cameras in the constituent array camera; capture an image using the separate camera from a viewpoint; generate a depth map using the image data captured by the constituent array camera; synthesize an image using the image data captured by the constituent array camera and the depth map; and construct an enhanced image using the image captured by the separate camera, the synthesized image, and the depth map used to synthesize the synthesized image by; warping the synthesized image into the viewpoint of the image captured by the separate camera using the calibrated warp data and the depth map; and blending the synthesized image warped into the viewpoint of the image captured by the separate camera and the image captured by the separate camera to create the enhanced image. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23)
-
Specification