Capturing and processing of images including occlusions focused on an image sensor by a lens stack array
First Claim
1. A camera array, comprising:
- a plurality of cameras configured to capture a plurality of images of a scene;
control circuitry configured to control the plurality of cameras;
an image processor configured to process at least a subset of images captured by the plurality of cameras;
wherein the plurality of cameras comprises at least three cameras, wherein a first camera is equipped with a lens at a first zoom level providing a widest-angle view, a second camera is equipped with a lens at a second zoom level, and a third camera is equipped with a telephoto lens at a third zoom level providing a greatest magnification view to provide at least three distinct zoom magnifications;
wherein cameras in the plurality of cameras are configured to operate with at least one difference in operating parameters;
wherein the image processor is configured to generate at least one higher resolution super-resolved image using a plurality of the captured images;
wherein the image processor is configured to;
measure parallax within the processed images by detecting parallax-induced changes taking into account the position of the cameras that captured the images;
generate a depth map using the measured parallax;
synthesize images having different levels of zoom; and
synthesize an image at a zoom level between the zoom level of the first camera and the zoom level of the third camera using the images captured by the plurality of cameras and the depth map; and
wherein the second camera provides a zoom level between the widest-angle view and the greatest magnification view.
1 Assignment
0 Petitions
Accused Products
Abstract
Systems and methods for implementing array cameras configured to perform super-resolution processing to generate higher resolution super-resolved images using a plurality of captured images and lens stack arrays that can be utilized in array cameras are disclosed. An imaging device in accordance with one embodiment of the invention includes at least one imager array, and each imager in the array comprises a plurality of light sensing elements and a lens stack including at least one lens surface, where the lens stack is configured to form an image on the light sensing elements, control circuitry configured to capture images formed on the light sensing elements of each of the imagers, and a super-resolution processing module configured to generate at least one higher resolution super-resolved image using a plurality of the captured images.
96 Citations
19 Claims
-
1. A camera array, comprising:
-
a plurality of cameras configured to capture a plurality of images of a scene; control circuitry configured to control the plurality of cameras; an image processor configured to process at least a subset of images captured by the plurality of cameras; wherein the plurality of cameras comprises at least three cameras, wherein a first camera is equipped with a lens at a first zoom level providing a widest-angle view, a second camera is equipped with a lens at a second zoom level, and a third camera is equipped with a telephoto lens at a third zoom level providing a greatest magnification view to provide at least three distinct zoom magnifications; wherein cameras in the plurality of cameras are configured to operate with at least one difference in operating parameters; wherein the image processor is configured to generate at least one higher resolution super-resolved image using a plurality of the captured images; wherein the image processor is configured to;
measure parallax within the processed images by detecting parallax-induced changes taking into account the position of the cameras that captured the images;generate a depth map using the measured parallax; synthesize images having different levels of zoom; and synthesize an image at a zoom level between the zoom level of the first camera and the zoom level of the third camera using the images captured by the plurality of cameras and the depth map; and wherein the second camera provides a zoom level between the widest-angle view and the greatest magnification view. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19)
-
Specification