Systems and methods for controlling aliasing in images captured by an array camera for use in super resolution processing using pixel apertures
First Claim
1. An array camera, comprising:
- a plurality of cameras;
a processor configured to receive digital pixel data from the plurality of cameras via interface circuitry; and
memory containing an image processing pipeline application;
wherein the image processing pipeline application directs the processor to;
obtain a set of images of a scene that include aliasing from the plurality of cameras, wherein the aliasing is different in each image;
fuse portions of the set of images to form fused image at each of a plurality of hypothesized disparities;
compare the portion of the fused image obtained at each hypothesized disparity to the scene captured in the set of images;
select a hypothesized disparity at which the portion of the fused image is most similar to the scene captured in the set of images accounting for aliasing as a disparity estimate; and
synthesize an image of the scene from a reference viewpoint using the set of images and disparity information including the disparity estimate.
1 Assignment
0 Petitions
Accused Products
Abstract
Imager arrays, array camera modules, and array cameras in accordance with embodiments of the invention utilize pixel apertures to control the amount of aliasing present in captured images of a scene. One embodiment includes a plurality of focal planes, control circuitry configured to control the capture of image information by the pixels within the focal planes, and sampling circuitry configured to convert pixel outputs into digital pixel data. In addition, the pixels in the plurality of focal planes include a pixel stack including a microlens and an active area, where light incident on the surface of the microlens is focused onto the active area by the microlens and the active area samples the incident light to capture image information, and the pixel stack defines a pixel area and includes a pixel aperture, where the size of the pixel apertures is smaller than the pixel area.
1037 Citations
20 Claims
-
1. An array camera, comprising:
-
a plurality of cameras; a processor configured to receive digital pixel data from the plurality of cameras via interface circuitry; and memory containing an image processing pipeline application; wherein the image processing pipeline application directs the processor to; obtain a set of images of a scene that include aliasing from the plurality of cameras, wherein the aliasing is different in each image; fuse portions of the set of images to form fused image at each of a plurality of hypothesized disparities; compare the portion of the fused image obtained at each hypothesized disparity to the scene captured in the set of images; select a hypothesized disparity at which the portion of the fused image is most similar to the scene captured in the set of images accounting for aliasing as a disparity estimate; and synthesize an image of the scene from a reference viewpoint using the set of images and disparity information including the disparity estimate. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18)
-
-
19. A method of determining a disparity of a point in a scene using image data comprising a set of images that capture the scene, the method comprising:
-
capturing a set of images, where each image includes aliasing and the aliasing is different in each captured image; fusing portions of the set of images to form a portion of an image at each of a plurality of hypothesized disparities; comparing the portion of the fused higher resolution image obtained at each hypothesized disparity to the scene captured in the set of low resolution images; and selecting the hypothesized disparity at which the portion of the fused image is most similar to the scene captured in the set of images as the disparity of at least one point in the scene captured by the set of low resolution images.
-
-
20. A method of determining a disparity of a point in a scene using image data comprising a set of images that capture the scene, the method comprising:
-
fusing portions of a first subset of a set of images to form a portion of a first image at each of a plurality of hypothesized disparities; fusing portions of a second subset of the set of images to form a portion of a second image at each of the plurality of hypothesized disparities; comparing at least the portions of the first and second images fused at each of the plurality of hypothesized disparities, wherein comparing at least the portions of the first and second images fused at each of the plurality of hypothesized disparities comprises comparing the portions of the first and second images for matching error at each of the plurality of hypothesized disparities; and selecting the hypothesized disparity at which the portions of the compared images are most similar as the disparity of at least one point in the scene imaged by pixels within portions of the first and second subsets of the set of images.
-
Specification