Systems and methods for synthesizing high resolution images using images captured by an array of independently controllable imagers
First Claim
1. A method for generating an image of a scene using an imager array including a plurality of imagers that each capture an image of the scene, photometric calibration data for the imager array, geometric calibration data for the imager, the method comprising:
- obtaining input images captured by the plurality of imagers using a processor configured by image processing pipeline software, where the input images capture a scene in which depths of points in the imaged scene vary and each of the input images differs from the other input images due to scene dependent geometric displacements due to parallax experienced by each of the plurality of imagers based upon the different depths of the points in the imaged scene;
applying scene independent geometric corrections to the plurality of images using the geometric calibration data to obtain a plurality of geometrically registered images using the processor configured by image processing pipeline software;
determining scene dependent parallax information with respect to the input images based upon disparity relative to a reference point of view resulting from the different depths of points in the imaged scene using the processor configured by the image processing pipeline software, where the scene dependent parallax information comprises scene dependent geometric transformations;
determining an initial estimate of at least a portion of an image from a plurality of pixels from the plurality of input images based upon a total shift for each of the plurality of pixels relative to a reference view, where the total shift of a given pixel location is the combination of the scene independent geometric correction determined for the given pixel using the geometric calibration data and the scene dependent geometric transformation determined for the given pixel location; and
synthesizing an image using the initial estimate of the portion of the image.
5 Assignments
0 Petitions
Accused Products
Abstract
Systems and methods in accordance with embodiments of the invention are disclosed that use super-resolution (SR) processes to use information from a plurality of low resolution (LR) images captured by an array camera to produce a synthesized higher resolution image. One embodiment includes obtaining input images using the plurality of imagers, using a microprocessor to determine an initial estimate of at least a portion of a high resolution image using a plurality of pixels from the input images, and using a microprocessor to determine a high resolution image that when mapped through the forward imaging transformation matches the input images to within at least one predetermined criterion using the initial estimate of at least a portion of the high resolution image. In addition, each forward imaging transformation corresponds to the manner in which each imager in the imaging array generate the input images, and the high resolution image synthesized by the microprocessor has a resolution that is greater than any of the input images.
1094 Citations
25 Claims
-
1. A method for generating an image of a scene using an imager array including a plurality of imagers that each capture an image of the scene, photometric calibration data for the imager array, geometric calibration data for the imager, the method comprising:
-
obtaining input images captured by the plurality of imagers using a processor configured by image processing pipeline software, where the input images capture a scene in which depths of points in the imaged scene vary and each of the input images differs from the other input images due to scene dependent geometric displacements due to parallax experienced by each of the plurality of imagers based upon the different depths of the points in the imaged scene; applying scene independent geometric corrections to the plurality of images using the geometric calibration data to obtain a plurality of geometrically registered images using the processor configured by image processing pipeline software; determining scene dependent parallax information with respect to the input images based upon disparity relative to a reference point of view resulting from the different depths of points in the imaged scene using the processor configured by the image processing pipeline software, where the scene dependent parallax information comprises scene dependent geometric transformations; determining an initial estimate of at least a portion of an image from a plurality of pixels from the plurality of input images based upon a total shift for each of the plurality of pixels relative to a reference view, where the total shift of a given pixel location is the combination of the scene independent geometric correction determined for the given pixel using the geometric calibration data and the scene dependent geometric transformation determined for the given pixel location; and synthesizing an image using the initial estimate of the portion of the image. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25)
-
Specification