Systems and Methods for Synthesizing Higher Resolution Images Using Images Captured by Camera Arrays
First Claim
1. A method of synthesizing a higher resolution image from a plurality of images captured from different viewpoints, comprising:
- normalizing a set of images using calibration data stored in a storage device using an address conversion module, where the set of images comprises a plurality of images that are;
captured from different viewpoints;
include different occlusions sets;
wherein the occlusion set of a first image is the portion of a scene visible in a second image that is occluded in the first image; and
detecting and metering parallax using a parallax confirmation and measurement module, where detecting and metering parallax comprises ignoring pixels in the images that are in an exposed occlusion set;
aligning portions of different images to compensate for parallax using an image pixel correlation module based upon the detected and metered parallax and the stored calibration data; and
obtaining a higher resolution image having a resolution that is higher than the resolutions of the images in the set of images using a super-resolution module.
14 Assignments
0 Petitions
Accused Products
Abstract
A camera array, an imaging device and/or a method for capturing image that employ a plurality of imagers fabricated on a substrate is provided. Each imager includes a plurality of pixels. The plurality of imagers include a first imager having a first imaging characteristics and a second imager having a second imaging characteristics. The images generated by the plurality of imagers are processed to obtain an enhanced image compared to images captured by the imagers. Each imager may be associated with an optical element fabricated using a wafer level optics (WLO) technology.
169 Citations
30 Claims
-
1. A method of synthesizing a higher resolution image from a plurality of images captured from different viewpoints, comprising:
-
normalizing a set of images using calibration data stored in a storage device using an address conversion module, where the set of images comprises a plurality of images that are; captured from different viewpoints; include different occlusions sets; wherein the occlusion set of a first image is the portion of a scene visible in a second image that is occluded in the first image; and detecting and metering parallax using a parallax confirmation and measurement module, where detecting and metering parallax comprises ignoring pixels in the images that are in an exposed occlusion set; aligning portions of different images to compensate for parallax using an image pixel correlation module based upon the detected and metered parallax and the stored calibration data; and obtaining a higher resolution image having a resolution that is higher than the resolutions of the images in the set of images using a super-resolution module. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29)
-
-
30. A method of synthesizing a higher resolution image from a plurality of images captured from different viewpoints, comprising:
-
normalizing a set of images using calibration data stored in a storage device using an address conversion module, where the set of images comprises a plurality of images that are; captured from different viewpoints; include different occlusions sets; wherein the occlusion set of a first image is the portion of a scene visible in a second image that is occluded in the first image; and detecting and metering parallax using a parallax confirmation and measurement module, where detecting and metering parallax comprises ignoring pixels in the images that are in an exposed occlusion set; aligning portions of different images to compensate for parallax using an image pixel correlation module based upon the detected and metered parallax and the stored calibration data; and obtaining a higher resolution image having a resolution that is higher than the resolutions of the images in the set of images using a super-resolution module by; fusing the aligned image portions; and performing super-resolution processing on the fused image portions to synthesize a super-resolution image; and generating a depth map for the higher resolution image using the parallax confirmation and measurement module.
-
Specification