Systems and methods for synthesizing high resolution images using image deconvolution based on motion and depth information
First Claim
1. An array camera, comprising:
- a processor; and
a memory connected to the processor and configured to store an image deconvolution application;
wherein the image deconvolution application configures the processor to;
obtain light field image data, where the light field image data comprises an image having a plurality of pixels and a depth map;
determine motion data by applying ego-motion techniques to estimate motion data by;
detecting features in a first image and matching those features to a second image; and
generate an optical flow describing the estimate of the motion of the array camera;
generate a depth-dependent point spread function based on the image, the depth map, and the motion data;
measure the quality of the image based on the generated depth-dependent point spread function;
when the measured quality of the image is within a quality threshold, incorporate the image into the light field image data.
1 Assignment
0 Petitions
Accused Products
Abstract
Systems and methods for synthesizing high resolution images using image deconvolution and depth information in accordance embodiments of the invention are disclosed. In one embodiment, an array camera includes a processor and a memory, wherein an image deconvolution application configures the processor to obtain light field image data, determine motion data based on metadata contained in the light field image data, generate a depth-dependent point spread function based on the synthesized high resolution image, the depth map, and the motion data, measure the quality of the synthesized high resolution image based on the generated depth-dependent point spread function, and when the measured quality of the synthesized high resolution image is within a quality threshold, incorporate the synthesized high resolution image into the light field image data.
-
Citations
20 Claims
-
1. An array camera, comprising:
-
a processor; and a memory connected to the processor and configured to store an image deconvolution application; wherein the image deconvolution application configures the processor to; obtain light field image data, where the light field image data comprises an image having a plurality of pixels and a depth map; determine motion data by applying ego-motion techniques to estimate motion data by; detecting features in a first image and matching those features to a second image; and generate an optical flow describing the estimate of the motion of the array camera; generate a depth-dependent point spread function based on the image, the depth map, and the motion data; measure the quality of the image based on the generated depth-dependent point spread function; when the measured quality of the image is within a quality threshold, incorporate the image into the light field image data. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15)
-
-
16. A method for performing image deconvolution, comprising:
-
obtain light field image data using an array camera having a plurality of cameras, wherein the light field image data comprises an image having a plurality of pixels and a depth map; determine motion data by applying ego-motion techniques to estimate motion data by; detecting features in a first image and matching those features to a second image; and generate an optical flow describing the estimate of the motion of the array camera; generate a depth-dependent point spread function based on the image, the depth map, and the motion data; measure the quality of the image based on the generated depth-dependent point spread function; and when the measured quality of the image is within a quality threshold, incorporate the image into the light field image data. - View Dependent Claims (17, 18, 19, 20)
-
Specification