SYSTEMS AND METHODS FOR GENERATING COMPRESSED LIGHT FIELD REPRESENTATION DATA USING CAPTURED LIGHT FIELDS, ARRAY GEOMETRY, AND PARALLAX INFORMATION
First Claim
1. An array camera, comprising:
- a processor; and
a memory connected to the processor and configured to store an image processing application;
wherein the image processing application configures the processor to;
obtain image data, wherein;
the image data comprises a set of images comprising a reference image and at least one alternate view image; and
each image in the set of images comprises a set of pixels;
generate a depth map based on the image data, where the depth map describes the distance from the viewpoint of the reference image with respect to objects imaged by pixels within the reference image;
determine at least one prediction image based on the reference image and the depth map, where the prediction images correspond to at least one alternate view image;
compute prediction error data based on the at least one prediction image and the at least one alternate view image, where a portion of prediction error data describes the difference in photometric information between a pixel in a prediction image and a pixel in at least one alternate view image corresponding to the prediction image; and
generate compressed light field representation data based on the reference image, the prediction error data, and the depth map.
13 Assignments
0 Petitions
Accused Products
Abstract
Systems and methods for the generating compressed light field representation data using captured light fields in accordance embodiments of the invention are disclosed. In one embodiment, an array camera includes a processor and a memory connected configured to store an image processing application, wherein the image processing application configures the processor to obtain image data, wherein the image data includes a set of images including a reference image and at least one alternate view image, generate a depth map based on the image data, determine at least one prediction image based on the reference image and the depth map, compute prediction error data based on the at least one prediction image and the at least one alternate view image, and generate compressed light field representation data based on the reference image, the prediction error data, and the depth map.
-
Citations
22 Claims
-
1. An array camera, comprising:
-
a processor; and a memory connected to the processor and configured to store an image processing application; wherein the image processing application configures the processor to; obtain image data, wherein; the image data comprises a set of images comprising a reference image and at least one alternate view image; and each image in the set of images comprises a set of pixels; generate a depth map based on the image data, where the depth map describes the distance from the viewpoint of the reference image with respect to objects imaged by pixels within the reference image; determine at least one prediction image based on the reference image and the depth map, where the prediction images correspond to at least one alternate view image; compute prediction error data based on the at least one prediction image and the at least one alternate view image, where a portion of prediction error data describes the difference in photometric information between a pixel in a prediction image and a pixel in at least one alternate view image corresponding to the prediction image; and generate compressed light field representation data based on the reference image, the prediction error data, and the depth map. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16)
-
-
17. A method for generating compressed light field representation data, comprising:
-
obtaining image data using an array camera, where the image data comprises a set of images comprising a reference image and at least one alternate view image and the images in the set of images comprise a set of pixels; generating a depth map based on the image data using the array camera, where the depth map describes the distance from the viewpoint of the reference image with respect to objects imaged by pixels within the reference image based on the alternate view images; determining a set of prediction images based on the reference image and the depth map using the array camera, where a prediction image in the set of prediction images is a representation of a corresponding alternate view image in the at least one alternate view image; computing prediction error data by calculating the difference between a prediction image in the set of prediction images and the corresponding alternate view image that describes the difference in photometric information between a pixel in the reference image and a pixel in an alternate view image using the array camera; and generating compressed light field representation data based on the reference image, the prediction error data, and the depth map using the array camera. - View Dependent Claims (18, 19, 20, 21, 22)
-
Specification