Systems and methods for encoding light field image files
First Claim
1. An image processing system, comprising:
- a processor; and
memory containing an encoding application;
wherein the encoding application configures the processor to;
control capture of a plurality of images of a scene from different viewpoints by an array of cameras;
generate a depth map that specifies depths for pixels from a reference viewpoint using the plurality of captured images;
synthesize an image of the scene from the reference viewpoint using the plurality of captured images, where synthesizing the image involves using the depth map that specifies depths from the reference viewpoint for pixels in the synthesized image;
encode the synthesized image; and
store the synthesized image in an image file, and store the depth map and at least one of the plurality of captured images in the image file.
13 Assignments
0 Petitions
Accused Products
Abstract
Systems and methods configured to store images synthesized from light field image data and metadata describing the images in electronic files and render images using the stored image and the metadata in accordance with embodiments of the invention are disclosed. One embodiment includes a processor and memory containing an encoding application and light field image data, where the light field image data comprises a plurality of low resolution images of a scene captured from different viewpoints. In addition, the encoding application configures the processor to synthesize a higher resolution image of the scene from a reference viewpoint using the low resolution images, where synthesizing the higher resolution image involves creating a depth map that specifies depths from the reference viewpoint for pixels in the higher resolution image; encode the higher resolution image; and create a light field image file including the encoded image and metadata including the depth map.
957 Citations
21 Claims
-
1. An image processing system, comprising:
-
a processor; and memory containing an encoding application; wherein the encoding application configures the processor to; control capture of a plurality of images of a scene from different viewpoints by an array of cameras; generate a depth map that specifies depths for pixels from a reference viewpoint using the plurality of captured images; synthesize an image of the scene from the reference viewpoint using the plurality of captured images, where synthesizing the image involves using the depth map that specifies depths from the reference viewpoint for pixels in the synthesized image; encode the synthesized image; and store the synthesized image in an image file, and store the depth map and at least one of the plurality of captured images in the image file. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19)
-
-
20. A method for encoding light field image data as a image file, comprising:
-
capture a plurality of images of a scene from different viewpoints by an array of cameras; generate a depth map that specifies depths for pixels from a reference viewpoint using the plurality of captured images using a processor; synthesize an image of a scene from the reference viewpoint based upon the plurality of captured images using a processor, wherein synthesizing the image involves using the depth map that specifies depths from the reference viewpoint for pixels in the synthesized image; encoding the synthesized image using a processor; and storing the synthesized image in an image file using a processor, and storing the depth map and at least one of the plurality of captured images in the image file.
-
-
21. A non-transitory machine readable medium containing processor instructions, where execution of the instructions by a processor causes the processor to perform a process comprising:
-
controlling capturing of a plurality of images of a scene from different viewpoints by an array of cameras; generating a depth map that specifies depths for pixels from a reference viewpoint using the plurality of captured images; synthesizing an image of a scene from the reference viewpoint using the plurality of captured images, wherein synthesizing the image involves using the depth map that specifies depths from the reference viewpoint for pixels in the synthesized image; encoding the synthesized image; and storing the synthesized image in an image file, and storing the depth map and at least one of the plurality of captured images in the image file.
-
Specification