Systems and methods for encoding image files containing depth maps stored as metadata
First Claim
1. A system for generating modifiable blur effects, comprising:
- a processor;
an array of cameras comprising a plurality of cameras;
a display; and
a memory containing machine readable instructions;
wherein the machine readable instructions direct the processor to;
obtain image data using the array of cameras, where the image data comprises a plurality of images of a scene captured from different viewpoints that includes a reference image captured from a reference viewpoint;
create a depth map that specifies depths for pixels in the reference image using at least a portion of the image data;
apply a depth based blur effect during synthesis of an image using the reference image and the depth map;
encode the synthesized image and the reference image;
write the encoded images and the depth map to an image file;
store the image file in the memory;
retrieve the image from the memory;
decode the synthesized image;
display the synthesized image using the display;
create a modified synthesized image by applying a second depth based blur effect using the depth map;
display the modified synthesized image using the display;
encode the modified synthesized image; and
store the modified synthesized image in the image file.
1 Assignment
0 Petitions
Accused Products
Abstract
Systems and methods for storing images synthesized from light field image data and metadata describing the images in electronic files in accordance with embodiments of the invention are disclosed. One embodiment includes a processor and memory containing an encoding application and light field image data, where the light field image data comprises a plurality of low resolution images of a scene captured from different viewpoints. In addition, the encoding application configures the processor to synthesize a higher resolution image of the scene from a reference viewpoint using the low resolution images, where synthesizing the higher resolution image involves creating a depth map that specifies depths from the reference viewpoint for pixels in the higher resolution image; encode the higher resolution image; and create a light field image file including the encoded image, the low resolution images, and metadata including the depth map.
-
Citations
20 Claims
-
1. A system for generating modifiable blur effects, comprising:
-
a processor; an array of cameras comprising a plurality of cameras; a display; and a memory containing machine readable instructions; wherein the machine readable instructions direct the processor to; obtain image data using the array of cameras, where the image data comprises a plurality of images of a scene captured from different viewpoints that includes a reference image captured from a reference viewpoint; create a depth map that specifies depths for pixels in the reference image using at least a portion of the image data; apply a depth based blur effect during synthesis of an image using the reference image and the depth map; encode the synthesized image and the reference image; write the encoded images and the depth map to an image file; store the image file in the memory; retrieve the image from the memory; decode the synthesized image; display the synthesized image using the display; create a modified synthesized image by applying a second depth based blur effect using the depth map; display the modified synthesized image using the display; encode the modified synthesized image; and store the modified synthesized image in the image file. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10)
-
-
11. A method for generating modifiable blur effects, comprising:
-
obtaining image data using an array of cameras comprising a plurality of cameras, where the image data comprises a plurality of images of a scene captured from different viewpoints that includes a reference image captured from a reference viewpoint; creating a depth map that specifies depths for pixels in the reference image using a processor configured by machine readable instructions based upon at least a portion of the image data; applying a depth based blur effect during synthesis of an image using the processor configured by machine readable instructions based upon the reference image and the depth map; encoding the synthesized image and the reference image using the processor configured by machine readable instructions; writing the encoded images and the depth map to an image file using the processor configured by machine readable instructions; storing the image file to a memory using the processor configured by machine readable instructions; retrieving the image from the memory using the processor configured by machine readable instructions; decoding the synthesized image using the processor configured by machine readable instructions; displaying the synthesized image using a display using the processor configured by machine readable instructions; creating a modified synthesized image by applying a second depth based blur effect using using the processor configured by machine readable instructions based upon the depth map; displaying the modified synthesized image using the display; encoding the modified synthesized image using the processor configured by machine readable instructions; and storing the modified synthesized image in the image file using the processor configured by machine readable instructions. - View Dependent Claims (12, 13, 14, 15, 16, 17, 18, 19, 20)
-
Specification