Systems and methods for decoding image files containing depth maps stored as metadata
First Claim
1. A system for rendering image files containing depth maps, the system comprising:
- a display;
a processor; and
a memory containing a rendering application and an image file comprising;
a reference encoded image from a reference viewpoint; and
metadata describing at least one supplementary encoded image taken from a supplementary viewpoint using at least one supplementary camera stored as metadata within the image file; and
metadata describing a depth map based on the parallax variation between the encoded reference image and the at least one encoded supplementary image that specifies depths from the reference viewpoint for pixels in the encoded reference image;
wherein the rendering application directs the processor to;
locate the reference image within the image file;
synthesize an image based on the reference image and the depth map;
render the synthesized image; and
display the synthesized image using the display.
2 Assignments
0 Petitions
Accused Products
Abstract
Systems and methods in accordance with embodiments of the invention are configured to render images using light field image files containing an image synthesized from light field image data and metadata describing the image that includes a depth map. One embodiment of the invention includes a processor and memory containing a rendering application and a light field image file including an encoded image, a set of low resolution images, and metadata describing the encoded image, where the metadata comprises a depth map that specifies depths from the reference viewpoint for pixels in the encoded image. In addition, the rendering application configures the processor to: locate the encoded image within the light field image file; decode the encoded image; locate the metadata within the light field image file; and post process the decoded image by modifying the pixels based on the depths indicated within the depth map and the set of low resolution images to create a rendered image.
-
Citations
25 Claims
-
1. A system for rendering image files containing depth maps, the system comprising:
-
a display; a processor; and a memory containing a rendering application and an image file comprising; a reference encoded image from a reference viewpoint; and metadata describing at least one supplementary encoded image taken from a supplementary viewpoint using at least one supplementary camera stored as metadata within the image file; and metadata describing a depth map based on the parallax variation between the encoded reference image and the at least one encoded supplementary image that specifies depths from the reference viewpoint for pixels in the encoded reference image; wherein the rendering application directs the processor to; locate the reference image within the image file; synthesize an image based on the reference image and the depth map; render the synthesized image; and display the synthesized image using the display. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16)
-
-
17. A system for storing image files containing depth maps, the system comprising:
-
a display; a processor; an array camera comprising a plurality of cameras; and a memory containing a rendering application and an image file comprising; a stereo pair of encoded images comprising; a reference encoded image from a reference viewpoint; and a supplementary encoded image from a supplementary viewpoint; wherein the supplementary encoded image is taken by a camera in the plurality of cameras; and wherein the supplementary encoded image is stored as metadata within the image file; and metadata describing a depth map based on the parallax variation between the reference encoded image and the at least one supplementary encoded image that specifies depths from the reference viewpoint for pixels in the encoded reference image; wherein the rendering application directs the processor to; locate the reference encoded image within the image file; synthesize an image based on the reference encoded image and the depth map; render the synthesized image; and display the synthesized image using the display. - View Dependent Claims (18, 19, 20, 21, 22, 23, 24, 25)
-
Specification