Systems and methods for decoding light field image files using a depth map
First Claim
1. A system for rendering an image using a light field image file, the system comprising:
- a processor; and
memory containing a rendering application and a light field image file;
wherein the light field image file is structured using the Exchangeable image file (Exif) format and comprises;
an encoded image, where the encoded image is generated based on image data captured from a reference viewpoint using a first imager; and
metadata describing the encoded image stored within an application marker segment within the light field image file;
wherein the metadata comprises a depth map that specifies depths from a reference viewpoint for pixels in the encoded image, where the depth map is generated using at least the image data captured form the reference viewpoint by the first imager and image data captured from a different viewpoint to the reference viewpoint using a second imager; and
wherein the first imager and the second imager are contained in a camera array comprising a collection of imagers designed to function as a unitary component, where the collection of imagers comprises at least two heterogeneous imagers; and
wherein the rendering application directs the processor to render an image by applying post processing to the encoded image using metadata contained within the light field image by;
locating the encoded image within the light field image file by locating a start of image marker within the light field image file;
decoding the encoded image;
locating the metadata within the light field image file; and
processing the decoded image by modifying the pixels of the decoded image based on the depths of the pixels indicated within the depth map to create a rendered image by applying a depth based effect to the pixels of the decoded image.
13 Assignments
0 Petitions
Accused Products
Abstract
Systems and methods in accordance with embodiments of the invention are configured to render images using light field image files containing an image synthesized from light field image data and metadata describing the image that includes a depth map. One embodiment of the invention includes a processor and memory containing a rendering application and a light field image file including an encoded image and metadata describing the encoded image, where the metadata comprises a depth map that specifies depths from the reference viewpoint for pixels in the encoded image. In addition, the rendering application configures the processor to: locate the encoded image within the light field image file; decode the encoded image; locate the metadata within the light field image file; and post process the decoded image by modifying the pixels based on the depths indicated within the depth map to create a rendered image.
-
Citations
28 Claims
-
1. A system for rendering an image using a light field image file, the system comprising:
-
a processor; and memory containing a rendering application and a light field image file; wherein the light field image file is structured using the Exchangeable image file (Exif) format and comprises; an encoded image, where the encoded image is generated based on image data captured from a reference viewpoint using a first imager; and metadata describing the encoded image stored within an application marker segment within the light field image file; wherein the metadata comprises a depth map that specifies depths from a reference viewpoint for pixels in the encoded image, where the depth map is generated using at least the image data captured form the reference viewpoint by the first imager and image data captured from a different viewpoint to the reference viewpoint using a second imager; and wherein the first imager and the second imager are contained in a camera array comprising a collection of imagers designed to function as a unitary component, where the collection of imagers comprises at least two heterogeneous imagers; and wherein the rendering application directs the processor to render an image by applying post processing to the encoded image using metadata contained within the light field image by; locating the encoded image within the light field image file by locating a start of image marker within the light field image file; decoding the encoded image; locating the metadata within the light field image file; and processing the decoded image by modifying the pixels of the decoded image based on the depths of the pixels indicated within the depth map to create a rendered image by applying a depth based effect to the pixels of the decoded image. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26)
-
-
27. A method for decoding a light field image file, where the light field image file is structured using the Exchangeable image file (Exif) format and comprises an encoded image and metadata describing the encoded image stored within an application marker segment within the light field image file, the method comprising:
-
locating the encoded image within the light field image file by locating a start of image marker within the light field image file using an image rendering system, where the encoded image is generated based on image data captured using a first imager; decoding the encoded image using the image rendering system; locating the metadata within the light field image file using the image rendering system, where the metadata comprises a depth map that specifies depths from the reference viewpoint for pixels in the encoded image, where the depth map is generated based on data captured using a second imager, where the first imager and the second imager are contained in a camera array comprising a collection of imagers designed to function as a unitary component, where the collection of imagers comprises at least two heterogeneous imagers; and processing the decoded image by modifying the pixels of the decoded image based on the depths of the pixels indicated within the depth map to create a rendered image by applying a depth based effect to the pixels of the decoded image using the image rendering system.
-
-
28. A non-transitory machine readable medium containing processor instructions, where execution of the instructions by a processor causes the processor to perform a process comprising:
-
locating an encoded image within a light field image file by locating a start of image marker within the light field image file, where the light field image file is structured using the Exchangeable image file (Exif) format, and comprises the encoded image and metadata describing the encoded image stored within an application marker segment within the light field image file, where the encoded image is generated based on image data captured using a first imager; decoding the encoded image; locating the metadata within the light field image file, where the metadata comprises a depth map that specifies depths from the reference viewpoint for pixels in the encoded image, where the depth map is generated based on data captured using a second imager, where the first imager and the second imager are contained in a camera array comprising a collection of imagers designed to function as a unitary component, where the collection of imagers comprises at least two heterogeneous imagers; and processing the decoded image by modifying the pixels of the decoded image based on the depths of the pixels indicated within the depth map to create a rendered image by applying a depth based effect to the pixels of the decoded image.
-
Specification