Methods and apparatus for full-resolution light-field capture and rendering
First Claim
1. A computer-implemented method, comprising:
- obtaining a flat comprising a plurality of separate portions of an image of a scene, wherein each of the plurality of separate portions is in a separate region of the flat, wherein each of the plurality of separate portions comprises a plurality of pixels, and wherein the flat is a 2D representation of a 4D light-field that captures both spatial and angular information of the scene;
generating a plurality of m1×
m2 pixel subregions from the plurality of separate portions, wherein said generating comprises cropping each of the plurality of separate portions to an m1×
m2 pixel subregion of the respective portion, where at least one of m1 and m2 is an integer greater than or equal to two; and
assembling the plurality of subregions to produce a single image of the scene.
2 Assignments
0 Petitions
Accused Products
Abstract
Method and apparatus for full-resolution light-field capture and rendering. A radiance camera is described in which the microlenses in a microlens array are focused on the image plane of the main lens instead of on the main lens, as in conventional plenoptic cameras. The microlens array may be located at distances greater than f from the photosensor, where f is the focal length of the microlenses. Radiance cameras in which the distance of the microlens array from the photosensor is adjustable, and in which other characteristics of the camera are adjustable, are described. Digital and film embodiments of the radiance camera are described. A full-resolution light-field rendering method may be applied to flats captured by a radiance camera to render higher-resolution output images than are possible with conventional plenoptic cameras and rendering methods.
-
Citations
24 Claims
-
1. A computer-implemented method, comprising:
-
obtaining a flat comprising a plurality of separate portions of an image of a scene, wherein each of the plurality of separate portions is in a separate region of the flat, wherein each of the plurality of separate portions comprises a plurality of pixels, and wherein the flat is a 2D representation of a 4D light-field that captures both spatial and angular information of the scene; generating a plurality of m1×
m2 pixel subregions from the plurality of separate portions, wherein said generating comprises cropping each of the plurality of separate portions to an m1×
m2 pixel subregion of the respective portion, where at least one of m1 and m2 is an integer greater than or equal to two; andassembling the plurality of subregions to produce a single image of the scene. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8)
-
-
9. A system, comprising:
-
at least one processor; and a memory comprising program instructions, wherein the program instructions are executable by the at least one processor to; obtain a flat comprising a plurality of separate portions of an image of a scene, wherein each of the plurality of separate portions is in a separate region of the flat, wherein each of the plurality of separate portions comprises a plurality of pixels, and wherein the flat is a 2D representation of a 4D light-field that captures both spatial and angular information of the scene; crop each of the plurality of separate portions to an m1×
m2 pixel subregion of the respective portion to generate a plurality of m1×
m2 pixel subregions from the plurality of separate portions, where at least one of m1 and m2 is an integer greater than or equal to two; andassemble the plurality of subregions to produce a single image of the scene. - View Dependent Claims (10, 11, 12, 13, 14, 15, 16)
-
-
17. A non-transitory computer-readable storage medium storing program instructions, wherein the program instructions are computer-executable to implement:
-
obtaining a flat comprising a plurality of separate portions of an image of a scene, wherein each of the plurality of separate portions is in a separate region of the flat, wherein each of the plurality of separate portions comprises a plurality of pixels, and wherein the flat is a 2D representation of a 4D light-field that captures both spatial and angular information of the scene; generating a plurality of m1×
m2 pixel subregions from the plurality of separate portions, wherein said generating comprises cropping each of the plurality of separate portions to an m1×
m2 pixel subregion of the respective portion, where at least one of m1 and m2 is an integer greater than or equal to two; andassembling the plurality of subregions to produce a single high-resolution image of the scene. - View Dependent Claims (18, 19, 20, 21, 22, 23)
-
-
24. A non-transitory computer-readable storage medium storing program instructions, wherein the program instructions are computer-executable to implement:
-
obtaining a flat comprising a plurality of separate portions of an image of a scene, wherein each of the plurality of separate portions is in a separate region of the flat, wherein each of the plurality of separate portions comprises a plurality of pixels, and wherein the flat is a 2D representation of a 4D light-field that captures both spatial and angular information of the scene; examining each of two or more of the plurality of separate portions to determine a direction of movement of edges within the two or more separate portions, wherein said examining is performed in a direction, and wherein an edge is a feature of the image of the scene that appears in one or more of the portions; detecting that the direction of movement of edges in the two or more separate portions is the same as the direction in which said examining is performed; inverting at least the two or more separate portions relative to their respective centers in response to said detecting; and assembling the plurality of separate portions to produce a single high-resolution image of the scene.
-
Specification