Methods and Apparatus for Full-Resolution Light-Field Capture and Rendering

• US 20110211824A1
• Filed: 05/09/2011
• Published: 09/01/2011
• Est. Priority Date: 01/23/2008
• Status: Active Grant

• Current Assignee: Adobe Inc.
• Original Assignee: Andrew Lumsdaine, Todor G. Georgiev
• Inventors: Georgiev, Todor G., Lumsdaine, Andrew
• Granted Patent: US 8,160,439 B2
• Time in Patent Office: Days
• US Class Current: 396/332
• CPC Class Codes: G02B 27/0075 with means for altering, e.g. increasing, the depth of field or depth of focus
• CPC Class Codes: G03B 15/00 Special procedures for taking photographs; Apparatus therefor
• CPC Class Codes: G03B 35/08 by simultaneous recording
• CPC Class Codes: G03B 35/24 using apertured or refractive resolving means on screens or between screen and eye
• CPC Class Codes: H04N 23/957 Light-field or plenoptic cameras or camera modules

Abstract

Method and apparatus for full-resolution light-field capture and rendering. A radiance camera is described in which the microlenses in a microlens array are focused on the image plane of the main lens instead of on the main lens, as in conventional plenoptic cameras. The microlens array may be located at distances greater than f from the photosensor, where f is the focal length of the microlenses. Radiance cameras in which the distance of the microlens array from the photosensor is adjustable, and in which other characteristics of the camera are adjustable, are described. Digital and film embodiments of the radiance camera are described. A full-resolution light-field rendering method may be applied to light-fields captured by a radiance camera to render higher-resolution output images than are possible with conventional plenoptic cameras and rendering methods.

Claims

1-38. -38. (canceled)

39. An imaging device, comprising:

a photosensor that captures light projected onto the photosensor;

an objective lens, wherein the objective lens refracts light from a scene located in front of the imaging device to form an image of the scene at an image plane of the objective lens; and

an array of microlenses positioned between the objective lens and the photosensor, wherein the image plane is located in front of or behind the array of microlenses, and wherein each microlens is focused on the image plane and not on the objective lens;

wherein each microlens projects a respective portion of the image of the scene formed at the image plane by the objective lens onto a respective region of the photosensor to form, on the photosensor, a light-field image comprising a plurality of microimages of the scene, each microimage corresponding to a respective microlens in the array of microlenses.

40. The imaging device as recited in claim 39, where the array of microlenses is positioned at a distance from the photosensor that is greater than or less than the focal length of the microlenses.

41. The imaging device as recited in claim 39, where the imaging device further comprises a mechanism for adjusting distance from the array of microlenses to the photosensor.

42. The imaging device as recited in claim 41, wherein the mechanism automatically adjusts the distance from the array of microlenses to the photosensor in response to detecting a change in an optical characteristic of the imaging device.

43. The imaging device as recited in claim 39, wherein the photosensor is a digital medium or a film.

44. The imaging device as recited in claim 39, wherein the imaging device captures the light-field image of the scene formed on the photosensor to generate a captured light-field image.

45. The imaging device as recited in claim 44, wherein the imaging device stores the captured light-field image to a memory device.

46. A method, comprising:

receiving light from a scene located in front of an imaging device at an objective lens of the imaging device;

refracting light from the objective lens to form an image of the scene at an image plane of the objective lens; and

projecting, by an array of microlenses positioned between the objective lens and a photosensor of the imaging device, respective portions of the image of the scene formed at the image plane by the objective lens onto respective regions of the photosensor, wherein the image plane is located in front of or behind the array of microlenses, and wherein each microlens is focused on the image plane and not on the objective lens;

wherein the respective portions of the image of the scene projected onto the respective regions of the photosensor by the array of microlenses form a light-field image on the photosensor, the light-field image comprising a plurality of separate microimages of the scene, each microimage corresponding to a respective microlens in the array of microlenses.

47. The method as recited in claim 46, where the array of microlenses is positioned at a distance from the photosensor that is greater than or less than the focal length of the microlenses.

48. The method as recited in claim 46, further comprising adjusting distance from the array of microlenses to the photosensor.

49. The method as recited in claim 46, further comprising:

detecting a change in an optical characteristic of the imaging device; and

automatically adjusting distance from the array of microlenses to the photosensor in response to said detecting.

50. The method as recited in claim 46, wherein the photosensor is a digital medium or a film.

51. The method as recited in claim 46, further comprising capturing, by the imaging device, the light-field image of the scene formed on the photosensor to generate a captured light-field image.

52. The method as recited in claim 51, further comprising storing the captured light-field image to a memory device.

53. An optical imaging system, comprising:

an objective lens configured to refract light from a scene located in front of the imaging device to form an image of the scene at an image plane behind the objective lens; and

an array of microlenses focused on the image plane and configured to project respective portions of the image of the scene formed at the image plane by the objective lens onto respective regions of a photosensor to form a light-field image on the photosensor, the light-field image comprising an array of microimages of the scene, each microimage corresponding to a respective microlens in the array of microlenses.

54. The optical imaging system as recited in claim 53, wherein the image plane is located in front of or behind the array of microlenses.

55. The optical imaging system as recited in claim 53, wherein distance from the array of microlenses to the photosensor is greater than or less than the focal length of the microlenses.

56. The optical imaging system as recited in claim 53, where the optical imaging system is configured to adjust distance from the array of microlenses to the photosensor.

57. The optical imaging system as recited in claim 53, wherein the photosensor is configured to capture the light-field image of the scene formed on the photosensor to generate a captured light-field image.

58. The optical imaging system as recited in claim 57, wherein the photosensor is configured to store the captured light-field image to a memory device.