Fast Computational Camera Based On Two Arrays of Lenses

• US 20090102956A1
• Filed: 10/18/2007
• Published: 04/23/2009
• Est. Priority Date: 10/18/2007
• Status: Active Grant

• Current Assignee: Adobe Inc.
• Original Assignee: Adobe Systems Incorporated (Adobe Inc.)
• Inventors: Georgiev, Todor G.
• Granted Patent: US 7,956,924 B2
• Time in Patent Office: Days
• US Class Current: 348/315
• CPC Class Codes: G02B 7/343 using light beam separating prisms

Abstract

Method and apparatus for a fast (low F/number) computational camera that incorporates two arrays of lenses. The arrays include a lenslet array in front of a photosensor and an objective lens array of two or more lenses. Each lens in the objective lens array captures light from a subject. Each lenslet in the lenslet array captures light from each objective lens and separates the captured light to project microimages corresponding to the objective lenses on a region of the photosensor under the lenslet. Thus, a plurality of microimages are projected onto and captured by the photosensor. The captured microimages may be processed in accordance with the geometry of the objective lenses to align the microimages to generate a final image. One or more other algorithms may be applied to the image data in accordance with radiance information captured by the camera, such as automatic refocusing of an out-of-focus image.

Claims

1. A camera, comprising:

a photosensor configured to capture images projected onto the photosensor;

an objective lens array comprising N discrete objective lenses, wherein N is an integer greater than or equal to two, wherein each objective lens is configured to refract light from a subject located in front of an aperture of the camera; and

a lenslet array located between the objective lens array and the photosensor, wherein the lenslet array comprises M lenslets, where M is an integer greater than or equal to two, wherein each lenslet in the lenslet array is configured to;

refract light from each of the N objective lenses in the objective lens array; and

separate the light refracted from the N objective lenses and project the separated light onto N separate subregions of a region of the photosensor corresponding to the lenslet to thus project N separate images of the subject onto the region of the photosensor.

2. The camera as recited in claim 1, wherein the photosensor is a charge-coupled device (CCD).

3. The camera as recited in claim 1, wherein the photosensor is configured to capture the (N*M) separate images projected onto the photosensor by the plurality of lenslets.

4. The camera as recited in claim 3, wherein the camera is configured to provide the captured (N*M) separate images projected onto the photosensor by the plurality of lenslets to a module, wherein the module is configured to align and combine the (N*M) separate images to generate a final image of the subject in accordance with an algorithm for aligning and combining the (N*M) separate images according to geometry of the N objective lenses in the objective lens array.

5. The camera as recited in claim 4, wherein the module is further configured to determine radiance information for the image of the subject from the captured (N*M) separate images of the subject.

6. The camera as recited in claim 4, wherein the module is a component of the camera.

7. The camera as recited in claim 4, wherein the module is implemented in a computing device separate from the camera.

8. The camera as recited in claim 1, wherein the objective lens array, the lenslet array, and the photosensor are configured to fit within a volume that is no less than 10×

10×

10 millimeters and no more than 200×

200×

200 millimeters.

9. The camera as recited in claim 1, wherein each objective lens has an F/number of F/10 to F/100 and each lenslet has an F/number of F/0.7 to F/2.

10. The camera as recited in claim 1, wherein the objective lenses are arranged in the objective lens array in a regular geometric shape.

12. The camera as recited in claim 1, wherein the photosensor comprises at least P discrete pixels, where P=(N*M).

13. The camera as recited in claim 1, wherein pixel size of the photosensor is Ito 5 microns.

14. The camera as recited in claim 1, wherein the camera has an F/number of F/0.7 to F/2.

15. The camera as recited in claim 1, wherein the camera further comprises a memory for storing image information captured by the camera.

11. The camera as recited in claim 11, wherein the regular geometric shape is a polygon, and wherein the number of objective lenses is less than or equal to 10,000.

16. A method for capturing a digital image of a subject, comprising:

refracting light from the subject at an objective lens array of a camera, wherein the objective lens array comprises a plurality of objective lenses, wherein each objective lens is configured to refract light from the subject located in front of an aperture of the camera;

refracting light from each of the plurality of objective lenses in the objective lens array at each of a plurality of lenslets of a lenslet array located between the objective lens array and a photosensor configured to capture images projected onto the photosensor;

separating, at each lenslet in the lenslet array, the light refracted from the plurality of objective lenses and projecting the separated light onto a plurality of separate subregions of a region of the photosensor corresponding to the lenslet to thus project a plurality of separate images of the subject onto the region of the photosensor; and

capturing, at the photosensor, the plurality of separate images projected onto the photosensor by the plurality of lenslets.

17. The method as recited in claim 16, further comprising aligning and combining the plurality of separate images to generate a final digital image of the subject in accordance with an algorithm for aligning and combining the plurality of separate images according to geometry of the plurality of objective lenses in the objective lens array.

18. The method as recited in claim 16, further comprising determining radiance information for the image of the subject from the captured plurality of separate images of the subject.

19. The method as recited in claim 16, wherein the objective lens array, the lenslet array, and the photosensor are configured to fit within a volume that is no less than 10×

10×

10 millimeters and no more than 200×

200×

200 millimeters.

20. The method as recited in claim 16, wherein each objective lens has an F/number of F/10 to F/100 and each lenslet has an F/number of F/0.7 to F/2.

21. The method as recited in claim 16, wherein the objective lenses are arranged in the objective lens array in a regular geometric shape.

22. The method as recited in claim 21, wherein the regular geometric shape is a polygon, and wherein the number of objective lenses is less than or equal to 10,000.

23. The method a recited in claim 16, wherein the photosensor comprises at least P discrete pixels, where P=(N*M).

24. The method as recited in claim 16, wherein pixel size of the photosensor is 1 to 5 microns.

25. The method as recited in claim 16, wherein the camera has an F/number of F/0.7 to F/2.