Microscopy arrangements and approaches

• US 7,723,662 B2
• Filed: 10/06/2006
• Issued: 05/25/2010
• Est. Priority Date: 10/07/2005
• Status: Active Grant

• Current Assignee: Board of Trustees of the Leland Stanford Junior University (Stanford University)
• Original Assignee: Board of Trustees of the Leland Stanford Junior University (Stanford University)
• Inventors: Ng, Yi-Ren, Horowitz, Mark A., Levoy, Marc S.
• Primary Examiner(s): Sohn; Seung C
• Application Number:
  US12/089,371
• Publication Number:
  US 20080266655A1
• Time in Patent Office: 1,327 Days
• Field of Search: 250/208.1, 250/227.2
• US Class Current: 250/208.1
• CPC Class Codes: G02B 21/361 Optical details, e.g. image relay to the camera or image sensor G02B21/364 takes precedence; illumination details G02B21/06 and subgroups
• CPC Class Codes: G02B 21/367 providing an output produced by processing a plurality of individual source images, e.g. image tiling, montage, composite images, depth sectioning, image comparison
• CPC Class Codes: G02B 27/0075 with means for altering, e.g. increasing, the depth of field or depth of focus

Abstract

Light-field microscopy is facilitated using an approach to image computation. In connection with an example embodiment, a subject (e.g., 105) is imaged by passing light from the subject through a microlens array (e.g., 120) to a photosensor array (e.g., 130) to simultaneously detect light from the subject that is passed through different directions to different locations. In certain embodiments, information from the detected light is used to compute refocused images, perspective images and/or volumetric datasets, from a single-shot photograph.

Claims

1. A light-field microscopy system for imaging a specimen in a light-field microscope arrangement, the system comprising:

an objective lens;

a photosensor array; and

a microlens array located at an intermediate image plane between the photosensor array and the objective lens, wherein the photosensor array detects light rays passing from the objective lens and through the microlens array at a resolution that is sufficiently high to record a light field of the specimen for computing a three-dimensional volume image dataset of the specimen.

2. The system of claim 1, wherein the photosensor array and the microlens array are arranged to facilitate the detection of a light field from the specimen, and to provide light data for computing an image of the specimen using the light field from the specimen.

3. The system of claim 1, wherein the microlens array and photosensor array are respectively arranged to detect light and to provide, for each microlens, at least two sample image portions of the specimen, and to provide directional information regarding light from the specimen.

4. The system of claim 1, wherein the ƒ

-number of the image-side of the objective lens matches the ƒ

-number of the microlenses.

5. A light-field microscopy system for collecting data useful for digitally imaging a specimen in a light-field microscope arrangement, the system comprising:

an objective lens;

a photosensor array;

a microlens array located at an intermediate image plane between the photosensor array and the objective lens, where the photosensor array detects light rays passing from the objective lens and through the microlens array; and

a processor configured to receive data from the photosensor array and to compute an image of the specimen, the data characterizing light detected at the photosensor array at a resolution sufficiently high for the processor to compute the image as a three-dimensional volume dataset using one of;

3D convolution, tomography, and a stack of images where each image in the stack is focused to a different depth into the specimen.

6. The system of claim 5, wherein the processor computes a three-dimensional volume dataset of the specimen using 3D deconvolution.

7. The system of claim 5, wherein the processor computes a three-dimensional volume dataset of the specimen using tomography.

8. The system of claim 5, wherein the processor computes a stack of images, each image in the stack focused to a different depth into the specimen, relative to the objective, and computes a three-dimensional volume dataset of the specimen via the combination of the stack of images.

9. The system of claim 5, wherein the processor is implemented with a light-field microscope arrangement having the objective lens, photosensor array and microlens array.

10. The system of claim 5, wherein the processor is separate from an arrangement with the objective lens, photosensor array and microlens array.

11. The system of claim 5, further including at least one filter between the microlens array and the objective lens.

12. The system of claim of claim 5, wherein computing an output image includes refocusing the detected light to form an image having at least a portion thereof focused at a different plane than the focal plane of the microscope.

13. The system of claim 5, wherein the processor is adapted to use light data from the photosensor array to record a light field to determine a desirable plane of focus, and to provide information for positioning at least a portion of the light-field microscope arrangement for recording a final image of the specimen without the microlens array.

14. The system of claim 5, wherein the processor is adapted to use the light data from the photosensor array to provide information for positioning at least a portion of the light-field microscope arrangement in order to follow the motion of a moving specimen.

16. The system of claim 5, wherein the processor computes a perspective image of the specimen.

17. The system of claim 5, wherein the processor computes an oblique image of the specimen.

18. The system of claim 5, wherein the processor computes an image of the specimen with an extended depth of field.

15. A light-field microscopy system for collecting data useful for digitally imaging a specimen in a light- field microscope arrangement, the system comprising:

an objective lens;

a photosensor array;

a microlens array located at an intermediate image plane between the photosensor array and the objective lens, the photosensor array being configured to detect light rays passing through the microlens array;

a second microlens array in the illumination path that facilitates the illumination of the specimen with an arbitrary four-dimensional light field; and

a processor configured to

receive, from the photosensor array, data characterizing light detected at the photosensor array, and

compute an image of the specimen using the received data.

19. A light-field microscopy system for collecting data useful for digitally imaging a specimen in a light-field microscope arrangement, the system comprising:

an objective lens;

a photosensor array;

a microlens array located at an intermediate image plane between the photosensor array and the objective lens, where the photosensor array detects light rays from the specimen, passing from the objective lens and through the microlens array; and

a processor configured to receive data from the photosensor array and to compute an image of the specimen using the received data, the data characterizing a light field detected at the photosensor array at a resolution sufficiently high for the processor to compute the image as a three-dimensional volume dataset of the specimen.

20. The system of claim 19, wherein the microlens array includes a number of microlenses that sets the spatial resolution of the detected light field and the number of pixels in the computed image.

21. The system of claim 19, wherein the microlens array and photosensor array are configured to set the angular resolution of the detected light field by setting the number of resolvable spots in each microlens sub-image.

22. The system of claim 19, wherein the microlens array and photosensor array are configured to set the angular resolution of the detected light field by setting the number of unique oblique views that can be computed from each microlens sub-image.

23. The system of claim 19, wherein the processor is configured to compute an image of the specimen by computing a plurality of volume images that respectively represent an image of a slice of the specimen.

24. The system of claim 19, wherein

the processor is configured to compute an image of the specimen by computing a plurality of volume images that respectively represent slices of the specimen, and

the microlens array and photosensor array are configured to set the number of the slices with non-overlapping depths of field in focal stacks computed from the detected light field.