SYSTEMS AND METHODS FOR IMAGE RECONSTRUCTION

• US 20170168285A1
• Filed: 12/14/2016
• Published: 06/15/2017
• Est. Priority Date: 12/14/2015
• Status: Abandoned Application

• Current Assignee: Regents of the University of California (University of California)
• Original Assignee: Regents of the University of California (University of California)
• Inventors: Luo, Wei, Ozcan, Aydogan
• Application Number:
  US15/379,143
• Publication Number:
  US 20170168285A1
• Time in Patent Office: Days
• CPC Class Codes: G02B 21/0008 Microscopes having a simple construction, e.g. portable microscopes
• CPC Class Codes: G02B 21/0056 based on optical coherence, e.g. phase-contrast arrangements, interference arrangements
• CPC Class Codes: G02B 21/365 Control or image processing arrangements for digital or video microscopes G02B21/361, G02B21/362 take precedence
• CPC Class Codes: G02B 21/367 providing an output produced by processing a plurality of individual source images, e.g. image tiling, montage, composite images, depth sectioning, image comparison
• CPC Class Codes: G03H 1/0443 Digital holography, i.e. recording holograms with digital recording means holobject computation G03H1/0866
• CPC Class Codes: G03H 1/0866 Digital holographic imaging, i.e. synthesizing holobjects from holograms
• CPC Class Codes: G03H 2001/0447 In-line recording arrangement
• CPC Class Codes: G03H 2001/046 Synthetic aperture
• CPC Class Codes: G03H 2222/34 Multiple light sources
• CPC Class Codes: H04N 23/56 provided with illuminating means

Abstract

A method for obtaining a high resolution image of objects contained within a sample is disclosed that combines pixel super-resolution and phase retrieval techniques into a unified algorithmic framework that enables new holographic image reconstruction methods with significantly improved data efficiency, i.e., using much less number of raw measurements to obtain high-resolution and wide-field reconstructions of the sample. Using the unified algorithmic framework, twin image noise and spatial aliasing signals, along with other digital holographic artifacts, can be interpreted as noise terms modulated by digital phasors, which are all analytical functions of the imaging parameters including e.g., the lateral displacement between the hologram and the sensor array planes (x, y shifts), sample-to-image sensor distance (z), illumination wavelength (λ), and the angle of incidence (θ,φ).

Claims

1. A method for obtaining a high resolution image of one or more objects contained within a sample comprising:

illuminating the sample with a light source emitting partially coherent light or coherent light, wherein the sample is interposed between the light source and an image sensor with a sample-to-image sensor distance z_k;

obtaining a plurality of lower resolution hologram image frames of the objects with the image sensor, wherein the plurality of lower resolution hologram image frames are obtained at different (1) sample-to-image sensor distances z_k or (2) different illumination angles θ

_k,φ

_k;

generating from the plurality of lower resolution hologram image frames a high-resolution initial guess of the objects based on a summation of upsampled holograms in the lower resolution image frames;

iteratively eliminating twin image noise, aliasing signal, and artifacts and retrieving phase information from the high-resolution initial guess, wherein the iterative process comprises;

forward-propagating the high-resolution initial guess from an object plane to an image sensor plane to generate a high-resolution forward-propagated field;

updating an amplitude of the high-resolution forward-propagated field using holograms in the lower resolution hologram image frames;

back-propagating the updated high-resolution forward-propagated field to the object plane;

updating a transmitted field of the object at the object plane in the spatial frequency domain; and

outputting a phase retrieved high resolution image of the one or more objects contained within the sample based on the updated transmitted field of the one or more objects.

2. The method of claim 1, further comprising obtaining a plurality of additional lower resolution hologram image frames of the one or more objects with the image sensor, wherein the additional lower resolution hologram image frames are obtained using sub-pixel lateral shifts and wherein the additional lower resolution hologram image frames are used to generate the high-resolution initial guess of the objects.

3. The method of claim 2, wherein the sub-pixel lateral shifts are obtained at a single sample-to-image sensor distance z_k.

4. The method of claim 2, wherein the sub-pixel lateral shifts are obtained at a single illumination angles θ

_k,φ

_k.

5. The method of claim 1, wherein the sample comprises a biological sample.

6. The method of claim 1, wherein the sample comprises a pathology sample.

7. The method of claim 1, wherein the plurality of lower resolution hologram image frames comprise less than fifty (50) image frames.

8. The method of claim 1, wherein the light source comprises a wavelength-tunable light source and wherein the plurality of lower resolution hologram image frames of the objects with the image sensor are obtained at different illumination wavelengths λ

_k.

9. The method of claim 8, wherein the different illumination wavelengths λ

_k separated by one another by at least 2 nm.

10. The method of claim 8, wherein the different illumination wavelengths λ

_k are within a spectrum range less than 30 nm.

11. A method for obtaining a high resolution image of one or more objects contained within a sample comprising:

sequentially illuminating the sample at a plurality of different wavelengths with a light source emitting partially coherent light or coherent light, wherein the sample is interposed between the light source and an image sensor with a sample-to-image sensor distance z_k;

obtaining a plurality of lower resolution hologram image frames of the objects with the image sensor at the plurality of different wavelengths, wherein the plurality of lower resolution hologram image frames are also obtained at different (1) sample-to-image sensor distances z_k or (2) different illumination angles θ

_k,φ

_k;

generating from the plurality of lower resolution hologram image frames a high-resolution initial guess of the objects based on a summation of upsampled holograms in the lower resolution image frames;

iteratively eliminating twin image noise, aliasing signal, and artifacts and retrieving phase information from the high-resolution initial guess, wherein the iterative process comprises;

forward-propagating the high-resolution initial guess from an object plane to an image sensor plane to generate a high-resolution forward-propagated field;

updating an amplitude of the high-resolution forward-propagated field using holograms in the lower resolution hologram image frames;

back-propagating the updated high-resolution forward-propagated field to the object plane;

updating a transmitted field of the object at the object plane in the spatial frequency domain; and

outputting a phase retrieved high resolution image of the objects contained within the sample based on the updated transmitted field of the object.

12. The method of claim 11, wherein the plurality of different wavelengths are separated by one another by at least 2 nm.

13. The method of claim 11, wherein the plurality of different wavelengths span a wavelength range of less than 30 nm.

14. The method of claim 11, wherein the phase retrieved high resolution image comprises a phase unwrapped image obtained from the plurality of different wavelengths.

15. The method of claim 11, wherein the sample comprises a biological sample.

16. The method of claim 11, wherein the sample comprises a pathology sample.

17. A wavelength scanning pixel super-resolution microscope device for imaging a sample comprising:

a sample holder configured to hold the sample;

a wavelength-tunable light source or multiple different light sources configured to illuminate the sample at a plurality of different wavelengths λ

_k along an optical path;

a lens or set of lenses disposed along the optical path;

an image sensor configured to receive illumination passing through the sample and lens or set of lenses along the optical path, wherein the at least one of the sample holder, lens, set of lenses, or image sensor are moveable along the optical path to introduce incremental defocusing conditions to the microscope device, wherein the image sensor obtains a plurality of images of the sample at the different wavelengths under the incremental defocusing conditions; and

at least one processor configured to (1) generate a high-resolution initial guess of the sample image based on the plurality of images of the sample at the different wavelengths under the incremental defocusing conditions, (2) iteratively eliminate artifacts and retrieving phase information from the high-resolution initial guess of the sample image, and (3) output a high resolution, phase retrieved high resolution image of the sample.

18. The wavelength scanning pixel super-resolution microscope device of claim 17, wherein the lens or set of lenses comprises an objective lens and the objective lens is moved incrementally.

19. The wavelength scanning pixel super-resolution microscope device of claim 17, wherein the different illumination wavelengths λ

_k separated by one another by at least 2 nm.

20. The wavelength scanning pixel super-resolution microscope device of claim 17, wherein the incremental defocusing conditions are created by moving one or more of the sample, image sensor, or the lens or set of lenses.