Computerized adaptive imaging

• US 6,658,142 B1
• Filed: 01/27/1999
• Issued: 12/02/2003
• Est. Priority Date: 12/01/1998
• Status: Expired due to Fees

• Current Assignee: Regents of the University of California (University of California), Yeda Research and Development Co. Ltd. (Weizmann Institute of Science)
• Original Assignee: Regents of the University of California (University of California), Yeda Research and Development Co. Ltd. (Weizmann Institute of Science)
• Inventors: Agard, David A., Hanser, Bridget M., Kam, Zvi, Sedat, John W.
• Primary Examiner(s): Patel, Jayanti K.
• Assistant Examiner(s): Choobin, Barry
• Application Number:
  US09/238,225
• Time in Patent Office: 1,770 Days
• Field of Search: 382/130, 382/128, 514/356, 250/548, 250/201.9, 345/419
• US Class Current: 382/130
• CPC Class Codes: G02B 21/0072 details concerning resolution or correction, including general design of CSOM objectives
• CPC Class Codes: G02B 21/008 Details of detection or image processing, including general computer control
• CPC Class Codes: G06T 1/00 General purpose image data processing

Abstract

Apparatus for computational adaptive imaging comprises the following:

an image information acquirer, which provides information relating to the refractive characteristics in a three-dimensional imaged volume;

a ray tracer, which uses the information relating to the refractive characteristics to trace a multiplicity of rays from a multiplicity of locations in the three-dimensional imaged volume through the three-dimensional imaged volume, thereby providing a location dependent point spread function; and

a deconvolver, which uses the location dependent point spread function, to provide an output image corrected for distortions due to variations in the refractive characteristics in the three-dimensional imaged volume.

Claims

1. Apparatus for three-dimensional image processing, comprising:

an imaging system reading a three dimensional map of variations in the refractive characteristics in a volume;

a ray tracer, utilizing said three dimensional map to analytically trace a multiplicity of rays from a multiplicity of locations in said volume through said volume, thereby providing a location dependent point spread function; and

a three dimensional deconvolver, utilizing the location dependent point spread function, to provide an output image corrected for distortions due to three dimensional variations in the refractive characteristics in said volume.

2. Apparatus according to claim 1 wherein the imaging system is adapted to obtain refractive index information from DIC, or from phase microscopy or from fluorescence.

3. Apparatus according to claim 1 wherein the imaging system is adapted to utilise previously determined refractive characteristics.

4. Apparatus according to claim 1 and wherein the three dimensional map comprises at least two three-dimensional images of said volume, at least one of the two three-dimensional images containing information relating to the refractive characteristics in said volume.

5. Apparatus according to claim 4 and wherein the three dimensional map comprises at least three three-dimensional images of said volume.

6. Apparatus according to claim 4 and wherein the three dimensional map comprises a plurality of three-dimensional images of said volume, each of the images having a discrete wavelength band.

7. Apparatus according to claim 4 and wherein the three dimensional map comprises a multiplicity of three-dimensional images of said volume, each -of the images having a wavelength band which is part of a continuum represented by the wavelength bands of the multiplicity of three-dimensional images.

8. Apparatus according to claim 4 wherein the three dimensional map comprises a single three-dimensional image of said volume.

9. Apparatus according to claim 4 and wherein at least one of the ray tracer and the deconvolver utilize the three dimensional map of variations in the refractive characteristics in said volume obtained from one of the three-dimensional images to correct at least another one of the three-dimensional images.

10. Apparatus according to claim 9 wherein the ray tracer includes effects on the image of at least one of absorptions, reflections and scattering in the sample.

11. Apparatus according to claim 1, and wherein the imaging system provides electromagnetic energy images.

12. Apparatus according to claim 11 and wherein the electromagnetic energy is infrared energy.

13. Apparatus according to claim 1, and wherein the imaging system provides non-electromagnetic energy images.

14. Apparatus according to claim 1, and wherein the imaging system receives digital image data from a digital image source and derives therefrom said three-dimensional map of variations in the refractive characteristics in said volume.

15. Apparatus according to claim 1, and wherein the imaging system, the ray tracer and the deconvolver operate repeatedly over time to provide a multiplicity of output images, each corrected for distortions due to three-dimensional variations in the refractive characteristics in said volume.

16. Apparatus according to claim 1, and wherein the output image is an acoustic image and the refractive characteristics are characteristics of a material which influence the passage of acoustic energy therethrough.

17. Apparatus according to claim 1, and wherein the output image is an electromagnetic image and the refractive characteristics are characteristics of a material which influence the passage of electromagnetic energy therethrough.

30. Apparatus according to claim 1, and wherein said image processing is computational adaptive three-dimensional image processing.

31. Apparatus according to claim 1, and wherein said three dimensional map of variations in the refractive characteristics is obtained from measurement of the gradient of said three-dimensional refractive characteristic of said volume at at least one point using DIC microscopy, and computational integration performed therefrom.

18. A method for three-dimensional image processing comprising the steps of:

providing an imaging system;

utilizing said imaging system for reading a three dimensional map of variations in the refractive characteristics in a volume;

analytically ray tracing, utilizing said three dimensional map, a multiplicity of rays from a multiplicity of locations in said volume through said volume, thereby providing a location dependent point spread function; and

three-dimensionally deconvoluting, utilizing the location dependent point spread function, thereby providing an output image corrected for distortions due to three dimensional variations in the refractive characteristics in said volume.

19. A method according to claim 18, and also comprising the step of adding in an imaging path a three-dimensional medium with refractive properties that correct for the distortions of the three-dimensional sample.

20. A method according to claim 18 and wherein the step of reading a three dimensional map comprises acquiring at least two three-dimensional images of a said volume, at least one of the two three-dimensional images containing information relating to the refractive characteristics in said volume.

21. A method according to claim 20 and wherein the step of reading a three dimensional map comprises acquiring at least three three-dimensional images of said volume.

22. A method according to claim 20 and wherein the step of reading a three dimensional map comprises acquiring a plurality of three-dimensional images of said volume, each the images having a discrete wavelength band.

23. A method according to claim 20 and wherein the step of reading a three dimensional map comprises acquiring a multiplicity of three-dimensional images of said volume, each of the images having a wavelength band which is part of a continuum represented by the wavelength bands of the multiplicity of three-dimensional images.

24. A method according to claim 18, and wherein said imaging system provides electromagnetic energy images.

25. A method according to claim 24 and wherein the electromagnetic images are infrared images.

26. A method according to claim 18, and wherein said imaging system provides non-electromagnetic images.

27. A method according to claim 18, and wherein the step of utilizing said imaging system comprises receiving digital image data from a digital image source and deriving therefrom a three dimensional map of variations in the refractive characteristics along a multiplicity of light paths in said volume.

28. A method according to claim 18, and wherein the steps of reading a three dimensional map, ray tracing and deconvoluting operate repeatedly over time to provide a multiplicity of output images, each corrected for distortions due to variations in the three-dimensional refractive characteristics in said volume.

29. A method according to claim 28 wherein the three-dimensional refractive characteristics are estimated.

32. A method according to claim 18, and wherein said image processing is computational adaptive three-dimensional image processing.

33. A method according to claim 18, and wherein said step of utilizing said imaging system for reading a three dimensional map of variations in the refractive characteristics in a volume is performed by measurement of the gradient of said three-dimensional refractive characteristic of said volume at at least one point using DIC microscopy, and performing computational integration therefrom.