IMAGE FORMING METHOD AND IMAGE FORMING APPARATUS

• US 20150185460A1
• Filed: 12/15/2014
• Published: 07/02/2015
• Est. Priority Date: 12/26/2013
• Status: Abandoned Application

• Current Assignee: Olympus Corporation
• Original Assignee: Olympus Corporation
• Inventors: ISHIWATA, Hiroshi, NAKASHO, Eiji
• Application Number:
  US14/571,244
• Publication Number:
  US 20150185460A1
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G02B 21/0056 based on optical coherence, e.g. phase-contrast arrangements, interference arrangements
• CPC Class Codes: G02B 21/008 Details of detection or image processing, including general computer control
• CPC Class Codes: G02B 21/16 adapted for ultraviolet illumination ; Fluorescence microscopes G02B21/0076 takes precedence

Abstract

An image forming method for a biological sample includes calculating a component corresponding to a phase distribution of the sample and a component corresponding to a matter other than the phase distribution according to a plurality of pieces of images with different image contrasts, to form a normalized phase component; separating the phase component image into a plurality of frequency components according to spatial frequencies of the image; merging the phase distribution of the refraction component and the phase distribution of the structure component calculated by applying a deconvolution process to each of the frequency components using an optical response characteristic corresponding to each, to calculate the phase distribution, and forming a phase distribution image from the calculated phase distribution; and merging the phase distribution image with an image of the sample in which a biochemical phenomenon and/or a physical phenomenon in the sample are visualized.

Claims

1. An image forming method for a biological sample, comprising:

capturing optical images of a biological sample formed by a microscope that converts a phase distribution into an image intensity distribution while changing an image contrast, to form a plurality of pieces of images with different image contrasts;

calculating a component corresponding to a phase distribution of the biological sample and a component corresponding to a matter other than the phase distribution of the biological sample according to the plurality of pieces of images, and forming a normalized phase component image by dividing the component corresponding to the phase distribution by the component corresponding to the matter other than the phase distribution of the biological sample;

separating the phase component image into a plurality of frequency components according to spatial frequencies of the image;

applying a deconvolution process to each of the frequency components using an optical response characteristic corresponding to each, to calculate a phase distribution of a refraction component formed by light refracted inside the biological sample and a phase distribution of a structure component formed by light diffracted in a structure inside the biological sample;

merging the phase distribution of the refraction component and the phase distribution of the structure component to calculate the phase distribution of the biological sample, and forming a phase distribution image from the calculated phase distribution of the biological sample; and

merging the phase distribution image of the biological sample with an image of the biological sample in which a biochemical phenomenon and/or a physical phenomenon in the biological sample are visualized and which is obtained using a method that is different from a method used for the phase distribution image.

2. The image forming method according to claim 1, wherein

the microscope is a differential interference contrast microscope that images a phase distribution of an observed object as an image intensity distribution;

and the image forming method further comprises;

switching a shear direction of the microscope; and

merging two phase distributions of the biological sample calculated in two shear directions before and after the switching.

3. The image forming method according to claim 1, further comprising:

applying a deconvolution process to the structure component using an optical response characteristic in a state of defocusing with respect to an observation plane to calculate a second phase distribution of the structure component;

comparing the second phase distribution of the structure component and the phase distribution of the structure component calculated using an optical response characteristic in a focused state with respect to the observation plane; and

removing a phase distribution in which the defocusing has caused a blur from the phase distribution of the structure component, according to a comparison result of the phase distributions;

wherein

the forming of the phase distribution image includes merging of a phase distribution in which the phase distribution in which the defocusing has caused a blur has been removed from the phase distribution of the structure component with the phase distribution of the refraction component.

4. The image forming method according to claim 1, further comprising:

changing a focal plane in an optical axis direction with respect to an observation plane;

comparing phase distributions of the structure component calculated for respective focal planes, to identify a phase distribution leaking from structures of the biological sample above and below the observation plane into the observation plane; and

removing the identified phase distribution from the phase distribution of the structure component.

5. The image forming method according to claim 1, wherein

the merging of the phase distribution image of the biological sample with the image obtained using a method that is different from a method used for the phase distribution image includes

performing position matching between the images according to coordinate information of the phase distribution image and coordinate information of the image obtained using a method that is different from a method used for the phase distribution image;

and

merging the phase distribution image with the image obtained using a method that is different from a method used for the phase distribution image for which position matching has been performed.

6. The image forming method according to claim 1, wherein

the merging of the phase distribution image of the biological sample with the image obtained using a method that is different from a method used for the phase distribution image includes

performing position matching between the images according to coordinate information and angle information of the phase distribution image and coordinate information and angle information of the image obtained using a method that is different from a method used for the phase distribution image;

and

merging the phase distribution image with the image obtained using a method that is different from a method used for the phase distribution image for which position matching has been performed.

7. The image forming method according to claim 5, wherein

the merging of the phase distribution image of the biological sample with the image obtained using a method that is different from a method used for the phase distribution image further includes performing matching of magnifications between the images according to magnification information of the phase distribution image and magnification information of the image obtained using a method that is different from a method used for the phase distribution image.

8. The image forming method according to claim 1, wherein

the image obtained using a method that is different from a method used for the phase distribution image is an image formed according to light emitted from the biological sample.

9. The image forming method according to claim 8, wherein

the image obtained using a method that is different from a method used for the phase distribution image is a fluorescence image of the biological sample.

10. An image forming apparatus comprising:

a microscope that converts a phase distribution of a biological sample into an image intensity distribution and that includes an image contrast changing unit which changes an image contrast of the image intensity distribution;

a control unit which controls the image contrast changing unit so as to obtain a plurality of pieces of images with different image contrasts;

an operating unit which calculates a component corresponding to the phase distribution of the biological sample and a component corresponding to a matter other than the phase distribution of the biological sample according to the plurality of pieces of images obtained with control by the control unit, and forms a normalized phase component image by dividing the component corresponding to the phase distribution by the component corresponding to the matter other than the phase distribution of the biological sample;

separates the phase component image into a plurality of frequency components according to spatial frequencies of the image;

applies a deconvolution process to each of the frequency components using an optical response characteristic corresponding to each, to calculate a phase distribution of a refraction component formed by light refracted inside the biological sample and a phase distribution of a structure component formed by light diffracted in a structure inside the biological sample; and

merges the phase distribution of the refraction component and the phase distribution of the structure component to calculate the phase distribution of the biological sample, and forms a phase distribution image from the calculated phase distribution of the biological sample; and

a merging unit which merges an image of the biological sample in which a biochemical phenomenon and/or a physical phenomenon in the biological sample are visualized and which is obtained using a method that is different from a method used for the phase distribution image with the phase distribution image of the biological sample formed by the operating unit.

11. The image forming apparatus according to claim 10, wherein

the merging unit is configured

to perform position matching between the images according to coordinate information of the phase distribution image and coordinate information of the image obtained using a method that is different from a method used for the phase distribution image;

and

to merge the phase distribution image with the image obtained using a method that is different from a method used for the phase distribution image for which position matching has been performed.

12. The image forming apparatus according to claim 10, wherein

the image obtained using a method that is different from a method used for the phase distribution image is a fluorescence image of the biological sample.

13. The image forming apparatus according to claim 10, wherein

the image obtained using a method that is different from a method used for the phase distribution image is obtained by the microscope.

14. The image forming apparatus according to claim 13, wherein

the image obtained using a method that is different from a method used for the phase distribution image is an image formed according to light emitted from the biological sample.

15. The image forming apparatus according to claim 14, wherein

the image obtained using a method that is different from a method used for the phase distribution image is a fluorescence image of the biological sample.