Method for analyzing biological specimens by spectral imaging

• US 9,129,371 B2
• Filed: 06/25/2012
• Issued: 09/08/2015
• Est. Priority Date: 06/25/2010
• Status: Active Grant

• Current Assignee: Cireca Theranostics, LLC
• Original Assignee: Cireca Theranostics, LLC
• Inventors: Remiszewski, Stanley, Thompson, Clay M.
• Primary Examiner(s): Bitar, Nancy
• Application Number:
  US13/507,386
• Publication Number:
  US 20120328178A1
• Time in Patent Office: 1,170 Days
• Field of Search: None
• US Class Current: 1/1
• CPC Class Codes: A61B 5/0071 by measuring fluorescence emission
• CPC Class Codes: A61B 5/0075 by spectroscopy, i.e. measuring spectra, e.g. Raman spectroscopy, infrared absorption spectroscopy A61B5/0071 takes precedence
• CPC Class Codes: A61B 5/7257 using Fourier transforms
• CPC Class Codes: G01N 2021/3595 using FTIR
• CPC Class Codes: G01N 21/314 with comparison of measurements at specific and non-specific wavelengths dual wavelength spectrometry G01J3/427
• CPC Class Codes: G01N 21/35 using infrared light G01N21/39 takes precedence
• CPC Class Codes: G01N 21/3581 using far infrared light; using Terahertz radiation
• CPC Class Codes: G06T 11/60 Editing figures and text; Combining figures or text
• CPC Class Codes: G06T 2207/10048 Infrared image
• CPC Class Codes: G06T 2207/10056 Microscopic image
• CPC Class Codes: G06T 2207/20221 Image fusion; Image merging
• CPC Class Codes: G06T 2207/30024 Cell structures in vitro; Tissue sections in vitro
• CPC Class Codes: G06T 2207/30204 Marker
• CPC Class Codes: G06T 7/33 using feature-based methods
• CPC Class Codes: G06T 7/337 involving reference images or patches
• CPC Class Codes: G06V 20/69 Microscopic objects, e.g. biological cells or cellular parts

Abstract

A method for registering a visual image and a spectral image of a biological sample includes aligning a first set of coordinate positions of a plurality of reticles on a slide holder and a second set of coordinate positions of the plurality of reticles on the slide holder. The method further includes generating a registered image of a visual image of a biological sample and a spectral image of the biological sample based upon the alignment of the first and second set of coordinate positions.

Claims

1. A method for registering a visual image and a spectral image of a biological sample, comprising:

receiving a first set of coordinate positions of a plurality of reticles on a slide or a slide holder with the biological sample;

receiving image features of a visual image of the biological sample;

receiving a second set of coordinate positions of the plurality of reticles on the slide or the slide holder with the biological sample;

receiving image features of a spectral image of the biological sample;

aligning the first set of coordinate positions independent from the image features of the visual image and the second set of coordinate positions independent from the image features of the spectral image; and

generating a registered image with the spectral image and the visual image based upon the alignment of the first set of coordinate positions and the second set of coordinate positions.

2. The method of claim 1, wherein generating the registered image occurs automatically based upon the alignment of the first set of image coordinate positions and the second set of image coordinate positions.

3. The method of claim 1, wherein the reticles establish a common coordinate system for the registered image.

4. The method of claim 1, further comprising:

performing optimization of the registered image.

5. A system for registering a visual image and a spectral image of a biological sample, comprising:

a processor;

a user interface functioning via the processor; and

a repository accessible by the processor;

wherein a first set of coordinate positions of a plurality of reticles on a slide or a slide holder with the biological sample is received;

wherein image features of a visual image of the biological sample is received;

wherein a second set of coordinate positions of the plurality of the reticles on the slide or the slide holder with the biological sample is received;

wherein image features of a spectral image of the biological sample is received;

wherein the first set of coordinate positions independent from the image features of the visual image is aligned with the second set of coordinate positions independent from the image features of the spectral image; and

wherein a registered image is generated with the spectral image and the visual image based upon the alignment of the first set of coordinate positions and the second set of coordinate positions.

6. A computer program product comprising a non-transitory computer usable medium having control logic stored therein for causing a computer to register a visual image and a spectral image of a biological sample, comprising:

receiving a first set of coordinate positions of a plurality of reticles on a slide or a slide holder with the biological sample;

receiving image features of a visual image of the biological sample;

receiving a second set of coordinate positions of the plurality of reticles on the slide or the slide holder with the biological sample;

receiving image features of a spectral image of the biological sample;

aligning the first set of coordinate positions independent from the image features of the visual image and the second set of coordinate positions independent from the image features of the spectral image; and

generating a registered image with the spectral image and the visual image based upon the alignment of the first set of coordinate positions and the second set of coordinate positions.

7. A method for image registration refinement, comprising:

receiving image features of a spectral image of a biological sample and image features of a visual image of the biological sample;

applying a first threshold value to the spectral image and a second threshold value to the visual image; and

generating a binary spectral image based on the first threshold value;

generating a binary visual image based on the second threshold value;

scaling a ratio between the spectral image and the visual image;

applying a normalization to the spectral image to improve the image features of the spectral image;

applying a morphological closure to the binary spectral image and the binary visual image;

aligning the image features of the spectral image with the image features of the visual image using the binary spectral image and the binary visual image; and

refining an image registration of the spectral image and the visual image based upon the alignment of the image features of the spectral image and the image features of the visual image.

8. The method of claim 7, wherein aligning the image features of the spectral image and the image features of the visual image improve the image registration of the spectral image and the visual image.

9. The method of claim 7, further comprising:

softening the edges in the binary spectral image and the binary visual image.

10. The method of claim 7, further comprising:

minimizing the grayscale difference between the binary spectral image and the binary visual image.

11. A system for image registration refinement, comprising:

a processor;

a user interface functioning via the processor; and

a repository accessible by the processor;

wherein image features of a spectral image of a biological sample and image features of a visual image of the biological sample are received;

wherein a first threshold value is applied to the spectral image and a second threshold value is applied to the visual image;

wherein a binary spectral image is generated based on the first threshold value;

wherein a binary visual image is generated based on the second threshold value;

wherein a ratio is scaled between the spectral image and the visual image;

wherein a normalization is applied to the spectral image to improve the image features of the spectral image;

wherein a morphological closure is applied to the binary spectral image and the binary visual image;

wherein the image features of the spectral image are aligned with the image features of the visual image using the binary spectral image and the binary visual image; and

wherein an image registration of the spectral image and the visual image is refined based upon the alignment of the image features of the spectral image and the image features of the visual image.

12. A computer program product comprising a non-transitory computer usable medium having control logic stored therein for causing a computer to refine a registered image, comprising:

receiving image features of a spectral image of a biological sample and image features of a visual image of the biological sample;

applying a first threshold value to the spectral image and a second threshold value to the visual image; and

generating a binary spectral image based on the first threshold value;

generating a binary visual image based on the second threshold value;

scaling a ratio between the spectral image and the visual image;

applying a normalization to the spectral image to improve the image features of the spectral image;

applying a morphological closure to the binary spectral image and the binary visual image;

aligning the image features of the spectral image with the image features of the visual image using the binary spectral image and the binary visual image; and

refining an image registration of the spectral image and the visual image based upon the alignment of the image features of the spectral image and the image features of the visual image.