Method for analyzing biological specimens by spectral imaging

• US 20120328178A1
• Filed: 06/25/2012
• Published: 12/27/2012
• Est. Priority Date: 06/25/2010
• Status: Active Grant

• Current Assignee: Cireca Theranostics, LLC
• Original Assignee: Cireca Theranostics, LLC
• Inventors: Remiszewski, Stanley, Thompson, Clay M.
• Granted Patent: US 9,129,371 B2
• Time in Patent Office: Days
• US Class Current: 382/133
• CPC Class Codes: A61B 5/0071 by measuring fluorescence emission
• CPC Class Codes: A61B 5/0075 by spectroscopy, i.e. measuring spectra, e.g. Raman spectroscopy, infrared absorption spectroscopy A61B5/0071 takes precedence
• CPC Class Codes: A61B 5/7257 using Fourier transforms
• CPC Class Codes: G01N 2021/3595 using FTIR
• CPC Class Codes: G01N 21/314 with comparison of measurements at specific and non-specific wavelengths dual wavelength spectrometry G01J3/427
• CPC Class Codes: G01N 21/35 using infrared light G01N21/39 takes precedence
• CPC Class Codes: G01N 21/3581 using far infrared light; using Terahertz radiation
• CPC Class Codes: G06T 11/60 Editing figures and text; Combining figures or text
• CPC Class Codes: G06T 2207/10048 Infrared image
• CPC Class Codes: G06T 2207/10056 Microscopic image
• CPC Class Codes: G06T 2207/20221 Image fusion; Image merging
• CPC Class Codes: G06T 2207/30024 Cell structures in vitro; Tissue sections in vitro
• CPC Class Codes: G06T 2207/30204 Marker
• CPC Class Codes: G06T 7/33 using feature-based methods
• CPC Class Codes: G06T 7/337 involving reference images or patches
• CPC Class Codes: G06V 20/69 Microscopic objects, e.g. biological cells or cellular parts

Abstract

A method for registering a visual image and a spectral image of a biological sample includes aligning a first set of coordinate positions of a plurality of reticles on a slide holder and a second set of coordinate positions of the plurality of reticles on the slide holder. The method further includes generating a registered image of a visual image of a biological sample and a spectral image of the biological sample based upon the alignment of the first and second set of coordinate positions.

Claims

1. A method for registering a visual image and a spectral image of a biological sample, comprising:

receiving a first set of coordinate positions of a plurality of reticles on a slide holder with the biological sample;

receiving a visual image of the biological sample;

receiving a second set of coordinate positions of the plurality of reticles on the slide holder with the biological sample;

receiving a spectral image of the biological sample;

aligning the first set of coordinates and the second set of coordinates; and

generating a registered image with the spectral image and the visual image based upon the alignment of the first set of coordinates and the second set of coordinates.

2. The method of claim 1, wherein generating the registered image occurs automatically based upon the alignment of the first set of image coordinate and the second set of image coordinates.

3. The method of claim 1, wherein the first set of coordinates and the second set of coordinates create a common coordinate system for the registered image.

4. The method of claim 1, wherein the first set of coordinates are independent from image features within the visual image.

5. The method of claim 1, wherein the second set of coordinates are independent from image features within the spectral image.

6. The method of claim 1, further comprising:

performing optimization of the registered image.

7. A system for registering a visual image and a spectral image of a biological sample, comprising:

a processor;

a user interface functioning via the processor; and

a repository accessible by the processor;

wherein a first set of coordinate positions of a plurality of reticles on a slide holder with the biological sample is received;

wherein a visual image of the biological sample is received;

wherein a second set of coordinate positions of the plurality of reticles on the slide holder with the biological sample is received;

wherein a spectral image of the biological sample is received;

wherein the first set of coordinates is aligned with the second set of coordinates; and

wherein a registered image is generated with the spectral image and the visual image based upon the alignment of the first set of coordinates and the second set of coordinates.

8. A computer program product comprising a computer usable medium having control logic stored therein for causing a computer to register a visual image and a spectral image of a biological sample, the control logic comprising:

a set of codes for causing a computer to receive a first set of coordinate positions of a plurality of reticles on a slide holder with the biological sample;

a set of codes for causing the computer to receive a visual image of the biological sample;

a set of codes for causing the computer to receive a second set of coordinate positions of the plurality of reticles on the slide holder with the biological sample;

a set of codes for causing the computer to receive a spectral image of the biological sample;

a set of codes for causing the computer to align the first set of coordinates and the second set of coordinates; and

a set of codes for causing the computer to generate a registered image with the spectral image and the visual image based upon the alignment of the first set of coordinates and the second set of coordinates.

9. A method for image registration refinement, comprising:

receiving a spectral image of a biological sample and a visual image of the biological sample;

applying a first threshold value to the spectral image and a second threshold value to the visual image; and

generating a binary spectral image based on the first threshold value;

generating a binary visual image based on the second threshold value;

aligning biological features of the spectral image with biological features of the visual image using the binary spectral image and the binary visual image; and

refining an image registration of the spectral image and the visual image based upon the alignment of the biological features of the spectral image and the biological features of the visual image.

10. The method of claim 9, wherein aligning the features of the spectral image and the features of the visual image improve the image registration of the spectral image and the visual image.

11. The method of claim 9, further comprising:

applying a weighted normalization to the spectral image to improve image features of the spectral image.

12. The method of claim 9, further comprising:

applying a morphological closure to the binary spectral image and the binary visual image.

13. The method of claim 9, further comprising:

softening the edges in the binary spectral image and the binary visual image.

14. The method of claim 9, further comprising:

minimizing the grayscale difference between the binary spectral image and the binary visual image.

15. The method of claim 9, further comprising:

scaling the visual image; and

scaling the spectral image.

16. A system for image registration refinement, comprising:

a processor;

a user interface functioning via the processor; and

a repository accessible by the processor;

wherein a spectral image of a biological sample and a visual image of the biological sample is received;

wherein a first threshold value is applied to the spectral image and a second threshold value is applied to the visual image;

wherein a binary spectral image is generated based on the first threshold value;

wherein a binary visual image is generated based on the second threshold value;

wherein biological features of the spectral image are aligned with biological features of the visual image using the binary spectral image and the binary visual image; and

wherein an image registration of the spectral image and the visual image is refined based upon the alignment of the biological features of the spectral image and the biological features of the visual image.

17. A computer program product comprising a computer usable medium having control logic stored therein for causing a computer to refine a registered image, the control logic comprising:

a set of codes for causing a computer to receive a spectral image of a biological sample and a visual image of the biological sample;

a set of codes for causing the computer to apply a first threshold value to the spectral image and a second threshold value to the visual image; and

a set of codes for causing the computer to generate a binary spectral image based on the first threshold value;

a set of codes for causing the computer to generate a binary visual image based on the second threshold value;

a set of codes for causing the computer to align biological features of the spectral image with biological features of the visual image using the binary spectral image and the binary visual image; and

a set of codes for causing the computer to refine an image registration of the spectral image and the visual image based upon the alignment of the biological features of the spectral image and the biological features of the visual image.