Evaluation of co-registered images of differently stained tissue slices

• US 9,740,912 B2
• Filed: 12/20/2011
• Issued: 08/22/2017
• Est. Priority Date: 12/20/2011
• Status: Active Grant

• Current Assignee: Definiens AG (Astrazeneca PLC)
• Original Assignee: Definiens AG (Astrazeneca PLC)
• Inventors: Schoenmeyer, Ralf, Binnig, Gerd, Schmidt, Guenter, Athelogou, Maria, Ellenberg, Peter
• Primary Examiner(s): Mazumder, Tapas
• Application Number:
  US13/330,900
• Publication Number:
  US 20130156279A1
• Time in Patent Office: 2,072 Days
• CPC Class Codes: G06T 2207/10056 Microscopic image
• CPC Class Codes: G06T 2207/30024 Cell structures in vitro; Tissue sections in vitro
• CPC Class Codes: G06T 7/33 using feature-based methods
• CPC Class Codes: G06V 20/695 Preprocessing, e.g. image segmentation
• CPC Class Codes: G16H 30/40 for processing medical images, e.g. editing

Abstract

A method for co-registering images of tissue slices stained with different biomarkers displays a first digital image of a first tissue slice on a graphical user interface such that an area of the first image is enclosed by a frame. Then a portion of a second image of a second tissue slice is displayed such that the area of the first image enclosed by the frame is co-registered with the displayed portion of the second image. The displayed portion of the second image has the shape of the frame. The tissue slices are both z slices of a tissue sample taken at corresponding positions in the x and y dimensions. The displayed portion of the second image is shifted in the x and y dimensions to coincide with the area of the first image that is enclosed by the frame as the user shifts the first image under the frame.

Claims

1. A method comprising:

displaying a first digital image of a first tissue slice on a graphical user interface such that an area of the first digital image is enclosed by a frame, wherein the displayed portion of the first digital image is larger than the frame;

displaying a portion of a second digital image of a second tissue slice on the graphical user interface, wherein the first tissue slice and the second tissue slice are both z slices taken from a tissue sample at corresponding positions in the x and y dimensions, wherein the displayed portion of the second digital image has a shape of the frame, wherein the area of the first digital image that is enclosed by the frame corresponds to the displayed portion of the second digital image, wherein the area of the first digital image that is enclosed by the frame is co-registered with the displayed portion of the second digital image; and

shifting the displayed portion of the second digital image in the x and y dimensions to coincide with the area of the first digital image that is enclosed by the frame as the frame is shifted in the x and y dimensions over the stationary first digital image.

2. The method of claim 1, wherein the first tissue slice is stained with a first biomarker, and wherein the second tissue slice is stained with a second biomarker.

3. The method of claim 2, wherein the first biomarker is taken from the group consisting of:

hematoxylin and eosin (HE), Human Epidermal growth factor Receptor 2 (Her2), estrogen receptor (ER) stain, progesterone receptor (PR) stain, Silver In Situ Hybridization chromosome 17 (SishChr17) stain, Silver In Situ Hybridization Her2 (SishHer2) stain, and monoclonal antibody Mib-1 stain.

4. The method of claim 1, further comprising:

replacing the first digital image with an object image generated from the first digital image, wherein the object image depicts objects that are generated by segmenting the first digital image, and wherein an area of the object image that is enclosed by the frame is co-registered with the displayed portion of the second digital image.

5. The method of claim 4, wherein the first digital image is replaced with the object image in response to clicking on the first digital image.

6. A method comprising:

displaying a first digital image of a first tissue portion on a graphical user interface such that an area of the first digital image is enclosed by a frame, wherein the displayed portion of the first digital image is larger than the frame;

displaying a second digital image of a second tissue portion on the graphical user interface; and

displaying a third digital image of a third tissue portion on the graphical user interface adjacent to the second digital image, wherein the first, second and third tissue portions are z slices taken from a tissue sample at corresponding positions in the x and y dimensions, wherein each of the second digital image and the third digital image has a shape of the frame, wherein the area of the first digital image that is enclosed by the frame is co-registered with both the second digital image and the third digital image, and wherein the second digital image shifts in the x and y dimensions to coincide with the area of the first digital image that is enclosed by the frame as the first digital image is shifted in the x and y dimensions under the stationary frame.

7. The method of claim 6, wherein the second digital image and the third digital image are displayed in a row above the first digital image.

8. The method of claim 6, wherein the first tissue portion is stained with a first biomarker, and wherein the second tissue portion is stained with a second biomarker.

9. The method of claim 6, wherein the second digital image borders the third digital image.

10. The method of claim 6, further comprising:

replacing the second digital image with an object image generated from the second digital image, wherein the object image depicts objects that are generated by segmenting the second digital image, and wherein the object image is co-registered with the area of the first digital image that is enclosed by the frame.

11. A method comprising:

displaying a first digital image of a first tissue slice on a graphical user interface such that an area of the first digital image is enclosed by a frame, wherein the displayed portion of the first digital image is larger than the frame;

displaying a portion of a second digital image of a second tissue slice on the graphical user interface, wherein the displayed portion of the second digital image has a size of the frame, wherein the area of the first digital image that is enclosed by the frame corresponds to the displayed portion of the second digital image, wherein the area of the first digital image that is enclosed by the frame is co-registered with the displayed portion of the second digital image; and

shifting the displayed portion of the second digital image to coincide with the area of the first digital image that is enclosed by the frame in response to a user shifting the frame relative to the first digital image, wherein the frame is shifted relative to the first digital image by shifting the frame over the stationary first digital image or by shifting the first digital image under the stationary frame.

12. The method of claim 11, wherein the user shifts the first digital image under the frame by clicking on the first digital image and then moving a mouse.

13. The method of claim 11, wherein the first tissue slice is stained with a first biomarker, and wherein the second tissue slice is stained with a second biomarker.

14. The method of claim 13, wherein the first biomarker is taken from the group consisting of:

hematoxylin and eosin (HE), Human Epidermal growth factor Receptor 2 (Her2), estrogen receptor (ER) stain, progesterone receptor (PR) stain, Silver In Situ Hybridization chromosome 17 (SishChr17) stain, Silver In Situ Hybridization Her2 (SishHer2) stain, and monoclonal antibody Mib-1 stain.

15. The method of claim 11, further comprising:

replacing the first digital image with an object image generated from the first digital image, wherein the object image depicts objects that are generated by segmenting the first digital image, and wherein an area of the object image that is enclosed by the frame is co-registered with the displayed portion of the second digital image.

16. The method of claim 15, wherein the first digital image is replaced with the object image in response to clicking on the first digital image.

17. The method of claim 11, wherein the frame is shifted relative to the first digital image by shifting the first digital image under the frame, and wherein the frame is present at a fixed location on the graphical user interface over the first digital image.