Referencing in multi-acquisition slide imaging

• US 10,088,658 B2
• Filed: 03/18/2013
• Issued: 10/02/2018
• Est. Priority Date: 03/18/2013
• Status: Active Grant

• Current Assignee: Leica Microsystems Gmbh (Danaher Corporation)
• Original Assignee: General Electric Company
• Inventors: Kenny, Kevin Bernard, Corwin, Alex David
• Primary Examiner(s): Kelley, Christopher S
• Assistant Examiner(s): Walsh, Kathleen
• Application Number:
  US13/846,490
• Publication Number:
  US 20140267671A1
• Time in Patent Office: 2,024 Days
• Field of Search: 348 79, 348143, 348144, 348147, 382128, 382133, 382276, 382278, 382280, 382294
• CPC Class Codes: G02B 21/26 Stages; Adjusting means therefor
• CPC Class Codes: G06T 3/147 using affine transformations
• CPC Class Codes: G06T 3/40 Scaling of whole images or parts thereof, e.g. expanding or contracting
• CPC Class Codes: G06T 3/60 Rotation of whole images or parts thereof
• CPC Class Codes: G06T 7/0012 Biomedical image inspection

Abstract

Referencing of image acquired in multiple rounds of imaging is disclosed. In certain implementations, a baseline round of images are acquired and registered to one another to establish a global transformation matrix. In a subsequent round of image acquisition, a limited number of field of view images are initially acquired and registered to the corresponding baseline images to solve for translation, rotation, and scale. The full set of baseline images is then acquired for the subsequent round and each image is pre-rotated and pre-scaled based on the transform determined for the subset of images. The pre-rotated, pre-scaled images are then registered using a translation-only transform.

Claims

1. A computer-implemented method for registering images, comprising:

acquiring a first set of images of a sample on a slide positioned on a stage, wherein each image is taken at a different field of view;

generating a global transformation matrix by registering the images of the first set to one another to form a composite image;

acquiring a subset of images of the sample on the slide after the slide is removed from and replaced on the stage, wherein the subset of images is less than the number of images in the first set;

registering each image of the subset with a corresponding image of the first set of images to determine a translation, a rotation, and a scale factor;

acquiring a second set of images of the sample at the same respective fields of view used to acquire the first set of images;

rotating and scaling each image of the second set of images using the rotation and the scale factor determined for the subset of images; and

registering the rotated and scaled images of the second set to the corresponding images of the first set.

2. The computer-implemented method of claim 1, wherein each image of the first set of images overlaps one or more respective adjacent images of the first set.

3. The computer-implemented method of claim 1, wherein the first set of images and the second set of images are taken over a uniform grid of spatial locations.

4. The computer-implemented method of claim 1, wherein the first set of images, the subset of images, and the second set of images are acquired using a digital microscopy system.

5. The computer-implemented method of claim 1, wherein the sample is differently stained before being replaced on the stage.

6. The computer-implemented method of claim 1, wherein the global transformation matrix maps coordinates from a slide on which the sample is disposed to both the composite image and the respective individual images of the first set.

7. The computer-implemented method of claim 1, wherein each image of the subset is registered with the corresponding image of the first set of images using a log-polar fast Fourier transform.

8. The computer-implemented method of claim 1, wherein registering the rotated and scaled images of the second set to the corresponding images of the first set comprises translating the rotated and scaled images of the second set without additional rotation or scaling.

9. An image analysis system, comprising:

a memory storing one or more routines; and

a processing component configured to execute the one or more routines stored in the memory, wherein the one or more routines, when executed by the processing component, cause acts to be performed comprising;

performing an alignment operation between a limited set of images acquired of a sample and a previously acquired full set of images of the sample wherein the limited set of images comprise fewer images than the full set of images, wherein the alignment operation generates at least a rotation relating the limited set of images to corresponding images of the full set of images;

rotating a subsequently acquired full set of images by the rotation; and

translating the rotated images of the subsequently acquired full set of images to register the rotated images with corresponding images of the previously acquired full set of images.

10. The image analysis system of claim 9, wherein the limited set of images comprises 3, 4, or 5 images of the sample.

11. The image analysis system of claim 9, wherein the alignment operation comprises a log-polar fast Fourier transform.

12. The image analysis system of claim 9, wherein the alignment operation also generates a scale factor and wherein the subsequently acquired full set of images is scaled by the scale factor prior to translation.

13. The image analysis system of claim 9, wherein each image of the subsequently acquired full set of images corresponds to a respective image of the previously acquired full set of images.

14. The image analysis system of claim 9, wherein the one or more routines, when executed by the processing component, cause further acts to be performed comprising:

generating and displaying at least one composite image from the previously acquired full set of images or the subsequently acquired full set of images.

15. A digital microscopy imaging system, comprising:

a stage configured to hold a slide;

an objective lens and image sensor configured to acquire images of a portion of the slide, when present;

a position controller configured to move one or both of the objective lens and the stage relative to one another in accordance with an imaging protocol;

a controller configured to control operation of one or both of the position controller and the image sensor;

a memory storing one or more routines; and

a processing component configured to execute the one or more routines stored in the memory, wherein the one or more routines, when executed by the processing component, cause acts to be performed comprising;

acquiring a first full set of images of at least a portion of the slide, wherein each image overlaps with at least one adjacent image;

acquiring a second full set of images of at least the portion of the slide after the slide is removed from and replaced on the stage;

rotating the images of the second full set of images by a predetermined angle to generate a set of pre-rotated images; and

translating the pre-rotated images to register the pre-rotated images to corresponding images of the first full set of images.

16. The digital microscopy imaging system of claim 15, wherein the first and the second full sets of images are acquired over a uniform grid.

17. The digital microscopy imaging system of claim 15, wherein the one or more routines, when executed by the processing component, cause further acts to be performed comprising:

scaling the images of the second full set of images by a predetermined scale factor prior to translating the pre-rotated images.

18. The digital microscopy imaging system of claim 15, wherein the one or more routines, when executed by the processing component, cause further acts to be performed comprising:

acquiring a limited set of images of the slide after the slide is remove from and replaced on the stage; and

calculating the predetermined angle by registering the limited set of images to corresponding images in the first full set of images.

19. The digital microscopy system of claim 18, wherein the limited set of images comprises 3, 4, or 5 images.

20. The digital microscopy system of claim 18, wherein the predetermined angle is calculated using a log-polar fast Fourier transform.