Image quality assessment of microscopy images

• US 9,064,304 B2
• Filed: 03/18/2013
• Issued: 06/23/2015
• Est. Priority Date: 03/18/2013
• Status: Active Grant

• Current Assignee: Leica Microsystems CMS GmbH (Danaher Corporation)
• Original Assignee: General Electric Company
• Inventors: Kenny, Kevin Bernard, Rothney, Megan Pearl
• Primary Examiner(s): Liew, Alex
• Application Number:
  US13/846,447
• Publication Number:
  US 20140270425A1
• Time in Patent Office: 827 Days
• Field of Search: 382128-134, 382254-308
• US Class Current: 1/1
• CPC Class Codes: G06T 2200/32 involving image mosaicing
• CPC Class Codes: G06T 2207/30024 Cell structures in vitro; Tissue sections in vitro
• CPC Class Codes: G06T 2207/30072 Microarray; Biochip, DNA array; Well plate
• CPC Class Codes: G06T 7/0002 Inspection of images, e.g. flaw detection
• CPC Class Codes: G06T 7/0012 Biomedical image inspection
• CPC Class Codes: G06T 7/37 using transform domain methods
• CPC Class Codes: G06V 10/993 Evaluation of the quality of the acquired pattern
• CPC Class Codes: G06V 20/693 Acquisition

Abstract

Automated assessment of registration quality, focus, and area defects in sequentially acquired images, such as images acquired by a digital microscope, is disclosed. In one embodiment, acquired images are registered and whole-image defects are automatically detected based on a figure of merit generated by the registration process. In related implementations, area defects may be automatically detected by calculating correlations in localized image regions for images acquired in different imaging rounds.

Claims

1. A computer-implemented method for assessing image quality, comprising:

acquiring a first image and a second image, wherein at least a portion of the first image and the second image overlap;

determining a rotation and a scale relating the first image and the second image;

rotating and scaling a respective Fourier transform of the first image to correspond to a respective Fourier transform of the second image;

determining a translation for the respective first image and the second image based upon the rotated and scaled Fourier transforms of the first image and the second image;

determining a score quantifying the quality of the registration of the first image and the second image; and

wherein determining the rotation and the scale comprises;

Fourier transforming the first image and the second image to generate a respective first spatial frequency bin and second spatial frequency bin;

extracting a first modulus from the first spatial frequency bin and a second modulus from the second spatial frequency bin to generate a first translation invariant signature and a second translation invariant signature;

performing a log-polar transformation of the first translation invariant signature and the second translation invariant signature;

in log-polar space, performing a Fourier domain correlation operation; and

determining the rotation and the scale based on the result of the Fourier domain correlation operation.

2. The computer-implemented method of claim 1, wherein the first image and the second image are acquired using a microscope.

3. The computer-implemented method of claim 1, wherein the first image and the second image are acquired in different imaging rounds of a sequential staining imaging protocol.

4. The computer-implemented method of claim 1, wherein determining the translation comprises:

performing a phase correlation on the rotated and scaled Fourier transforms of the first image and the second image to obtain the translation.

5. The computer-implemented method of claim 4, wherein performing the phase correlation comprises:

performing an inverse Fourier transform to return the rotated and scaled Fourier transforms of the first image and the second image to the pixel domain; and

locating a correlation peak in the pixel domain, wherein the location of the correlation peak corresponds to the translation.

6. The computer-implemented method of claim 5, wherein determining the score comprises:

determining the height of the correlation peak, wherein the height of the correlation peak corresponds to the score.

7. The computer-implemented method of claim 6, wherein the height of the correlation peak comprises the zero-mean normalized cross-power correlation coefficient for the registered first image and second image.

8. An image analysis system, comprising:

a memory storing one or more routines; and

a processing component configured to execute the one or more routines stored in the memory, wherein the one or more routines, when executed by the processing component, cause acts to be performed comprising;

acquiring or accessing a first image and a second image, wherein at least a portion of the first image and the second image overlap;

determining a rotation and a scale relating the first image and the second image;

rotating and scaling a respective Fourier transform of the first image to correspond to a respective Fourier transform of the second image;

determining a translation for the respective first image and the second image based upon the rotated and scaled Fourier transforms of the first image and the second image; and

determining a score quantifying the quality of the registration of the first image and the second image; and

wherein determining the rotation and the scale comprises;

Fourier transforming the first image and the second image to generate a respective first spatial frequency bin and second spatial frequency bin;

extracting a first modulus from the first spatial frequency bin and a second modulus from the second spatial frequency bin to generate a first translation invariant signature and a second translation invariant signature;

performing a log-polar transformation of the first translation invariant signature and the second translation invariant signature;

in log-polar space, performing a Fourier domain correlation operation; and

determining the rotation and the scale based on the result of the Fourier domain correlation operation.

9. The image analysis system of claim 8, wherein determining the translation comprises:

performing a phase correlation on the rotated and scaled Fourier transforms of the first image and the second image to obtain the translation.

10. The image analysis system of claim 9, wherein performing the phase correlation comprises:

performing an inverse Fourier transform to return the rotated and scaled Fourier transforms of the first image and the second image to the pixel domain; and

locating a correlation peak in the pixel domain, wherein the location of the correlation peak corresponds to the translation.

11. The image analysis system of claim 10, wherein determining the score comprises:

determining the height of the correlation peak, wherein the height of the correlation peak corresponds to the score.