Model-based grayscale registration of medical images

• US 7,668,358 B2
• Filed: 07/18/2003
• Issued: 02/23/2010
• Est. Priority Date: 07/18/2003
• Status: Active Grant

• Current Assignee: Hologic Incorporated
• Original Assignee: Hologic Incorporated
• Inventors: Karssemeijer, Nico, Snoeren, Peter R.
• Primary Examiner(s): Mehta; Bhavesh M
• Assistant Examiner(s): ZARKA, DAVID PETER
• Application Number:
  US10/623,191
• Publication Number:
  US 20050013471A1
• Time in Patent Office: 2,412 Days
• Field of Search: 382/131
• US Class Current: 382/131
• CPC Class Codes: G06T 2207/30068 Mammography; Breast
• CPC Class Codes: G06T 7/35 using statistical methods

Abstract

Numerical image processing based on a model of medical image acquisition of two or more medical images to provide grayscale registration is described. The grayscale registered temporal images may then be displayed for visual comparison and/or further processed by a computer-aided diagnosis system for detection of medical abnormalities therein. A parametric method includes spatially registering two images and performing gray scale registration of the images. A parametric transform model, e.g., analog to analog, digital to digital, analog to digital, or digital to analog model, is selected based on the image acquisition method(s) of the images, i.e., digital or analog/film. Gray scale registration involves generating a joint pixel value histogram from the two images, statistically fitting parameters of the transform model to the joint histogram, generating a lookup table, and using the lookup table to transform and register pixel values of one image to the pixel values of the other image.

Claims

1. A method implemented by a computing device comprising at least one processor and memory for grayscale registration of a first medical image and a second medical image, the method comprising:

spatially registering, by the computing device, the first medical image and the second medical image relative to each other;

generating, by the computing device, at least one joint pixel value histogram based on pixel values of the first and second medical images;

generating, by the computing device, a lookup table based at least in part on the at least one joint pixel value histogram, a first image acquisition method for the first medical image and a second image acquisition method for the second medical image; and

applying, by the computing device, the lookup table to the pixel values of the first medical image to generate a third medical image, the third medical image being transformed from the first medical image and registered to the second medical image;

wherein the step of generating the lookup table includes;

selecting a parametric transform function from a plurality of predetermined, parametric transform functions based on the first and second medical image acquisition methods for the first and second medical images, respectively; and

statistically fitting parameters of the selected parametric transform function to the at least one pixel value histogram, the statistically fitting determines values of the parameters, wherein the lookup table is generated using the selected parametric transform function and the values of the fitted parameters;

and wherein each of the first and second medical images is one of a digitized analog image and a digitally acquired image and wherein the plurality of predetermined parametric transform functions includes;

(1) a function for registering a digitized analog image to another digitized analog image, (2) a function for registering a digitally acquired image to another digitally acquired image, (3) a function for registering a digitally acquired image to a digitized analog image, and (4) a function for registering a digitized analog image to a digitally acquired image.

2. The method of claim 1, wherein the plurality of predetermined parametric transform functions are one-dimensional monotonic functions.

3. The method of claim 1, wherein each of the plurality of predetermined parametric transform functions models image acquisition parameters, the image acquisition parameters being at least one of incident radiation intensity, exposure time, film characteristic curve for an analog image, digitizer characteristic for digitizing an analog image, and digital detector response for a digitally acquired image.

4. The method of claim 1, wherein each of the first and second medical images is a mammogram, and wherein each of the plurality of predetermined parametric transform functions models image acquisition parameters, the image acquisition parameters being at least one of breast thickness, incident radiation intensity, exposure time, film characteristic curve for an analog image, digitizer characteristic for digitizing an analog image, and digital detector response for a digitally acquired image.

5. The method of claim 1, further comprising the steps of:

performing computer aided detection process for comparing the second and third medical images; and

displaying the second and third medical images with results of said computer aided detection process.

6. The method of claim 1, wherein spatially registering the first and second medical images includes at least one of translating, rotating, shearing and scaling at least one of the first and second medical images.

7. The method of claim 1, wherein each of the first and second medical images includes a target portion and a remainder portion and wherein spatially registering the first and second medical images includes segmenting the target portion and the remainder portion of each of the first and second medical images.

8. The method of claim 1, wherein each of the first and second medical images includes a target portion and a remainder portion and wherein spatially registering the first and second medical images includes cropping each of the first and second medical images to contain only the target portion that is in both the first and second medical images.

9. The method of claim 8, wherein the at least one pixel value histogram is generated based on pixel values of only the cropped first and second medical images.

10. The method of claim 1, wherein spatially registering the first and second medical images includes optimization of an entropy correlation coefficient of the first and second medical images.

11. A method implemented by a computing device comprising at least one processor and memory for registering a first medical image to a second medical image, the method comprising:

generating, by the computing device, a joint pixel value histogram using pixel values of the first and second medical images;

selecting, by the computing device, a parametric transform function from a plurality of predetermined parametric transform functions, the selecting being based on a first medical image acquisition method for the first medical image and a second medical image acquisition method for the second medical image; and

statistically fitting, by the computing device, parameters of the selected parametric transform function to the joint pixel value histogram, the statistically fitting determining values of the parameters;

wherein each of the first and second medical images is one of a digitized analog image and a digitally acquired image and wherein the plurality of predetermined parametric transform functions includes;

(1) a function for registering a digitized analog image to another digitized analog image, (2) a function for registering a digitally acquired image to another digitally acquired image, (3) a function for registering a digitally acquired image to a digitized analog image, and (4) a function for registering a digitized analog image to a digitally acquired image.

12. The method of claim 11, further comprising:

generating a lookup table using the selected parametric transform function and the values of the fitted parameters; and

applying the lookup table to the pixel values of the first medical image to generate a third medical image, the third medical image being transformed from the first medical image and registered to the second medical image.

13. The method of claim 11, further comprising the steps of:

performing computer aided detection process for comparing the second and third medical images; and

displaying the second and third medical images with results of said computer aided detection process.

14. The method of claim 11, wherein the plurality of predetermined parametric transform functions are one-dimensional monotonic functions.

15. The method of claim 11, wherein each of the plurality of predetermined parametric transform functions models image acquisition parameters, the image acquisition parameters being at least one of incident radiation intensity, exposure time, film characteristic curve for an analog image, digitizer characteristic for digitizing an analog image, and digital detector response for a digitally acquired image.

16. The method of claim 11, wherein each of the first and second medical images is a mammogram, and wherein each of the plurality of predetermined parametric transform functions models image acquisition parameters, the image acquisition parameters being at least one of breast thickness, incident radiation intensity, exposure time, film characteristic curve for an analog image, digitizer characteristic for digitizing an analog image, and digital detector response for a digitally acquired image.

17. The method of claim 11, further comprising spatially registering the first medical image and the second medical image relative to each other.

18. The method of claim 17, wherein spatially registering the first and second medical images includes at least one of translating, rotating, shearing and scaling at least one of the first and second medical images.

19. The method of claim 17, wherein each of the first and second medical images includes a target portion and a remainder portion and wherein spatially registering the first and second medical images includes segmenting the target portion and the remainder portion of each of the first and second medical images.

20. The method of claim 17, wherein each of the first and second medical images includes a target portion and a remainder portion and wherein spatially registering the first and second medical images includes cropping each of the first and second medical images to contain only the target portion that is in both the first and second medical images.

21. The method of claim 20, wherein the joint pixel value histogram is genera ted based on pixel values of only the cropped first and second medical images.

22. The method of claim 17, wherein spatially registering the first and second medical images includes optimization of an entropy correlation coefficient of the medical images.

23. A system for registering a first medical image to a second medical image, comprising:

an input for receiving data for the first and second medical images; and

a processor generating a joint pixel value histogram using pixel values of the first and second medical images, selecting a parametric transform function from a plurality of predetermined parametric transform functions based on a first image acquisition method for the first medical image and a second image acquisition method for the second medical image, and statistically fitting parameters of the selected parametric transform function to the joint histogram to determine the values of the parameters;

wherein each of the first and second medical images is one of a digitized analog image and a digitally acquired image, and wherein the plurality of predetermined parametric transform functions includes;

(1) a function for registering a digitized analog image to another digitized analog image, (2) a function for registering a digitally acquired image to another digitally acquired image, (3) a function for registering a digitally acquired image to a digitized analog image, and (4) a function for registering a digitized analog image to a digitally acquired image.

24. The system of claim 23, the processor further generating a lookup table using the selected parametric transform function and the values of the fitted parameters and applying the lookup table to the pixel values of the first medical image to generate a third medical image, the third medical image being transformed from the first medical image and registered to the second medical image.

25. The system of claim 23, the processor further performing a computer aided detection process for comparing the second and third medical images, the system further comprising:

a display for displaying the second and third medical images with results of the computer aided detection process.

26. The system of claim 23, wherein the plurality of predetermined parametric transform functions are one-dimensional monotonic functions.

27. The system of claim 23, wherein each of the plurality of predetermined parametric transform functions models image acquisition parameters, the image acquisition parameters being at least one of incident radiation intensity, exposure time, film characteristic curve for an analog image, digitizer characteristic for digitizing an analog image, and digital detector response for a digitally acquired image.

28. The system of claim 23, the processor further spatially registering the first medical image and the second medical image relative to each other.

29. The system of claim 28, the processor further spatially registering the first and second medical images by at least one of translating, rotating, shearing and scaling at least one of the first and second medical images.

30. The system of claim 28, wherein each of the first and second medical image includes a target portion and a remainder portion and wherein the processor spatially registers the first and second medical images by segmenting the target portion and the remainder portion of each of the first and second medical images.

31. The system of claim 28, wherein each of the first and second medical images includes a target portion and a remainder portion and wherein the processor further crops each of the first and second medical images to contain only the target portion that is in both the first and second medical images.

32. The system of claim 31, the processor further generating the joint pixel value histogram based on pixel values of only the cropped first and second medical images.

33. The system of claim 28, the processor further spatially registering the first and second medical images by optimizing an entropy correlation coefficient of the first and second medical images.

34. A tangible computer readable storage medium embodied with a computer program product such that when executed directs a computing apparatus to automatically register a first medical image and a second medical image, comprising:

computer code for generating a joint pixel value histogram using pixel values of the first and second medical images;

computer code for selecting a parametric transform function from a plurality of predetermined parametric transform functions, the selecting being based on a first image acquisition method for the first medical image and a second image acquisition method for the second medical image; and

computer code for statistically fitting parameters of the selected parametric transform function to the joint pixel value histogram, the statistically fitting determines values of the parameters, wherein each of the first and second medical images is one of a digitized analog image and a digitally acquired image and wherein the plurality of predetermined parametric transform functions includes;

(1) a function for registering a digitized analog image to another digitized analog image, (2) a function for registering a digitally acquired image to another digitally acquired image, (3) a function for registering a digitally acquired image to a digitized analog image, and (4) a function for registering a digitized analog image to a digitally acquired image.

35. A tangible computer readable storage medium embodied with a computer program product such that when executed directs a computing apparatus to automatically register a first medical image and a second medical image, comprising:

computer code for spatially registering the first medical image and the second medical image relative to each other;

computer code for generating at least one joint pixel value histogram based on pixel values of the first and second medical images;

computer code for generating a lookup table based on the at least one joint pixel value histogram, a first image acquisition method for the first medical image and a second image acquisition method for the second medical image; and

computer code for applying the lookup table to the pixel values of the first medical image to generate a third medical image, the third medical image being transformed from the first medical image and registered to the second medical image;

wherein the computer code for generating the lookup table includes;

computer code for selecting a parametric transform function from a plurality of predetermined, parametric transform functions based on the first and second medical image acquisition methods for the first and second medical images, respectively; and

computer code for statistically fitting parameters of the selected parametric transform function to the at least one pixel value histogram, the statistically fitting determines values of the parameters, wherein the lookup table is generated using the selected parametric transform function and the values of the fitted parameters;

wherein each of the first and second medical images is one of a digitized analog image and a digitally acquired image, and wherein the plurality of predetermined parametric transform functions includes;

(1) a function for registering a digitized analog image to another digitized analog image, (2) a function for registering a digitally acquired image to another digitally acquired image, (3) a function for registering a digitally acquired image to a digitized analog image, and (4) a function for registering a digitized analog image to a digitally acquired image.