Context driven image mining to generate image-based biomarkers

• US 20110122138A1
• Filed: 01/18/2011
• Published: 05/26/2011
• Est. Priority Date: 08/28/2006
• Status: Active Grant

• Current Assignee: Definiens AG (Astrazeneca PLC)
• Original Assignee: Definiens AG (Astrazeneca PLC)
• Inventors: Schaepe, Arno, Schoenmeyer, Ralf, Schmidt, Guenter, Binnig, Gerd
• Granted Patent: US 8,594,410 B2
• Time in Patent Office: Days
• US Class Current: 345/440
• CPC Class Codes: G01N 2800/00 Detection or diagnosis of diseases
• CPC Class Codes: G06F 18/40 Software arrangements specially adapted for pattern recognition, e.g. user interfaces or toolboxes therefor
• CPC Class Codes: G06T 2207/10116 X-ray image
• CPC Class Codes: G06T 2207/30004 Biomedical image processing
• CPC Class Codes: G06T 2207/30061 Lung
• CPC Class Codes: G06T 2207/30068 Mammography; Breast
• CPC Class Codes: G06T 7/0012 Biomedical image inspection
• CPC Class Codes: G06T 7/0014 using an image reference approach
• CPC Class Codes: G06V 10/945 User interactive design; Environments; Toolboxes

Abstract

An image-based biomarker is generated using image features obtained through object-oriented image analysis of medical images. The values of a first subset of image features are measured and weighted. The weighted values of the image features are summed to calculate the magnitude of a first image-based biomarker. The magnitude of the biomarker for each patient is correlated with a clinical endpoint, such as a survival time, that was observed for the patient whose medical images were analyzed. The correlation is displayed on a graphical user interface as a scatter plot. A second subset of image features is selected that belong to a second image-based biomarker such that the magnitudes of the second image-based biomarker for the patients better correlate with the clinical endpoints observed for those patients. The second biomarker can then be used to predict the clinical endpoint of other patients whose clinical endpoints have not yet been observed.

Claims

1-61. -61. (canceled)

62. A method comprising:

determining a value of each of a first subset of image features of objects generated using object-oriented image analysis, wherein the image features of the first subset belong to a first image-based biomarker;

calculating a magnitude of the first image-based biomarker for each patient of a group of patients;

correlating the magnitude of the first image-based biomarker for each patient of the group with a clinical endpoint observed for that patient;

displaying on a graphical user interface how the first image-based biomarker correlates with the clinical endpoint observed for each of the patients of the group; and

selecting a second subset of image features that belong to a second image-based biomarker such that the magnitudes of the second image-based biomarker for the patients of the group better correlate with the clinical endpoints observed for the patients of the group.

63. The method of claim 62, wherein the calculating the magnitude involves weighting each value of each image feature in the first subset and summing all of the weighted values of the image features in the first subset.

64. The method of claim 62, further comprising:

modifying how the value of each image feature in the second subset is weighted such that the magnitudes of the second image-based biomarker for the patients of the group better correlate with the clinical endpoints observed for the patients in the subgroup.

65. The method of claim 62, wherein the correlating the magnitude of the first image-based biomarker for each patient of the group with the clinical endpoint observed for that patient uses a fuzzy membership function of patients for whom the first image-based biomarker provides a good correlation with the observed clinical endpoint.

66. The method of claim 62, wherein the objects are generated from medical images of the patients of the group.

67. The method of claim 66, wherein the objects are generated from regions of interest in the medical images, and wherein the regions of interest are manually selected by a clinical expert.

68. The method of claim 66, wherein the objects are generated from regions of interest in the medical images, and wherein the regions of interest depict cancerous tissue selected by a pathologist.

69. A method comprising:

acquiring pixel values of medical images of patients;

generating objects of a data network for each of the medical images by linking selected pixel values to selected objects according to a class network and a process hierarchy;

measuring the objects to obtain a value for each of a plurality of image features;

selecting a first subset of the image features that belong to a first image-based biomarker;

correlating the first image-based biomarker for each of the patients with a clinical endpoint observed for that patient;

displaying on a graphical user interface how the first image-based biomarker correlates with the clinical endpoint observed for each of the patients;

identifying a subgroup of the patients for which the first image-based biomarker correlates poorly with the clinical endpoints observed for the patients in the subgroup; and

selecting a second subset of the image features that belong to a second image-based biomarker that better correlates with the clinical endpoints observed for the patients in the subgroup.

70. The method of claim 69, wherein each value for each image feature in the first subset is weighted and summed with weighted values of the remaining image features in the first subset to obtain a magnitude of the first image-based biomarker.

71. The method of claim 70, wherein the correlating the first image-based biomarker with the clinical endpoint involves plotting the magnitude of the first image-based biomarker for each patient against the clinical endpoint observed for that patient.

72. The method of claim 71, wherein the identifying the subgroup of patients involves performing a regression analysis on the magnitudes of the first image-based biomarker plotted against the clinical endpoints observed for the patients.

73. The method of claim 69, wherein the identifying the subgroup is performed using a scatter plot displayed on the graphical user interface, and wherein each point on the scatter plot represents one of the patients.

74. The method of claim 69, wherein the subgroup is expanded to include patients corresponding to points on the scatter plot that are closest to the points originally included in the subgroup.

75. The method of claim 69, wherein the identifying the subgroup involves plotting the clinical endpoints observed for each of the patients as a Kaplan-Meier curve.

76. The method of claim 69, wherein the correlating the first image-based biomarker with the clinical endpoint involves performing a decision tree analysis with each of the first subset of image features to generate a predicted clinical endpoint for each patient and then plotting the predicted clinical endpoint for each patient against the clinical endpoint observed for that patient.

77. The method of claim 69, further comprising:

modifying how the value of each image feature in the second subset is weighted such that the second image-based biomarker better correlates with the clinical endpoint observed for the patients in the subgroup.

78. The method of claim 69, further comprising:

saving the second image-based biomarker to a computer-readable medium.

79. The method of claim 69, further comprising:

correlating the second image-based biomarker for each of the patients in the subgroup with the clinical endpoint observed for that patient.

80. The method of claim 69, wherein the class network has a class, and wherein a membership function defines a likelihood that each of the objects of the data network belongs to the class.

81. The method of claim 80, wherein a process step is part of the process hierarchy, and wherein the process step has a domain that designates the class.

82. The method of claim 69, wherein the clinical endpoint is a survival time.

83. The method of claim 69, wherein the clinical endpoint is a time for recurrence of cancer.

84-88. -88. (canceled)