MULTI-MODALITY FUSION CLASSIFIER WITH INTEGRATED NON-IMAGING FACTORS

• US 20090082637A1
• Filed: 09/21/2007
• Published: 03/26/2009
• Est. Priority Date: 09/21/2007
• Status: Abandoned Application

• Current Assignee: Almen Laboratories, Inc.
• Original Assignee: Almen Laboratories, Inc.
• Inventors: Galperin, Michael
• Application Number:
  US11/859,311
• Publication Number:
  US 20090082637A1
• Time in Patent Office: Days
• US Class Current: 600/300
• CPC Class Codes: G06F 18/254 of classification results, e.g. of results related to same input data
• CPC Class Codes: G06T 2207/30008 Bone
• CPC Class Codes: G06T 2207/30024 Cell structures in vitro; Tissue sections in vitro
• CPC Class Codes: G06T 2207/30068 Mammography; Breast
• CPC Class Codes: G06T 7/0012 Biomedical image inspection
• CPC Class Codes: G06V 10/809 of classification results, e.g. where the classifiers operate on the same input data
• CPC Class Codes: G06V 20/698 Matching; Classification
• CPC Class Codes: G06V 2201/03 Recognition of patterns in medical or anatomical images
• CPC Class Codes: G16H 30/20 for handling medical images, e.g. DICOM, HL7 or PACS
• CPC Class Codes: G16H 50/20 for computer-aided diagnosis, e.g. based on medical expert systems

Abstract

Disease or biomedical condition assessments or classifications are computed with scores from multiple different image modalities. Non-image information such as biometric, demographic, anthropomorphic and various risk factors may also be fused (combined) with one or more image modality disease or biomedical condition assessments or classifications to produce an integrated disease or biomedical condition assessment or suspicion score output and/or classification.

Claims

1. A computer implemented method of producing a disease assessment, said method comprising:

producing a first numerical disease or condition classification or assessment score from at least one image;

producing a second numerical disease or condition classification or assessment score from non-image information;

combining at least the first and second disease or condition classification or assessment scores to produce a combined disease or condition classification or assessment score; and

displaying the combined disease or condition classification or assessment score.

2. The method of claim 1, wherein the non-image information comprises demographic information.

3. The method of claim 1, wherein the non-image information comprises age and other anthropomorphic and biometric information.

4. The method of claim 1, wherein the non-image information comprises risk information.

5. The method of claim 1, wherein the non-image information comprises at least one physician diagnosis or impression.

6. The method of claim 1, wherein said first disease or condition classification or assessment score is derived at least in part by comparing an object in a first image with objects in other images.

7. The method of claim 1, comprising:

producing a third numerical disease or condition classification or assessment score from additional image information;

combining at least the first, second, and third disease or condition classification or assessment scores to produce a combined disease or condition classification or assessment score.

8. The method of claim 7, wherein the additional image information is derived from different image modalities from the first image information.

9. The method of claim 1, wherein the combined disease or condition classification or assessment score is dependent on the consistency and contingency between the first and second disease or condition classification or assessment scores.

10. The method of claim 9, wherein the combined disease or condition classification or assessment score is produced with a modified Dempster-Shafer normalization factor.

11. The method of claim 1 wherein one or both of the first and second disease or condition classification or assessment scores comprise combined classification scores.

12. The method of claim 1, additionally comprising storing said first, second, and combined disease or condition classification or assessment scores in a teaching file in associate with physician input information.

13. A computer implemented method of producing a disease suspicion score, said method comprising:

producing a first numerical disease or condition classification or assessment score from at least one image produced with a first imaging modality;

producing a second numerical disease or condition classification or assessment score from at least one image produced with a second imaging modality;

combining at least the first and second disease or condition classification or assessment scores with non-neural network statistical analysis to produce a combined disease or condition classification or assessment score; and

displaying the combined disease or condition classification or assessment score.

14. The method of claim 13, wherein the combined disease or condition classification or assessment score is dependent on the consistency between the first and second disease or condition classification or assessment scores.

15. The method of claim 14, wherein the combined disease or condition classification or assessment score is produced with a modified Dempster-Shafer normalization factor.

16. The method of claim 13, additionally comprising storing said first, second, and combined disease or condition classification or assessment scores in a teaching file in associate with physician input information.

17. A system for producing a disease assessment, said system comprising:

means for producing a first numerical disease or condition classification or assessment score from at least one image;

means for producing a second numerical disease or condition classification or assessment score from non-image information; and

means for combining at least the first and second disease or condition classification or assessment scores to produce a combined disease or condition classification or assessment score.

18. The system of claim 17, wherein both means for producing and the means for combining comprise software modules stored in a computer readable memory.

19. A system for producing a disease suspicion score, said system comprising:

means for producing a first numerical disease or condition classification or assessment score from at least one image produced with a first imaging modality;

means for producing a second numerical disease or condition classification or assessment score from at least one image produced with a second imaging modality; and

means for combining at least the first and second disease or condition classification or assessment scores with non-neural network statistical analysis to produce a combined disease or condition classification or assessment score.

20. The system of claim 19, wherein both means for producing and the means for combining comprise software modules stored in a computer readable memory.