Methods and systems for automatically mapping biopsy locations to pathology results

• US 10,332,251 B2
• Filed: 06/10/2016
• Issued: 06/25/2019
• Est. Priority Date: 06/12/2015
• Status: Active Grant

• Current Assignee: Merative US LP
• Original Assignee: Merge Healthcare Incorporated (International Business Machines Corporation)
• Inventors: Reicher, Murray A., DeVries, Jon T., Ferro, Jr., Michael W., Sati, Marwan
• Primary Examiner(s): Bali, Vikkram
• Application Number:
  US15/179,501
• Publication Number:
  US 20160364630A1
• Time in Patent Office: 1,110 Days
• Field of Search: None
• CPC Class Codes: A61B 10/02 Instruments for taking cell samples or for biopsy A61B10/0038 and A61B10/0045 take precedence; needle locating or guiding means A61B17/3403; samplers for enzymology or microbiology C12M1/26; sampling or preparing biological specimens G01N33/48
• CPC Class Codes: A61B 2034/108 Computer aided selection or customisation of medical implants or cutting guides
• CPC Class Codes: A61B 2090/373 using light, e.g. by using optical scanners
• CPC Class Codes: A61B 2090/374 NMR or MRI
• CPC Class Codes: A61B 2090/3762 using computed tomography systems [CT]
• CPC Class Codes: A61B 2090/378 using ultrasound
• CPC Class Codes: A61B 34/10 Computer-aided planning, simulation or modelling of surgical operations
• CPC Class Codes: A61B 5/0077 Devices for viewing the surface of the body, e.g. camera, magnifying lens
• CPC Class Codes: A61B 5/015 By temperature mapping of body part
• CPC Class Codes: A61B 5/055 involving electronic [EMR] or nuclear [NMR] magnetic resonance, e.g. magnetic resonance imaging
• CPC Class Codes: A61B 5/318 Heart-related electrical modalities, e.g. electrocardiography [ECG]
• CPC Class Codes: A61B 5/4312 Breast evaluation or disorder diagnosis A61B5/0091 takes precedence
• CPC Class Codes: A61B 5/441 Skin evaluation, e.g. for skin disorder diagnosis
• CPC Class Codes: A61B 5/7267 involving training the classification device
• CPC Class Codes: G06F 18/213 Feature extraction, e.g. by transforming the feature space; Summarisation; Mappings, e.g. subspace methods
• CPC Class Codes: G06F 18/214 Generating training patterns; Bootstrap methods, e.g. bagging or boosting
• CPC Class Codes: G06F 18/217 Validation; Performance evaluation; Active pattern learning techniques
• CPC Class Codes: G06F 18/2411 based on the proximity to a decision surface, e.g. support vector machines
• CPC Class Codes: G06F 18/2413 based on distances to training or reference patterns
• CPC Class Codes: G06F 18/285 Selection of pattern recognition techniques, e.g. of classifiers in a multi-classifier system
• CPC Class Codes: G06F 3/0482 : Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/0488 : using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06F 40/169 : Annotation, e.g. comment data or footnotes
• CPC Class Codes: G06F 40/205 : Parsing
• CPC Class Codes: G06N 20/00 : Machine learning
• CPC Class Codes: G06T 11/008 : Specific post-processing after tomographic reconstruction, e.g. voxelisation, metal artifact correction
• CPC Class Codes: G06T 2200/24 : involving graphical user interfaces [GUIs]
• CPC Class Codes: G06T 2207/10088 : Magnetic resonance imaging [MRI]
• CPC Class Codes: G06T 2207/20081 : Training; Learning
• CPC Class Codes: G06T 2207/30004 : Biomedical image processing
• CPC Class Codes: G06T 2207/30008 : Bone
• CPC Class Codes: G06T 2207/30016 : Brain
• CPC Class Codes: G06T 2207/30052 : Implant; Prosthesis
• CPC Class Codes: G06T 2207/30061 : Lung
• CPC Class Codes: G06T 2207/30068 : Mammography; Breast
• CPC Class Codes: G06T 2207/30088 : Skin; Dermal
• CPC Class Codes: G06T 7/0012 : Biomedical image inspection
• CPC Class Codes: G06T 7/0014 : using an image reference approach
• CPC Class Codes: G06V 10/764 : using classification, e.g. of video objects
• CPC Class Codes: G06V 2201/031 : of internal organs
• CPC Class Codes: G16H 10/20 : for electronic clinical trials or questionnaires
• CPC Class Codes: G16H 15/00 : ICT specially adapted for medical reports, e.g. generation or transmission thereof
• CPC Class Codes: G16H 20/10 : relating to drugs or medications, e.g. for ensuring correct administration to patients
• CPC Class Codes: G16H 30/20 : for handling medical images, e.g. DICOM, HL7 or PACS
• CPC Class Codes: G16H 50/20 : for computer-aided diagnosis, e.g. based on medical expert systems
• CPC Class Codes: G16H 50/50 : for simulation or modelling of medical disorders
• CPC Class Codes: G16Z 99/00 : Subject matter not provided for in other main groups of this subclass

Abstract

Methods and systems for automatically mapping biopsy locations to pathology results. One system includes a server including an electronic processor and an interface for communicating with at least one data source and at least one pathology result source. The electronic processor is configured to receive an image from the at least one data source over the interface. The electronic processor is also configured to receive a biopsy location. The biopsy location includes a three-dimensional position mapped to a position within the image. The electronic processor is also configured to automatically locate an electronic pathology result for the biopsy location within the at least one pathology result source over the interface. The electronic processor is also configured to generate an electronic correlation between the biopsy location and the electronic pathology result. The electronic processor is also configured to display the image with the biopsy location marked within the image.

Claims

1. A system for creating a map of biopsy locations represented in an image to pathology results of biopsies taken at the biopsy locations, the system comprising:

an electronic processor and an interface for communicating with at least one image repository and at least one pathology result source, the pathology result source storing a plurality of pathology reports, each of the plurality of pathology reports including a pathology result of a biopsy, the electronic processor configured to

receive a plurality of images from the at least one image repository over the interface;

receive a biopsy location for each of the plurality of biopsies, each biopsy location including a three-dimensional position mapped to a position within one of the plurality of images;

for each of the plurality of biopsies, access a corresponding pathology report stored in the at least one pathology result source to determine a reported result of the biopsy;

store, in a data structure, each of the plurality of biopsy locations and the reported result associated with each biopsy location;

display one of the plurality of images with a selectable identifier marking the biopsy location for the one of the plurality of images; and

in response to receiving a selection of the selectable identifier within the image,

retrieve the reported result for the one of the plurality of biopsies from the data structure associated with the biopsy location marked with the selectable identifier; and

display the reported result.

2. The system of claim 1, wherein the electronic processor is further configured to enable and disable the display of the selectable identifier within the one of the plurality of images.

3. The system of claim 1, wherein the electronic processor is configured to enable and disable the display of the selectable identifier within the one of the plurality of images in response to one or more preferences associated with a user.

4. The system of claim 1, wherein the electronic processor is configured to automatically locate the corresponding pathology report for each of the biopsy locations within the at least one pathology result source using a model developed using machine learning, the model automatically extracting pathology location information from the plurality of pathology reports and mapping each extracted pathology location to an associated image from the plurality of images and a position within the associated image.

5. The system of claim 1, wherein the electronic processor is configured to automatically locate the corresponding pathology report for each of the plurality of biopsies within the at least one pathology result source over the interface by deducting semantics from text included in a pathology report.

6. The system of claim 1, wherein the electronic processor is configured to automatically locate the corresponding pathology report for each of the plurality of biopsies within the at least one pathology result source over the interface by locating a field within a structured pathology report.

7. The system of claim 1, wherein the electronic processor is configured to access medical information associated with a patient associated with each of the plurality of images to map the biopsy location for each of the plurality of biopsies to the position within one of the plurality of images.

8. The system of claim 7, wherein the medical information includes at least one of an additional image, patient information, and procedure information.

9. The system of claim 1, wherein the electronic processor is configured to display the reported result within the corresponding pathology report.

10. The system of claim 1, wherein the electronic processor is further configured to perform a comparison of a computer-generated diagnosis associated with each of the plurality of images and the pathology result for each biopsy location in each of the plurality of images, the computer-generated diagnosis generated prior to the pathology result, and update a model used to generate the computer-generated diagnosis based on the comparison.

11. The system of claim 10, wherein the electronic processor is further configured to generate at least one statistic based on the comparison.

12. The system of claim 11, wherein the at least one statistic includes a percentage of computer-generated diagnoses generated using the model consistent with a corresponding pathology report.

13. The system of claim 11, wherein the electronic processor is further configured to display the at least one statistic within a user interface.

14. The system of claim 1, wherein the electronic processor is further configured to generate and display a table comparing the biopsy location of at least one of the plurality of biopsies within the one of the plurality of images and the corresponding pathology report of the at least one of the plurality of biopsies.

15. A system for displaying identifiers within a clinical image marking biopsy locations represented in the clinical image, the identifiers selectable to access pathology results of biopsies taken at the biopsy locations, the system comprising:

an electronic processor; and

an interface for communicating with at least one data source and at least one pathology result source,

the electronic processor configured to

receive a plurality of images from the at least one data source over the interface;

receive a biopsy location for each of the plurality of biopsies, each biopsy location including a three-dimensional position mapped to a position within one of the plurality of images;

for each of the plurality of biopsies, access a corresponding pathology report stored in the at least one pathology report source to determine a reported result of the biopsy;

store, in a data structure, each of the plurality of biopsy locations and the reported result associated with each biopsy location;

display one of the plurality of images with a selectable identifier marking the biopsy location for one of the plurality of biopsies; and

in response to receiving a selection of the selectable identifier within the image, retrieve the reported result for the one of the plurality of biopsies from the data structure associated with the biopsy location marked with the selectable identifier and display the reported result.