AUTOMATED IMAGE DATA PROCESSING AND VISUALIZATION

• US 20120166462A1
• Filed: 12/28/2010
• Published: 06/28/2012
• Est. Priority Date: 12/28/2010
• Status: Abandoned Application

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Criminisi, Antonio, White, Steven J., Sharp, Toby, Dove, Bryan, Gillam, Michael T., Pathak, Sayan D., Fu, Liqun, Siddiqui, Khan M., Konukoglu, Ender
• Application Number:
  US12/979,362
• Publication Number:
  US 20120166462A1
• Time in Patent Office: Days
• US Class Current: 707/758
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/04845 for image manipulation, e.g. dragging, rotation, expansion or change of colour
• CPC Class Codes: G06F 9/451 Execution arrangements for user interfaces
• CPC Class Codes: G16H 15/00 ICT specially adapted for medical reports, e.g. generation or transmission thereof
• CPC Class Codes: G16H 30/20 for handling medical images, e.g. DICOM, HL7 or PACS
• CPC Class Codes: G16H 30/40 for processing medical images, e.g. editing
• CPC Class Codes: G16H 40/63 for local operation

Abstract

The present discussion relates to automated image data processing and visualization. One example can facilitate generating a graphical user-interface (GUI) from image data that includes multiple semantically-labeled user-selectable anatomical structures. This example can receive a user selection of an individual semantically-labeled user-selectable anatomical structure. The example can locate a sub-set of the image data associated with the individual semantically-labeled user-selectable anatomical structure and can cause presentation of the sub-set of the image data on a subsequent GUI.

Claims

1. At least one computer-readable storage medium having instructions stored thereon that, when executed by a computing device, cause the computing device to perform acts, comprising:

facilitating a graphical user-interface (GUI) to be generated from image data that includes multiple semantically-labeled user-selectable anatomical structures;

receiving a user selection of an individual semantically-labeled user-selectable anatomical structure;

locating a sub-set of the image data associated with the individual semantically-labeled user-selectable anatomical structure; and

,

causing presentation of the sub-set of the image data on a subsequent GUI.

2. The computer-readable storage medium of claim 1, wherein the facilitating further comprises allowing the user to select one or more views for the presentation.

3. The computer-readable storage medium of claim 2, wherein the facilitating further comprises allowing the user to select non-image patient data to be displayed on the presentation.

4. The computer-readable storage medium of claim 1, wherein the receiving is responsive to a user clicking on the individual semantically-labeled user-selectable anatomical structure or responsive to the user entering text corresponding to the individual semantically-labeled user-selectable anatomical structure in a command window.

5. The computer-readable storage medium of claim 1, wherein the image data comprises recent image data from a patient and further comprising obtaining historical image data of the patient and transforming the historical image data in a manner that promotes a meaningful comparison between the recent image data and the historical image data.

6. The computer-readable storage medium of claim 5, further comprising aligning the transformed historical image data with the recent image data.

7. The computer-readable storage medium of claim 1, further comprising selecting a view for the sub-set of image data and in an instance where historical image data of the individual semantically-labeled anatomical structure is located, but the located historical image data does not match the view, synthesizing a view of the historical image data from the available historical image data.

8. The computer-readable storage medium of claim 1, wherein the locating further comprises searching for corresponding historical image data that includes a matching semantically-labeled anatomical structure.

9. The computer-readable storage medium of claim 1, further comprising automatically adjusting a parameter of the anatomical structure in the presentation to distinguish the anatomical structure from surrounding tissues.

10. The computer-readable storage medium of claim 1, further comprising processing the sub-set of image data utilizing a context-based semantic labeling algorithm to identify elements of the anatomical structure.

11. The computer-readable storage medium of claim 1, wherein the sub-set of image data includes a first semantically-labeled image and further comprising leveraging the first semantically-labeled image to automatically semantically label anatomical structures in a second image.

12. The computer-readable storage medium of claim 1, wherein the locating comprises automatically processing the image data utilizing a semantic labeling algorithm.

13. The computer-readable storage medium of claim 1, further comprising identifying non-image patient data that is relevant to the user-selected anatomical structure.

14. At least one computer-readable storage medium having instructions stored thereon that, when executed by a computing device, cause the computing device to perform acts, comprising:

receiving a request for image data associated with a semantic label, wherein the image data is from a set of relatively recently obtained images of a patient;

retrieving other relatively older image data belonging to the patient and associated with a similar semantic label; and

,

searching for other non-image patient data that is germane to the semantic label.

15. The computer-readable storage medium of claim 14, wherein the retrieving further comprises causing the relatively older image data to be semantically labeled.

16. The computer-readable storage medium of claim 14, wherein the retrieving further comprises transforming the relatively older image data to match a size or view of the relatively recently obtained images.

17. The computer-readable storage medium of claim 16, wherein the transforming is accomplished via a registration process.

18. A system, comprising:

a semantic labeling component configured to cause recent image data to be semantically labeled; and

,

a visualization component configured to cause individual semantically labeled anatomical structures from the recent image data to be displayed with non-image data that is relevant to the individual semantically labeled anatomical structures.

19. The system of claim 18, wherein the visualization component is further configured to register semantically labeled historic image data and to cause a presentation to be generated that includes both the semantically labeled recent image data and the registered semantically labeled historic image data.

20. The system of claim 18, wherein the visualization component is further configured to perform a quality control evaluation based upon the individual semantically labeled anatomical structures and the non-image data.