Method and system for facilitating an image guided medical procedure

• US 8,934,684 B2
• Filed: 06/07/2010
• Issued: 01/13/2015
• Est. Priority Date: 07/31/2009
• Status: Active Grant

• Current Assignee: Siemens Healthineers AG (Siemens AG)
• Original Assignee: Siemens AG
• Inventors: Mohamed, Ashraf
• Primary Examiner(s): Chen, Wenpeng
• Application Number:
  US12/794,967
• Publication Number:
  US 20110026786A1
• Time in Patent Office: 1,681 Days
• Field of Search: None
• US Class Current: 382/128
• CPC Class Codes: G16H 30/20 for handling medical images, e.g. DICOM, HL7 or PACS
• CPC Class Codes: G16H 30/40 for processing medical images, e.g. editing
• CPC Class Codes: G16H 40/63 for local operation

Abstract

A method for facilitating an image guided medical procedure, utilizing images relating to the procedure, that includes performing a planning stage; performing an assessment stage; and performing an assessment stage via a unified workflow and user interface. The images relating to the procedure and extracted objects from the images are treated in the same manner so that image information from the stages may be combined for pre-, intra-, and post-procedural tasks.

Claims

1. A method for facilitating an image guided medical procedure, comprising:

performing a planning stage, comprising tasks of;

obtaining a plurality of pre-procedural images,

registering and fusing together said plurality of pre-procedural images, and

extracting or creating entities, based on said pre-procedural images;

performing an intervention stage, comprising tasks of;

obtaining intra-procedural images,

registering and fusing said pre-procedural and intra-procedural images,

registering and fusing said entities with said intra-procedural images, and

segmenting selected ones of said entities, based on said intra-procedural images;

performing an assessment stage, comprising tasks of;

obtaining post-procedural images,

registering and fusing said pre-procedural, said intra-procedural, and said post-procedural images,

registering and fusing said entities with said post-procedural images, and

segmenting selected ones of said entities based on said post-procedural images;

determining an availability of a task during each respective stage depending on previously performed tasks, a modality of at least one obtained image, and a respective anatomical region shown in said at least one obtained image; and

providing information on operation and the availability of a task during each respective stage to a user,

wherein said images and said entities are treated in a unified manner as data objects that enables said images and said entities to be registered and fused in a respective task,

wherein said images comprise a plurality of associated attributes,

wherein said entities comprise a plurality of different associated attributes,

wherein the plurality of associated attributes of said images and the plurality of different associated attributes of said entities differ in values, and

wherein the plurality of associated attributes of said images and the plurality of different associated attributes of said entities control a way in which said images and said entities are displayed, manipulated, and used by the respective task.

2. The method for facilitating an image guided medical procedure as recited in claim 1, wherein said extracting or creating entities includes any of segmenting an image area, segmenting a feature, segmenting a tumor, segmenting a treated tumor, segmenting a device, simulating a device, segmenting a vessel tree, planning a needle trajectory, and tracking a needle position.

3. The method for facilitating an image guided medical procedure as recited in claim 1, further comprising utilizing an application assistant computer software program to provide to a user information on the operation and availability of a task during a respective stage, said program being generated by utilizing a particular development tool adapted therefore.

4. The method for facilitating an image guided medical procedure as recited in claim 1, further comprising obtaining information regarding said at least one obtained image from a respective header associated with said at least one obtained image.

5. The method for facilitating an image guided medical procedure as recited in claim 1, further comprising utilizing a single user interface for the performing steps of said planning, intervention, and assessment stages to assist planning, intervention, and assessment stages to assist images, task results, and other data to be shared among the respective tasks of the stages.

6. The method for facilitating an image guided medical procedure as recited in claim 5, further comprising:

developing an application assistant computer software program for facilitating said image guided medical procedure by utilizing a computer software program operating on data, said data comprising data of;

types of images to be handled by said application assistant,

tasks involved at respective stages, and

pre-required conditions necessary before performing a respective task; and

running said application assistant computer software program for facilitating said image guided medical procedure.

7. The method for facilitating an image guided medical procedure as recited in claim 6, wherein said utilizing a computer software program operating on data comprises:

defining user interface software components that permits the user to execute an action as part of carrying out a respective task or an associated sub-task; and

defining pre-required conditions, inputs, and actions on said inputs of a respective task or an associated sub-task.

8. The method for facilitating an image guided medical procedure as recited in claim 6, wherein a respective application assistant makes said data and images from a respective stage available to a subsequently-performed stage, including fused images comprising data from a plurality of images from at least one stage, and provides guidance for the user on the operation and availability of a particular task during a respective stage by way of said user interface.

9. The method for facilitating an image guided medical procedure as recited in claim 8, wherein said guidance for the user comprises making available data derived from header information of a respective obtained image.

10. The method for facilitating an image guided medical procedure as recited in claim 8, wherein said guidance for the user comprises providing step by step guidance through tasks required in a specific clinical medical procedure.

11. The method for facilitating an image guided medical procedure as recited in claim 1, further comprising facilitating images, task results, and other data to be shared among the respective tasks of the stages.

12. A method for facilitating an image guided medical procedure, utilizing images relating to said procedure, comprising:

supporting planning, intervention, and assessment stages of said procedure via a unified image-related workflow and a user interface, each respective stage comprising a plurality of tasks, a unified image being comprised of an image or extracted, simulated, or planned image object treated with all other images and image objects in a unified manner as data objects that enables said images and said image objects to be registered and fused in a respective stage;

making data, images, and image objects from a respective stage available to a subsequent stage, including fused images comprising data from a plurality of images from at least one stage;

determining an availability of a task during each respective stage depending on previously performed tasks, a modality of at least one obtained image, and a respective anatomical region shown in said at least one obtained image; and

providing guidance for a user during each respective stage of said procedure on operation and the availability of a task by way of said user interface,

wherein said images comprise a plurality of associated attributes,

wherein said entities comprise a plurality of different associated attributes,

wherein the plurality of associated attributes of said images and the plurality of different associated attributes of said entities differ in values, and

wherein the plurality of associated attributes of said images and the plurality of different associated attributes of said entities control a way in which said images and said entities are displayed, manipulated, and used by the respective task.

13. The method as recited in claim 12, wherein said making data, images and image objects comprises:

making available data on fused images comprising data from a plurality of images from a plurality of stages; and

making available data on fused images comprising data from image objects.

14. The method as recited in claim 12, wherein said making data, images and image objects comprises:

making available data on fused images comprising data from a plurality of images from a plurality of stages; and

making available data on fused images comprising data from image objects including data from a plurality of stages.

15. The method as recited in claim 12, wherein said providing guidance for the user comprises making available data derived from header information of a respective image.

16. The method as recited in claim 15, wherein said providing guidance for the user comprises utilizing a respective application assistant computer software program to provide step by step guidance through tasks required in a specific clinical procedure.

17. A system for facilitating an image guided medical procedure, utilizing images relating to said procedure, comprising:

a memory device for storing a program and other data; and

a processor in communication with said memory device, said processor being operative with said program for;

supporting planning, intervention, and assessment stages of said procedure via a unified image-related workflow and a user interface, each respective stage comprising a plurality of tasks, a unified image being comprised of an image or extracted, simulated, or planned image object treated with all other images and image objects in a unified manner as data objects that enables said images and said image objects to be registered and fused in a respective stage;

making data, images, and image objects from a respective stage available to a subsequent stage, including fused images comprising data from a plurality of images from at least one stage;

determining an availability of a task during each respective stage depending on previously performed tasks, a modality of at least one obtained image, and a respective anatomical region shown in said at least one obtained image; and

providing guidance for a user during each respective stage of said procedure on operation and the availability of a task by way of said user interface,

wherein said images comprise a plurality of associated attributes,

wherein said entities comprise a plurality of different associated attributes,

wherein the plurality of associated attributes of said images and the plurality of different associated attributes of said entities differ in values, and

wherein the plurality of associated attributes of said images and the plurality of different associated attributes of said entities control a way in which said images and said entities are displayed, manipulated, and used by the respective task.

18. A method for facilitating an image guided medical procedure, comprising:

treating images obtained during pre-procedural, intra-procedural, and post-procedural stages of the procedure and entities either simulated, or extracted or created from said images as data objects;

establishing a single coordinate system for said data objects;

performing tasks of registration and fusion of said data objects in a coupled manner with other image-related tasks operating said data objects during each of the pre-procedural, intra-procedural, and post-procedural stages;

determining an availability of a task during each respective stage depending on previously performed tasks, a modality of at least one obtained image, and a respective anatomical region shown in said at least one obtained image; and

providing, during each respective stage, image information that combines results of the performing step carried out during a respective stage and any stage preceding said respective stage and the availability of a task during a respective stage to a user,

wherein said images comprise a plurality of associated attributes,

wherein said entities comprise a plurality of different associated attributes,

wherein the plurality of associated attributes of said images and the plurality of different associated attributes of said entities differ in values, and

wherein the plurality of associated attributes of said images and the plurality of different associated attributes of said entities control a way in which said images and said entities are displayed, manipulated, and used by the respective task.

19. A non-transitory computer medium embodied a computer program for performing method steps comprising:

performing a planning stage, comprising tasks of;

obtaining a plurality of pre-procedural images,

registering and fusing together said plurality of pre-procedural images, and

extracting or creating entities, based on said pre-procedural images;

performing an intervention stage, comprising tasks of;

obtaining intra-procedural images,

registering and fusing said pre-procedural and intra-procedural images,

registering and fusing said entities with said intra-procedural images, and

segmenting selected ones of said entities, based on said intra-procedural images;

performing an assessment stage, comprising tasks of;

obtaining post-procedural images,

registering and fusing said pre-procedural, said intra-procedural, and said post-procedural images,

registering and fusing said entities with said post-procedural images, and

segmenting selected ones of said entities based on said post-procedural images;

determining an availability of a task during each respective stage depending on previously performed tasks, a modality of at least one obtained image, and a respective anatomical region shown in said at least one obtained image;

providing information on operation and the availability of a task during each respective stage to a user; and

presenting a plurality of views for each of the method steps comprising a user interface view and an action view,

wherein said images and said entities are treated in a unified manner as data objects that enables said images and said entities to be registered and fused in a respective task,

wherein said images comprise a plurality of associated attributes,

wherein said entities comprise a plurality of different associated attributes,

wherein the plurality of associated attributes of said images and the plurality of different associated attributes of said entities differ in values,

wherein the plurality of associated attributes of said images and the plurality of different associated attributes of said entities control a way in which said images and said entities are displayed, manipulated, and used by the respective task,

wherein the user interface view presents a layout to the user via a user interface view component, and

wherein the action view presents preconditions to be met before performing said each of the method steps and inputs from previous method steps.

20. The non-transitory computer medium as recited in claim 19,

wherein said user interface view component is selected from the group consisting of:

a push button, a radio button, and a text box,

wherein said user interface view component is clicked by the user for triggering a service task, and

wherein the service task comprises a registration service task to register an external MRI image to a real-time angiographic X-ray image.