Method and computerized user interface for presentation of multiple image data sets

• US 8,640,053 B2
• Filed: 06/12/2009
• Issued: 01/28/2014
• Est. Priority Date: 06/12/2008
• Status: Expired due to Fees

• Current Assignee: Siemens Healthcare GMBH (Siemens AG)
• Original Assignee: Siemens AG
• Inventors: Hellinger, Marion, Schmidt, Sebastian
• Primary Examiner(s): TRAN, TUYETLIEN T
• Application Number:
  US12/483,361
• Publication Number:
  US 20090313585A1
• Time in Patent Office: 1,691 Days
• Field of Search: 715/848, 715/850, 715/853, 715/854
• US Class Current: 715/850
• CPC Class Codes: A61B 5/7425 Displaying combinations of multiple images regardless of image source, e.g. displaying a reference anatomical image with a live image geometric transforms for image registration G06T3/14; enhancement using image fusion G06T5/50; algorithms for registration of images G06T7/30
• CPC Class Codes: G06T 19/00 Manipulating 3D models or images for computer graphics

Abstract

In a method and user interface for the presentation of multiple image data sets within the scope of a comparative evaluation, a determination is made of at least three organization parameters that describe a sorting of images within an image data set and/or across image data sets, at least one organization parameter is associated with at least one dimension of a three-dimensional matrix, which one dimension is associated with a spatial direction, the images of the image data sets are arranged in the three-dimensional matrix according to the sorting, using the organization parameters and the dimensions, and at least a portion of the images is shown on a presentation device according to their arrangement in the three-dimensional matrix and the spatial directions.

Claims

1. A method for presenting multiple image data sets in a display format allowing comparative evaluation of image content of the respective multiple image data sets, comprising:

in a processor, automatically determining at least three organization parameters that describe a sorting of images within an image data set, or image among a plurality of image data sets, each of said images having an image content comprising more information than is visually representable by an icon;

at a display in communication with said processor, visually displaying a display format comprising at least two displayed axes and comprising a plurality of said at least three organization parameters respectively as organization parameter icons;

via an input unit in communication with said processor, allowing manual interaction with said display format to selectively associate one of said organization parameter icons with one of said displayed axes;

in said processor, associating the organization parameter represented by said one of said organization parameter icons with at least one dimension of a three-dimensional matrix, said at least one dimension being associated with a spatial direction;

in said processor, arranging said image data sets at respective three-dimensionally defined positions in said three-dimensional matrix according to said at least three organization parameters and said at least one dimension; and

from said processor, causing said image data sets to be visually displayed in said display format at said display according to said arrangement in said three-dimensional matrix and said at least one spatial dimension, with said image content of each of said displayed images being visible in said display format in a form allowing comparative evaluation the respective image content of the displayed images.

2. A method as claimed in claim 1 comprising allowing manual navigation within said three-dimensional matrix presented at said display by manipulating an input unit, in communication with said processor, having an input modality for spatial direction, respectively associated with the dimensions of said three-dimensional matrix, that are perpendicular to one another, selected from the group consisting of a zero-dimensional input modality and a one-dimensional input modality.

3. A method as claimed in claim 1 comprising allowing navigation within said three-dimensional matrix presented at said display by manipulating an input unit in communication with said processor having a two-dimensional input modality for two spatial directions respectively associated with dimensions of said three-dimensional matrix.

4. A method as claimed in claim 1 comprising navigating within said three-dimensional matrix presented at said display by manipulating an input unit in communication with said processor having a one-dimensional input modality allowing interactive actuation along said spatial direction associated with said at least one dimension.

5. A method as claimed in claim 1 comprising presenting said images at said display in a two-dimensional presentation having two spatial directions associated therewith, and allowing selection of individual ones of the images in said three-dimensional matrix in a third direction by operating a computer mouse in communication with said processor, by an operation selected from the group consisting of combined actuation of two actuation directions of said computer mouse that are perpendicular to each other by moving said mouse on a pad, and operating a scroll wheel of said computer mouse.

6. A method as claimed in claim 1 comprising varying a number of said images presented at said display and a corresponding variation of a size of the presented images by selecting a zoom function.

7. A method as claimed in claim 6 comprising navigating among said images presented in said three-dimensional matrix at said display with a first input modality, and selecting said zoom function with a second input modality.

8. A method as claimed in claim 1 comprising presenting said images at said display with respectively different presentation sizes with a central one of the displayed images having a larger size than images presented at an edge of display.

9. A method as claimed in claim 1 comprising presenting said images in a two-dimensional presentation at said display and, in said presentation, overlapping a currently presented image with a following or preceding image in a third dimension of said three-dimensional matrix, using a presentation effect selected from the group consisting of a transparency effect and a false color effect.

10. A method as claimed in claim 1 comprising allowing selection of said image data to be presented at said display by user-operated manipulation of said input unit in communication with said processor.

11. A method as claimed in claim 1 comprising, in said processor, automatically determining at least a portion of said organization parameters from at least one of said image data sets.

12. A method as claimed in claim 11 comprising storing said organization parameters in said at least one image data set.

13. A method as claimed in claim 11 comprising determining said at least one organization parameter by backward calculation from image data of said at least one image data set.

14. A method as claimed in claim 1 comprising allowing selection of said organization parameters and said at least one dimension by user manipulation of said input unit connected to said processor.

15. A method as claimed in claim 1 comprising associating more than one of said organization parameters with one of said dimensions.

16. A method as claimed in claim 15 comprising, in said processor, sorting said images in said one dimension having more than one organization parameter associated therewith in an order determined by association of said organization parameters with said one dimension.

17. A method as claimed in claim 1 comprising, in said processor employing organization parameters selected from the group consisting of an acquisition time of said image data sets, a time of administration of a contrast agent to generate said image data sets, spatial dimensions within an image data set, at least one image acquisition parameter used to acquire the image data sets, a magnetic resonance sequence used to acquire said imaged data sets, an evaluation parameter for evaluating said image data sets, a filter type for evaluating said image data sets, an orientation of said image data sets in a patient, and an imaging modality used to acquire said imaged data sets.

18. A method as claimed in claim 1 comprising, before presenting said image data sets at said display, editing said image data sets to be displayed, in said processor, by an editing function selected from the group consisting of bringing said image data sets into registration with each other, and correcting for distortion in said image data sets.

19. A method as claimed in claim 1 comprising presenting successive images in one dimension of said three-dimensional matrix at said display with identical presentation parameters to facilitate said comparative evaluation among said images presented at said display.

20. A method as claimed in claim 1 wherein said images are two-dimensional images and three-dimensional images and comprising, in said processor, determining, for each of said three-dimensional images that is displayed, a two-dimensional projection thereof that corresponds to a projection of the two-dimensional images that are displayed, and presenting said three-dimensional images at said display with said two-dimensional projection.

21. A method as claimed in claim 1 comprising, in said processor, adapting successive images presented in said display with each other with regard to an anatomical region shown therein.

22. A user interface for presenting multiple image data sets in a display format allowing comparative evaluation of image content of the respective multiple image data sets, comprising:

a processor configured to automatically determine at least three organization parameters that describe a sorting of images within an image data set, or image among a plurality of image data sets, each of said images having an image content comprising more information than is visually representable by an icon;

a display in communication with said processor, said processor being configured to visually display a display format at said display comprising at least two displayed axes and comprising a plurality of said at least three organization parameters respectively as organization parameter icons;

an input unit in communication with said processor being configured to allow manual interaction with said display format to selectively associate one of said organization parameter icons with one of said displayed axes;

said processor being configured to associate the organization parameter represented by said one of said organization parameter icons with at least one dimension of a three-dimensional matrix, said at least one dimension being associated with a spatial direction;

said processor being configured to arrange said image data sets at respective three-dimensionally defined positions in said three-dimensional matrix according to said at least three organization parameters and said at least one dimension; and

said processor being configured to cause said image data sets to be visually displayed in said display format at said display according to said arrangement in said three-dimensional matrix and said at least one spatial dimension, with said image content of each of said displayed images being visible in said display format in a form allowing comparative evaluation the respective image content of the displayed images.

23. A user interface as claimed in claim 22 wherein said input unit is configured to implement a first input modality wherein said input unit is manipulatable to allow manual navigation among said images presented in said three-dimensional matrix at said display, and to implement a second input modality to select a zoom function.

24. A user interface as claimed in claim 22 wherein said processor is configured to present said images at said display with respectively different presentation sizes with a central one of the displayed images having a larger size than images presented at an edge of display.

25. A user interface as claimed in claim 22 wherein said processor is configured to present said images in said two-dimensional presentation at said display by overlapping a currently presented image with a following or preceding image in a third dimension of said three-dimensional matrix, using a presentation effect selected from the group consisting of a transparency effect and a false color effect.

26. A user interface as claimed in claim 22 wherein said processor is configured to present successive images in one dimension of said three-dimensional matrix at said display with identical presentation parameters to facilitate said comparative evaluation among said images presented at said display.

27. A user interface as claimed in claim 22 wherein said images are two-dimensional images and three-dimensional images and wherein said processor is configured to determine, for each of said three-dimensional images that is displayed, a two-dimensional projection thereof that corresponds to a projection of the two-dimensional images that are displayed, and to present said three-dimensional images at said display with said two-dimensional projection.

28. A user interface as claimed in claim 22 wherein said processor is configured to adapt successive images presented in said display with each other with regard to an anatomical region shown therein.