MULTI-MODALITY MEDICAL IMAGE VIEWING

• US 20080008401A1
• Filed: 06/14/2006
• Published: 01/10/2008
• Est. Priority Date: 06/14/2006
• Status: Active Grant

• Current Assignee: Koninklijke Philips N.V.
• Original Assignee: Koninklijke Philips Electronics N.V. (Koninklijke Philips N.V.)
• Inventors: SUKALAC, Ronald W., CHEN, Richard Cheng-Hsiu, MANIAWSKI, Dawn M., DAUTERMAN, Chris A., NORTMANN, Charles A., ZHU, Yang-Ming, AHUJA, Madhavi, WU, Xiangyu, LOVE, L. Alan, COCHOFF, Steven M.
• Granted Patent: US 8,280,483 B2
• Time in Patent Office: Days
• US Class Current: 382/294
• CPC Class Codes: A61B 5/05 Detecting, measuring or recording for diagnosis by means of electric currents or magnetic fields; Measuring using microwaves or radio waves impedance plethysmography A61B5/0295; measuring movement of the entire body or parts thereof A61B5/11; detecting, measuring or recording bioelectric or biomagnetic signals of the body or parts thereof A61B5/24
• CPC Class Codes: A61B 6/463 characterised by displaying multiple images or images and diagnostic data on one display
• CPC Class Codes: G06F 16/957 Browsing optimisation, e.g. caching or content distillation
• CPC Class Codes: G06F 16/9577 Optimising the visualization of content, e.g. distillation of HTML documents
• CPC Class Codes: G06T 2200/24 involving graphical user interfaces [GUIs]
• CPC Class Codes: G16H 30/00 ICT specially adapted for the handling or processing of medical images computed tomography A61B6/03
• CPC Class Codes: G16H 30/20 for handling medical images, e.g. DICOM, HL7 or PACS
• CPC Class Codes: G16H 30/40 for processing medical images, e.g. editing
• CPC Class Codes: G16H 40/63 for local operation
• CPC Class Codes: G16Z 99/00 Subject matter not provided for in other main groups of this subclass

Abstract

A medical imaging system (10) comprises one or more displays (66). A viewer device (86) generates an interactive user interface screen (80) on the display (66), which viewer device (86) enables a user to simultaneously inspect selected image data of multiple patients or multiple images.

Claims

1. A medical imaging system (10) comprising:

one or more displays (66); and

a viewer device (86) for generating an interactive user interface screen (80) on the display (66), which viewer device (86) enables a user to simultaneously inspect selected image data of multiple patients or multiple images.

2. The system as set forth in claim 1, wherein the viewer device (86) includes:

a patient viewer manager (90) which launches each patient for viewing in a preselected order; and

a patient viewing component (92) which displays image data of each patient.

3. The system as set forth in claim 2, wherein the patient viewing component (92) displays image data of multiple patients for direct side by side comparison on one of a single display (66) or the displays (66).

4. The system as set forth in claim 1, further including:

a layout device (94) which automatically selects a layout for display of the images based at least on the selected image data and user preferences.

5. The system as set forth in claim 1, further including:

a registration device (108) which identifies a global reference image (110) in the selected image data, and determines a registration matrix (116) which aligns an image (112) with the global reference image (110).

6. The system as set forth in claim 5, further including:

a comparator (130) which compares selected viewing groups (132, 134) of images.

7. The system as set forth in claim 6, further including:

a group registration device (138) which registers or aligns images of the selected groups (132, 134).

8. The system as set forth in claim 7, wherein the group registration device (138) is programmed to perform steps of:

identifying at least a first point in a first group image;

determining coordinates of the first point;

identifying at least a second point in a second group image;

determining coordinates of the second point; and

computing a registration relation between the first and second points.

9. The system as set forth in claim 7, wherein the group registration device (138) is programmed to perform steps of:

selecting a reference image in a first group (132);

selecting a reference image in a second group (134);

computing registration between the images of the first and second groups (132, 134) as

M_r1r2=M_r1<sup>−

1</sup>M_r2,

where M_r1r2 is the registration between the images of the first and second groups,

M_r1 is a registration of the selected first group reference image with respect to the global reference image, and

M_r2 is the registration of the selected second group reference image with respect to the global reference image.

10. The system as set forth in claim 1, wherein the images are generated by scanners (22, 40) which include at least one of:

PET, SPECT, MRI, ultrasound, fluoroscopy, CT, and digital x-ray.

11. A medical imaging system (10) comprising:

a memory (114) which stores frame of reference of a selected global reference (110);

a registration device (108) which registers images to the global frame of reference such that all images are aligned with one another; and

a display (66) which concurrently displays aligned images.

12. The system as set forth in claim 11, further including:

a registration matrix memory (116) in which the registration device (108) stores a registration matrix which defines a relationship between each image (112) and the global reference image (110).

13. The system as set forth in claim 11, wherein the registration device (108) is programmed to perform steps of:

comparing a frame of reference of each image (112) to the global frame of reference; and

based on the comparison, one of;

determining a registration matrix as an identity matrix; and

determining values of the registration matrix between the image and the global reference image, and

propagating the determined registration matrix to the images whose frames of reference coincide with the frame of reference of the image (112).

14. The system as set forth in claim 11, wherein the registration device (108) is programmed to perform a step of:

determining a registration relation between first and second images (117, 118) as

M_r1r2=M r1<sup>−

1</sup>M_r2,

where M_r1r2 is the registration between the first and second images,

M_r1 is the registration of the first image with respect to the global reference image; and

M_r2 is the registration of the second image with respect to the global reference image.

15. The system as set forth in claim 14, wherein at least one of the images is oblique.

16. The system as set forth in claim 11, wherein the images are generated by a multi-modality imaging system which includes at least two of:

PET, SPECT, MRI, ultrasound, fluoroscopy, CT and digital x-ray.

17. The system as set forth in claim 11, wherein the images are generated by imaging different patients.

18. A medical imaging system (10) comprising:

a localization device (120) which determines a 3D position of a point of interest (124) in one image and, based on the determined position of the point of interest in the image, determines positions of corresponding points of interest (126) in associated images; and

a display (66) which concurrently displays the images with the determined points of interest (124, 126).

19. The system as set forth in claim 18, wherein the localization device (120) is programmed to perform steps of:

retrieving a position of the point of interest (124) in the display coordinate system;

transforming the display coordinates of the point of interest (124) into patient coordinates in accordance with image position and orientation;

determining a position of an original point of interest in the patient coordinate system;

transforming coordinates of the original point into the common coordinate system; and

updating the associated images.

20. The system as set forth in claim 18, wherein the localization device (120) propagates image elements identified in the one image to the associated images, the image elements including at least one of a region of interest, marker, and label;

and wherein the display (66) concurrently displays the images with the image elements.

21. A medical imaging system (10) comprising:

a memory (114) which stores a frame of reference of a selected global reference (110);

a registration device (108) which registers first and second images (A, B) to the global frame of reference; and

an oblique processor or algorithm (168) which reformats the first image (A) with respect to the second image (B), the second image (B) having oblique orientation.

22. A medical imaging system (10) comprising:

a display (66); and

a layout definition (196) which defines attributes (200) of a layout of the images to be displayed on the display (66) for a view by a user.

23. The system as set forth in claim 22, wherein the layout attributes (200) include at least a data input (202), and a viewer (204).

24. The system as set forth in claim 22, further including:

a layout device (94) which builds a complete display protocol based at least on the defined layout attributes (200).

25. The system as set forth in claim 24, wherein the selected image data includes studies including series and the layout device (94) is programmed to perform steps of:

based on studies sorting rules (214), determining a succession in which the studies are to be displayed;

based on series role sorting rules (222), selecting a reference series in the study determined to be displayed first;

based on series sorting rules (232) and the selected reference series, determining a preferred order for series display;

identifying matching layouts based at least on the determined preferred order for the series display;

based on layout sorting rules (252) and identified matching layouts, determining a succession of launching layouts; and

executing the determined preferential layout.

26. The system as set forth in claim 25, wherein the rules (214, 222, 232, 252) include at least one of:

a rule by which a newer study is displayed before an older study,

a rule by which a series with the highest resolution is selected,

a rule by which the series are sorted into at least anatomical and functional groups,

a rule by which the series succession within the group is based on an imaging device (22, 40), and

a rule by which the layout is selected based at least on one of a match of the layout attributes (200) and data inputs, and user preference.

27. The system as set forth in claim 26, wherein the succession of the imaging devices (22, 40) is PET/SPECT/CT/MR/SC.

28. The system as set forth in claim 25, wherein the layout device (94) is further programmed to perform steps of:

building the full display protocol; and

executing the full display protocol.

29. The system as set forth in claim 28, further including:

a protocol engine (290) which establishes a viewing network based on the full display protocol.

30. The system as set forth in claim 29, further including:

a link controller (294) which dynamically links viewers with an associated image data based on linking rules in response to user'"'"'s interactions such as changing fusion states in viewers.

31. The system as set forth in claim 25, wherein the layout device (94) is further programmed to perform a step of:

preserving the viewing context based on a set of rules which context includes at least one of a color map, a window level, a hot spot, zoom/pan factors, image index offset, start position and free dimension.

32. The system as set forth in claim 25, wherein the user controls the display of oblique images by determining an oblique angle and setting an oblique display based on the determined oblique angle.

33. A medical imaging system (10) comprising:

a display (66); and

a fusion controller (326) which controls the display of fused and non fused images on the display (66) with a toggle switch (328).

34. The system as set forth in claim 33, further including:

a link controller (294) which automatically connects or disconnects viewers with an associated image data based on a status of the toggle switch.

35. A medical imaging system (10) comprising:

a display (66); and

a layout definition (196) which facilitates a user to define attributes (200) of a layout of images to be displayed on the display (66).

36. The system as set forth in claim 35, wherein each layout attribute (200) includes a selectable number of layout elements.

37. The system as set forth in claim 35, wherein at least some of the layout elements include modifiable at least one of a size, location, color, and image type.

38. A medical imaging system (10) comprising:

a display (66);

a layout device (94) which automatically selects a layout for display of selected images based at least on the selected images and user preferences;

an interface screen (80) which facilitates a user to modify the selected layout; and

a means (82) for saving the modified layout.

39. The system as set forth in claim 38, further including:

an icon (344) under which the modified layout is saved.

40. A medical imaging method comprising:

generating an interactive user interface screen (80) on a display (66); and

simultaneously inspecting selected image data of multiple patients or multiple images on the display.

41. The method as set forth in claim 40, further including:

launching each patient in a preselected order; and

displaying image data of each patient on the display.

42. The method as set forth in claim 41, further including:

displaying image data of multiple patients for a direct side by side comparison on one or more displays.

43. The method as set forth in claim 40, further including:

selecting a layout for display of the images based at least on the selected image data and user preferences.

44. The method as set forth in claim 40, further including:

identifying a global reference image (110) in the selected image data;

determining a registration matrix (116) which aligns a registering image (112) with the global reference image (110);

comparing a frame of reference of remaining images to a frame of reference of the global reference image (110); and

propagating the registration matrix (116) to the images whose frames of reference coincide with the frame of reference of the registering image (112).

45. The method as set forth in claim 40, further including:

identifying a global reference image (110); and

aligning all images to the selected global reference image (110).

46. The method as set forth in claim 45, further including:

defining a relationship between each image and the global reference image (110) via a registration matrix.

47. The method as set forth in claim 46, further including:

comparing a frame of reference of each image (112) to the frame of reference of the global reference image; and

based on the comparison, one of;

defining an identity matrix as the registration matrix, and

propagating the registration matrix to the images whose frames of reference coincide with the frame of reference of the image (112).

48. The method as set forth in claim 46, further including:

determining a registration relation between first and second images as

M_r1r2=M_r1<sup>−

1</sup>M_r2,

where M_r1r2 is the registration relation between the first and second images,

M_r1 is the registration of the first image with respect to the global reference image; and

M_r2 is the registration of the second image with respect to the global reference image.

49. The method as set forth in claim 45, further including:

determining a 3D position of a point of interest (124) in one image; and

based on the determined position of the point of interest in the image, determining positions of corresponding points of interest (126) in associated images.

50. The method as set forth in claim 49, further including:

retrieving a position of the point of interest (124) in the display coordinate system;

transforming the display coordinates of the point of interest (124) into patient coordinates in accordance with image position and orientation;

determining a position of an original point of interest in the patient coordinate system;

transforming coordinates of the original point into the common coordinate system; and

updating the associated images.

51. The method as set forth in claim 40, further including:

comparing selected viewing groups (132, 134) of images, the images in each group (132, 134) having a known registration relation to a common global reference (110).

52. The method as set forth in claim 51, further including:

registering or aligning images of the selected groups (132, 134).

53. The method as set forth in claim 52, further including:

identifying a first point in a first group image;

determining coordinates of the first point;

identifying a second point in a second group image;

determining coordinates of the second point; and

computing a registration relation between the first and second points.

54. The method as set forth in claim 52, further including:

selecting a reference image in a first group (132);

selecting a reference image in a second group (134); and

computing registration between the images of the first and second groups (132, 134) as

M_r1r2=M_r1<sup>−

1</sup>M_r2,

where M_r1r2 is the registration between the images of the first and second groups,

M_r1 is a registration of the selected first group reference image with respect to the global reference image, and

M_r2 is the registration of the selected second group reference image with respect to the global reference image.

55. The method as set forth in claim 40, wherein the selected image data includes at least first and second images (A, B), the first and second images (A, B) having a known registration relation to a common global reference (110) and further including:

registering the first image (A) with respect to the second image (B), the second image (B) having oblique orientation with relation to the first image (A).

56. The method as set forth in claim 40, further including:

generating images by at least one of;

PET, SPECT, MRI, ultrasound, fluoroscopy, CT, and digital x-ray.

57. The method as set forth in claim 40, further including:

defining attributes (200) of a layout of the images; and

displaying the images with the defined attributes on the display (66) for a view by a user.

58. The method as set forth in claim 57, further including:

building a complete display protocol based at least on the defined layout attributes (200).

59. The method as set forth in claim 58, wherein the selected image data includes studies including series and further including:

based on studies sorting rules (214), determining a succession in which the studies are to be displayed;

based on series role sorting rules (222), selecting a reference series in the study determined to be displayed first;

based on series sorting rules (232) and the selected reference series, determining a preferred order for series display;

identifying matching layouts based at least on the determined preferred order for the series display;

based on layout sorting rules (252) and identified matching layouts, determining a succession of launching layouts; and

executing the determined preferential layout.

60. The method as set forth in claim 59, further including:

building the full display protocol; and

executing the full display protocol.

61. The method as set forth in claim 60, further including:

establishing a viewing network based on the full display protocol.

62. The method as set forth in claim 61, further including:

automatically linking viewers with an associated image data based on linking rules.

63. The method as set forth in claim 59, further including:

preserving the viewing context based on a set of rules which context includes at least one of a color map, a window level, a hot spot, zoom/pan factors, image index offset, start position and free dimension.

64. The method as set forth in claim 59, further including:

controlling the display of fused and non fused images with a toggle switch (328); and

automatically connecting or disconnecting viewers with an associated image data based on a status of the toggle switch.

65. The method as set forth in claim 59, further including:

modifying the executed layout; and

saving the modified layout as an icon (344).

66. The method as set forth in claim 59, further including:

controlling display of oblique images including;

determining an oblique angle; and

setting an oblique display based on the determined oblique angle.

67. A medical imaging system for performing the method of claim 40.