METHOD AND SYSTEM FOR INTERACTIVE CONTROL OF WINDOW/LEVEL PARAMETERS OF MULTI-IMAGE DISPLAYS

• US 20120218290A1
• Filed: 02/26/2012
• Published: 08/30/2012
• Est. Priority Date: 02/28/2011
• Status: Active Grant

• Current Assignee: Siemens Healthineers International AG (Siemens AG)
• Original Assignee: Varian Medical Systems International AG (Siemens AG)
• Inventors: WASCHBUESCH, Michael, MUNRO, Peter
• Granted Patent: US 10,152,951 B2
• Time in Patent Office: Days
• US Class Current: 345/619
• CPC Class Codes: F04C 2270/0421 Controlled or regulated
• CPC Class Codes: G06F 3/04847 Interaction techniques to control parameter settings, e.g. interaction with sliders or dials
• CPC Class Codes: G06T 2207/10072 Tomographic images
• CPC Class Codes: G06T 2207/20092 Interactive image processing based on input by user
• CPC Class Codes: G06T 5/40 using histogram techniques
• CPC Class Codes: G06T 5/92 based on global image properties
• CPC Class Codes: G09G 2340/12 Overlay of images, i.e. displayed pixel being the result of switching between the corresponding input pixels
• CPC Class Codes: G09G 2380/08 Biomedical applications
• CPC Class Codes: G09G 5/377 for mixing or overlaying two or more graphic patterns G09G5/02, G09G5/397 take precedence

Abstract

A method, system, and article of manufacture are described for interactive control of multiple images with a high dynamic range that are displayed simultaneously. A medical image control engine provides several synchronous functional capabilities, which comprises an input module, a blending factor synchronization module, a window/level synchronization module, a display module, and an image storage. For window/level adjustment of two images in blended views, the blending factor synchronization module is configured to automatically link the activation of a window/level control of one image with a transparency blending factor that affects both images. For synchronization of window/level adjustments of two or more images, a window/level synchronization module is configured to automatically change window/level parameters of all remaining images when the user makes an adjustment to a window/level control of one image such that all images with updated window/level parameters are displayed simultaneously.

Claims

1. A computer-implemented method for adjusting a plurality of images, comprising:

displaying a first image and a second image in a blended view on a display, the first image associated with first window/level parameters and the second image associated with second window/level parameters;

adjusting the first window/level parameters of the first image thereby causing a transparency blending factor to change to a first value; and

displaying the first and second images in the blended view on the display based on the adjustments to the first window/level parameters and the transparency blending factor.

2. The method as recited in claim 1, wherein the adjusting step comprises adjusting the second window/level parameters of the second image thereby causing the transparency blending factor to change to a second value.

3. The method as recited in claim 1, wherein the adjusting step comprises adjusting the first window/level parameters in the first image causing the transparency blending factor to slide completely in a first direction, the first image being fully opaque and the second image being fully transparent when the transparency blending factor is at the first value.

4. The method as recited in claim 1, wherein the adjusting step comprises adjusting the second window/level parameters in the second image causing the transparency blending factor to slide completely in a second direction, wherein the second image is fully opaque and the first image is fully transparent when the transparency blending factor is at the second value.

5. The method as recited in claim 1, wherein the value of the transparency blending factor ranges from zero to one.

6. The method as recited in claim 1, wherein the second displaying step comprises both the first and second images being semi-transparent and semi-opaque.

7. The method as recited in claim 1, wherein the first displaying step comprises displaying a first control region associated with first window/level parameters of the first image;

and displaying a second control region associated with the second window/level parameters of the second image.

8. The method as recited in claim 7, wherein the adjusting step is directed by an input device for selecting the adjustment in the first control region affecting the first image without affecting the second image, or selecting the adjustment in the second control region affecting the second image without affecting the first image.

9. The method as recited in claim 7, wherein the first control region has a first predetermined invisible area on the display that is responsive to a directing action by an input device placed within the first control region, and the second control region has a second predetermined invisible area on the display that is responsive to the directing action by the input device placed within the second control region.

10. The method as recited in claim 7, wherein the first control region has a first predetermined invisible area on the display that is responsive to a directing action by an input device placed within the first control region, the second control region has a second predetermined invisible area on the display that is responsive to the directing action by the input device placed within the second control region, the directing action in the first control region being independent of the directing action in the second control region.

11. The method as recited in claim 7, wherein the first control region has a first predetermined invisible area on the display that is responsive to a directing action by an input device placed within the first control region, the directing action simultaneously causing a combination of increased transparency and increased zooming such that the first image become more transparent and enlarged.

12. The method as recited in claim 1, prior to the first displaying step, further comprising scanning the first image and the second image, wherein the scanning step is performed by at least one scanner from the group of scanners consisting of an x-ray scanner, a computerized tomographic (CT) scanner, a cone beam computerized tomographic (CBCT) scanner, a magnetic resonance imaging (MRI) scanner, a positron emission tomographic (PET) scanner, and an ultrasound scanner.

13. The method as recited in claim 1, wherein the first image comprises a first medical image obtained from a first medical image scanner, and the second image comprises a second medical image obtained from the first medical imaging scanner.

14. The method as recited in claim 1, wherein the first image comprises a first medical image obtained from a first medical image scanner, and the second image comprises a second medical image obtained from a second medical imaging scanner.

15. The method as recited in claim 1, wherein the first and second images comprise two-dimensional (2D) images, three-dimensional (3D) images, 2D videos, and 3D videos, and any combination of these.

16. The method as recitec in claim, wherein the first image comprises a disease-matched expert case with a set of target volume contours providing outlines of different computerized tomographic (CT) images, the second image including a first medical image obtained from a first medical scanner and overlaying the first image.

17. A system for adjusting a plurality of images in a blended view, comprising:

an input module configured to receive a first image and a second image, the first image associated with first window/level parameters and the second image associated with second window/level parameters;

a display module configured to display the first and second images in a blended view on a display; and

a synchronization module configured to adjust the first window/level parameters in the first image thereby causing a transparency blending factor to change to a value;

wherein the display module displaying the first and second images in the blended view on the display based on the adjustments to the first window/level parameters and the transparency blending factor.

18. The system as recited in claim 17, wherein the synchronization module is configured to reset the transparency blending factor to an initial value.

19. The system as recited in claim 17, further comprising at least one scanner for scanning the first and second images, wherein the at least one scanner is selected from the group of scanners consisting of an x-ray scanner, a computerized tomographic (CT) scanner, a cone beam computerized tomographic (CBCT) scanner, a magnetic resonance imaging (MRI) scanner, a positron emission tomographic (PET) scanner, and an ultrasound scanner.

20. The system as recited in claim 17, wherein the first image comprises a first medical image obtained from a first medical imaging scanner, and the second image comprises a second medical image obtained from the first medical imaging scanner.

21. The system as recited in claim 17, wherein the first image comprises a first medical image obtained from a first medical imaging scanner, and the second image comprises a second medical image obtained from a second medical imaging scanner.

22. The system as recited in claim 17, wherein the first and second images comprise two-dimensional (2D) images, three-dimensional (3D) images, 2D videos, and 3D videos, and any combination of these.

23. A computer-implemented method for interactive control of a plurality of images, comprising:

receiving an input window/level parameters of a first image;

adjusting the input window/level parameters of the first image with updated window/level parameters associated with the first image;

responsive to the adjusting step, computing window/level parameters of a second image with updated window/level parameters associated with the second image, the updated window/level parameters of the second image being computed based on a synchronization relationship with the input window/level parameters of the first image; and

simultaneously displaying the first image with the updated window/level parameters associated with the first image and the second image with the updated window level parameters associated with the second image.

24. The method as recited in claim 23, wherein the response step comprises calculating a plurality of window/level parameters associated with a plurality of images, each image in the plurality of images having respective updated window/level parameters;

and wherein the simultaneously displaying step comprises simultaneously displaying the first image with the updated window/level parameters associated with the first image, the second image with the updated window/level parameters associated with the second image, and the plurality of images with the updated window/level parameters.

25. The method as recited in claim 23, wherein the synchronization relationship in the calculating step comprises mapping the updated window/level parameters of the second image from the input window/level parameters of the first image, pixel data of the first image, pixel data of the second image, metadata of the first image, metadata of the second image and characteristics of a display.

26. The method as recited in claim 23, wherein the synchronization relationship in the calculating step comprises passing through the input window/level parameters of the first image to the updated window/level parameters of the second image.

27. The method as recited in claim 23, wherein the synchronization relationship in the calculating step comprises a histogram equalization of the first image and the second image by comparing a first histogram of display intensities of the first image with a second histogram of display intensities of the second image.

28. The method as recited in claim 27, wherein the histogram equalization comprises further adjusting the window/level parameters of the second image based on a miniature optimization technique if the first histogram of display intensities of the first image is insufficiently similar to the second histogram of display intensities of the second image.

29. The method as recited in claim 27, wherein the histogram equalization comprises generating an output of the window/level associated with the second image if the first histogram of display intensities of the first image is sufficiently similar to the second histogram of display intensities of the second image.

30. The method as recited in claim 23, prior to the first displaying step, further comprising scanning the first image and the second image, wherein the scanning step is performed by at least one scanner from the group of scanners consisting of an x-ray scanner, a computerized tomographic (CT) scanner, a cone beam computerized tomographic (CBCT) scanner, a magnetic resonance imaging (MRI) scanner, a positron emission tomographic (PET) scanner, and an ultrasound scanner.

31. The method as recited in claim 23, wherein the first image comprises a first medical image obtained from a first medical image scanner, and the second image comprises a second medical image obtained from the first medical imaging scanner.

32. The method as recited in claim 23, wherein the first image comprises a first medical image obtained from a first medical image scanner, and the second image comprises a second medical image obtained from a second medical imaging scanner.

33. The method as recited in claim 23, wherein the first and second images comprise two-dimensional (2D) images, three-dimensional (3D) images, 2D videos, and 3D videos, and any combination of these.

34. A system for adjusting a plurality of images, comprising:

an input module configured to receive input window/level parameters of a first image and to initialize window/level parameters of a second image;

a window/level application component configured to generate updated window/level parameters of the first image;

a window/level synchronization module configured to compute updated window/level parameters of the second image, the updated window/level parameters of the second image being computed based on a synchronization relationship with the input window/level parameters of the first image; and

a display module for simultaneously displaying the first image with the updated window/level parameters associated with the first image and the second image with the updated window level parameters associated with the second image.

35. The system as recited in claim 34, wherein the synchronization relationship in the calculating step comprises mapping the updated window/level parameters of the second image from the input window/level parameters of the first image, pixel data of the first image, pixel data of the second image, metadata of the first image, metadata of the second image and characteristics of a display.

36. The system as recited in claim 34, wherein the synchronization relationship in the calculating step comprises passing through the input window/level parameters of the first image to the updated window/level parameters of the second image.

37. The system as recited in claim 34, wherein the synchronization relationship in the calculating step comprises a histogram equalization of the first image and the second image by comparing a first histogram of display intensities of the first image with a second histogram of display intensities of the second image.

38. The system as recited in claim 37, wherein the histogram equalization comprises further adjusting the window/level parameters of the second image based on a miniature optimization technique if the first histogram of display intensities of the first image is insufficiently similar to the second histogram of display intensities of the second image.

39. The system as recited in claim 37, wherein the histogram equalization comprises generating an output of the window/level associated with the second image if the first histogram of display intensities of the first image is sufficiently similar to the second histogram of display intensities of the second image.

40. The system as recited in claim 34, further comprising at least one scanner for scanning the first and second images, wherein the at least one scanner is selected from the group of scanners consisting of an x-ray scanner, a computerized tomographic (CT) scanner, a cone beam computerized tomographic (CBCT) scanner, a magnetic resonance imaging (MRI) scanner, a positron emission tomographic (PET) scanner, and an ultrasound scanner.

41. The system as recited in claim 34, wherein the first image comprises a first medical image obtained from a first medical image scanner, and the second image comprises a second medical image obtained from the first medical imaging scanner.

42. The system as recited in claim 34, wherein the first image comprises a first medical image obtained from a first medical image scanner, and the second image comprises a second medical image obtained from a second medical imaging scanner.

43. The system as recited in claim 34, wherein the first and second images comprise two-dimensional (2D) images, three-dimensional (3D) images, 2D videos, and 3D videos, and any combination of these.

44. A computer program product comprising a computer readable storage medium structured to store instructions executable by a processor, the instructions, when executed cause the processor to:

first displaying a first image and a second image in a blended view on a display, the first image associated with first window/level parameters and the second image associated with second window/level parameters;

adjusting the first window/level parameters in the first image thereby causing a transparency blending factor to change to a value that is proportional to the adjustment made to the first window/level parameters; and

second displaying the first and second images in the blended view on the display based on the adjustments to the first window/level parameters and the transparency blending factor.

45. A computer program product for adjusting multiple images, the computer program product being stored on a computer readable storage medium and comprising:

program code for receiving an input window/level parameters of a first image;

program code for adjusting the input window/level parameters of the first image with updated window/level parameters associated with the first image;

responsive to the adjusting step, program code for computing window/level parameters of a second image with updated window/level parameters associated with the second image, the updated window/level parameters of the second image being computed based on a synchronization relationship with the input window/level parameters of the first image; and

program code for simultaneously displaying the first image with the updated window/level parameters associated with the first image and the second image with the updated window level parameters associated with the second image.

46. A method for viewing images in a cloud computing environment, comprising:

accessing a first image and a second image stored in a cloud computer of the cloud computing environment, the first image associated with first window/level parameters and the second image associated with second window/level parameters;

transmitting the first image and the second image to a mobile device; and

displaying the first and second images in a blended view on the display of the mobile device based on the adjustments to the first window/level parameters and the transparency blending factor.