Systems and methods for interleaving series of medical images

• US 9,734,576 B2
• Filed: 09/01/2016
• Issued: 08/15/2017
• Est. Priority Date: 11/04/2004
• Status: Active Grant

• Current Assignee: Merative US LP
• Original Assignee: DR Systems Incorporated (International Business Machines Corporation)
• Inventors: Fram, Evan K., Greim, Steven M., Schumacher, John J., Reicher, Murray A.
• Primary Examiner(s): Park, Chan
• Assistant Examiner(s): Thomas, Mia M
• Application Number:
  US15/254,627
• Publication Number:
  US 20170039705A1
• Time in Patent Office: 348 Days
• CPC Class Codes: A61B 6/463 characterised by displaying multiple images or images and diagnostic data on one display
• CPC Class Codes: A61B 6/464 involving a plurality of displays
• CPC Class Codes: A61B 6/502 for diagnosis of breast, i.e. mammography
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/04845 for image manipulation, e.g. dragging, rotation, expansion or change of colour
• CPC Class Codes: G06T 2207/10004 Still image; Photographic image
• CPC Class Codes: G06T 2207/10081 Computed x-ray tomography [CT]
• CPC Class Codes: G06T 2207/10104 Positron emission tomography [PET]
• CPC Class Codes: G06T 2207/10116 X-ray image
• CPC Class Codes: G06T 2207/30061 Lung
• CPC Class Codes: G06T 7/0012 Biomedical image inspection
• CPC Class Codes: G06T 7/0016 involving temporal comparison
• CPC Class Codes: G06T 7/33 using feature-based methods
• CPC Class Codes: G16H 30/20 for handling medical images, e.g. DICOM, HL7 or PACS
• CPC Class Codes: G16H 30/40 for processing medical images, e.g. editing
• CPC Class Codes: G16H 40/67 for remote operation

Abstract

After selecting two or more image series for comparison, images of the image series are interleaved so that they are alternatively displayed in a comparison pane on a display device. In one embodiment, after one or more image series are selected for comparison, an interleaved image series is created containing each of the images of the one or more selected image series, or, alternatively, the interleaved image series comprises links to the images arranged in the interleaved pattern. If differences exist in the images of the multiple image series, these differences may be more easily detectable as the display device cycles between the images. Comparison of images in an interleaved image series may be more advantageous if the images of each selected image series are of a common anatomical area, common image size, and the images are in the same order.

Claims

1. A method comprising:

receiving, at a computing system, at least a first plurality of images comprising a first image series and a second plurality of images comprising a second image series, wherein the first plurality of images and the second plurality of images together comprise a set of images;

analyzing, by the computing system, the set of images to identify values of a first characteristic associated with respective images of the set of images, wherein the first characteristic comprises a time at which the respective images of the set of images were obtained;

determining, by the computing system, at least a second characteristic associated with each of the images of the set of images;

determining, by the computing system, an ordering of the images of the set of images based on;

first;

values of the first characteristic associated with respective images of the set of images, and

second;

values of the second characteristic associated with respective images of the set of images;

displaying at a location of a display, a first image of the set of images, that is first in the determined ordering of the images; and

in response to input from a user of the computing system indicating a direction of movement within the set of images, replacing, at the location, the first image with a second image, wherein the second image is adjacent to the first image in the ordering of the images.

2. The method of claim 1, wherein the second characteristic comprises at least one of:

a modality, an application of contrast agent, or an anatomical position associated with the respective images.

3. The method of claim 2, wherein the ordering of the images is further determined based on at least one of a type of image, an area imaged, a clinical indication, a source of image, a display device, or a user.

4. The method of claim 2, wherein the ordering of the images is further determined based on at least one of brightness, contrast, size, opacity map, rotation, location, zoom level, cropping, morphing, or color of the images.

5. The method of claim 1, wherein said analyzing comprises determining the times by reference to headers of the respective images.

6. The method of claim 1, wherein a display characteristic of the second image is adjusted such that the information displayed in the first image and the second image more closely matches, and differences between the first image and the second image are more easily detectable by the user.

7. The method of claim 6, wherein the display characteristic comprises at least one of brightness, contrast, size, opacity map, rotation, location, zoom level, cropping, morphing, or color.

8. The method of claim 1, wherein the computing system is configured to provide the input in response to the user moving a scroll wheel of a mouse or other input device in a first direction.

9. The method of claim 1 further comprising:

in response to a second input from the user of the computing system indicating an opposite direction of movement within the set of images, replacing, at the location, the second image with the first image.

10. The method of claim 9, wherein the computing system is configured to provide the second input in response to the user moving a scroll wheel of a mouse or other input device in a first direction.

11. The method of claim 10, wherein the computing system is configured to provide the second input in response to the user moving a scroll wheel of a mouse or other input device in a second direction.

12. The method of claim 1 further comprising:

determining, by the computing system, a characteristic associated with the first image series;

identifying, by the computing system, the second image series for comparison with the first image series, wherein the second image series is identified based on the second image series being associated with the same characteristic as the first image series.

13. The method of claim 12, wherein the characteristic associated with the first image series comprises at least one of:

a header information item, a filename, a modality, a name, an anatomical area, an image size, or an image orientation.

14. The method of claim 1, further comprising in response to another input from the user of the computing system indicating the direction of movement within the set of images, replacing, at the location, a third image in the images of the set of images with another image of the set of images that is adjacent to the third image in the ordering of the images.

15. A computing system comprising:

an electronic display;

an input device;

a non-transitory computer-readable storage medium configured to store software instructions; and

one or more computer processors in communication with the electronic display, the input device, and the non-transitory computer-readable medium, the one or more computer processors configured to execute the software instructions in order to cause the computing system to;

receive at least a first plurality of images comprising a first image series and a second plurality of images comprising a second image series, wherein the first plurality of images and the second plurality of images together comprise a set of images;

analyze the set of images to identify values of a first characteristic associated with respective images of the set of images, wherein the first characteristic comprises a time at which the respective images of the set of images were obtained;

determine at least a second characteristic associated with each of the images of the set of images;

determine an ordering of the images of the set of images based on;

first;

values of the first characteristic associated with respective images of the set of images, and

second;

values of the second characteristic associated with respective images of the set of images;

display a location of a display, a first image of the set of images, that is first in the determined ordering of the images; and

in response to input from a user of the computing system indicating a direction of movement within the set of images, replace, at the location, the first image with a second image, wherein the second image is adjacent to the first image in the ordering of the images.

16. A non-transitory computer readable storage medium having program instructions embodied therewith, the program instructions executable by one or more processors to cause the one or more processors to:

receive at least a first plurality of images comprising a first image series and a second plurality of images comprising a second image series, wherein the first plurality of images and the second plurality of images together comprise a set of images;

analyze the set of images to identify values of a first characteristic associated with respective images of the set of images, wherein the first characteristic comprises a time at which the respective images of the set of images were obtained;

determine at least a second characteristic associated with each of the images of the set of images;

determine an ordering of the images of the set of images based on;

first;

values of the first characteristic associated with respective images of the set of images, and

second;

values of the second characteristic associated with respective images of the set of images;

display a location of a display, a first image of the set of images, that is first in the determined ordering of the images; and

in response to input from a user of the computing system indicating a direction of movement within the set of images, replace, at the location, the first image with a second image, wherein the second image is adjacent to the first image in the ordering of the images.