Rules-based approach to rendering medical imaging data

• US 9,042,617 B1
• Filed: 02/12/2014
• Issued: 05/26/2015
• Est. Priority Date: 09/28/2009
• Status: Active Grant

• Current Assignee: Merative US LP
• Original Assignee: DR Systems Incorporated (International Business Machines Corporation)
• Inventors: Reicher, Murray A., Fram, Evan K.
• Primary Examiner(s): ANSARI, TAHMINA N
• Application Number:
  US14/179,328
• Time in Patent Office: 468 Days
• Field of Search: None
• US Class Current: 382/128
• CPC Class Codes: A61B 2576/00 Medical imaging apparatus involving image processing or analysis A61B1/00009, A61B6/52 and A61B8/52 take precedence; image processing per se G06T; details of algorithms for analysing medical images G06T7/0012
• CPC Class Codes: A61B 5/7271 Specific aspects of physiological measurement analysis A61B5/316, A61B5/349 and A61B5/374 take precedence
• CPC Class Codes: A61B 5/742 using visual displays A61B5/339 takes precedence
• CPC Class Codes: G06F 18/22 Matching criteria, e.g. proximity measures
• CPC Class Codes: G06F 18/24 Classification techniques
• CPC Class Codes: G06F 2101/00 Indexing scheme relating to the type of digital function generated
• CPC Class Codes: G06T 11/60 Editing figures and text; Combining figures or text
• CPC Class Codes: G06T 15/005 General purpose rendering architectures
• CPC Class Codes: G06T 15/08 Volume rendering
• CPC Class Codes: G06T 19/00 Manipulating 3D models or images for computer graphics
• CPC Class Codes: G06T 2200/04 involving 3D image data
• CPC Class Codes: G06T 2207/30004 Biomedical image processing
• CPC Class Codes: G06T 2210/41 Medical
• CPC Class Codes: G06T 7/0012 Biomedical image inspection
• CPC Class Codes: G06V 2201/03 Recognition of patterns in medical or anatomical images
• CPC Class Codes: G16H 10/60 for patient-specific data, e.g. for electronic patient records
• CPC Class Codes: G16H 30/20 for handling medical images, e.g. DICOM, HL7 or PACS
• CPC Class Codes: G16H 30/40 for processing medical images, e.g. editing
• CPC Class Codes: G16H 50/20 for computer-aided diagnosis, e.g. based on medical expert systems
• CPC Class Codes: H04L 67/01 Protocols
• CPC Class Codes: H04L 67/02 : based on web technology, e.g. hypertext transfer protocol [HTTP]
• CPC Class Codes: H04L 67/10 : in which an application is distributed across nodes in the network software deployment G06F8/60; multiprogramming arrangements G06F9/46
• CPC Class Codes: H04N 19/70 : characterised by syntax aspects related to video coding, e.g. related to compression standards

Abstract

Systems and methods that allow transfer criteria to be defined based on one or more of several attributes, such as a particular user, site, or device, as well as whether individual images and/or image series are classified as thin slices, and applied to medical images in order to determine which images are downloaded, viewed, stored, and/or any number of other actions that might be performed with respect to particular images.

Claims

1. A method comprising:

by a computing device configured for displaying medical images;

determining that a dataset is stored at a first storage location remote from the computing device;

determining an availability of a first processing server local to the first storage location to render the dataset, the first processing server configured to render the dataset;

in response to determining that the first processing server is available to render the dataset, requesting rendering of the dataset by the first processing server and accessing the rendered dataset from the first processing server; and

in response to determining that the first processing server is not available to render the dataset, requesting transmission of at least some of the dataset to the computing device and rendering the at least some of the dataset at the computing device,

wherein rendering comprises generating at least one of a 2D image or 3D image from the dataset.

2. The method of claim 1, wherein the dataset comprises 3D volumetric medical imaging data.

3. The method of claim 1, wherein the first processing server comprises a server configured to render 3D volumetric medical imaging data.

4. The method of claim 1, wherein accessing the rendered dataset from the processing server comprises displaying the at least one of a 2D image or 3D image rendered from the dataset rendered by the first processing server via a thin client interface with the first processing server.

5. The method of claim 1, wherein the at least some of the dataset comprises a portion of the dataset selected based on one or more characteristics of the computing device.

6. The method of claim 1 further comprising:

by the computing device configured for displaying medical images;

prior to rendering the dataset at either the first processing server or the computing device, determining if the dataset was previously rendered and is stored at another location and, in response to determining that the dataset was previously rendered and is stored at another location, requesting access and/or transfer of the dataset that was previously rendered.

7. The method of claim 1 further comprising:

by the computing device configured for displaying medical images;

querying a group of processing servers or a device that load-balances the group of processing servers with a request that a best available processing server of the group of processing servers is selected for rendering the dataset.

8. The method of claim 7, wherein the best available processing server is not a fastest processing server of the group of processing servers but is the processing server with the most rapid access to the dataset.

9. The method of claim 1 further comprising:

by the computing device configured for displaying medical images;

accessing smart switching rules that indicate criteria for determining whether respective datasets are rendered by the computing device or one or more processing servers.

10. A computer system comprising:

one or more computing devices configured for executing software instructions; and

a non-transitory computer-readable medium in communication with the one or more computing devices and having software instructions stored thereon, the software instructions configured for reading by the one or more computing devices in order to perform operations comprising;

determining that a medical imaging dataset is stored at a storage location remote from the computer system;

in response to determining that the rendering server is available to render the medical imaging dataset, requesting rendering of the medical imaging dataset by the rendering server and accessing the rendered medical imaging dataset from the rendering server; and

in response to determining that the rendering server is not available to render the medical imaging dataset, requesting transmission of at least some of the medical imaging dataset to the computer system and rendering the at least some of the medical imaging dataset at the computer system,

wherein rendering comprises generating at least one of a 2D image or 3D image from the medical imaging dataset.

11. The computer system of claim 10, wherein accessing the rendered medical imaging dataset from the rendering server comprises displaying the at least one of a 2D image or 3D image rendered from the medical imaging dataset by the rendering server via a thin client interface in communication with the rendering server.

12. The computer system of claim 10, wherein the at least some of the medical imaging dataset comprises a portion of the medical imaging dataset selected based on one or more characteristics of the computer system.

13. The computer system of claim 10, the software instructions further configured for reading by the one or more computing devices in order to perform operations comprising:

prior to rendering the medical imaging dataset at either the rendering server or the computer system, in response to determining that the medical imaging dataset was previously rendered and is stored at another location, requesting access and/or transfer of the medical imaging dataset that was previously rendered from the another location.

14. The computer system of claim 10, the software instructions further configured for reading by the one or more computing devices in order to perform operations comprising:

querying a group of rendering servers or a device that load-balances the group of rendering servers with a request that a best available rending server of the group of rendering servers is selected for rendering the medical imaging dataset.

15. The computer system of claim 14, wherein the best available rending server is not a fastest rending server of the group of rendering servers but is the rendering server with the most rapid access to the medical imaging dataset.

16. The computer system of claim 10, the software instructions further configured for reading by the one or more computing devices in order to perform operations comprising:

accessing smart switching rules that indicate criteria for determining whether respective medical imaging datasets are rendered by the computer system or one or more rendering servers.

17. A non-transitory computer-readable medium having instructions stored thereon, the instructions configured for reading by a computing device in order to perform operations comprising:

determining that a dataset is stored at a storage location remote from the computing device;

in response to determining that the processing server is available to render the dataset, requesting rendering of the dataset by the processing server and accessing the rendered dataset from the processing server; and

in response to determining that the processing server is not available to render the dataset, requesting transmission of at least some of the dataset to the computing device and rendering the at least some of the dataset at the computing device,

wherein rendering comprises generating at least one of a 2D image or 3D image from the dataset.

18. The non-transitory computer-readable medium of claim 17, wherein the dataset comprises medical imaging data, and wherein the at least some of the dataset comprises a portion of the dataset selected based on one or more characteristics of the computing device.

19. The non-transitory computer-readable medium of claim 17, wherein the instructions are further configured for reading by the computing device in order to perform operations comprising:

prior to rendering the dataset at either the processing server or the computing device, in response to determining that the dataset was previously rendered and is stored at another location, requesting access and/or transfer of the dataset that was previously rendered.

20. The non-transitory computer-readable medium of claim 17, wherein the instructions are further configured for reading by the computing device in order to perform operations comprising:

querying a group of processing servers or a device that load-balances the group of processing servers with a request that a best available processing server of the group of processing servers is selected for rendering the dataset.

21. The non-transitory computer-readable medium of claim 17, wherein the best available processing server is not a fastest processing server of the group of processing servers but is the processing server with the most rapid access to the dataset.

22. A method comprising:

by a computing device configured for displaying medical images;

receiving a request for least one of a 2D image or 3D image from each of a first dataset and a second dataset, the first dataset comprising an exam of a patient obtained at a first time, the second dataset comprising an exam of the patient obtained at a second time;

determining that the first dataset is stored at a first storage location remote from the computing device;

determining that the second dataset is stored at a second storage location remote from the computing device, the second storage location being different from the first storage location;

determining an availability of a first processing server local to the first storage location to render the first dataset, the first processing server configured to render the first dataset;

determining an availability of a second processing server local to the second storage location to render the second dataset, the second processing server configured to render the second dataset;

in response to determining that both the first processing server and the second processing server are available to render the respective first and second datasets, requesting rendering of the first and second datasets by the respective first and second processing servers and requesting transmission of the rendered first and second datasets from the respective first and second processing servers to the computing device;

in response to determining that the first processing server is not available to render the first dataset, requesting transmission of the first dataset to the computing device and rendering the first dataset at the computing device; and

in response to determining that the second processing server is not available to render the second dataset, requesting transmission of the second dataset to the computing device and rendering the second dataset at the computing device,

wherein rendering comprises generating at least one of a 2D image or 3D image from a dataset.