Method and system for rule based display of sets of images

• US 9,524,577 B1
• Filed: 01/30/2015
• Issued: 12/20/2016
• Est. Priority Date: 03/15/2013
• Status: Active Grant

• Current Assignee: PME IP Pty., Ltd.
• Original Assignee: PME IP Pty., Ltd.
• Inventors: Westerhoff, Malte, Stalling, Detlev
• Primary Examiner(s): Sajous, Wesner
• Application Number:
  US14/611,163
• Time in Patent Office: 690 Days
• US Class Current: 1/1
• CPC Class Codes: A61B 5/055 involving electronic [EMR] or nuclear [NMR] magnetic resonance, e.g. magnetic resonance imaging
• CPC Class Codes: A61B 6/032 Transmission computed tomography [CT]
• CPC Class Codes: A61B 6/037 Emission tomography
• CPC Class Codes: A61B 6/465 adapted to display user selection data, e.g. graphical user interface, icons or menus
• CPC Class Codes: A61B 6/466 adapted to display 3D data
• CPC Class Codes: G06F 3/0481 based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
• CPC Class Codes: G06T 11/001 Texturing; Colouring; Generation of texture or colour inpainting G06T5/77
• CPC Class Codes: G06T 15/08 Volume rendering
• CPC Class Codes: G06T 19/20 Editing of 3D images, e.g. changing shapes or colours, aligning objects or positioning parts
• CPC Class Codes: G06T 2200/04 involving 3D image data
• CPC Class Codes: G06T 2210/41 Medical
• CPC Class Codes: G06T 2219/2012 Colour editing, changing, or manipulating; Use of colour codes
• CPC Class Codes: G06T 2219/2024 Style variation
• CPC Class Codes: G09G 5/363 Graphics controllers
• CPC Class Codes: G16H 30/20 for handling medical images, e.g. DICOM, HL7 or PACS
• CPC Class Codes: G16H 30/40 for processing medical images, e.g. editing
• CPC Class Codes: G16H 50/70 for mining of medical data, e.g. analysing previous cases of other patients

Abstract

The invention provides, in some aspects, a system for implementing a rule derived basis to display image sets. In various embodiments of the invention, the selection of the images to be displayed, the layout of the images, as well as the rendering parameters and styles can be determined using a rule derived basis. In an embodiment of the present invention, the user is presented with images displayed based on their preferences without having to first manually adjust parameters.

Claims

1. A system of displaying one or more Sets of Images from a plurality of images comprising:

a processor capable of selecting a primary Study from a plurality of studies based on one or more characteristics selected from the group consisting of an anatomical location selected, an anatomical organ selected, an anatomical organ system selected, an anatomical tissue selected, a type of analysis selected, a type of condition selected, a type of treatment selected and a type of disease selected; and

one or more digital data processor devices capable of carrying out the steps including;

a. applying one or more Study Selection Rules to generate a plurality of second studies based on the one or more characteristics and one or more Digital Imaging and Communication in Medicine (DICOM) parameters from the primary Study, one or more Abstract Tags from the primary Study, one or more DICOM parameters from the plurality of second studies and one or more Abstract Tags from the plurality of second studies;

b. applying one or more Protocol Selection Rules to select a Display Protocol, where the one or more Protocol Selection Rules are based on the one or more characteristics and one or more DICOM parameters from the primary Study, one or more Abstract Tags from the primary Study, one or more DICOM parameters from the plurality of second studies and one or more Abstract Tags from the plurality of second studies;

c. applying one or more Image Set Rules to define a plurality of Image Sets from the plurality of second studies; and

d. displaying the plurality of Image Sets, where the one or more digital data processor devices load the plurality of Image Sets in one or more Viewports for display based on one or more of the one or more Protocol Selection Rules, and the one or more Image Set Rules.

2. The system of claim 1, where at least one study from the plurality of Image Sets is a two dimensional image.

3. The system of claim 1, where at least one study from the plurality of Image Sets is a three dimensional (3D) image displayed with a 3D rendering style.

4. The system of claim 1, further comprising applying one or more Viewport Assignment Rules to assign one or more Image Sets from the plurality of Image Sets to one or more Viewports defined in the Display Protocol, where at least one of the one or more Viewports displays an oblique cross section through a volumetric image set.

5. The system of claim 4, where at least one of the one or more Viewports displays a maximum intensity projection of an image set.

6. The system of claim 4, where at least one of the one or more Viewports displays a post processed rendering of an image set.

7. The system of claim 4, where at least one of the one or more Viewports displays a thick slab image.

8. The system of claim 4, where at least one of the one or more Viewports displays a volume rendered image.

9. The system of claim 4, where at least one of the one or more Viewports displays a three dimensional image.

10. The system of claim 1, where one or more Study Selection Rules used DICOM parameters and Abstract Tags derived from a single reference image.

11. The system of claim 1, where the primary Study selected is a single reference image.

12. The system of claim 11, where one or more Study Selection Rules are derived from the one or more DICOM Parameters from the primary Study.

13. The system of claim 4, where the one or more Viewport Assignment Rules contain protocols for displaying two dimensional images in the one or more Viewports.

14. The system of claim 1, where the one or more Image Set Rules are selected from selection, sorting, and breaking rules.

15. The system of claim 1, where the one or more Image Set Rules are Boolean expressions that contain parameters selected from the group consisting of DICOM parameters, abstract tags, and used-defined functions.

16. The system of claim 14, where in order to specify image sorting, the one or more Image Set Rules contain an ordered list of sorting criteria.

17. The system of claim 16, where a split flag is used in order to specify image splitting.

18. The method of claim 1, where the characteristic is an anatomical location.

19. The method of claim 18, where the anatomical location is the chest and the first Study is a chest X-Ray.

20. The method of claim 19, where the plurality of second studies is selected from the group consisting of a chest computer tomography scan, a magnetic resonance imaging scan of the body, positron-emission tomography scan of the chest, and an image of the chest.

21. The method of claim 18, where the anatomical location is the gastrointestinal tract and the first Study selected is an X-Ray image of the stomach.

22. The method of claim 21, where the plurality of second studies are a series of X-Ray images taken after ingestion of a contrast agent.

23. The method of claim 22, where the contrast agent is barium.

24. A system of displaying one or more Sets of Images from a plurality of images comprising:

selecting one or more studies from a plurality of studies based on one or more characteristics selected from the group consisting of anatomical location selected, anatomical organ selected, anatomical organ system selected, anatomical tissue selected, type of analysis selected, type of condition selected, type of treatment selected and type of disease selected; and

one or more digital data processor devices for carrying out the steps including;

a. applying one or more Protocol Selection Rules to select a Display Protocol, where the one or more Protocol Selection Rules are based on the one or more characteristics and one or more Digital Imaging and Communication in Medicine (DICOM) parameters from the plurality of studies and Abstract Tags from the plurality of studies;

b. applying one or more Image Set Rules to define a plurality of Image Sets from the plurality of studies; and

c. applying one or more Viewport Assignment Rules to assign one or more Image Sets from the plurality of Image Sets to one or more Viewports defined in the Display Protocol; and

d. displaying the one or more Image Sets, where the one or more digital data processor devices load the one or more Image Sets in one or more Viewports for display based on one or more of the one or more Protocol Selection Rules, the one or more Image Set Rules, and the one or more Viewport Assignment Rules, where at least one of the one or more Viewports displays a three dimensional image.

25. A method of displaying one or more Sets of Images from a plurality of images comprising:

selecting a primary Study from a plurality of studies based on one or more characteristics selected from the group consisting of anatomical location selected, anatomical organ selected, anatomical organ system selected, anatomical tissue selected, type of analysis selected, type of condition selected, type of treatment selected and type of disease selected; and

executing on a server digital data processor device a render server program which applies one or more Study Selection Rules, one or more Protocol Selection Rules, one or more Image Set Rules, one or more Viewport Assignment Rules, and one or more Style Rules to display one or more Sets of Images including;

a. applying the one or more Study Selection Rules to generate a plurality of second studies based on the one or more characteristics and one or more Digital Imaging and Communication in Medicine (DICOM) parameters from the primary Study and one or more Abstract Tags from the primary Study and one or more DICOM parameters from the plurality of studies and one or more Abstract Tags from the plurality of studies, where the plurality of second studies include the primary Study;

b. applying one or more Protocol Selection Rules to select a Display Protocol, where the one or more Protocol Selection Rules are based on the one or more characteristics and one or more DICOM parameters from the plurality of second studies and one or more Abstract Tags from the plurality of second studies;

c. applying the one or more Image Set Rules to define a plurality of Image Sets from the plurality of second studies;

d. applying the one or more Viewport Assignment Rules to assign one or more Image Sets from the plurality of Image Sets to one or more Viewports defined in the Display Protocol; and

e. displaying the one or more Sets of Images in the one or more Viewports, where the server digital data processor device loads the Image Sets in one or more Viewports for display based on one or more of the one or more Protocol Selection Rules, the one or more Image Set Rules, and the one or more Viewport Assignment Rules, where at least one of the one or more Viewports displays a volume rendered image.

26. The method of claim 25, where the step of displaying is carried out on a client display device.