Macro-enabled display elements

• US 10,372,874 B2
• Filed: 08/18/2014
• Issued: 08/06/2019
• Est. Priority Date: 08/18/2014
• Status: Active Grant

• Current Assignee: General Electric Company
• Original Assignee: General Electric Company
• Inventors: Warner, Adrian F., Manak, Joseph John, Eberhard, Jeffrey Wayne, Schneidewend, Daniel Richard, Lai, Hao
• Primary Examiner(s): Bhatia, Ajay M
• Assistant Examiner(s): Chung, Mong-Shune
• Application Number:
  US14/462,437
• Publication Number:
  US 20160048635A1
• Time in Patent Office: 1,814 Days
• CPC Class Codes: G06F 2203/04803 Split screen, i.e. subdividing the display area or the window area into separate subareas
• CPC Class Codes: G06F 2203/04806 Zoom, i.e. interaction techniques or interactors for controlling the zooming operation
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G16H 30/00 ICT specially adapted for the handling or processing of medical images computed tomography A61B6/03
• CPC Class Codes: G16H 30/20 for handling medical images, e.g. DICOM, HL7 or PACS
• CPC Class Codes: G16H 30/40 for processing medical images, e.g. editing

Abstract

Embodiments for aggregating multiple data sources on a single display device are provided. In one example, a computing device comprises at least one input configured to receive data from one or more data sources, a user interface to receive user input, and instructions to identify an event of a procedure based on one or more of data received from the one or more data sources and user input received via the user interface, and arrange one or more display information elements on a display device based on the identified event and a workflow protocol.

Claims

1. A method, comprising:

automatically arranging, via a display controller, a first set of display information elements according to a first display macro of a workflow protocol, the workflow protocol comprising a predefined series of display macros including the first display macro that each correspond to a given event of a procedure, each display macro defining an arrangement of display information elements for display, the procedure comprising a heart ablation;

displaying, on a display device, the first set of display information elements arranged according to the first display macro;

receiving, at the display controller, a plurality of data signals, each data signal sent from a respective external medical device, one data signal of the plurality of data signals comprising a data signal from an ablation generator;

receiving, at the display controller, user input;

identifying, with the display controller, an event of the procedure, the event comprising activation of the ablation generator identified based on the data signal from the ablation generator;

automatically selecting, with the display controller, a second display macro from the predefined series of display macros of the workflow protocol based on the identified event, the second display macro including a second set of display information elements that includes at least a representation of the data signal received from the ablation generator; and

displaying, on the display device, the second set of display information elements according to the second display macro, each display information element including a representation of a respective data signal.

2. The method of claim 1, wherein automatically arranging the first set of display information elements according to the first display macro comprises automatically processing a first data signal from the plurality of data signals into a first screen element and processing the first screen element into a first display information element using an edge detection algorithm to capture a dynamic portion of the first screen element, and arranging the first display information element according to the first display macro, and further comprising, prior to displaying on the display device the one or more display information elements according to the first display macro, selecting the first display macro from the predefined series of display macros based on the user input.

3. The method of claim 2, wherein the first display macro includes the first display information element and the second display macro excludes the first display information element.

4. The method of claim 2, wherein the second display macro adjusts a position and/or a size of the first display information element respective to a position, size, and/or focal point of the first display information element arranged according to the first display macro.

5. A computing device, comprising:

a universal interface coupled to one or more medical devices, the one or more medical devices including an ablation generator;

a user interface to receive user input;

a processor in electronic communication with the one or more medical devices and with a display device; and

memory storing instructions executable by the processor to;

identify an event of a predefined series of events of a medical procedure based on data signals received from the one or more medical devices, the medical procedure defined by a duration where a patient is monitored by the one or more medical devices, the event including activation of the ablation generator identified based on a data signal received from the ablation generator,

automatically arrange one or more display information elements for display according to a first arrangement based on the identified event and a workflow protocol, including adjusting each of a size and a position of the one or more display information elements based on the identified event, the one or more display information elements representing at least a portion of the data signals received from the one or more medical devices including at least a representation of the data signal received from the ablation generator, and

send the one or more display information elements arranged according to the first arrangement to the display device.

6. The computing device of claim 5, wherein one or more of the data signals comprise a video signal, wherein the event is a first event, and wherein the instructions are executable to identify a second event responsive to receiving a message from a recording system, the recording system configured to record information in an event log and generate the message responsive to the recorded information, and wherein the recorded information includes the data signals from the one or more medical devices.

7. The computing device of claim 5, wherein the data signals further comprise a temperature, a pressure, and/or a heart rate signal.

8. The computing device of claim 5, wherein the instructions to arrange the one or more display information elements according to the first arrangement based on the identified event and the workflow protocol include instructions to automatically select a display macro from a set of display macros based on the identified event and the workflow protocol, and arrange the one or more display information elements according to the selected display macro, wherein the selected display macro defines the size and the position of the one or more display information elements and further defines a presence and a focal point of the one or more display information elements, each display information element comprising a representation of data from a respective medical device.

9. The computing device of claim 8, wherein the workflow protocol comprises the predefined series of events of the medical procedure and the set of display macros, each display macro corresponding to a given event of the medical procedure, and wherein the memory stores instructions executable to, for a first data signal received from a first medical device, process the first data signal into a first display information element using computer vision to adjust a selected region of interest of the first display information element as the first data signal changes.

10. The computing device of claim 8, wherein the identified event is a first event, the selected display macro is a first display macro, and wherein the memory stores further instructions executable to identify a second event of the predefined series of events of the medical procedure, and automatically arrange the one or more display information elements according to a second display macro selected based on the second event and the workflow protocol, where the second display macro includes the one or more display information elements being displayed at a different size and/or position than when displayed according to the first display macro, and send the one or more display information elements arranged according to the second display macro to the display device.

11. The computing device of claim 5, wherein the memory stores further instructions executable to select the workflow protocol responsive to user input.

12. The computing device of claim 5, wherein the instructions to arrange the one or more display information elements according to the first arrangement based on the identified event and the workflow protocol include instructions to adjust a size of a first display information element from a first, smaller size to a second, larger size, and to adjust a position of the first display information element from a first position to a second position, wherein the first display information element includes a representation of a data signal and the data signal is the same when the first display information element is displayed at the first size and when the first display information element is displayed at the second size, and wherein the first display macro includes an additional version of the first display information element at the first size and at a third position, different than the second position.

13. A system, comprising:

a controller including a processor comprising one or more physical devices;

a plurality of external medical devices each operably coupled to the controller the plurality of external medical devices including an ablation generator;

a display device operably coupled to the controller; and

instructions on the controller to;

identify each of a plurality of events of a procedure based on data received from the plurality of external medical devices and automatically select a display device element arrangement based on a current event of the plurality of events, the display device element arrangement defining a size and a position for each of one or more display information elements on the display device, where the plurality of events includes at least activation of the ablation generator identified based on first data received from the ablation generator and when the activation of the ablation generator is detected, the display device element arrangement defines a size and a position for a first display information element that represents the first data; and

output the one or more display information elements arranged according to the display device element arrangement to the display device.

14. The system of claim 13, wherein the plurality of external medical devices further comprises a mapping system, a recording device, an x-ray machine, an ultrasound imaging device, a stimulator, a balloon inflation device, and/or one or more sensors.

15. The system of claim 14, wherein the recording device records each event of the procedure and sends a notification identifying the current event to the controller.

16. The system of claim 13, wherein the display device element arrangement further defines one or more of a focal point and a magnification of the one or more display information elements, including the display device element arrangement defining a focal point of the first display information element independent of an original display context of a source display system of the ablation generator.

17. The system of claim 16, wherein the one or more display information elements are each configured to display a representation of data received from an external medical device of the plurality of external medical devices.

18. The system of claim 13, wherein the instructions on the controller include instructions to execute a workflow protocol that defines a respective display device element arrangement for each event of the procedure.

19. The system of claim 13, wherein each event of the procedure is identified based on the data received from the plurality of external medical devices and further based on user input to the controller.