Context-Aware User Interface For Integrated Operating Room

• US 20160378939A1
• Filed: 06/24/2015
• Published: 12/29/2016
• Est. Priority Date: 06/24/2015
• Status: Active Grant

• Current Assignee: Karl Storz Se & Co. Kg
• Original Assignee: Karl Storz Se & Co. Kg
• Inventors: Baumberger, Juri, Rutland, Timothy, Applebaum, Ted, Contolini, Matteo
• Granted Patent: US 10,600,015 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06Q 10/063114 Status monitoring or status determination for a person or group
• CPC Class Codes: G06Q 10/0633 Workflow analysis
• CPC Class Codes: G16H 20/40 relating to mechanical, radiation or invasive therapies, e.g. surgery, laser therapy, dialysis or acupuncture
• CPC Class Codes: G16H 40/20 for the management or administration of healthcare resources or facilities, e.g. managing hospital staff or surgery rooms
• CPC Class Codes: G16H 40/40 for the management of medical equipment or devices, e.g. scheduling maintenance or upgrades
• CPC Class Codes: G16H 40/63 for local operation
• CPC Class Codes: G16H 70/20 relating to practices or guidelines

Abstract

A system and method for managing workflow of a medical procedure, including a control and at least one detector such as a sensor, where the control interprets a user input to control the workflow of the medical procedure. The system and method include multiple input modalities and hazard mitigation measures to control the medical procedure and/or control various medical devices in an operating room.

Claims

1. A system for managing workflow of a medical procedure, the system comprising:

a control including a control processor, the control able to manipulate at least one medical device in the system via at least one control command, the control processor tracking the workflow of the medical procedure, whereby the workflow of the medical procedure occurs in particular stages;

at least one detector, the at least one detector able to detect a user input during the medical procedure, the at least one detector being in communication with the control processor;

wherein during a particular stage of the medical procedure, the at least one detector receives a user input and transmits a data signal to the control processor,

wherein the control processor interprets the data signal from the user input according to the particular stage of the medical procedure to determine at least one control command to send to the at least one medical device based at least in part upon the particular stage of the medical procedure,

wherein the control processor sends the at least one control command to the at least one medical device to manipulate the at least one medical device.

2. The system of claim 1, wherein during a first stage of the medical procedure, a user input corresponds to a first command determined by the control, and during a second stage of the medical procedure, the user input corresponds to an second command determined by the control, the first command and the second command being based at least in part upon the particular stage of the medical procedure.

3. The system of claim 1, further comprising:

a database storing clinical information;

at least one display displaying a user interface; and

software executing on said processor for displaying a subset of the clinical information on said at least one display monitor via the interface.

4. The system of claim 3, wherein a different subset of the clinical information is displayed on the at least one display monitor for each stage of the medical procedure, the medical procedure being a multi-stage medical procedure.

5. The system of claim 3, wherein the control is aware of the subset of the clinical information displayed on the interface of said at least one display monitor and interprets the at least one control command based at least in part upon the user input, the clinical information displayed on the interface and the particular stage of the medical procedure.

6. The system of claim 3, wherein the at least one medical instrument manipulated by the control is the at least one display monitor.

7. The system of claim 1, wherein the workflow of the medical procedure is controlled at least in part by the control.

8. The system of claim 1, wherein the at least one medical device includes at least one medical device control, wherein the at least one medical device control performs a different task during different stages of the multi-stage medical procedure.

9. The system of claim 8, wherein the at least one medical device control is able to be reprogrammed to perform a different task during different stages of the multi-stage medical procedure.

10. The system of claim 1, further comprising an image recognition module able to detect a stage of the medical procedure to at least partially determine the subset of clinical information that is displayed on the at least one display monitor.

11. The system of claim 1, wherein the user input is speech recognition and/or gesture control.

12. The system of claim 1, further comprising a hazard mitigation module.

13. The system of claim 12, wherein the hazard mitigation module filters out user input that are not appropriate in the particular stage of the medical procedure.

14. The system of claim 3, wherein during the medical procedure, the control updates the progress of the medical procedure by providing updates through the at least one display monitor.

15. The system of claim 3, wherein the clinical information is divided into subsets according to the authorization level or permission level of an intended recipient of the clinical information.

16. The system of claim 15, further comprising at least two display monitors, wherein at least one display monitor displays a subset of information that is relevant for a first intended recipient, and wherein at least one display monitor displays a subset of information that is relevant for a second intended recipient.

17. A method for managing workflow of a medical procedure, the method comprising:

providing a control including a control processor, the control able to manipulate at least one medical device in the system via at least one control command, the control tracking the workflow of the medical procedure, whereby the workflow of the medical procedure occurs in particular stages;

providing at least one detector, the at least one detector able to detect a user input during the medical procedure, the at least one detector being in communication with the control processor;

receiving a user input during a particular stage of the medical procedure;

correlating the user input with a particular stage of the medical procedure;

determining the at least one control command to send to the at least one medical device based at least in part upon the correlation of the user input and the particular stage of the medical procedure; and

sending the at least one control command to the at least one medical device to manipulate the at least one medical device.

18. The method of claim 17, wherein during a first stage of the medical procedure, a user input corresponds to a first command determined by the control, and during a second stage of the medical procedure, the user input corresponds to an second command determined by the control, the first command and the second command being based at least in part by the particular stage of the medical procedure.

19. The method of claim 17, further comprising:

providing a database storing clinical information;

providing at least one display monitor having an interface; and

providing software executing on said processor for displaying a subset of the clinical information on the said at least one display monitor via the interface.

20. The method of claim 19, wherein a different subset of the clinical information is displayed on the at least one display monitor for each stage of a multi-stage medical procedure.

21. The method of claim 19, wherein the control is aware of the subset of the clinical information displayed on said at least one display monitor via the interface and interprets the at least one control command based at least in part upon the user input, the clinical information displayed on said at least one display via the interface and based at least in part on the particular stage of the medical procedure.

22. The method of claim 19, wherein the clinical information displayed on said at least one display monitor is for a multi-stage medical procedure.

23. The method of claim 17, wherein the at least one medical device is an input device that can be dynamically re-programmed.

24. The method of claim 17, wherein the user input is speech recognition and/or gesture control.

25. A system for managing workflow of a medical procedure, the system comprising:

a control including a control processor, the control able to manipulate at least one medical device in the system via at least one control command, the control processor tracking the workflow of the medical procedure, whereby the workflow of the medical procedure occurs in particular stages;

at least one detector, the at least one detector able to detect a user input during the medical procedure, the at least one detector being in communication with the control processor;

wherein the at least one detector receives a user input and transmits a data signal to the control processor,

wherein the control processor interprets the data signal from the user input to determine at least one control command to send to the at least one medical device.

26. The system of claim 25, wherein the detector is a multi-modal sensor.

27. The system of claim 26, wherein the multi-modal sensor is able to detect a second user input, the second user input being of a different modality than the user input.

28. The system of claim 25, wherein the controller is configured to send the at least one control command to at least two medical devices, the at least one control command being able to control the at least two medical devices.

29. The system of claim 25, further comprising a hazard mitigation module, the hazard mitigation module being able to mitigate errors in interpreting the user input.