COMPUTER IMPLEMENTED METHOD, COMPUTER SYSTEM AND SOFTWARE FOR REDUCING ERRORS ASSOCIATED WITH A SITUATED INTERACTION

• US 20160246929A1
• Filed: 10/07/2014
• Published: 08/25/2016
• Est. Priority Date: 10/07/2013
• Status: Abandoned Application

• Current Assignee: President and Fellows of Harvard College (Harvard Corporation), U.S. Government Represented By The Department Of Veterans Affairs
• Original Assignee: President and Fellows of Harvard College (Harvard Corporation), The United States of America Represented by The Department of Veterans Affairs
• Inventors: Zenati, Marco, Maron, Jason
• Application Number:
  US15/027,977
• Publication Number:
  US 20160246929A1
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G10L 15/22 Procedures used during a speech recognition process, e.g. man-machine dialogue
• CPC Class Codes: G16H 20/40 relating to mechanical, radiation or invasive therapies, e.g. surgery, laser therapy, dialysis or acupuncture
• CPC Class Codes: G16H 40/20 for the management or administration of healthcare resources or facilities, e.g. managing hospital staff or surgery rooms
• CPC Class Codes: G16H 80/00 ICT specially adapted for facilitating communication between medical practitioners or patients, e.g. for collaborative diagnosis, therapy or health monitoring
• CPC Class Codes: H04N 5/77 between a recording apparatus and a television camera

Abstract

A computer implemented method and computer system for reducing errors associated with a situated interaction performed by at least two agents of a sociotechnical team and for augmenting situation awareness of the at least two agents. Also, a non-transitory computer-readable storage medium used to store instructions relating to the computer method and the computer system. The situated interaction can be surgery and the at least two agents can be members of a surgical team.

Claims

1. A computer implemented method for reducing errors associated with a situated interaction performed by at least two agents of a sociotechnical team and for augmenting situation awareness of the at least two agents, comprising:

on a computer device having one or more processors and a memory storing one or more programs for execution by the one or more processors, the one or more programs including instructions for;

detecting and recording communications between the at least two agents using a detection and recording system;

analyzing the communications using a semantic, syntactic and pragmatics recognition system; and

providing the at least two agents with corrective information based on the results of the analyzing in order to reduce the errors associated with the situated interaction and to augment the situation awareness of the at least two agents during the situated interaction.

2. The method of claim 1, wherein the errors are communication errors, wherein the situated interaction is surgery and wherein the at least two agents are members of a surgical team.

3. The method of claim 2, wherein the surgery is cardiovascular surgery and wherein the at least two agents are part of a cardiovascular surgical team.

4. The method of claim 3, wherein the cardiovascular surgical team comprises at least one of a surgeon, an anesthesiologist and a perfusionist.

5. The method any one of claim 1, wherein the detection and recording system comprises a camera and a microphone.

6. The method of claim 5, wherein the camera is adapted to capture a panoramic view of the team members located in a room adapted for the situated interaction.

7. The method of claim 5, wherein the camera is adapted to capture an overhead view of the team members located in a room adapted for the situated interaction.

8. The method of claim 5, wherein the microphone comprises a hypercardoid condenser microphone.

9. The method any one of claim 1, wherein the detection and recording system comprises a dual stream recorder adapted for simultaneous viewing and analysis of panoramic and technical audiovisual feeds.

10. The method any one of claim 1, further comprising:

identifying critical procedural points related to the situated interaction based on information obtained from the analyzing of the communications using the semantic, syntactic and pragmatics recognition system,

wherein the providing of the corrective information comprises a display of the critical procedural points related to the situated interaction using a graphical user interface.

11. The method of claim 10, wherein the providing of the corrective information comprises emission of an audible alert by an audio transmission device, wherein the audible alert relates to the critical procedural points and regards a safety concern and wherein the audible alert is emitted before proceeding to a next stage within the situated interaction.

12. The method of claim 10, wherein the graphical user interface comprises a display of a phase of the situated interaction, an elapsed time for the phase and a heat map.

13. The method of claim 12, wherein the heat map displays a color-coded indicator to indicate a frequency of error during the phase for each of the at least two agents.

14. The method of claim 10, wherein the graphical user interface comprises a stage alert, which will be ON during a stage of the situated interaction until one or more events are detected that are known to be indicative of a safe progression to a next stage of the situated interaction.

15. The method of claim 10, wherein the graphical user interface comprises display of expected communications between the at least two agents, wherein the expected communications relate to a given step of the situated interaction.

16. The method any one of claims 1, wherein the analyzing of the communications using the semantic, syntactic and pragmatics recognition system comprises a system for detecting one or more of repeat backs, callouts, confirmation and structured communication between the at least two agents.

17. The method any one of claims 1, wherein the detecting and recording communications between the at least two agents using the detection and recording system comprises:

detecting and recording initiation of a message from a first team member to a second team member;

detecting and recording an acceptance of the message by the second team member;

detecting and recording a confirmation of the second team member'"'"'s acceptance of the message by the first team member;

identifying an open loop in the communications when either initiation, acceptance or confirmation is not detected; and

providing the at least two agents with corrective information if the open loop is identified.

18. The method any one of claim 1, wherein the analyzing of the communications using the semantic, syntactic and pragmatics recognition system comprises one of the group consisting of natural language understanding, natural language processing, development of a statistical language model, statistical learning, speech recognition utilizing Partially Observable Markov Decision Processes, development of statistical grammar, development of statistical semantic classifiers, reinforcement learning, incremental speech processing, one or more components of a Hidden Markov Model Toolkit, and an HDecode Speech Recognizer of the Hidden Markov Model Toolkit.

19. The method any one of claim 1, wherein the analyzing of the communications using the semantic, syntactic and pragmatics recognition system comprises identification of decision points related to the situated interaction by searching the recorded communication for a word or phrase corresponding with the one or more of the decision points against a database of known decision points related to the situated interaction.

20. The method any one of claim 1, the method further comprising:

searching the recorded communication between the at least two agents for a word or phrase from one of the team agents indicating initiation of a surgical action against a database of words or phrases corresponding with the initiation of the surgical action;

searching the recorded communication between the at least two agents for a word or phrase from another of the team agents indicating an expected response to the surgical action against a database of words or phrases corresponding with the expected response to the surgical action; and

providing the at least two agents with corrective information if the initiation or the expected response is not given.

21-98. -98. (canceled)