Smart medical room optimization of speech recognition systems

• US 10,510,348 B1
• Filed: 09/28/2018
• Issued: 12/17/2019
• Est. Priority Date: 09/28/2018
• Status: Active Grant

• Current Assignee: Merative US LP
• Original Assignee: International Business Machines Corporation
• Inventors: Lavery, Andrew J., Ng, Kenney, Picheny, Michael A., Tang, Paul C.
• Primary Examiner(s): Vo, Huyen X
• Application Number:
  US16/145,572
• Time in Patent Office: 445 Days
• Field of Search: 704 1- 10, 704230-257, 704270-277
• CPC Class Codes: G10L 15/18 using natural language modelling
• CPC Class Codes: G10L 15/22 Procedures used during a speech recognition process, e.g. man-machine dialogue
• CPC Class Codes: G10L 15/26 Speech to text systems G10L15/08 takes precedence
• CPC Class Codes: G10L 2015/228 of application context
• CPC Class Codes: G16H 10/60 for patient-specific data, e.g. for electronic patient records
• CPC Class Codes: G16H 40/40 for the management of medical equipment or devices, e.g. scheduling maintenance or upgrades
• CPC Class Codes: G16H 40/63 for local operation
• CPC Class Codes: G16H 50/70 for mining of medical data, e.g. analysing previous cases of other patients
• CPC Class Codes: G16H 80/00 ICT specially adapted for facilitating communication between medical practitioners or patients, e.g. for collaborative diagnosis, therapy or health monitoring

Abstract

A method, computer system, and a computer program product for optimizing speech recognition in a smart medical room. The present invention may include receiving a piece of verbal data associated with a medical encounter from one or more audio recording devices. The present invention may also include accessing a plurality of signals from a plurality of biometric sensors associated with a plurality of medical equipment associated with the smart medical room based on the received piece of verbal data associated with the medical encounter. The present invention may further include selecting, from a database, one or more speech domain models based on the accessed plurality of signals from the plurality of biometric sensors associated with the plurality of medical equipment, wherein the one or more speech domain models are utilized to optimize a transcription of speech during the medical encounter in the smart medical room.

Claims

1. A method for optimizing speech recognition in a smart medical room, the method comprising:

receiving a piece of verbal data associated with a medical encounter from one or more audio recording devices;

accessing a plurality of signals from a plurality of biometric sensors associated with a plurality of medical equipment associated with the smart medical room based on the received piece of verbal data associated with the medical encounter; and

selecting, from a database, one or more speech domain models based on the accessed plurality of signals from the plurality of biometric sensors associated with the plurality of medical equipment,

wherein the one or more speech domain models are utilized to optimize a transcription of speech during the medical encounter in the smart medical room,

wherein the one or more speech domain models are trained with one or more feedback from the clinician based on the medical encounter and from a continuous feedback display in the smart medical room,

wherein the one or more feedback from the clinician is based on an optional notification to the clinician to confirm the one or more speech models in use.

2. The method of claim 1 in which the medical encounter includes at least one clinician and a patient.

3. The method of claim 2, further comprising:

identifying the at least one clinician is located in the smart medical room by utilizing an active badge device and one or more cameras; and

detecting a proximity of the identified at least one clinician to the patient by utilizing the one or more cameras.

4. The method of claim 2, further comprising:

determining that the patient is present in the smart medical room by utilizing one or more cameras and one or more biometric devices; and

confirming the identity of the patient in the smart medical room by utilizing one or more cameras and one or more biometric devices.

5. The method of claim 4 in which the one or more biometric devices utilized to confirm the identity of the patient in the smart medical room is selected from the group consisting of:

(i) a finger print recognition device,

(ii) a facial recognition device,

(iii) a voice pattern recognition device,

(iv) an iris recognition device,

(v) a retinal recognition device,

(vi) a hand geometry recognition device,

(vii) a palm print recognition device, and

(viii) a walking gait recognition device.

6. The method of claim 1 in which the plurality of medical equipment is selected from the group consisting of:

(i) a smart prescription clipboard,

(ii) an examination bed,

(iii) an examination chair,

(iv) a stethoscope,

(v) a blood pressure cuff,

(vi) a weight scale,

(vii) an otoscope,

(viii) a syringe,

(ix) a drug infusion device,

(x) an ophthalmology device, and

(xi) a medical imaging device.

7. The method of claim 1, wherein selecting, from the database, the one or more speech domain models based on the accessed plurality of signals from the plurality of biometric sensors associated with the plurality of medical equipment, further comprises:

detecting a change in the use of at least one medical device associated with the plurality of medical equipment; and

triggering a switch of a current speech domain model utilized during the medical encounter.

8. The method of claim 1, further comprising:

determining the received piece of verbal data is selected from the group consisting of;

(i) a key word, and

(ii) a phrase; and

triggering a switch of a current speech domain model utilized during the medical encounter.

9. A computer system for optimizing speech recognition in a smart medical room, comprising:

one or more processors, one or more computer-readable memories, one or more computer-readable tangible storage medium, and program instructions stored on at least one of the one or more tangible storage medium for execution by at least one of the one or more processors via at least one of the one or more memories, wherein the computer system is capable of performing a method comprising;

receiving a piece of verbal data associated with a medical encounter from one or more audio recording devices;

accessing a plurality of signals from a plurality of biometric sensors associated with a plurality of medical equipment associated with the smart medical room based on the received piece of verbal data associated with the medical encounter; and

selecting, from a database, one or more speech domain models based on the accessed plurality of signals from the plurality of biometric sensors associated with the plurality of medical equipment,

wherein the one or more speech domain models are utilized to optimize a transcription of speech during the medical encounter in the smart medical room,

wherein the one or more speech domain models are trained with one or more feedback from the clinician based on the medical encounter and from a continuous feedback display in the smart medical room,

wherein the one or more feedback from the clinician is based on an optional notification to the clinician to confirm the one or more speech models in use.

10. The computer system of claim 9 in which the medical encounter includes at least one clinician and a patient.

11. The computer system of claim 10, further comprising:

identifying the at least one clinician is located in the smart medical room by utilizing an active badge device and one or more cameras; and

detecting a proximity of the identified at least one clinician to the patient by utilizing the one or more cameras.

12. The computer system of claim 10, further comprising:

determining that the patient is present in the smart medical room by utilizing one or more cameras and one or more biometric devices; and

confirming the identity of the patient in the smart medical room by utilizing one or more cameras and one or more biometric devices.

13. The computer system of claim 12 in which the one or more biometric devices utilized to confirm the identity of the patient in the smart medical room is selected from the group consisting of:

(i) a finger print recognition device,

(ii) a facial recognition device,

(iii) a voice pattern recognition device,

(iv) an iris recognition device,

(v) a retinal recognition device,

(vi) a hand geometry recognition device,

(vii) a palm print recognition device, and

(viii) a walking gait recognition device.

14. The computer system of claim 9 in which the plurality of medical equipment is selected from the group consisting of:

(i) a smart prescription clipboard,

(ii) an examination bed,

(iii) an examination chair,

(iv) a stethoscope,

(v) a blood pressure cuff,

(vi) a weight scale,

(vii) an otoscope,

(viii) a syringe,

(ix) a drug infusion device,

(x) an ophthalmology device, and

(xi) a medical imaging device.

15. The computer system of claim 9, wherein selecting, from the database, the one or more speech domain models based on the accessed plurality of signals from the plurality of biometric sensors associated with the plurality of medical equipment, further comprises:

detecting a change in the use of at least one medical device associated with the plurality of medical equipment; and

triggering a switch of a current speech domain model utilized during the medical encounter.

16. The computer system of claim 9, further comprising:

determining the received piece of verbal data is selected from the group consisting of;

(i) a key word, and

(ii) a phrase; and

triggering a switch of a current speech domain model utilized during the medical encounter.

17. A computer program product for optimizing speech recognition in a smart medical room, comprising:

one or more non-transitory computer-readable storage media and program instructions stored on at least one of the one or more tangible storage media, the program instructions executable by a processor to cause the processor to perform a method comprising;

receiving a piece of verbal data associated with a medical encounter from one or more audio recording devices;

accessing a plurality of signals from a plurality of biometric sensors associated with a plurality of medical equipment associated with the smart medical room based on the received piece of verbal data associated with the medical encounter; and

selecting, from a database, one or more speech domain models based on the accessed plurality of signals from the plurality of biometric sensors associated with the plurality of medical equipment,

wherein the one or more speech domain models are utilized to optimize a transcription of speech during the medical encounter in the smart medical room,

wherein the one or more speech domain models are trained with one or more feedback from the clinician based on the medical encounter and from a continuous feedback display in the smart medical room,

wherein the one or more feedback from the clinician is based on an optional notification to the clinician to confirm the one or more speech models in use.

18. The computer program product of claim 17 in which the medical encounter includes at least one clinician and a patient.

19. The computer program product of claim 18, further comprising:

identifying the at least one clinician is located in the smart medical room by utilizing an active badge device and one or more cameras; and

detecting a proximity of the identified at least one clinician to the patient by utilizing the one or more cameras.

20. The computer program product of claim 18, further comprising:

determining that the patient is present in the smart medical room by utilizing one or more cameras and one or more biometric devices; and

confirming the identity of the patient in the smart medical room by utilizing one or more cameras and one or more biometric devices.