Utilizing artificial intelligence to detect objects or patient safety events in a patient room

• US 10,643,446 B2
• Filed: 12/28/2017
• Issued: 05/05/2020
• Est. Priority Date: 12/28/2017
• Status: Active Grant

• Current Assignee: Cerner Innovation, Inc. (Oracle Corporation)
• Original Assignee: Cerner Innovation, Inc. (Oracle Corporation)
• Inventors: Kusens, Bruce Howard, Kusens, Michael
• Primary Examiner(s): Nguyen, Huy T
• Application Number:
  US15/856,419
• Publication Number:
  US 20190206218A1
• Time in Patent Office: 859 Days
• CPC Class Codes: G06V 20/52 Surveillance or monitoring of activities, e.g. for recognising suspicious objects recognising microscopic objects G06V20/69
• CPC Class Codes: G08B 21/0476 Cameras to detect unsafe condition, e.g. video cameras
• CPC Class Codes: G08B 25/08 using communication transmission lines G08B13/19658, G08B21/0286, G08B25/016 take precedence
• CPC Class Codes: G08B 29/185 Signal analysis techniques for reducing or preventing false alarms or for enhancing the reliability of the system
• CPC Class Codes: H04N 13/204 using stereoscopic image cameras stereoscopic photography G03B35/00

Abstract

Methods and systems are provided for detecting objects or patient safety events in a patient room. Artificial intelligence is utilized to enhance safety issue recognition capabilities by the methods and systems. Sensors collect a series of images and depth data in a room of a patient. Data (corresponding to images and depth data of an object or patient safety event) is received from the sensors and compared to stored data to identify the object or patient safety event. The images are communicated to a central video monitoring system and a user may be prompted to confirm if the object requires learning or a patient safety event occurred (or identify the object or patient safety event) or to provide additional parameters or actions. A patient safety learning system analyzes the data and incorporates the user response to enhance safety issue recognition capabilities of the system and reduce false alerts.

Claims

1. A system for utilizing artificial intelligence to detect objects in a patient room, the system comprising:

one or more motion sensors located to collect a series of images of a room of a patient;

a computerized patient safety monitoring system communicatively coupled to the one or more motion sensors, the computerized monitoring system receiving data from the one or more motion sensors and comparing the data to stored data in a database to identify an object; and

a central video monitoring system that;

receives images of the object or patient safety event from the computerized patient safety monitoring system;

prompts a user to confirm whether the object requires learning or the patient safety event occurred; and

upon receiving an indication that the object requires learning, creates a recording of the object prior, during, and after the object was detected; and

a patient safety learning system that analyzes the data and incorporates whether the object requires learning to enhance safety issue recognition capabilities of the system and reduce false alerts.

2. The system of claim 1, wherein if the object requires learning or the patient safety event occurred, the central video monitoring system creates the recording of the object prior to using data buffering.

3. The system of claim 1, wherein the recording is communicated to the patient safety learning system along with the object and additional parameters added by the user.

4. The system of claim 1, further comprising the database that stores new or modified lessons learned by the patient safety learning system.

5. The system of claim 1, wherein the central video monitoring system further prompts the user to add additional parameters to the object.

6. The system of claim 1, wherein if no object is detected, the computerized patient safety monitoring system communicates live images of the data to the central video monitoring system for the user to view.

7. Computer-readable storage media having embodied thereon instructions which, when executed by one or more computer processors, cause the processors to:

utilize one or more motion sensors to collect a series of images of a room of a patient;

receive data from the one or more motion sensors at a computerized patient safety monitoring system, the computerized patient safety monitoring system communicatively coupled to the one or more motion sensors;

compare the data to stored data in a database to identify an object, wherein the data comprises the object and one or more reference points assigned to one or more features of the object;

communicate, to a central video monitoring system, images of the object from the computerized patient safety monitoring system;

prompt a user to confirm whether the object requires learning;

upon receiving an indication that the object requires learning, create a recording of the object prior to, during, and after the object was detected; and

analyze, by a patient safety learning system, the data.

8. The computer-readable storage media of claim 7, further comprising communicating the recording to the patient safety learning system along with the object and additional parameters added by the user.

9. The computer-readable storage media of claim 7, further comprising storing, by the database, new or modified lessons learned by the patient safety learning system.

10. The computer-readable storage media of claim 7, further comprising prompting, by the central video monitoring system, the user to add additional parameters to the object.

11. The computer-readable storage media of claim 7, further comprising, if no object is detected, communicating, by the computerized patient safety monitoring system, live images of the data to the central video monitoring system for the user to view.

12. A method for utilizing artificial intelligence to detect objects in a patient room, the method comprising:

utilizing one or more motion sensors to collect a series of images of a room of a patient;

receiving data from the one or more motion sensors at a computerized patient safety monitoring system, the computerized patient safety monitoring system communicatively coupled to the one or more motion sensors;

receiving, by a central video monitoring system, images of the object from the computerized patient safety monitoring system;

enabling, at the central video monitoring system, a user to identify the object that requires learning and to add additional parameters to the object;

upon receiving an indication that the object requires learning, creating a recording of the object prior to, during, and after detection of the object; and

analyzing, by a patient safety learning system, the data and incorporating the identification of the object that requires learning.

13. The method of claim 12, further comprising communicating the recording to the patient safety learning system along with the identification of the object and the additional parameters added by the user.

14. The method of claim 12, further comprising storing, by the database, new or modified lessons learned by the patient safety learning system.

15. The method of claim 12, further comprising, if no object is identified by the user, communicating, by the computerized patient safety monitoring system, live images of the data to the central video monitoring system for the user to view.