Method and system for determining whether an individual takes appropriate measures to prevent the spread of healthcare-associated infections along with centralized monitoring

• US 10,491,862 B2
• Filed: 04/10/2019
• Issued: 11/26/2019
• Est. Priority Date: 01/17/2014
• Status: Active Grant

• Current Assignee: Cerner Innovation, Inc. (Oracle Corporation)
• Original Assignee: Cerner Innovation, Inc. (Oracle Corporation)
• Inventors: Kusens, Neil
• Primary Examiner(s): Brown, Jr., Howard D
• Application Number:
  US16/380,013
• Publication Number:
  US 20190253668A1
• Time in Patent Office: 230 Days
• CPC Class Codes: G06F 16/51 Indexing; Data structures therefor; Storage structures
• CPC Class Codes: G06T 7/0012 Biomedical image inspection
• CPC Class Codes: G06T 7/20 Analysis of motion motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51
• CPC Class Codes: G06T 7/285 using a sequence of stereo image pairs
• CPC Class Codes: G06V 10/235 based on user input or interaction
• CPC Class Codes: G06V 20/52 Surveillance or monitoring of activities, e.g. for recognising suspicious objects recognising microscopic objects G06V20/69
• CPC Class Codes: G06V 40/20 Movements or behaviour, e.g. gesture recognition recognition of facial expressions G06V40/16
• CPC Class Codes: G06V 40/23 Recognition of whole body movements, e.g. for sport training
• CPC Class Codes: G16H 10/00 ICT specially adapted for the handling or processing of patient-related medical or healthcare data for medical reports G16H15/00; for therapies or health-improving plans G16H20/00; for the handling or processing of medical images G16H30/00
• CPC Class Codes: G16H 40/20 for the management or administration of healthcare resources or facilities, e.g. managing hospital staff or surgery rooms
• CPC Class Codes: G16H 40/67 for remote operation
• CPC Class Codes: H04N 13/204 using stereoscopic image cameras stereoscopic photography G03B35/00
• CPC Class Codes: H04N 7/18 Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast

Abstract

A system and method that allows caregivers, central monitoring companies and other persons to monitor whether individuals entering patients'"'"' rooms take appropriate steps to mitigate the spread of healthcare associated infections to the patients receiving healthcare services. In one non-limiting example the system and method determine whether an individual who has entered the room of a patient has washed his or her hands prior to approaching the patient. A live video feed from the monitored rooms can be displayed on a centralized monitoring primary display which can be located remote to the monitored rooms. When it is determined that an individual in a specific room from the monitored rooms is approaching a patient and has not washed his or her hands an alert, notification and/or a live video feed for the specific room can be displayed on a centralized monitoring alert display which can also be preferably located remote to the monitored rooms.

Claims

1. A computerized method for live video analysis, the computerized method comprising:

receiving live video data of a virtual zone;

determining when at least a portion of an individual is observed in the virtual zone based on the live video data;

based on the live video data of the virtual zone, identifying a specific gesture of the at least a portion of the individual;

determining from the live video data whether the individual is in compliance with the sanitization task based on the specific gesture; and

when it is determined that the individual is in compliance with the sanitization task, transmitting the notification to the individual, wherein the notification indicates that the individual is in compliance with a sanitization task.

2. The method of claim 1, wherein determining from the live video data whether the individual is in compliance with the sanitization task based on the specific gesture comprises determining that the specific gesture corresponds to the sanitization task.

3. The method of claim 1, wherein determining from the live video data whether the individual is in compliance with the sanitization task based on the specific gesture comprises using three-dimensional coordinates of the at least a portion of the individual from the live video data to determine a duration of time during which the at least a portion of the individual remains in the virtual zone.

4. The method of claim 1, wherein the specific gesture of the at least the portion of the individual is the individual rubbing their hands together.

5. The method of claim 1, wherein identifying the specific gesture of the at least the portion of the individual comprises using three-dimensional coordinates of the at least a portion of the individual from the live video data to recognize that the individual rubs their hands together.

6. The method of claim 1, wherein identifying the specific gesture of the at least the portion of the individual comprises using three-dimensional coordinates of the at least a portion of the individual from the live video data to recognize that the individual activates a dispersal of a sanitizing fluid.

7. The method of claim 1, wherein identifying the specific gesture of the at least the portion of the individual comprises using three-dimensional coordinates of one or more joints of the at least a portion of the individual from the live video data to recognize that the individual rubs their hands together.

8. The method of claim 1 further comprising when it is determined that the individual is not in compliance with the sanitization task, transmitting a notification to the individual, wherein the notification indicates that the individual is not in compliance with the sanitization task.

9. One or more non-transitory computer-readable media storing executable instructions thereon for a method of live video analysis, wherein execution of the instructions by one or more processors provides a method, the method comprising:

defining a virtual zone;

receiving live video data of the virtual zone;

determining when hands of an individual are observed in the virtual zone based on the live video data;

based on the live video data of the virtual zone, identifying a specific gesture of the hands of the individual;

determining from the live video data whether the individual is in compliance with the hand sanitization task based on the specific gesture of the hands; and

when it is determined that the individual is in compliance with the hand sanitization task, transmitting a notification to the individual, wherein the notification indicates that the individual is in compliance with the hand sanitization task.

10. The method of claim 9, wherein determining from the live video data whether the individual is in compliance with the hand sanitization task based on the specific gesture comprises determining that the specific gesture corresponds to the hand sanitization task.

11. The method of claim 9, wherein determining from the live video data whether the individual is in compliance with the hand sanitization task based on the specific gesture comprises using three-dimensional coordinates of the at least a portion of the individual from the live video data to determine a duration of time during which the at least a portion of the individual remains in the virtual zone.

12. The method of claim 9, wherein the specific gesture of the hands of the individual is the individual rubbing their hands together.

13. The method of claim 9, wherein the specific gesture of the hands of the individual is the individual activating a dispersal of a sanitizing fluid.

14. The method of claim 9, wherein identifying the specific gesture of the hands of the individual comprises using three-dimensional coordinates of the hands from the live video data to recognize that the individual rubs their hands together.

15. The method of claim 9, wherein identifying the specific gesture of the hands of the individual comprises using three-dimensional coordinates of one or more joints of the hands from the live video data to recognize that the individual rubs their hands together.

16. The method of claim 9 further comprising when it is determined that the individual is in compliance with the hand sanitization task, transmitting the notification to the individual, wherein the notification indicates that the individual is in compliance with the hand sanitization task.

17. The method of claim 9, further comprising continuously displaying the live video data of the virtual zone via a graphical user display.

18. The method of claim 9, wherein the virtual zone corresponds to equipment for performing the hand sanitization task, and wherein the equipment is located in a patient room in a clinical setting.

19. The method of claim 9, wherein the live video data is received from one or more three-dimensional sensors, the one or more three-dimensional sensors capturing at least one of video, audio, or depth.

20. A system for live video analysis, the system comprising:

one or more three-dimensional sensors; and

one or more processors communicatively coupled to the one or more three-dimensional sensors, wherein the one or more processors;

define a virtual zone;

receive live video data of the virtual zone, the live video data received from the one or more three-dimensional sensors;

determine when hands of an individual are observed in the virtual zone based on the live video data;

based on the live video data of the virtual zone, identify a specific gesture of the hands of the individual;

determine from the live video data whether the individual is in compliance with a hand sanitization task based on the specific gesture of the hands; and

when it is determined that the individual is in compliance with the hand sanitization task, transmit a notification to the individual, wherein the notification indicates that the individual is in compliance with the hand sanitization task.