Method for determining whether an individual leaves a prescribed virtual perimeter

• US 9,905,113 B2
• Filed: 09/28/2016
• Issued: 02/27/2018
• Est. Priority Date: 07/12/2011
• Status: Active Grant

• Current Assignee: Cerner Innovation, Inc. (Oracle Corporation)
• Original Assignee: Cerner Innovation, Inc. (Oracle Corporation)
• Inventors: Kusens, Neil
• Primary Examiner(s): MCNALLY, KERRI L
• Application Number:
  US15/279,054
• Publication Number:
  US 20170084158A1
• Time in Patent Office: 517 Days
• Field of Search: 3405734
• CPC Class Codes: A61B 2503/08 Elderly
• CPC Class Codes: A61B 5/1115 Monitoring leaving of a patient support, e.g. a bed or a wheelchair
• CPC Class Codes: A61B 5/1128 using image analysis A61B5/1127 takes precedence
• CPC Class Codes: A61B 5/746 Alarms related to a physiological condition, e.g. details of setting alarm thresholds or avoiding false alarms alarms per se G08B
• CPC Class Codes: G06V 10/235 based on user input or interaction
• CPC Class Codes: G06V 20/52 Surveillance or monitoring of activities, e.g. for recognising suspicious objects recognising microscopic objects G06V20/69
• CPC Class Codes: G06V 20/64 Three-dimensional objects
• CPC Class Codes: G06V 40/10 Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
• CPC Class Codes: G06V 40/23 Recognition of whole body movements, e.g. for sport training
• CPC Class Codes: G08B 21/043 detecting an emergency event, e.g. a fall
• CPC Class Codes: G08B 21/0476 Cameras to detect unsafe condition, e.g. video cameras
• CPC Class Codes: G08B 21/22 responsive to presence or absence of persons
• CPC Class Codes: G08B 25/14 Central alarm receiver or annunciator arrangements
• CPC Class Codes: G08B 3/10 using electric transmission; using electromagnetic transmission

Abstract

A method and system that allows healthcare providers, hospitals, skilled nursing facilities and other persons to monitor disabled, elderly or other high-risk individuals to prevent or reduce falls and/or mitigate the impact of a fall by delivering automated notification of “at risk” behavior and falls by such an individual being monitored where assistance is required.

Claims

1. A system for detecting when a monitored individual or any part of the monitored individual has crossed outside of a designated electronic perimeter, the system comprising:

one or more 3D camera, motion and sound sensors within a room occupied by a specific individual to be monitored, the one or more 3D camera, motion and sound sensors configured to;

recognize one or more biometric identifiers of the specific individual; and

electronically forward a continuous video feed to a computerized virtual safety rail monitoring system;

wherein the computerized virtual safety rail monitoring system is configured to;

electronically calibrate virtual safety rails defining a designated electronic perimeter within an area of the room; and

electronically alert a computerized communication system when the computerized virtual safety rail monitoring system detects that the specific individual or any part of the specific individual has crossed over the designated electronic perimeter based on 3D information from the continuous video feed received from the one or more 3D camera, motion and sound sensors.

2. The system of claim 1, wherein, upon receiving an alert, the computerized communication system is configured to send an electronic notification message of the detected crossing of the designated electronic perimeter.

3. The system of claim 1, wherein no electronic alert is provided if one or more other persons are detected in the room at the time the individual or a part of the individual crosses outside of the designated electronic perimeter.

4. The system of claim 1, wherein the 3D camera, motion and sound sensors are configured to continue sending the video feed to the computerized virtual safety rail monitoring system after it is detected that the individual or a part of the individual has crossed outside of the designated electronic perimeter.

5. The system of claim 1, wherein the computerized communication system is further configured to electronically issue an audible message that the individual has crossed the designated electronic perimeter.

6. The system of claim 5, wherein the audible message is a pre-recorded message.

7. The system of claim 6, wherein the pre-recorded message comprises the voice of a caregiver associated with the individual.

8. The system of claim 6, wherein the pre-recorded message advises the individual to return within the designated electronic perimeter defined by the virtual safety rails.

9. The system of claim 1, further comprising a central video monitoring station configured to receive an alert from the computerized virtual safety rail monitoring system if the individual fails to return within the designated electronic perimeter within a predetermined period of time after first issuing an audible message to the individual to return within the designated electronic perimeter of the virtual safety rails.

10. The system of claim 9 wherein the alert is presented at the central video monitoring station as an audible alert or a visual alert.

11. The system of claim 9, wherein the computerized communication system is configured to send an electronic notification message informing a previously designated contact when the individual did not return within the designated electronic perimeter.

12. The system of claim 1, wherein the one or more biometric identifiers comprise distance between points on a body of the specific individual.

33. The system of claim 1, wherein electronically calibrating virtual safety rails comprises receiving placement information for the virtual safety rails.

34. The system of claim 33, wherein electronically calibrating virtual safety rails comprises allowing a user to draw the virtual safety rails over an image or video from the one or more 3D camera, motion and sound sensors.

13. A system for detecting when a monitored individual or any part of the monitored individual has crossed outside of a designated electronic perimeter, the system comprising:

one or more 3D camera, motion and sound sensors; and

a computerized virtual safety rail monitoring system configured to;

electronically calibrate virtual safety rails defining a designated electronic perimeter within an area of the room;

electronically receive a continuous video feed from the one or more 3D camera, motion and sound sensors located in the room and configured to recognize a specific individual using one or more biometric identifiers of the individual in order to monitor movements of the specific individual; and

electronically alert a computerized communication system when the computerized virtual safety rail monitoring system detects that the specific individual or any part of the specific individual has crossed over the designated electronic perimeter based on the continuous video feed received from the one or more 3D camera, motion and sound sensors.

14. The system of claim 13, wherein the one or more 3D camera, motion and sound sensors are configured to use biometric identifiers comprising distance between points on a body of the specific individual.

15. The system of claim 14, wherein the computerized virtual safety rail monitoring system is configured to detect that the designated electronic perimeter has been crossed by the specific individual by tracking skeletal points on the body of the specific individual in real time from the continuous video feed received from the one or more 3D camera, motion and sound sensors.

16. The system of claim 13, wherein the computerized communication system is configured to electronically issue an audible message to the individual to inform the individual that they have crossed the designated electronic perimeter.

17. The system of claim 13, further comprising a central video monitoring station configured to receive an alert from the computerized virtual safety rail monitoring system if the individual fails to return within the designated electronic perimeter within a predetermined period of time after the computerized communication system first issues an audible message to the individual to return within the designated electronic perimeter of the virtual safety rails.

18. The system of claim 17, wherein the computerized communication system is further configured to notify a designated person associated with the individual when the individual did not return within the designated electronic perimeter within a predetermined period of time after the computerized communication system first issues an audible message to the individual to return within the electronic perimeter of the virtual safety rails.

19. A system for detecting when a monitored individual or any part of the monitored individual has crossed outside of a designated electronic perimeter, the system comprising:

a computerized virtual safety rail monitoring system configured to;

electronically receive a continuous video feed of a room occupied by a specific individual to be monitored;

electronically recognize one or more biometric identifiers of the specific individual;

electronically calibrate virtual safety rails defining a designated electronic perimeter within an area of the room; and

electronically alert a computerized communication system when the computerized virtual safety rail monitoring system detects that the specific individual or any part of the specific individual has crossed over the designated electronic perimeter based on 3D information from the continuous video feed.

20. The system of claim 19, further comprising a database configured to receive information from the computerized virtual safety rail monitoring system regarding the detection of the individual or a part of the individual crossing over the designated electronic perimeter.

21. The system of claim 19, wherein, upon receiving an alert, the computerized communication system is configured to send an electronic notification message informing a previously designated contact of the detected crossing of the designated electronic perimeter.

22. The system of claim 19, wherein no electronic alert is provided if one or more other persons are detected in the room at the time the individual or a part of the individual crosses outside of the designated electronic perimeter.

23. The system of claim 19, wherein the computerized virtual safety rail monitoring system continues to receive the continuous video feed after it is detected that the individual or a part of the individual has crossed outside of the designated electronic perimeter.

24. The system of claim 19, wherein the computerized communication system is further configured to electronically issue an audible message to the individual to inform the individual that they have crossed the designated electronic perimeter.

25. The system of claim 24, wherein the audible message is a pre-recorded message.

26. The system of claim 25, wherein the pre-recorded message comprises the voice of a caregiver associated with the individual.

27. The system of claim 25, wherein the pre-recorded message advises the individual to return within the designated electronic perimeter defined by the virtual safety rails.

28. The system of claim 19, further comprising a central video monitoring station configured to receive an alert from the computerized virtual safety rail monitoring system if the individual fails to return within the designated electronic perimeter within a predetermined period of time after first issuing an audible message to the individual to return within the designated electronic perimeter of the virtual safety rails.

29. The system of claim 28 wherein the alert is presented at the central video monitoring station as an audible alert or a visual alert.

30. The system of claim 28, wherein the computerized communication system is configured to send an electronic notification message informing a previously designated contact when the individual did not return within the designated electronic perimeter.

31. The system of claim 19, wherein the one or more biometric identifiers comprise distance between points on a body of the specific individual.

32. A system for detecting when a monitored individual or any part of the monitored individual has crossed outside of a designated electronic perimeter, the system comprising:

a computerized virtual safety rail monitoring system configured to;

electronically receive 3D image data from a room occupied by a specific individual to be monitored;

electronically recognize one or more biometric identifiers of the specific individual in order to monitor movements of only the specific individual;

electronically calibrate virtual safety rails defining a designated electronic perimeter within an area of the room; and

electronically alert a computerized communication system when the computerized virtual safety rail monitoring system detects that the specific individual or any part of the specific individual has crossed over the designated electronic perimeter by tracking one or more of the one or more biometric identifiers of the specific individual in real time from the 3D image data.