Method and process for determining whether an individual suffers a fall requiring assistance

• US 10,217,342 B2
• Filed: 03/02/2018
• Issued: 02/26/2019
• Est. Priority Date: 07/12/2011
• Status: Active Grant

• Current Assignee: Cerner Innovation, Inc. (Oracle Corporation)
• Original Assignee: Cerner Innovation, Inc. (Oracle Corporation)
• Inventors: Kusens, Neil
• Primary Examiner(s): Hunnings, Travis R
• Application Number:
  US15/910,632
• Publication Number:
  US 20180190098A1
• Time in Patent Office: 361 Days
• CPC Class Codes: G06T 1/0007 Image acquisition
• CPC Class Codes: G06T 2207/10028 Range image; Depth image; 3D point clouds
• CPC Class Codes: G06T 2207/30196 Human being; Person
• CPC Class Codes: G06T 2207/30232 Surveillance
• CPC Class Codes: G06T 7/251 involving models
• CPC Class Codes: G06V 20/52 Surveillance or monitoring of activities, e.g. for recognising suspicious objects recognising microscopic objects G06V20/69
• CPC Class Codes: G06V 40/20 Movements or behaviour, e.g. gesture recognition recognition of facial expressions G06V40/16
• CPC Class Codes: G06V 40/23 Recognition of whole body movements, e.g. for sport training
• CPC Class Codes: G08B 21/043 detecting an emergency event, e.g. a fall
• CPC Class Codes: G08B 21/0476 Cameras to detect unsafe condition, e.g. video cameras
• CPC Class Codes: G08B 21/0492 Sensor dual technology, i.e. two or more technologies collaborate to extract unsafe condition, e.g. video tracking and RFID tracking
• CPC Class Codes: H04N 13/204 using stereoscopic image cameras stereoscopic photography G03B35/00
• CPC Class Codes: H04N 7/181 for receiving images from a plurality of remote sources

Abstract

A method for monitoring an individual in a dwelling so as to know when such individual falls or indicates the need of assistance. A plurality of 3D motion and sound sensors are located in the dwelling and provide data to a computerized monitoring system. The sensors are configured to recognize one or more biometric identifiers of the individual being monitored, which are used to track the individual'"'"'s movement. When the monitoring system detects that the individual has fallen or gestured for assistance, a computerized communication system alerts the individual, a caregiver, or other designated person.

Claims

1. A method for detecting when a monitored individual has fallen or otherwise indicated that he or she needs assistance, the method performed by a computerized monitoring system and comprising:

accessing data from one or more 3D motion and sound sensors within one or more rooms occupied by an individual, wherein the one or more 3D motion and sound sensors are configured to recognize one or more biometric identifiers of the individual;

tracking movement of the individual, regardless of lighting conditions, using one or more of the one or more biometric identifiers;

evaluating the movement of the individual to make a determination of whether the individual has fallen or gestured for assistance; and

sending the data and the determination to a centralized monitoring station.

2. The method of claim 1, further comprising aggregating data and determinations for multiple individuals at the centralized monitoring station.

3. The method of claim 2, further comprising displaying video of the individual at the centralized monitoring station.

4. The method of claim 3, further comprising sending an alert to the centralized monitoring station upon determining that the individual has fallen or gestured for assistance.

5. The method of claim 4, wherein the alert is displayed at the centralized monitoring station.

6. The method of claim 5, wherein the alert is displayed by one or more of flashing a specific camera view;

highlighting a specific camera view in a color;

issuing an audible sound;

displaying a text message;

displaying an e-mail;

turning on a light;

running a program on a computer; and

duplicating a display on a centralized monitoring station alert display.

7. The method of claim 1, further comprising sending, on determination that the individual has fallen or gestured for assistance, an alert to at least one of the centralized monitoring station or a computerized communication system.

8. The method of claim 7, wherein the computerized communication system, on receiving the alert, notifies the individual, a caregiver, or a designated person.

9. The method of claim 7, wherein, on receiving an alert, the computerized communication system contacts the individual to verify if a fall occurred and/or whether the individual requires assistance.

10. The method of claim 9, wherein if the individual confirms a fall has occurred and/or the individual requires assistance or if the individual fails to respond to the computerized communication system, the caregiver or the designated person is notified.

11. The method of claim 1, wherein the one or more biometric identifiers comprise height or distance between points on the individual'"'"'s body.

12. The method of claim 1, further comprising monitoring 3D coordinates of joints in the individual'"'"'s body.

13. The method of claim 12, further comprising monitoring a skeletal outline of the individual'"'"'s body.

14. The method of claim 13, wherein the one or more 3D motion and sound sensors are configured to lock on to the individual to be monitored.

15. The method of claim 1, further comprising defining a fall zone, wherein the tracking and evaluating are performed for data within the fall zone.

16. The method of claim 15, wherein the fall zone has a depth dimension.

17. The method of claim 16, wherein the fall zone excludes objects in front of and behind the individual.

18. A method for detecting when a monitored individual has fallen or otherwise indicated that he or she needs assistance, the method performed by a computerized monitoring system and comprising:

accessing data from one or more 3D motion and sound sensors within one or more rooms occupied by an individual, wherein the one or more 3D motion and sound sensors are configured to recognize one or more biometric identifiers of the individual;

tracking movement of the individual, regardless of lighting conditions, using one or more of the one or more biometric identifiers;

evaluating the movement of the individual to make a determination of whether the individual has fallen or gestured for assistance;

sending the data and the determination to a centralized monitoring station; and

upon determination that the individual has fallen or gestured for assistance, sending an alert to the centralized monitoring station and sending a notification to at least one of the individual, a caregiver, or a designated person.

19. The method of claim 18, further comprising attempting to communicate with the individual to confirm that the individual needs assistance, and notifying the caregiver or the designated person if the individual confirms that assistance is needed or does not respond.

20. A method for detecting when a monitored individual has fallen or otherwise indicated that he or she needs assistance, the method performed by a computerized monitoring system and comprising:

accessing data from one or more 3D motion and sound sensors within one or more rooms occupied by an individual, the one or more 3D motion and sound sensors configured to recognize one or more biometric identifiers of the individual;

tracking movement of the individual, regardless of lighting conditions, using one or more of the one or more biometric identifiers;

evaluating the movement of the individual to make a determination of whether the individual has fallen or gestured for assistance;

sending the data and the determination to a centralized monitoring station, wherein the data is displayed on a primary display associated with the centralized monitoring station; and

upon determination that the individual has fallen or gestured for assistance, sending an alert to the centralized monitoring station, wherein a display of the data is moved from the primary display to an alert display associated with the centralized monitoring station.