Method and process for determining whether an individual suffers a fall requiring assistance

• US 10,078,951 B2
• Filed: 12/30/2016
• Issued: 09/18/2018
• Est. Priority Date: 07/12/2011
• Status: Active Grant

• Current Assignee: Cerner Innovation, Inc. (Oracle Corporation)
• Original Assignee: Cerner Innovation, Inc. (Oracle Corporation)
• Inventors: Kusens, Neil
• Primary Examiner(s): Hunnings, Travis
• Application Number:
  US15/395,716
• Publication Number:
  US 20170109991A1
• Time in Patent Office: 627 Days
• CPC Class Codes: G06T 1/0007 Image acquisition
• CPC Class Codes: G06T 2207/10028 Range image; Depth image; 3D point clouds
• CPC Class Codes: G06T 2207/30196 Human being; Person
• CPC Class Codes: G06T 2207/30232 Surveillance
• CPC Class Codes: G06T 7/251 involving models
• CPC Class Codes: G06V 20/52 Surveillance or monitoring of activities, e.g. for recognising suspicious objects recognising microscopic objects G06V20/69
• CPC Class Codes: G06V 40/20 Movements or behaviour, e.g. gesture recognition recognition of facial expressions G06V40/16
• CPC Class Codes: G06V 40/23 Recognition of whole body movements, e.g. for sport training
• CPC Class Codes: G08B 21/043 detecting an emergency event, e.g. a fall
• CPC Class Codes: G08B 21/0476 Cameras to detect unsafe condition, e.g. video cameras
• CPC Class Codes: G08B 21/0492 Sensor dual technology, i.e. two or more technologies collaborate to extract unsafe condition, e.g. video tracking and RFID tracking
• CPC Class Codes: H04N 13/204 using stereoscopic image cameras stereoscopic photography G03B35/00
• CPC Class Codes: H04N 7/181 for receiving images from a plurality of remote sources

Abstract

A method for monitoring an individual in a dwelling so as to know when such individual falls or indicates the need of assistance. A plurality of 3D motion and sound sensors are located in the dwelling and provide data to a computerized monitoring system. The sensors are configured to recognize one or more biometric identifiers of the individual being monitored. When the monitoring system detects that the individual has fallen or gestured, a computerized communication system contacts the individual to determine the need to send assistance to help the individual. Where assistance is required the system automatics contacts the previously designated caregiver for the individual and can also contact emergency personnel.

Claims

1. A method for detecting when a monitored individual has fallen or otherwise indicated that he or she needs assistance, said method comprising the steps of:

(a) accessing data from one or more 3D motion and sound sensors within one or more rooms occupied by an individual;

(b) configuring the one or more sensors to recognize one or more biometric identifiers of the individual;

(c) tracking the individual'"'"'s movement, regardless of lighting conditions, using one or more of the one or more biometric identifiers by a computerized monitoring system; and

(d) sending a message to the individual or a caregiver from a computerized communication system in communication with the computerized monitoring system when the computerized monitoring system detects from the tracking that the individual has fallen or gestured that he or she needs assistance.

2. The method of claim 1 further comprising the step of updating a database in communication with the computerized monitoring system regarding the detection of a fall or gesture by the individual.

3. The method of claim 1 further comprising the step of notifying a previously designated contact by an electronic message of the detected fall or gesture from the monitored individual after detecting that the individual has fallen or gestured.

4. The method of claim 1 wherein the data comprises video and 3D depth data.

5. The method of claim 1 wherein the biometric identifiers comprise one or more of height, distance between points on the body, and skeletal points.

6. The method of claim 1 wherein the one or more sensors are continuously on.

7. The method of claim 1 wherein the gesture comprises waving a hand or rubbing hands together.

8. The method of claim 1 wherein video data from the one or more sensors is stored by the computerized monitoring system.

9. The method of claim 1, comprising accessing data from two or more sensors in two or more different rooms.

10. The method of claim 9 wherein the two or more different rooms are in an individual'"'"'s residence.

11. The method of claim 1, wherein the computerized monitoring system automatically begins monitoring data from the one or more sensors again after a fall is detected.

12. The method of claim 1 wherein the computerized communication system attempts to contact the individual to verify whether a fall occurred or the individual requires assistance when the computerized monitoring system detects from the tracking that the individual has fallen or gestured that he or she needs assistance.

13. The method of claim 1 wherein if the message received from the individual indicates a false alarm, the system continues to track the individual'"'"'s movement.

14. The method of claim 13 wherein the tracking continues for a specified period of time from receiving the message.

15. The method of claim 13 wherein the tracking continues until the system detects from the tracking that the individual has arisen from a fall.

16. The method of claim 13, wherein the tracking continues until the individual provides voice, electronic, or gesture reconfirmation to the system.

17. A method for detecting when a monitored individual has fallen or otherwise indicated that he or she needs assistance, said method comprising the steps of:

(a) accessing data from one or more 3D motion and sound sensors within one or more rooms occupied by an individual;

(b) configuring the one or more sensors to recognize one or more biometric identifiers of the individual;

(c) tracking the individual'"'"'s movement, regardless of lighting conditions, using one or more of the one or more biometric identifiers by a computerized monitoring system;

(d) sending a message to the individual or a caregiver from a computerized communication system in communication with the computerized monitoring system when the computerized monitoring system detects from the tracking that the individual has fallen or gestured that he or she needs assistance; and

(e) sending the data from the one or more 3D motion and sound sensors to a centralized monitoring station.

18. The method of claim 17, wherein the data sent to the centralized monitoring station comprises video data.

19. The method of claim 18, wherein the data sent to the centralized monitoring station comprises audio data.

20. The method of claim 18, wherein the video data is displayed on a central monitoring station display.

21. The method of claim 20, wherein the central monitoring station display aggregates data from more than one computerized monitoring system.

22. The method of claim 21, further comprising sending an alert to the centralized monitoring station when the computerized monitoring system detects from the tracking that the individual has fallen or gestured that he or she needs assistance.

23. The method of claim 22, wherein on receipt of an alert, data from the computerized monitoring system sending the alert is displayed on a centralized monitoring station alert display.

24. A non-transitory electronic storage mechanism, the electronic storage mechanism embodying computer-readable instructions which, when executed by a computer system, cause the computer system to:

(a) access data from one or more 3D motion and sound sensors within one or more rooms occupied by an individual;

(b) configure the one or more sensors to recognize one or more biometric identifiers of the individual;

(c) track the individual'"'"'s movement, regardless of lighting conditions, using one or more of the one or more biometric identifiers; and

(d) send a message to the individual or a caregiver when the system detects from the tracking that the individual has fallen or gestured that he or she needs assistance.

25. The electronic storage mechanism of claim 24, wherein the instructions further cause the computer system to:

(e) send the data from the one or more 3D motion and sound sensors to a centralized monitoring station.

26. The electronic storage mechanism of claim 25, wherein the instructions further cause the computer system to send an alert to the centralized monitoring station when the system detects from the tracking that the individual has fallen or gestured that he or she needs assistance.