System for determining whether an individual suffers a fall requiring assistance

• US 9,536,310 B1
• Filed: 06/18/2015
• Issued: 01/03/2017
• Est. Priority Date: 07/12/2011
• Status: Active Grant

• Current Assignee: Cerner Innovation, Inc. (Oracle Corporation)
• Original Assignee: Cerner Innovation, Inc. (Oracle Corporation)
• Inventors: Kusens, Neil
• Primary Examiner(s): Hunnings, Travis
• Application Number:
  US14/743,447
• Time in Patent Office: 565 Days
• Field of Search: None
• US Class Current: 1/1
• CPC Class Codes: G06T 1/0007 Image acquisition
• CPC Class Codes: G06T 2207/10028 Range image; Depth image; 3D point clouds
• CPC Class Codes: G06T 2207/30196 Human being; Person
• CPC Class Codes: G06T 2207/30232 Surveillance
• CPC Class Codes: G06T 7/251 involving models
• CPC Class Codes: G06V 20/52 Surveillance or monitoring of activities, e.g. for recognising suspicious objects recognising microscopic objects G06V20/69
• CPC Class Codes: G06V 40/20 Movements or behaviour, e.g. gesture recognition recognition of facial expressions G06V40/16
• CPC Class Codes: G06V 40/23 Recognition of whole body movements, e.g. for sport training
• CPC Class Codes: G08B 21/043 detecting an emergency event, e.g. a fall
• CPC Class Codes: G08B 21/0476 Cameras to detect unsafe condition, e.g. video cameras
• CPC Class Codes: G08B 21/0492 Sensor dual technology, i.e. two or more technologies collaborate to extract unsafe condition, e.g. video tracking and RFID tracking
• CPC Class Codes: H04N 13/204 using stereoscopic image cameras stereoscopic photography G03B35/00
• CPC Class Codes: H04N 7/181 for receiving images from a plurality of remote sources

Abstract

A system and method for monitoring an individual in a dwelling so as to know when such individual falls or indicates the need of assistance. A plurality of 3D motion and sound sensors are located in the dwelling and provide data to a computerized monitoring system. The sensors are configured to recognize one or more biometric identifiers of the individual being monitored. When the monitoring system detects that the individual has fallen or gestured, a computerized communication system contacts the individual to determine the need to send assistance to help the individual. Where assistance is required the system automatics contacts the previously designated caregiver for the individual and can also contact emergency personnel.

Claims

1. A system for detecting when a monitored individual within a dwelling has fallen, is about to fall or otherwise indicates that he or she needs medical assistance, the system comprising:

one or more 3D Camera, Motion and Sound sensors positioned such that the one or more sensors capture continuous video of a preconfigured area of a particular room wherein an individual is to be monitored, wherein during monitoring the one or more 3D Camera, Motion and Sound sensors are continually on and capturing video;

a computerized monitoring system in communication with said one or more 3D Camera, Motion and Sound sensors to receive the captured continuous video of the preconfigured area for analysis by the computerized monitoring system, said computerized monitoring system programmed to recognize skeletal points on a body of the monitored individual in order to identify and track movement by the monitored individual in the continuous video received from the 3D Camera, Motion and Sound sensors, wherein during monitoring said computerized monitoring system continuously receiving captured video from the one or more 3D Camera, Motion and Sound sensors independent of and prior to any determination by the computerized monitoring system that the monitored individual has fallen or made a hand gesture;

said computerized monitoring system programmed to continually monitor data sent by the one or more 3D Camera, Motion and Sound sensors; and

a computerized communication system in communication with the computerized monitoring system, said computerized communication system programmed to facilitate communication with the monitored individual or a caregiver or other designated person when the computerized monitoring system determines that the monitored individual has fallen, is about to fall or has gestured for assistance based on video received from the one or more 3D Camera, Motion and Sound sensors.

2. The system for detecting of claim 1 further comprising a centralized monitoring system in communication with the computerized monitoring system and the one or more 3D Camera, Motion and Sound Sensors, said centralized monitoring system receiving the captured video from the one or more 3D Camera, Motion and Sound sensors, said centralized monitoring system located in a different, room from the monitored room.

3. The system for detecting of claim 2 further comprising a centralized monitoring primary display in communication with the centralized monitoring system for displaying the captured video received by the centralized monitoring system.

4. The system for detecting of claim 3 wherein said centralized monitoring system receiving captured video for a plurality of different monitored rooms by receiving captured video from a plurality of one or more 3D Camera, Motion and Sound sensors with each one of the plurality of one or more 3D Camera, Motion and Sound sensors associated with a particular one of the plurality of different monitored rooms.

5. The system for detecting of claim 4 further comprising a centralized monitoring alert display in communication with the centralized monitoring system, said centralized monitoring alert display displaying a video for a particular monitored room from the plurality of monitored rooms when said computerized monitoring system determines that the monitored individual has fallen, is about to fall or has gestured for assistance.

6. The system for detecting of claim 3 wherein said centralized monitoring primary display continuously displays the continuously captured video from the one or more 3D Camera, Motion and Sound sensors while monitoring of the room is taking place.

7. The system for detecting of claim 2 further comprising an electronic database in communication with the centralized monitoring system;

said electronic database storing electronic records of any alerts received by the centralized monitoring system from the computerized monitoring system.

8. The system for detecting of claim 1 wherein the preconfigured area is a zone around a bed located in a hospital or nursing home room.

9. The system for detecting of claim 1 wherein the computerized communication system is programmed to facilitate communication with a caregiver when the computerized monitoring system determines that the monitored individual has fallen, is about to fall or has gestured for assistance.

10. The system for detecting of claim 9 wherein the computerized communication system is programmed to facilitate communication with the caregiver through one or more of a phone call, text messaging, speakerphone systems, email, or other electronic means of communication.

11. A system for detecting when a monitored individual within a dwelling has fallen or otherwise indicated that he or she needs medical assistance, the system comprising:

one or more 3D Camera, Motion and Sound sensors positioned such that the one or more sensors capture continuous video of a preconfigured area of a particular room wherein an individual is to be monitored, wherein during monitoring the one or more 3D Camera, Motion and Sound sensors are continually on and capturing video;

a computerized monitoring system in communication with said one or more 3D Camera, Motion and Sound sensors to receive the captured continuous video of the preconfigured area for analysis by the computerized monitoring system, said computerized monitoring system programmed to recognize skeletal points on a body of the monitored individual in order to identify and track movement by the monitored individual in the continuous video received from the 3D Camera, Motion and Sound sensors, wherein during monitoring said computerized monitoring system continuously receives captured video from the one or more 3D Camera, Motion and Sound sensors independent of and prior to any determination by the computerized monitoring system that the monitored individual has fallen or made a hand gesture;

said computerized monitoring system programmed to continually monitor data sent by the one or more 3D Camera, Motion and Sound sensors;

a centralized monitoring system in communication with the computerized monitoring system and the one or more 3D Camera, Motion and Sound Sensors, said centralized monitoring system receiving the captured video from the one or more 3D Camera, Motion and Sound sensors, said centralized monitoring system located in a different room from the monitored room; and

a centralized monitoring primary display in communication with the centralized monitoring system for displaying the captured video received by the centralized monitoring system.

12. The system for detecting of claim 11 wherein said centralized monitoring system receives captured video for a plurality of different monitored rooms by receiving captured video from a plurality of one or more 3D Camera, Motion and Sound sensors with each one of the plurality of one or more 3D Camera, Motion and Sound sensors associated with a particular one of the plurality of different monitored rooms.

13. The system for detecting of claim 12 further comprising a centralized monitoring alert display in communication with the centralized monitoring system, said centralized monitoring alert display displaying a video for a particular monitored room from the plurality of monitored rooms when said computerized monitoring system determines that the monitored individual has fallen, is about to fall or has gestured for assistance.

14. The system for detecting of claim 11 wherein said centralized monitoring system continuously receives captured video from the one or more 3D Camera, Motion and Sound sensors which is continuously displayed on the centralized monitoring primary display while monitoring of the room is taking place.

15. The system for detecting of claim 11 further comprising an electronic database in communication with the centralized monitoring system;

said electronic database storing electronic records of any alerts received by the centralized monitoring system from the computerized monitoring system.

16. The system for detecting of claim 13 wherein the preconfigured area is a zone around a bed located in a hospital or nursing home room.

17. A system for detecting when a monitored individual within a dwelling has fallen or otherwise indicated that he or she needs medical assistance, the system comprising:

one or more 3D Camera, Motion and Sound sensors positioned such that the one or more sensors captures continuous video of a preconfigured area of a particular room wherein an individual is to be monitored, wherein during monitoring the one or more 3D Camera, Motion and Sound sensors are continually on and capturing video;

a computerized communication system in communication with the computerized monitoring system, said computerized communication system programmed to facilitate communication with the monitored individual or a caregiver or other designated person when the computerized monitoring system determines that the monitored individual has fallen, is about to fall or has gestured for assistance based on video received from the one or more 3D Camera, Motion and Sound sensors;

a computerized monitoring system in communication with said one or more 3D Camera, Motion and Sound sensors to receive the captured continuous video of the preconfigured area for analysis by the computerized monitoring system, said computerized monitoring system programmed to recognize skeletal points on a body of the monitored individual in order to identify and track movement by the monitored individual in the continuous video received from the 3D Camera, Motion and Sound sensors, wherein during monitoring, said computerized monitoring system continuously receiving captured video from the one or more 3D Camera, Motion and Sound sensors independent of and prior to any determination by the computerized monitoring system that the monitored individual has fallen or made a hand gesture;

said computerized monitoring system programmed to continually monitor data sent by the one or more 3D Camera, Motion and Sound sensors;

a centralized monitoring system in communication with the computerized monitoring system and the one or more 3D Camera, Motion and Sound Sensors, said centralized monitoring system receiving the captured video from the one or more 3D Camera, Motion and Sound sensors, said centralized monitoring system located in a different room from the monitored room;

a centralized monitoring primary display in communication with the centralized monitoring system for displaying the captured video received by the centralized monitoring system, said centralized monitoring system receiving captured video for a plurality of different monitored rooms by receiving captured video from a plurality of one or more 3D Camera, Motion and Sound sensors with each one of the plurality of one or more 3D Camera, Motion and Sound sensors associated with a particular one of the plurality of different monitored rooms; and

a centralized monitoring alert display in communication with the centralized monitoring system, said centralized monitoring alert display displaying a video for a particular monitored room from the plurality of monitored rooms when said computerized monitoring system determines that the monitored individual has fallen, is about to fall or has gestured for assistance.

18. The system for detecting of claim 17 further comprising an electronic database in communication with the centralized monitoring system;

said electronic database storing electronic records of any alerts received by the centralized monitoring system from the computerized monitoring system.

19. The system for detecting of claim 17 wherein the preconfigured area is a zone around a bed located in a hospital or nursing home room.

20. The system for detecting of claim 17 wherein the computerized communication system is programmed to facilitate communication with a caregiver when the computerized monitoring system determines that the monitored individual has fallen, is about to fall or has gestured for assistance.