Methods for determining whether an individual enters a prescribed virtual zone using 3D blob detection

• US 10,210,395 B2
• Filed: 10/04/2016
• Issued: 02/19/2019
• Est. Priority Date: 02/16/2015
• Status: Active Grant

• Current Assignee: Cerner Innovation, Inc. (Oracle Corporation)
• Original Assignee: Cerner Innovation, Inc. (Oracle Corporation)
• Inventors: Kusens, Neil
• Primary Examiner(s): Azarian, Seyed
• Application Number:
  US15/285,416
• Publication Number:
  US 20170091562A1
• Time in Patent Office: 868 Days
• Field of Search: 382100, 382103, 382106-107, 382128, 382154-155, 382162, 382168, 382173, 382181, 382190, 382199, 382203, 382209, 382214, 382219, 382232, 382254, 382274, 382276, 382286-291, 382305, 382312, 128903, 705 2, 600476, 600474, 3482221, 348 46
• CPC Class Codes: A61B 5/0077 Devices for viewing the surface of the body, e.g. camera, magnifying lens
• CPC Class Codes: A61B 5/1117 Fall detection
• CPC Class Codes: A61B 5/743 Displaying an image simultaneously with additional graphical information, e.g. symbols, charts, function plots
• CPC Class Codes: G06F 16/51 Indexing; Data structures therefor; Storage structures
• CPC Class Codes: G06V 10/143 Sensing or illuminating at different wavelengths
• CPC Class Codes: G06V 10/255 Detecting or recognising potential candidate objects based on visual cues, e.g. shapes
• CPC Class Codes: G06V 10/28 Quantising the image, e.g. histogram thresholding for discrimination between background and foreground patterns
• CPC Class Codes: G06V 20/52 Surveillance or monitoring of activities, e.g. for recognising suspicious objects recognising microscopic objects G06V20/69
• CPC Class Codes: G06V 20/647 by matching two-dimensional images to three-dimensional objects
• CPC Class Codes: G06V 40/103 Static body considered as a whole, e.g. static pedestrian or occupant recognition
• CPC Class Codes: G08B 21/043 detecting an emergency event, e.g. a fall
• CPC Class Codes: G08B 21/0476 Cameras to detect unsafe condition, e.g. video cameras
• CPC Class Codes: G08B 21/22 responsive to presence or absence of persons
• CPC Class Codes: G16H 10/60 for patient-specific data, e.g. for electronic patient records
• CPC Class Codes: H04N 13/00 Stereoscopic video systems; Multi-view video systems; Details thereof
• CPC Class Codes: H04N 13/204 using stereoscopic image cameras stereoscopic photography G03B35/00
• CPC Class Codes: H04N 7/18 Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
• CPC Class Codes: H04N 7/181 for receiving images from a plurality of remote sources

Abstract

A method and system that allows healthcare providers, hospitals, skilled nursing facilities and other persons to monitor disabled, elderly or other high-risk individuals to prevent or reduce falls and/or mitigate the impact of a fall by delivering automated notification of “at risk” behavior and falls by such an individual being monitored where assistance is required. The monitored individual is virtually represented as a blob object of at least a specific size by a computerized monitoring system and such system detects and alerts when the blob object enters or crosses into a virtually defined or designated blob detection zone and remains in the zone for at least a predetermined period of time.

Claims

1. A method for detecting movement by an individual within a monitored room, the method performed at a computerized virtual blob detecting monitoring system and comprising:

receiving, by a computerized Virtual Blob Detecting Monitoring system, 3D depth data of a preconfigured area of a particular room wherein an individual is to be monitored, the 3D depth data captured by one or more 3D camera, motion and sound sensors;

determining, using the 3D depth data, that an object has entered the preconfigured area;

upon determining the object entered the preconfigured area, determining, using the 3D depth data and IR depth map, that the object within the preconfigured area satisfies a predetermined size; and

initiating an alert based on at least the object within the preconfigured area satisfying the predetermined size.

2. The method of claim 1 further comprising receiving video data from the one or more 3D camera, motion, and sound sensors.

3. The method of claim 2 further comprising transmitting the video data to a centralized monitoring system.

4. The method of claim 3 wherein the video data transmitted to the centralized monitoring system is displayed on a centralized monitoring primary display.

5. The method of claim 4, wherein the centralized monitoring system receives video data for a plurality of different monitored rooms by receiving video data from a plurality of two or more 3D camera, motion and sound sensors with each one of the plurality of two or more 3D camera, motion and sound sensors associated with a particular monitored room of the plurality of different monitored rooms.

6. The method of claim 5 further comprising displaying the video data received by the centralized monitoring system for a particular monitored room of the plurality of different monitored rooms on a centralized monitoring alert display when said computerized virtual blob detecting monitoring system determines that an object satisfying the predetermined size has entered into the preconfigured area for the particular monitored room.

7. The method of claim 4 wherein said centralized monitoring system continuously receives video captured by the one or more 3D camera, motion and sound sensors which is continuously displayed on the centralized monitoring primary display while monitoring is occurring.

8. The method of claim 3 further comprising storing electronic records of any alerts in an electronic database.

9. The method of claim 1 wherein the preconfigured area is defined by x, y, and z coordinates in relation to the one or more 3D camera, motion and/or sound sensors.

10. The method of claim 1 wherein the preconfigured area is a zone around a bed located in a hospital or nursing home room.

11. A method for detecting movement by an individual within a monitored room, the method performed by a computerized virtual blob detecting monitoring system and comprising:

receiving 3D depth data of a preconfigured area of a particular room wherein an individual is to be monitored, the 3D depth data captured by one or more 3D camera, motion and sound sensors;

determining, using the 3D depth data, that an object has entered the preconfigured area;

upon determining the object entered the preconfigured area, determining, using the 3D depth data and using an IR depth map, that the object within the preconfigured area satisfies a predetermined size;

initiating an alert to a centralized monitoring system based on at least the object within the preconfigured area satisfying the predetermined size; and

transmitting video data from the one or more 3D camera, motion, and sound sensors to the centralized monitoring system.

12. The method of claim 11 wherein said centralized monitoring system receives video data for a plurality of different monitored rooms by receiving video data from a plurality of two or more 3D camera, motion and sound sensors with each one of the plurality of two or more 3D camera, motion and sound sensors associated with a particular monitored room of the plurality of different monitored rooms.

13. The method of claim 12 wherein the centralized monitoring system displays video data for a particular monitored room from the plurality of different monitored rooms on a centralized monitoring alert display in communication with the centralized monitoring system when the computerized virtual blob detecting monitoring system determines that an object satisfying the predetermined size has entered into the preconfigured area for the particular monitored room.

14. The method of claim 11 wherein the video data is captured continuously while monitoring is occurring.

15. The method of claim 11 further comprising storing electronic records of any alerts received by the centralized monitoring system in an electronic database.

16. The method of claim 11 wherein the preconfigured area is a zone around a bed located in a hospital or nursing home room.

17. The method of claim 11, further comprising upon determining the object within the preconfigured area satisfies the predetermined size, determining that a duration the object has been within the preconfigured area satisfies a predetermined time.

18. The method of claim 17, wherein the alert initiated is further based on the duration the object is within the preconfigured area satisfying the predetermined time.

19. A system for detecting movement by an individual within a monitored room, the system comprising:

one or more 3D camera, motion, and sound sensors configured to captured 3D depth data of a preconfigured area of a particular room wherein an individual is to be monitored;

a computerized virtual blob detecting monitoring system configured to;

receive the 3D depth data of the preconfigured area;

based on the 3D data, determining that an object has entered the preconfigured area; and

upon determining the object entered the preconfigured area, determining that the object within the preconfigured area satisfies a predetermined size using the 3D depth data and an IR depth map; and

a centralized monitoring system configured to receive video data captured by the one or more 3D camera, motion, and sound sensors and display the video data on a centralized monitoring primary display.

20. The system of claim 19, wherein the centralized monitoring system is further configured to display the video data for the monitored room on a centralized monitoring alert display when the computerized virtual blob detecting monitoring system determines that an object satisfying the predetermined size has entered into the preconfigured area for the particular monitored room.