METHODS FOR DETERMINING WHETHER AN INDIVIDUAL ENTERS A PRESCRIBED VIRTUAL ZONE USING 3D BLOB DETECTION

• US 20170091562A1
• Filed: 10/04/2016
• Published: 03/30/2017
• Est. Priority Date: 02/16/2015
• Status: Active Grant

• Current Assignee: Cerner Innovation, Inc. (Oracle Corporation)
• Original Assignee: Cerner Innovation, Inc. (Oracle Corporation)
• Inventors: KUSENS, NEIL
• Granted Patent: US 10,210,395 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: A61B 5/0077 Devices for viewing the surface of the body, e.g. camera, magnifying lens
• CPC Class Codes: A61B 5/1117 Fall detection
• CPC Class Codes: A61B 5/743 Displaying an image simultaneously with additional graphical information, e.g. symbols, charts, function plots
• CPC Class Codes: G06F 16/51 Indexing; Data structures therefor; Storage structures
• CPC Class Codes: G06V 10/143 Sensing or illuminating at different wavelengths
• CPC Class Codes: G06V 10/255 Detecting or recognising potential candidate objects based on visual cues, e.g. shapes
• CPC Class Codes: G06V 10/28 Quantising the image, e.g. histogram thresholding for discrimination between background and foreground patterns
• CPC Class Codes: G06V 20/52 Surveillance or monitoring of activities, e.g. for recognising suspicious objects recognising microscopic objects G06V20/69
• CPC Class Codes: G06V 20/647 by matching two-dimensional images to three-dimensional objects
• CPC Class Codes: G06V 40/103 Static body considered as a whole, e.g. static pedestrian or occupant recognition
• CPC Class Codes: G08B 21/043 detecting an emergency event, e.g. a fall
• CPC Class Codes: G08B 21/0476 Cameras to detect unsafe condition, e.g. video cameras
• CPC Class Codes: G08B 21/22 responsive to presence or absence of persons
• CPC Class Codes: G16H 10/60 for patient-specific data, e.g. for electronic patient records
• CPC Class Codes: H04N 13/00 Stereoscopic video systems; Multi-view video systems; Details thereof
• CPC Class Codes: H04N 13/204 using stereoscopic image cameras stereoscopic photography G03B35/00
• CPC Class Codes: H04N 7/18 Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
• CPC Class Codes: H04N 7/181 for receiving images from a plurality of remote sources

Abstract

A method and system that allows healthcare providers, hospitals, skilled nursing facilities and other persons to monitor disabled, elderly or other high-risk individuals to prevent or reduce falls and/or mitigate the impact of a fall by delivering automated notification of “at risk” behavior and falls by such an individual being monitored where assistance is required. The monitored individual is virtually represented as a blob object of at least a specific size by a computerized monitoring system and such system detects and alerts when the blob object enters or crosses into a virtually defined or designated blob detection zone and remains in the zone for at least a predetermined period of time.

Claims

1-20. -20. (canceled)

21. A method for detecting movement by an individual within a monitored room, the method comprising:

capturing video data of a preconfigured area of a particular room where an individual is to be monitored, using one or more 3D Camera, Motion and Sound Sensors;

receiving, by a computerized Virtual Blob Detecting Monitoring system, the video data of the preconfigured area;

analyzing, by the computerized Virtual Blob Detecting Monitoring system, the video data using an IR depth map to recognize objects of a predetermined size entering within the preconfigured area; and

communicating with the individual, a caregiver or other designated persons, by a computerized communication system, when the computerized Virtual Blob Detection Monitoring system determines that an object meeting the predetermined size has entered the preconfigured area based on the video data received from the one or more 3D Camera, Motion and Sound Sensors.

22. The method of claim 21 wherein video data is captured continuously while monitoring is occurring.

23. The method of claim 21 further comprising analyzing the video data using skeletal tracking, virtual blob detection, or a combination thereof.

24. The method of claim 21 wherein the preconfigured area is defined by x, y, and z coordinates in relation to the one or more 3D Camera, Motion and/or Sound Sensors.

25. The method of claim 21 further comprising transmitting the video data to a centralized monitoring system.

26. The method of claim 25 further comprising displaying the video data received by the centralized monitoring system on a centralized monitoring primary display.

27. The method of claim 26, wherein the centralized monitoring system receives video data for a plurality of different monitored rooms by receiving video data from a plurality of two or more 3D Camera, Motion and Sound Sensors with each one of the plurality of two or more 3D Camera, Motion and Sound Sensors associated with a particular monitored room of the plurality of different monitored rooms.

28. The method of claim 27 further comprising displaying the video data received by the centralized monitoring system for a particular monitored room of the plurality of different monitored rooms on a centralized monitoring alert display when said computerized monitoring system determines that an object satisfying the predetermined size has entered into the preconfigured area for the particular monitored room.

29. The method of claim 26 wherein said centralized monitoring system continuously receives captured video from the one or more 3D Camera, Motion and Sound Sensors which is continuously displayed on the centralized monitoring primary display while monitoring is occurring.

30. The method of claim 25 further comprising storing electronic records of any alerts received by the centralized monitoring system from the computerized monitoring system in an electronic database.

31. The method of claim 21 wherein the preconfigured area is a zone around a bed located in a hospital or nursing home room.

32. A method for detecting movement by an individual within a monitored room, the method comprising:

capturing video data of a preconfigured area of a particular room where an individual is to be monitored, using one or more 3D Camera, Motion and Sound Sensors;

receiving, by a computerized Virtual Blob Detection Monitoring system, the video data of the preconfigured area;

analyzing, by the computerized Virtual Blob Detection Monitoring system, the video data using an IR depth map to recognize objects of a predetermined size entering within the preconfigured area;

receiving, by a centralized monitoring system in communication with the computerized Virtual Blob Detection Monitoring system and the one or more 3D Camera, Motion and Sound Sensors, the video data from the one or more 3D Camera, Motion and Sound Sensors; and

displaying the video data received by the centralized monitoring system on a centralized monitoring primary display.

33. The method of claim 32 wherein said centralized monitoring system receives video data for a plurality of different monitored rooms by receiving video data from a plurality of two or more 3D Camera, Motion and Sound Sensors with each one of the plurality of two or more 3D Camera, Motion and Sound Sensors associated with a particular monitored room of the plurality of different monitored rooms.

34. The method of claim 33 further comprising displaying video data for a particular monitored room from the plurality of different monitored rooms on a centralized monitoring alert display in communication with the centralized monitoring system when the computerized monitoring system determines that an object satisfying the predetermined size has entered into the preconfigured area for the particular monitored room.

35. The method of claim 32 wherein said centralized monitoring system continuously receives captured video data from the one or more 3D Camera, Motion and Sound Sensors which is continuously displayed on the centralized monitoring primary display while monitoring is occurring.

36. The method of claim 32 wherein the video data is captured continuously while monitoring is occurring.

37. The method of claim 32 further comprising analyzing the video data using skeletal tracking, virtual blob detection, or a combination thereof.

38. The method of claim 32 further comprising storing electronic records of any alerts received by the centralized monitoring system from the computerized monitoring system in an electronic database.

39. The method of claim 32 wherein the preconfigured area is a zone around a bed located in a hospital or nursing home room.

40. A method for detecting movement by an individual within a monitored room, the method comprising:

capturing video data of a preconfigured area of a particular room wherein an individual is to be monitored, using one or more 3D Camera, Motion and Sound Sensors;

receiving, by a computerized Virtual Blob Detection Monitoring system, the video data of the preconfigured area;

analyzing, by the computerized Virtual Blob Detection Monitoring system, the video data using an IR depth map to recognize objects of a predetermined size entering within the preconfigured area;

communicating with the individual, a caregiver or other designated persons using a computerized communication system when the computerized Virtual Blob Detection Monitoring system determines that an object meeting the predetermined size has entered the preconfigured area based on video data received from the one or more 3D Camera, Motion and Sound Sensors;

receiving, by a centralized monitoring system, the video data from the one or more 3D Camera, Motion and Sound Sensors; and

displaying the video data received by the centralized monitoring system on a centralized monitoring primary display.