Method and system for behavior detection

• US 9,600,993 B2
• Filed: 01/23/2015
• Issued: 03/21/2017
• Est. Priority Date: 01/27/2014
• Status: Active Grant

• Current Assignee: Atlas5D, Inc.
• Original Assignee: Atlas5D, Inc.
• Inventors: Kimmel, Zebadiah M.
• Primary Examiner(s): Park, Soo Jin
• Application Number:
  US14/604,582
• Publication Number:
  US 20150213702A1
• Time in Patent Office: 788 Days
• Field of Search: None
• US Class Current: 1/1
• CPC Class Codes: G06T 2207/30196 Human being; Person
• CPC Class Codes: G06T 7/20 Analysis of motion motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51
• CPC Class Codes: G06T 7/62 of area, perimeter, diameter or volume
• CPC Class Codes: G06V 20/52 Surveillance or monitoring of activities, e.g. for recognising suspicious objects recognising microscopic objects G06V20/69
• CPC Class Codes: G06V 40/20 Movements or behaviour, e.g. gesture recognition recognition of facial expressions G06V40/16
• CPC Class Codes: G08B 21/02 Alarms for ensuring the safety of persons
• CPC Class Codes: G08B 21/0423 detecting deviation from an expected pattern of behaviour or schedule
• CPC Class Codes: G08B 21/043 detecting an emergency event, e.g. a fall
• CPC Class Codes: H04N 7/183 for receiving images from a single remote source

Abstract

Described herein are systems and methods for automatically detecting a behavior of a monitored individual, for example, that the individual has fallen. In certain embodiments, a system is presented that includes one energy sensor (e.g., a camera of a mobile electronic device) configured to capture reflected energy (e.g., light) within a field-of view; an optional lens to modify the distance or angular range of the field-of-view; and an optional image obfuscator to blur or distort the images received by the energy sensor, thereby preserving privacy. Techniques are described for determining spatial measurements and body measurements from the images and using these measurements to identify a behavior of the monitored individual, for example, a fall.

Claims

1. A method for automatically detecting a behavior of an individual, the method comprising:

capturing a sequence of obfuscated images of a field of view of a mobile electronic device positioned at a height within a predetermined range of acceptable vertical heights and at an angular orientation within a predetermined range of acceptable angular orientations, wherein;

the field of view comprises a space at least occasionally inhabited by the individual, and

the sequence of obfuscated images protects the privacy of the individual;

pre-processing the captured sequence of obfuscated images by a processor of a computing device prior to subsequent image processing, thereby altering image data of the sequence of obfuscated images;

automatically identifying, by the processor of the computing device, graphical elements of the sequence of obfuscated images corresponding to the individual moving within the field of view of the mobile electronic device;

automatically determining, by the processor of the computing device, one or more spatial measurements from one or more obfuscated images of the sequence of obfuscated images;

automatically determining, by the processor of the computing device, one or more body measurements (i) from the one or more determined spatial measurements and/or (ii) directly from two or more obfuscated images of the sequence of obfuscated images; and

automatically initiating, by the processor of the computing device, an event when the behavior of the individual is detected, wherein the behavior is detected by directly evaluating when at least one of the one or more determined body measurements and the one or more determined spatial measurements exceeds a threshold.

2. The method of claim 1, comprising determining, by the processor of the computing device, a change of one or more of the spatial measurements and/or one or more of the body measurements.

3. The method of claim 1, comprising storing a predetermined number of obfuscated images of the sequence of obfuscated images and purging other images to protect the individual'"'"'s privacy.

4. The method of claim 1, comprising storing a sequence of obfuscated images corresponding to one or more particular detected behaviors at issue, and purging images that do not correspond to the one or more particular detected behaviors.

5. The method of claim 1, comprising transmitting, from the mobile electronic device, at least a portion of the sequence of obfuscated images to an external system or recipient.

6. The method of claim 1, comprising displaying graphics on a screen of the mobile electronic device while the sequence of obfuscated images is being captured.

7. The method of claim 1, wherein the sequence of obfuscated images is captured by a single camera and/or a single mobile electronic device.

8. A system comprising:

a processor; and

a memory having instructions stored thereon, wherein the instructions, when executed by the processor, cause the processor to;

(a) identify, with a mobile electronic device, graphical elements of a sequence of obfuscated images obtained of a field of view of a camera of the mobile electronic device corresponding to an individual moving within the field of view of the mobile electronic device, wherein the sequence of obfuscated images protects the privacy of the individual;

(b) determine one or more spatial measurements from one or more obfuscated images of the sequence of obfuscated images;

(c) determine one or more body measurements (i) from the one or more determined spatial measurements and/or (ii) directly from two or more obfuscated images of the sequence of obfuscated images; and

(d) initiate an event upon detection of a behavior of the individual, wherein the behavior is detected by directly evaluating when at least one of the one or more determined body measurements and/or the one or more determined spatial measurements exceeds a threshold.

9. The system of claim 8, wherein the system further comprises the mobile electronic device.

10. The system of claim 8, wherein the instructions, when executed by the processor, cause the processor to determine a change of one or more of the spatial measurements and/or one or more of the body measurements.

11. The system of claim 8, wherein the instructions, when executed by the processor, cause the processor to store a predetermined number of obfuscated images of the sequence of obfuscated images and purge other obfuscated images to protect the individual'"'"'s privacy.

12. The system of claim 8, wherein the instructions, when executed by the processor, cause the processor to store a sequence of obfuscated images corresponding to one or more particular detected behaviors at issue, and obfuscated purging images that do not correspond to the one or more particular detected behaviors.

13. The system of claim 8, wherein the instructions, when executed by the processor, cause the processor to transmit, from the mobile electronic device, at least a portion of the sequence of obfuscated images to an external system or recipient.

14. The system of claim 8, wherein the instructions, when executed by the processor, cause the processor to display graphics on a screen of the mobile electronic device while the sequence of obfuscated images is being captured.

15. The system of claim 8, wherein the sequence of obfuscated images is captured by a single camera and/or a single mobile electronic device.

16. A method for automatically detecting a behavior of an individual, the method comprising:

pre-processing a captured sequence of obfuscated images by a processor of a computing device prior to subsequent image processing, thereby altering image data of the sequence of obfuscated images, wherein the captured sequence of obfuscated images comprises a sequence of obfuscated images of a field of view of a mobile electronic device positioned at a height within a predetermined range of acceptable vertical heights and at an angular orientation within a predetermined range of acceptable angular orientations, wherein;

the field of view comprises a space at least occasionally inhabited by the individual, and

the sequence of obfuscated images protects the privacy of the individual;

automatically identifying, by the processor of the computing device, graphical elements of the sequence of obfuscated images corresponding to the individual moving within a field of view of the mobile electronic device;

automatically determining, by the processor of the computing device, one or more spatial measurements from one or more obfuscated images of the sequence of obfuscated images;

automatically determining, by the processor of the computing device, one or more body measurements (i) from the one or more determined spatial measurements and/or (ii) directly from two or more obfuscated images of the sequence of obfuscated images; and

automatically initiating, by the processor of the computing device, an event when the behavior of the individual is detected, wherein the behavior is detected by directly evaluating when at least one of the one or more determined body measurements and the one or more determined spatial measurements exceeds a threshold.