Predicting adverse behaviors of others within an environment based on a 3D captured image stream
First Claim
1. A computer-implemented method for warning a supervising user of behaviors of a monitored user representative of adverse behavior, comprising:
- monitoring a current location of a supervising user, wherein the supervising user is actively mobile;
identifying a particular type of physical environment from among the plurality of types of physical environments comprising the current location;
responsive to detecting the supervising user conducting law enforcement activity within the particular type of environment comprising a law enforcement environment, triggering at least one image capture device within the particular environment to capture the three-dimensional movement of a monitored user within the particular environment to capture a focus area surrounding the supervising user, wherein the three-dimensional movement is determined using at least one image capture device aimed at the monitored user;
identifying a three-dimensional object properties stream using the captured movement;
identifying a particular type of the interface accessible to the supervising user from among a plurality of types of interfaces;
accessing a selection of adverse behavior definitions specified for the particular environment from among a plurality of adverse behavior definitions specified for a plurality of environments from a behavior database and for at least one adverse behavior definition specified for the particular type of interface in the behavior database from among a plurality of adverse behavior definitions each specified for a separate one of the plurality of types of interfaces;
identifying a particular defined adverse behavior of the monitored user represented by the three-dimensional object properties stream by comparing the identified three-dimensional object properties stream with the selection of adverse behavior definitions, wherein identifying a particular defined adverse behavior representing the three-dimensional object properties stream further comprises calculating a percentage of probability that the captured three-dimensional movement represents a particular behavior defined in the selection of adverse behavior definitions and calculating a percentage of probability that the captured three-dimensional movement is adverse;
in response to identifying the particular defined adverse behavior of the monitored user from among the plurality of adverse behavior definitions, notifying the supervising user for the particular environment about the particular defined adverse behavior of the monitored user through an interface of the particular type of interface only detectable by the supervising user by;
sending the particular defined adverse behavior to a warning, system for controlling warning signals output to the supervising user;
translating, at the warning system, the particular defined adverse behavior into a tactile feedback control signal with a feedback strength specified to a percentage of total feedback strength to reflect the percentage probability that the captured three-dimensional movement is adverse and with a feedback position specified to one or multiple feedback positions to reflect a position of the particular defined adverse behavior in relation to the monitored user in the captured three-dimensional movement; and
controlling output of the feedback control signal to at least one tactile feedback device detectable b the supervising user for controlling the feedback strength and feedback position of the feedback output by at least one tactile feedback device;
capturing a response by the supervising user to the supervising user receiving the notification of the particular defined adverse behavior through the interface;
predicting whether the response indicates that the particular defined adverse behavior is correctly identified;
prompting the supervising user, within the interface, to indicate whether the prediction of whether the response indicates that the particular defined adverse behavior is correctly identified is correct; and
responsive to the supervising user indicating the prediction is correct, adjusting at least one definition in the selection of adverse behavior definitions specified for the particular type of environment and the particular type of interface in the behavior database to reflect the response.
1 Assignment
0 Petitions
Accused Products
Abstract
A computer-implemented method, system, and program includes a behavior processing system for capturing a three-dimensional movement of a monitored user within a particular environment monitored by a supervising user, wherein the three-dimensional movement is determined by using at least one image capture device aimed at the monitored user. The behavior processing system identifies a three-dimensional object properties stream using the captured movement. The behavior processing system identifies a particular defined adverse behavior of the monitored user represented by the three-dimensional object properties stream by comparing the identified three-dimensional object properties stream with multiple adverse behavior definitions. In response to identifying the particular defined adverse behavior from among the multiple adverse behavior definitions, the behavior processing system triggers a warning system to notify the supervising user about the particular defined adverse behavior of the monitored user through an output interface only detectable by the supervising user.
-
Citations
15 Claims
-
1. A computer-implemented method for warning a supervising user of behaviors of a monitored user representative of adverse behavior, comprising:
-
monitoring a current location of a supervising user, wherein the supervising user is actively mobile; identifying a particular type of physical environment from among the plurality of types of physical environments comprising the current location; responsive to detecting the supervising user conducting law enforcement activity within the particular type of environment comprising a law enforcement environment, triggering at least one image capture device within the particular environment to capture the three-dimensional movement of a monitored user within the particular environment to capture a focus area surrounding the supervising user, wherein the three-dimensional movement is determined using at least one image capture device aimed at the monitored user; identifying a three-dimensional object properties stream using the captured movement; identifying a particular type of the interface accessible to the supervising user from among a plurality of types of interfaces; accessing a selection of adverse behavior definitions specified for the particular environment from among a plurality of adverse behavior definitions specified for a plurality of environments from a behavior database and for at least one adverse behavior definition specified for the particular type of interface in the behavior database from among a plurality of adverse behavior definitions each specified for a separate one of the plurality of types of interfaces; identifying a particular defined adverse behavior of the monitored user represented by the three-dimensional object properties stream by comparing the identified three-dimensional object properties stream with the selection of adverse behavior definitions, wherein identifying a particular defined adverse behavior representing the three-dimensional object properties stream further comprises calculating a percentage of probability that the captured three-dimensional movement represents a particular behavior defined in the selection of adverse behavior definitions and calculating a percentage of probability that the captured three-dimensional movement is adverse; in response to identifying the particular defined adverse behavior of the monitored user from among the plurality of adverse behavior definitions, notifying the supervising user for the particular environment about the particular defined adverse behavior of the monitored user through an interface of the particular type of interface only detectable by the supervising user by; sending the particular defined adverse behavior to a warning, system for controlling warning signals output to the supervising user; translating, at the warning system, the particular defined adverse behavior into a tactile feedback control signal with a feedback strength specified to a percentage of total feedback strength to reflect the percentage probability that the captured three-dimensional movement is adverse and with a feedback position specified to one or multiple feedback positions to reflect a position of the particular defined adverse behavior in relation to the monitored user in the captured three-dimensional movement; and controlling output of the feedback control signal to at least one tactile feedback device detectable b the supervising user for controlling the feedback strength and feedback position of the feedback output by at least one tactile feedback device; capturing a response by the supervising user to the supervising user receiving the notification of the particular defined adverse behavior through the interface; predicting whether the response indicates that the particular defined adverse behavior is correctly identified; prompting the supervising user, within the interface, to indicate whether the prediction of whether the response indicates that the particular defined adverse behavior is correctly identified is correct; and responsive to the supervising user indicating the prediction is correct, adjusting at least one definition in the selection of adverse behavior definitions specified for the particular type of environment and the particular type of interface in the behavior database to reflect the response. - View Dependent Claims (2, 3, 4, 5)
-
-
6. A computer system for warning a supervising user of behaviors of a monitored user representative of adverse behavior, comprising:
-
one or more processors; a behavior system for execution by at least one of the one or more processors and operative to monitor a current location of a supervising user, wherein the supervising user is actively mobile; the behavior system operative to identify a particular type of physical environment from among the plurality of types of physical environments comprising the current location; the behavior system, responsive to detecting the supervising user conducting law enforcement activity within the particular type of environment comprising a law enforcement environment, operative to trigger at least one image capture device within the particular environment to capture the three-dimensional movement of a monitored user within the particular environment to capture a focus area surrounding the supervising user, wherein the three-dimensional movement is determined using at least one image capture device aimed at the monitored user; the behavior system operative to identify a three-dimensional object properties stream using the captured movement; the behavior system operative to identify a particular type of the interface accessible to the supervising user from among a plurality of types of interfaces; the behavior system operative to access a selection of adverse behavior definitions specified for the particular environment from among a plurality of adverse behavior definitions specified for a plurality of environments from a behavior database and for at least one adverse behavior definition specified for the particular type of interface in the behavior database from among a plurality of adverse behavior definitions each specified for a separate one of the plurality of types of interfaces; the behavior system operative to identify a particular defined adverse behavior of the monitored user represented by the three-dimensional object properties stream by comparing the identified three-dimensional object properties stream with the selection of adverse behavior definitions, wherein identifying a particular defined adverse behavior representing the three-dimensional object properties stream further comprises calculating a percentage of probability that the captured three-dimensional movement represents a particular behavior defined in the selection of adverse behavior definitions and calculating a percentage of probability that the captured three-dimensional movement is adverse; the behavior system, in response to identifying the particular defined adverse behavior of the monitored user from among the plurality of adverse behavior definitions, operative to notify the supervising user for the particular environment about the particular defined adverse behavior of the monitored user through an interface of the particular type of interface only detectable by the supervising user by; sending the particular defined adverse behavior to a warning system for controlling warning signals output to the supervising user; translating, at the warning system, the particular defined adverse behavior into a tactile feedback control signal with a feedback strength specified to a percentage of total feedback strength to reflect the percentage probability that the captured three-dimensional movement is adverse and with a feedback position specified to one or multiple feedback positions to reflect a position of the particular defined adverse behavior in relation to the monitored user in the captured three-dimensional movement; and controlling output of the feedback control signal to at least one tactile feedback device detectable b the supervising user for controlling the feedback strength and feedback position of the feedback output by at least one tactile feedback device; the behavior system operative to capture a response by the supervising user to the supervising user receiving the notification of the particular defined adverse behavior through the interface; the behavior system operative to predict whether the response indicates that the particular defined adverse behavior is correctly identified; the behavior system operative to prompt the supervising user, within the interface, to indicate whether the prediction of whether the response indicates that the particular defined adverse behavior is correctly identified is correct; and the behavior system, responsive to the supervising user indicating the prediction is correct, operative to adjust at least one definition in the selection of adverse behavior definitions specified for the particular type of environment and the particular type of interface in the behavior database to reflect the response. - View Dependent Claims (7, 8, 9, 10)
-
-
11. A computer-implemented method for warning a supervising user of behaviors of a monitored user representative of adverse behavior, comprising:
-
capturing a three-dimensional movement of a monitored user within a particular environment monitored by a supervising user, wherein the three-dimensional movement is determined using at least one image capture device aimed at the monitored user; identifying a three-dimensional object properties stream using the captured movement; accessing a selection of adverse behavior definitions specified for the particular environment from among a plurality of adverse behavior definitions specified for a plurality of environments from a behavior database; identifying a particular defined adverse behavior of the monitored user represented by the three-dimensional object properties stream by comparing the identified three-dimensional object properties stream with the selection of adverse behavior definitions, wherein identifying a particular defined adverse behavior representing the three-dimensional object properties stream further comprises calculating a percentage of probability that the captured three-dimensional movement represents a particular behavior defined in the selection of adverse behavior definitions and calculating a percentage of probability that the captured three-dimensional movement is adverse; in response to identifying the particular defined adverse behavior of the monitored user from among the plurality of adverse behavior definitions, notifying the supervising user for the particular environment about the particular defined adverse behavior of the monitored user through an interface of the particular type of interface only detectable by the supervising user; sending the particular defined adverse behavior to a warning system for controlling warning signals output to the supervising user; translating the particular defined adverse behavior into an image layer specifying a transparent overlay image and a position indicator mapping a position of the transparent overlay image to the particular defined adverse behavior within the captured three-dimensional movement for output to an image overlay controller of a display device for controlling overlay of the image layer over output of the captured three-dimensional movement in the interface to graphically indicate the warning signals for the particular defined adverse behavior to a supervising user at the interface that is undetectable by the monitored user; translating, at the warning system, the particular defined adverse behavior into a tactile feedback control signal with a feedback strength specified to a percentage of total feedback strength to reflect the percentage probability that the captured three-dimensional movement is adverse and with a feedback position specified to one or multiple feedback positions to reflect a position of the particular defined adverse behavior in relation to the monitored user in the captured three-dimensional movement; and controlling output of the feedback control signal to at least one tactile feedback device detectable b the supervising user for controlling the feedback strength and feedback position of the feedback output by at least one tactile feedback device; capturing a response by the supervising user to the supervising user receiving the notification of the particular defined adverse behavior through the interface; predicting whether the response indicates that the particular defined adverse behavior is correctly identified; prompting the supervising user, within the interface, to indicate whether the prediction of whether the response indicates that the particular defined adverse behavior is correctly identified is correct; and responsive to the supervising user indicating the prediction is correct, adjusting at least one definition in the selection of adverse behavior definitions specified for the particular type of environment and the particular type of interface in the behavior database to reflect the response. - View Dependent Claims (12, 13, 14, 15)
-
Specification