System, method, and computer program product for alerting a supervising user of adverse behavior of others within an environment by providing warning signals to alert the supervising user that a predicted behavior of a monitored user represents an adverse behavior

• US 10,354,127 B2
• Filed: 06/29/2016
• Issued: 07/16/2019
• Est. Priority Date: 01/12/2007
• Status: Active Grant

• Current Assignee: SINOEAST CONCEPT LIMITED (Tencent Holdings Limited)
• Original Assignee: SINOEAST CONCEPT LIMITED (Tencent Holdings Limited)
• Inventors: Albertson, Jacob C., Arnold, Kenneth C., Goldman, Steven D., Paolini, Michael A., Sessa, Anthony J.
• Primary Examiner(s): Murray, Daniel C.
• Application Number:
  US15/196,446
• Publication Number:
  US 20160321498A1
• Time in Patent Office: 1,112 Days
• Field of Search: 348 47
• CPC Class Codes: G01V 5/20 Detecting prohibited goods, e.g. weapons, explosives, hazardous substances, contraband or smuggled objects
• CPC Class Codes: G06F 9/451 Execution arrangements for user interfaces
• CPC Class Codes: G06T 2207/10028 Range image; Depth image; 3D point clouds
• CPC Class Codes: G06T 2207/20076 Probabilistic image processing
• CPC Class Codes: G06T 2207/20081 Training; Learning
• CPC Class Codes: G06T 2207/30232 Surveillance
• CPC Class Codes: G06T 7/292 Multi-camera tracking
• CPC Class Codes: G06T 7/33 using feature-based methods
• CPC Class Codes: G06V 20/52 Surveillance or monitoring of activities, e.g. for recognising suspicious objects recognising microscopic objects G06V20/69
• CPC Class Codes: G06V 40/20 Movements or behaviour, e.g. gesture recognition recognition of facial expressions G06V40/16
• CPC Class Codes: G08B 13/19602 Image analysis to detect motion of the intruder, e.g. by frame subtraction
• CPC Class Codes: G08B 13/19608 Tracking movement of a target, e.g. by detecting an object predefined as a target, using target direction and or velocity to predict its new position
• CPC Class Codes: G08B 13/19613 Recognition of a predetermined image pattern or behaviour pattern indicating theft or intrusion
• CPC Class Codes: G08B 13/19615 wherein said pattern is defined by the user
• CPC Class Codes: G08B 13/19641 Multiple cameras having overlapping views on a single scene
• CPC Class Codes: G08B 31/00 Predictive alarm systems characterised by extrapolation or other computation using updated historic data
• CPC Class Codes: G08B 6/00 Tactile signalling systems, e.g. personal calling systems
• CPC Class Codes: H04N 7/181 for receiving images from a plurality of remote sources
• CPC Class Codes: H04N 7/188 Capturing isolated or intermittent images triggered by the occurrence of a predetermined event, e.g. an object reaching a predetermined position signal generation from motion picture films H04N5/253
• CPC Class Codes: Y10S 706/933 Law, law enforcement, or government

Abstract

One or more audio feedback output devices receive warning signals for controlling types of audio output by the audio output devices, the warning signals representing that a predicted behavior of a monitored user represents a particular behavior that is potentially adverse and a percentage probability that the predicted behavior is adverse, the monitored user detected within a particular environment monitored by a supervising user, audio feedback output devices worn by the supervising user. The audio feedback output devices operative to control the types of audio outputs of the audio output devices that are detectable by the supervising user wearing the audio feedback output devices according to the warning signals to specifically alert the supervising user that the predicted behavior of the monitored user represents the particular behavior that is potentially adverse and the percentage probability that the predicted behavior is adverse.

Claims

1. A system, comprising:

one or more audio feedback output devices operative to receive one or more warning signals for controlling one or more types of audio output by one or more audio output devices, the one or more warning signals representing that a predicted behavior of a monitored user represents a particular behavior that is adverse and a percentage probability that the predicted behavior is adverse, the monitored user detected within a particular environment monitored by a supervising user, the one or more audio feedback output devices worn by the supervising user; and

the one or more audio feedback output devices operative to control the one or more types of audio outputs of the one or more audio output devices that are detectable by the supervising user wearing the one or more audio feedback output devices according to the one or more warning signals to specifically alert the supervising user that the predicted behavior of the monitored user represents the particular behavior that is adverse and the percentage probability that the predicted behavior is adverse.

2. The system according to claim 1, wherein the one or more audio feedback output devices operative to control the one or more types of audio outputs of the one or more audio output devices that are detectable by the supervising user wearing the one or more audio feedback output devices according to the one or more warning signals to specifically alert the supervising user that the predicted behavior of the monitored user represents the particular behavior that is adverse and the percentage probability that the predicted behavior is adverse further comprise:

the one or more audio feedback output devices operative to convert the one or more warning signals into one or more tonal signals to create a warning signal tonal pattern directed to one or more particular devices of the one or more audio feedback output devices.

3. The system according to claim 1, wherein the one or more audio feedback output devices operative to control the one or more types of audio outputs of the one or more audio output devices that are detectable by the supervising user wearing the one or more audio feedback output devices according to the one or more warning signals to specifically alert the supervising user that the predicted behavior of the monitored user represents the particular behavior that is adverse and the percentage probability that the predicted behavior is adverse further comprise:

the one or more audio feedback output devices operative to convert the one or more warning signals from text into audible speech feedback.

4. The system according to claim 1, further comprising:

a plurality of image capture devices each worn by a separate one of a plurality of users within the particular environment;

the plurality of image capture devices each operative to securely transmit one or more captured image streams within the particular environment to one or more computer systems;

the one or more computer systems operative to gather the one or more captured image streams from the plurality of image capture devices into a collaborative image;

the one or more computer systems operative to align the one or more captured image streams within the collaborative image;

the one or more computer systems operative to determine from the collaborative image the predicted behavior of the monitored user represents the particular behavior that is adverse within the particular environment;

the one or more computer systems operative to select the one or more warning signals representing that the predicted behavior of the monitored user represents the particular behavior that is adverse and the percentage probability that the predicted behavior is adverse; and

the one or more computer systems operative to securely transmit the one or more warning signals to the one or more audio feedback output devices for the supervising user.

5. A method, comprising:

receiving, by one or more audio feedback output devices, one or more warning signals for controlling one or more types of audio output by one or more audio output devices, the one or more warning signals representing that a predicted behavior of a monitored user represents a particular behavior that is adverse and a percentage probability that the predicted behavior is adverse, the monitored user detected within a particular environment monitored by a supervising user, the one or more audio feedback output devices worn by the supervising user; and

controlling, by the one or more audio feedback output devices, the one or more types of audio outputs of the one or more audio output devices that are detectable by the supervising user wearing the one or more audio feedback output devices according to the one or more warning signals to specifically alert the supervising user that the predicted behavior of the monitored user represents the particular behavior that is adverse and the percentage probability that the predicted behavior is adverse.

6. The method according to claim 5, wherein controlling, by the one or more audio feedback output devices, the one or more types of audio outputs of the one or more audio output devices that are detectable by the supervising user wearing the one or more audio feedback output devices according to the one or more warning signals to specifically alert the supervising user that the predicted behavior of the monitored user represents the particular behavior that is adverse and the percentage probability that the predicted behavior is adverse further comprises:

converting, by the one or more audio feedback output devices, the one or more warning signals into one or more tonal signals to create a warning signal tonal pattern directed to one or more particular devices of the one or more audio feedback output devices.

7. The method according to claim 5, wherein controlling, by the one or more audio feedback output devices, the one or more types of audio outputs of the one or more audio output devices that are detectable by the supervising user wearing the one or more audio feedback output devices according to the one or more warning signals to specifically alert the supervising user that the predicted behavior of the monitored user represents the particular behavior that is adverse and the percentage probability that the predicted behavior is adverse further comprises:

converting, by the one or more audio feedback output devices, the one or more warning signals from text into audible speech feedback.

8. The method according to claim 5, further comprising:

securely transmitting, by a plurality of image capture devices each worn by a separate one of a plurality of users within the particular environment, one or more captured image streams within the particular environment to one or more computer systems;

gathering, by the one or more computer systems, the one or more captured image streams from the plurality of image capture devices into a collaborative image;

aligning, by the one or more computer systems, the one or more captured image streams within the collaborative image;

determining, by the one or more computer systems, from the collaborative image, the predicted behavior of the monitored user represents the particular behavior that is adverse within the particular environment;

selecting, by the one or more computer systems, the one or more warning signals representing that the predicted behavior of the monitored user represents the particular behavior that is adverse and the percentage probability that the predicted behavior is adverse; and

securely transmitting, by the one or more computer systems, the one or more warning signals to the one or more audio feedback output devices for the supervising user.

9. A computer program product comprising one or more computer-readable storage devices and program instructions, stored on at least one of the one or more storage devices, the stored program instructions comprising:

program instructions to receive, by one or more audio feedback output devices, one or more warning signals for controlling one or more types of audio output by one or more audio output devices, the one or more warning signals representing that a predicted behavior of a monitored user represents a particular behavior that is adverse and a percentage probability that the predicted behavior is adverse, the monitored user detected within a particular environment monitored by a supervising user, the one or more audio feedback output devices worn by the supervising user; and

program instructions to control, by the one or more audio feedback output devices, the one or more types of audio outputs of the one or more audio output devices that are detectable by the supervising user wearing the one or more audio feedback output devices according to the one or more warning signals to specifically alert the supervising user that the predicted behavior of the monitored user represents the particular behavior that is adverse and the percentage probability that the predicted behavior is adverse.

10. The computer program product according to claim 9, wherein the program instructions further comprise:

program instructions to convert, by the one or more audio feedback output devices, the one or more warning signals into one or more tonal signals to create a warning signal tonal pattern directed to one or more particular devices of the one or more audio feedback output devices.

11. The computer program product according to claim 9, wherein the program instructions further comprise:

program instructions to convert, by the one or more audio feedback output devices, the one or more warning signals from text into audible speech feedback.

12. The computer program product according to claim 9, wherein the program instructions further comprise:

program instructions to securely transmit, by a plurality of image capture devices each worn by a separate one of a plurality of users within the particular environment, one or more captured image streams within the particular environment to one or more computer systems;

program instructions to gather, by the one or more computer systems, the one or more captured image streams from the plurality of image capture devices into a collaborative image;

program instructions to align, by the one or more computer systems, the one or more captured image streams within the collaborative image;

program instructions to determine, by the one or more computer systems, from the collaborative image, the predicted behavior of the monitored user represents the particular behavior that is adverse within the particular environment;

program instructions to select, by the one or more computer systems, the one or more warning signals representing that the predicted behavior of the monitored user represents the particular behavior that is adverse and the percentage probability that the predicted behavior is adverse; and

program instructions to securely transmit, by the one or more computer systems, the one or more warning signals to the one or more audio feedback output devices for the supervising user.