Surveillance monitoring systems and methods for remotely viewing data and controlling cameras

• US 10,475,314 B2
• Filed: 10/26/2018
• Issued: 11/12/2019
• Est. Priority Date: 10/29/2004
• Status: Active Grant

• Current Assignee: Johnson Controls Tyco IP Holdings LLP (Johnson Controls International plc)
• Original Assignee: Sensormatic Electronics LLC (Johnson Controls International plc)
• Inventors: Renkis, Martin
• Primary Examiner(s): Perez-Fuentes, Luis
• Application Number:
  US16/171,857
• Publication Number:
  US 20190180585A1
• Time in Patent Office: 382 Days
• CPC Class Codes: G06T 7/246 using feature-based methods, e.g. the tracking of corners or segments
• CPC Class Codes: G08B 13/19641 Multiple cameras having overlapping views on a single scene
• CPC Class Codes: G08B 13/19656 Network used to communicate with a camera, e.g. WAN, LAN, Internet
• CPC Class Codes: G08B 13/1966 Wireless systems, other than telephone systems, used to communicate with a camera
• CPC Class Codes: G08B 13/19669 Event triggers storage or change of storage policy
• CPC Class Codes: G08B 13/19682 Graphic User Interface [GUI] presenting system data to the user, e.g. information on a screen helping a user interacting with an alarm system
• CPC Class Codes: G08B 13/19693 using multiple video sources viewed on a single or compound screen
• CPC Class Codes: G08B 13/19695 Arrangements wherein non-video detectors start video recording or forwarding but do not generate an alarm themselves
• CPC Class Codes: G08B 25/009 Signalling of the alarm condition to a substation whose identity is signalled to a central station, e.g. relaying alarm signals in order to extend communication range
• CPC Class Codes: H04L 2209/80 Wireless network architectures or network communication protocols for wireless network security H04W12/00
• CPC Class Codes: H04L 63/0428 wherein the data content is protected, e.g. by encrypting or encapsulating the payload
• CPC Class Codes: H04L 67/01 Protocols
• CPC Class Codes: H04L 67/10 in which an application is distributed across nodes in the network software deployment G06F8/60; multiprogramming arrangements G06F9/46
• CPC Class Codes: H04L 67/125 involving control of end-device applications over a network
• CPC Class Codes: H04N 23/631 Graphical user interfaces [GUI] specially adapted for controlling image capture or setting capture parameters
• CPC Class Codes: H04N 23/661 Transmitting camera control signals through networks, e.g. control via the Internet
• CPC Class Codes: H04N 5/77 between a recording apparatus and a television camera
• CPC Class Codes: H04N 7/181 for receiving images from a plurality of remote sources
• CPC Class Codes: H04N 7/188 Capturing isolated or intermittent images triggered by the occurrence of a predetermined event, e.g. an object reaching a predetermined position signal generation from motion picture films H04N5/253
• CPC Class Codes: H04W 12/02 Protecting privacy or anonymity, e.g. protecting personally identifiable information [PII]
• CPC Class Codes: H04W 12/033 : of the user plane, e.g. user's traffic
• CPC Class Codes: H04W 4/70 : Services for machine-to-machine communication [M2M] or machine type communication [MTC]
• CPC Class Codes: H04W 76/15 : Setup of multiple wireless link connections
• CPC Class Codes: H04W 8/005 : Discovery of network devices, e.g. terminals
• CPC Class Codes: H04W 84/18 : Self-organising networks, e.g. ad-hoc networks or sensor networks
• CPC Class Codes: H05K 7/20145 : Means for directing air flow, e.g. ducts, deflectors, plenum or guides
• CPC Class Codes: H05K 7/20172 : Fan mounting or fan specifications
• CPC Class Codes: H05K 7/20209 : Thermal management, e.g. fan control

Abstract

A surveillance system monitors a predetermined environment based on received data. The surveillance system includes a first intelligent appliance configured to capture video and/or still images and configured to be in wireless communication with a second intelligent appliance that operates based on data from the first intelligent appliance. The surveillance system can detect a person located within the predetermined environment and can track the person'"'"'s movement. The surveillance system is configured to allow remote viewing of data and/or controlling cameras.

Claims

1. A computer-implemented method performed by a surveillance system including a wireless computing device and at least one intelligent appliance, the method comprising:

receiving surveillance area data and permissions data;

establishing a surveillance area based on the received surveillance area data;

comparing data associated with a person and the permissions data to determine whether to monitor the surveillance area,

if the surveillance system determines to monitor the surveillance area,

capturing, via at least one intelligent appliance, environmental data from the surveillance area, wherein the environment data includes video, images, sound, temperature data, chemical presence data, motion data, or any combinations thereof;

wirelessly transmitting data between the at least one intelligent appliance and a wireless computing device via a mesh network, wherein the wireless computing device is configured to communicate with a wireless access point and to control operation of the at least one intelligent appliance based on one or more settings set by a first operator,

detecting, via the surveillance system, one or more events associated with the person based on the captured environmental data,

automatically sending an alert for notifying a second operator based on the one or more events,

providing the first or second operator an interface to at least perform one of;

reviewing, at a remote viewing device, the environmental data captured by the surveillance system and associated with the one or more events, or

controlling, by the remote viewing device, at least one of the wireless computing device or the at least one intelligent appliance,

wherein the interface includes controls for video archive, camera settings, event calendar, and program options.

2. The method of claim 1, wherein the at least one intelligent appliance includes a first intelligent appliance and a second intelligent appliance, the method further comprising allowing the first or second operator to use the remote viewing device to access and control the surveillance system to coordinate operation of the first and second intelligent appliances.

3. The method of claim 1, wherein when a person within the surveillance area has permission to be in the surveillance area based on the received permissions data, the surveillance system does not send any alerts for notifying the second operator.

4. The method of claim 1, wherein the wireless computing device is configured to capture environmental data that includes video, images, sound, temperature data, chemical presence data, motion data, or any combination thereof.

5. The method of claim 1, wherein the at least one intelligent appliance includes a first intelligent appliance and a second intelligent appliance, the method further comprising

sending, via the mesh network, data between the first and second intelligent appliances to coordinate operation of the first and second intelligent appliances without requiring concurrent communication with a remove server computer.

6. A computer-readable medium storing contents that, when executed by one or more processors of a surveillance system including a first intelligent appliance configured to capture at least one of video or still images and being configured to be in wireless communication with a second intelligent appliance that operates based on data from the first intelligent appliance, cause the surveillance system to perform actions comprising:

receiving surveillance area data and permissions data from an operator;

establishing a predetermined environment based on the received surveillance area data;

capturing, via at least one intelligent appliance, environmental data from the predetermined environment, wherein the environment data includes video, images, sound, temperature data, chemical presence data, motion data, or any combinations thereof;

wirelessly transmitting data between the at least one intelligent appliance and a wireless computing device via a mesh network, wherein the wireless computing device is configured to communicate with a wireless access point and to control operation of the at least one intelligent appliance based on one or more settings set by the operator,

detecting a person located within the predetermined environment;

tracking the person'"'"'s movement; and

providing the operator an interface to perform at least one of;

reviewing, via a remote viewing device, at least one of the video or still images captured by the first intelligent appliance, or

controlling, via the remote viewing device, the second intelligent appliance,

wherein the interface includes controls for video archive, camera settings, event calendar, and program options.

7. The computer-readable medium of claim 6, wherein the actions further comprise:

receiving event input from the operator;

detecting a trigger event in the predetermined environment based on the received event input from the operator; and

coordinating operation of the first and second intelligent appliances in response to detection of the trigger event.

8. The computer-readable medium of claim 6, wherein the actions further comprise coordinating operation of the first and second intelligent devices using a wireless device in wireless communication with the first and second intelligent device, wherein the wireless device stores the data from the operator.

9. The computer-readable medium of claim 6, wherein the actions further comprise sending data between the first and second appliances to coordinate operation of the first and second appliances without requiring concurrent communication with a remove server computer.

10. The computer-readable medium of claim 6, further comprising:

comparing the detected person to the permissions data; and

determining whether the detected person has permission to be at a certain location within the predetermined environment based on the comparison.

11. The computer-readable medium of claim 6, wherein the first intelligent appliance is configured to detect motion in the predetermined environment.

12. The computer-readable medium of claim 6, wherein the first and second intelligent appliances each include a camera.

13. The computer-readable medium of claim 6, wherein the first and second intelligent appliances communicate via with one another via a direct wireless connection.

14. The computer-readable medium of claim 6, wherein the actions further comprise:

receiving data from a communication device associated with the person or another person;

comparing the received data from the communication device with reference information; and

detecting a trigger event in the predetermined environment based on the comparison.

15. The computer-readable medium of claim 14, wherein the trigger event is detection of a person, without permission, within the predetermined environment.

16. The computer-readable medium of claim 6, where the actions further comprise

causing an alert to be sent to the operator in response to detection of the person located within the predetermined area.

17. The computer-readable medium of claim 6, wherein the actions further comprise:

receiving data from a device associated with the person;

comparing the data from the device to the permissions data; and

determining whether the person has permission to be within the predetermined environment based on the comparison.

18. The computer-readable medium of claim 6, wherein the second intelligent appliance is configured to capture data that includes one or more of:

temperature data, chemical presence data, motion data, or any combination thereof.

19. The computer-readable medium of claim 6, wherein the actions further comprise:

analyzing at least one of the video or still images captured by the first intelligent appliance;

identifying an event in the predetermined environment based on the analysis of at least one of the captured video or still images; and

controlling operation of at least one of the first intelligent appliance or second the intelligent appliance based upon identification of the event.

20. A system at least partly operable on a mesh network, comprising:

at least one processor;

and

memory having instructions configured to cause the at least one processor to;

receive surveillance area data and permissions data;

establish a target environment based on the received surveillance area data;

capture, via at least one intelligent appliance, environmental data from the target environment, wherein the environment data includes video, images, sound, temperature data, chemical presence data, motion data, or any combinations thereof;

wirelessly transmit data between the at least one intelligent appliance and a wireless computing device via a mesh network, wherein the wireless computing device is configured to communicate with a wireless access point and to control operation of the at least one intelligent appliance based on one or more settings set by an operator;

detecting a person located within the surveillance environment; and

providing the operator an interface to perform at least one of;

reviewing, via a remote viewing device, the environment data captured by the at least one intelligent appliance, or

controlling, via the remote viewing device, the at least one intelligent appliance,

wherein the interface includes controls for video archive, camera settings, event calendar, and program options.

21. The system of claim 20, wherein the at least one intelligent appliance includes first and second intelligent appliances, and wherein the instructions are configured to cause the at least one processor to coordinate operation of the first and second intelligent appliances.

22. The system of claim 20, wherein the instructions cause the at least one processor to:

detect a trigger event based in the target environment based on the captured environment data from the target environment; and

coordinate operation of first and second cameras on the mesh network in response to detection of the trigger event.

23. The system of claim 20, wherein the instructions cause the at least one processor to perform detection within the target environment and tracking within the target environment based on the one or more settings set by the operator.

24. The system of claim 20, wherein the instructions cause the at least one processor to

cause an alert to be sent to the operator in response to detection of a person located within the target area.

25. The system of claim 20, wherein the instructions cause the at least one processor to

identify an event within the target environment based on the captured environment data from the target environment and at least one operator-set detection rules;

and

perform at least one of activating an alarm or sending a notification when the event is identified.