Surveillance monitoring systems and methods for remotely viewing data and controlling cameras

• US 10,115,279 B2
• Filed: 11/18/2016
• Issued: 10/30/2018
• Est. Priority Date: 10/29/2004
• Status: Active Grant

• Current Assignee: Sensormatic Electronics LLC (Johnson Controls International plc)
• Original Assignee: Sensormatic Electronics LLC (Johnson Controls International plc)
• Inventors: Renkis, Martin
• Primary Examiner(s): PEREZ FUENTES, LUIS M
• Application Number:
  US15/356,479
• Publication Number:
  US 20170178475A1
• Time in Patent Office: 711 Days
• Field of Search: 709217
• CPC Class Codes: G06T 7/246 using feature-based methods, e.g. the tracking of corners or segments
• CPC Class Codes: G08B 13/19641 Multiple cameras having overlapping views on a single scene
• CPC Class Codes: G08B 13/19656 Network used to communicate with a camera, e.g. WAN, LAN, Internet
• CPC Class Codes: G08B 13/1966 Wireless systems, other than telephone systems, used to communicate with a camera
• CPC Class Codes: G08B 13/19669 Event triggers storage or change of storage policy
• CPC Class Codes: G08B 13/19682 Graphic User Interface [GUI] presenting system data to the user, e.g. information on a screen helping a user interacting with an alarm system
• CPC Class Codes: G08B 13/19693 using multiple video sources viewed on a single or compound screen
• CPC Class Codes: G08B 13/19695 Arrangements wherein non-video detectors start video recording or forwarding but do not generate an alarm themselves
• CPC Class Codes: G08B 25/009 Signalling of the alarm condition to a substation whose identity is signalled to a central station, e.g. relaying alarm signals in order to extend communication range
• CPC Class Codes: H04L 2209/80 Wireless network architectures or network communication protocols for wireless network security H04W12/00
• CPC Class Codes: H04L 63/0428 wherein the data content is protected, e.g. by encrypting or encapsulating the payload
• CPC Class Codes: H04L 67/01 Protocols
• CPC Class Codes: H04L 67/10 in which an application is distributed across nodes in the network software deployment G06F8/60; multiprogramming arrangements G06F9/46
• CPC Class Codes: H04L 67/125 involving control of end-device applications over a network
• CPC Class Codes: H04N 23/631 Graphical user interfaces [GUI] specially adapted for controlling image capture or setting capture parameters
• CPC Class Codes: H04N 23/661 Transmitting camera control signals through networks, e.g. control via the Internet
• CPC Class Codes: H04N 5/77 between a recording apparatus and a television camera
• CPC Class Codes: H04N 7/181 for receiving images from a plurality of remote sources
• CPC Class Codes: H04N 7/188 Capturing isolated or intermittent images triggered by the occurrence of a predetermined event, e.g. an object reaching a predetermined position signal generation from motion picture films H04N5/253
• CPC Class Codes: H04W 12/02 Protecting privacy or anonymity, e.g. protecting personally identifiable information [PII]
• CPC Class Codes: H04W 12/033 : of the user plane, e.g. user's traffic
• CPC Class Codes: H04W 4/70 : Services for machine-to-machine communication [M2M] or machine type communication [MTC]
• CPC Class Codes: H04W 76/15 : Setup of multiple wireless link connections
• CPC Class Codes: H04W 8/005 : Discovery of network devices, e.g. terminals
• CPC Class Codes: H04W 84/18 : Self-organising networks, e.g. ad-hoc networks or sensor networks
• CPC Class Codes: H05K 7/20145 : Means for directing air flow, e.g. ducts, deflectors, plenum or guides
• CPC Class Codes: H05K 7/20172 : Fan mounting or fan specifications
• CPC Class Codes: H05K 7/20209 : Thermal management, e.g. fan control

Abstract

A surveillance systems monitors a predetermined environment based on received data. The surveillance system includes a first intelligent appliance configured to capture video and/or still images and configured to be in wireless communication with a second intelligent appliance that operates based on data from the first intelligent appliance. The surveillance system can detect a person located within the predetermined environment and can track the person'"'"'s movement. The surveillance system is configured to allow remote viewing of data and/or controlling cameras.

Claims

1. A system, comprising:

a plurality of intelligent appliances,

the plurality of intelligent appliances including a first intelligent appliance and a second intelligent appliance; and

,

a wireless computing device configured to;

detect first wireless data that identifies the first intelligent appliance and second wireless data that identifies the second intelligent appliance;

in response to detecting the first and second wireless data, establish

(1) a first wireless communication channel through which the first intelligent appliance communicates with the wireless computing device and

(2) a second wireless communication channel through which the second intelligent appliance communicates with the wireless computing device,

wherein the first and second intelligent appliances are configured to wirelessly communicate with each other through a direct wireless communication channel between the first and second intelligent appliances without an intermediate access point or gateway and

wherein the first wireless communication channel, the second wireless communication channel, and the direct wireless channel belong to a same wireless network; and

receiving, by the wireless computing device and via the first wireless communication channel, at least a portion of environment data captured by the first intelligent appliance,

wherein the environment data includes video, images, sound, temperature data, chemical presence data, motion data, or any combinations thereof regarding a surveillance area;

wherein the system is further configured to;

receive data from a communication device associated with a person;

detect one or more trigger events based, at least in part, on the data received from the communication device associated with the person, reference information, and the at least a portion of the captured environment data; and

in response to detecting the one or more trigger events, causing the second intelligent appliance to perform an action for controlling an associated device within the surveillance area,

wherein at least one setting of the second intelligent appliance is adjusted based on control data generated by the wireless computing device using one or more instances of logic locally stored on the wireless computing device and one or more user settings,

wherein the control data is transmitted from the wireless computing device to the second intelligent appliance via the second wireless communication channel.

2. The system of claim 1, wherein the system is further configured to:

receive event input from an operator;

detect at least one of the one or more trigger events in the surveillance area based further on the received event input from the operator; and

coordinate operation of a plurality of intelligent appliances in response to detection of the at least one trigger event,

wherein the plurality of intelligent appliances includes the second intelligent appliance.

3. The system of claim 1, wherein the system is further configured to coordinate operation of the first and second intelligent appliances using the wireless computing device in wireless communication with the first and second intelligent appliance, wherein the wireless computing device stores the data from an operator.

4. The system of claim 1, wherein the wireless computing device is further configured to send data between the first and second appliances to coordinate operation of the first and second appliances without requiring communication with a remove server computer.

5. The system of claim 1, wherein the system is further configured to:

compare a person associated with the one or more events to permission information in a database; and

determine whether the person has permission to be at a certain location within the surveillance area based on the comparison.

6. The system of claim 1, wherein the first intelligent appliance is configured to detect motion in the surveillance area.

7. The system of claim 1, wherein the first and second intelligent appliances each include a camera.

8. The system of claim 1, wherein the same wireless network to which the first wireless communication channel, the second wireless communication channel, and the direct wireless channel belong corresponds to an adaptive mesh network.

9. The system of claim 1, wherein at least one of the one or more trigger events is detection of a person, without permission, within the surveillance area.

10. The system of claim 1, wherein the system is further configured to:

cause an alert to be sent to an operator in response to detection of the one or more trigger events; and

allow the operator to view at least a portion of environment data captured by the system.

11. The system of claim 1, wherein the system is further configured to:

receive data from a device associated with a person;

compare the data from the device to permission data; and

determine whether the person has permission to be within the surveillance area based on the comparison.

12. The system of claim 1, wherein the second intelligent appliance is configured to capture data that includes one or more of:

temperature data, chemical presence data, motion data, or any combination thereof.

13. The system of claim 1, wherein the system is further configured to:

analyze at least one of a video or a plurality of still images captured by the first intelligent appliance;

identify an event in the surveillance area based on the analysis of the at least one of the captured video or the captured still images; and

control operation of at least one of the first intelligent appliance or the second intelligent appliance based upon identification of the event.

14. The system of claim 1, wherein the system is further configured to provide an operator interface for accessing and controlling at least one of the first intelligent appliance or second intelligent appliance to perform at least one of:

(a) reviewing, via a remote viewing device, at least one of a video or a plurality of still images captured by the first intelligent appliance, or

(b) controlling, via the remote viewing device, the second intelligent appliance.

15. A wireless device operable on a mesh network including a first intelligent appliance and a second intelligent appliance, comprising:

at least one processor;

at least one network element; and

memory having instructions configured to cause the at least one processor to;

detect the first intelligent appliance and the second intelligent appliance;

in response to detecting the first and second intelligent appliances, establish

(1) a first wireless communication channel through which the first intelligent appliance communicates with the wireless computing device and

(2) a second wireless communication channel through which the second intelligent appliance communicates with the wireless computing device,

wherein the first and second intelligent appliances are configured to wirelessly communicate with each other through a direct wireless communication channel between the first and second intelligent appliances without an intermediate access point or gateway and

wherein the first wireless communication channel, the second wireless communication channel, and the direct wireless channel belong to the mesh network;

receive, via the first wireless communication channel, at least a portion of environment data captured by the first intelligent appliance,

wherein the environment data includes video, images, sound, temperature data, chemical presence data, motion data, or any combinations thereof;

receive user data from a communication device associated with at least one person;

detect one or more trigger events based, at least in part, on the user data, reference information, and the at least a portion of the captured environment data; and

in response to detecting the one or more trigger events, cause the second intelligent appliance to perform an action,

wherein at least one setting of the second intelligent appliance is adjusted based on control data generated by the wireless device using at least one or more instances of logic locally stored on the memory,

wherein the control data is transmitted from the wireless device to the second intelligent appliance via the second wireless communication channel.

16. The wireless device of claim 15, wherein the instructions are configured to cause the at least one processor to coordinate operation of a plurality of intelligent appliances, wherein the plurality of intelligent appliances includes at least one of the first intelligent appliance or the second intelligent appliance.

17. The wireless device of claim 15, wherein the instructions are configured to cause the at least one processor to:

coordinate operation of a plurality of intelligent appliances including the second intelligent appliance on the mesh network in response to detection of at least one trigger event.

18. The wireless device of claim 15, wherein the instructions are configured to cause the at least one processor to perform tracking within a surveillance environment based on permission settings set by an operator.

19. The wireless device of claim 15, wherein the instructions are configured to cause the at least one processor to cause an alert to be sent to an operator in response to detection of a person located within a surveillance area;

and allow viewing of at least a portion of environment data captured by at least one of the first intelligent appliance or the second intelligent appliance.

20. The wireless device of claim 15, wherein the instructions are configured to cause the at least one processor to identify an event within a surveillance environment based on the at least a portion of captured environment data and at least one operator-set detection rule;

and perform at least one of activating an alarm or sending a notification, in response to the identifying of the event.

21. The wireless device of claim 15, wherein the action performed by the second intelligent appliance includes capturing one or more of video, still images, or temperature data.