WIRELESS ENVIRONMENTAL DATA CAPTURE SYSTEM AND METHOD FOR MESH NETWORKING

• US 20160174015A1
• Filed: 11/18/2015
• Published: 06/16/2016
• Est. Priority Date: 10/29/2004
• Status: Active Grant

• Current Assignee: Sensormatic Electronics LLC (Johnson Controls International plc)
• Original Assignee: KIP SMRT P1 LP
• Inventors: Renkis, Martin
• Granted Patent: US 11,138,847 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06T 7/246 using feature-based methods, e.g. the tracking of corners or segments
• CPC Class Codes: G08B 13/19641 Multiple cameras having overlapping views on a single scene
• CPC Class Codes: G08B 13/19656 Network used to communicate with a camera, e.g. WAN, LAN, Internet
• CPC Class Codes: G08B 13/1966 Wireless systems, other than telephone systems, used to communicate with a camera
• CPC Class Codes: G08B 13/19669 Event triggers storage or change of storage policy
• CPC Class Codes: G08B 13/19682 Graphic User Interface [GUI] presenting system data to the user, e.g. information on a screen helping a user interacting with an alarm system
• CPC Class Codes: G08B 13/19693 using multiple video sources viewed on a single or compound screen
• CPC Class Codes: G08B 13/19695 Arrangements wherein non-video detectors start video recording or forwarding but do not generate an alarm themselves
• CPC Class Codes: G08B 25/009 Signalling of the alarm condition to a substation whose identity is signalled to a central station, e.g. relaying alarm signals in order to extend communication range
• CPC Class Codes: H04L 2209/80 Wireless network architectures or network communication protocols for wireless network security H04W12/00
• CPC Class Codes: H04L 63/0428 wherein the data content is protected, e.g. by encrypting or encapsulating the payload
• CPC Class Codes: H04L 67/01 Protocols
• CPC Class Codes: H04L 67/10 in which an application is distributed across nodes in the network software deployment G06F8/60; multiprogramming arrangements G06F9/46
• CPC Class Codes: H04L 67/125 involving control of end-device applications over a network
• CPC Class Codes: H04N 23/631 Graphical user interfaces [GUI] specially adapted for controlling image capture or setting capture parameters
• CPC Class Codes: H04N 23/661 Transmitting camera control signals through networks, e.g. control via the Internet
• CPC Class Codes: H04N 5/77 between a recording apparatus and a television camera
• CPC Class Codes: H04N 7/181 for receiving images from a plurality of remote sources
• CPC Class Codes: H04N 7/188 Capturing isolated or intermittent images triggered by the occurrence of a predetermined event, e.g. an object reaching a predetermined position signal generation from motion picture films H04N5/253
• CPC Class Codes: H04W 12/02 Protecting privacy or anonymity, e.g. protecting personally identifiable information [PII]
• CPC Class Codes: H04W 12/033 : of the user plane, e.g. user's traffic
• CPC Class Codes: H04W 4/70 : Services for machine-to-machine communication [M2M] or machine type communication [MTC]
• CPC Class Codes: H04W 76/15 : Setup of multiple wireless link connections
• CPC Class Codes: H04W 8/005 : Discovery of network devices, e.g. terminals
• CPC Class Codes: H04W 84/18 : Self-organising networks, e.g. ad-hoc networks or sensor networks
• CPC Class Codes: H05K 7/20145 : Means for directing air flow, e.g. ducts, deflectors, plenum or guides
• CPC Class Codes: H05K 7/20172 : Fan mounting or fan specifications
• CPC Class Codes: H05K 7/20209 : Thermal management, e.g. fan control

Abstract

A mesh network environmental data capture system and method for providing communication between a base system having at least one wireless input capture device ICD(s) and other ICD(s), wherein the ICD(s) are capable of smart cross-communication with each other and remote access to their inputs via a server computer, including the steps of providing this base system; at least one user accessing the ICDs and inputs remotely via a user interface through a remote server computer and/or electronic device communicating with it, for providing a secure surveillance system with extended inputs range and wireless smart cross-communication for monitoring a target environment.

Claims

1. A method, comprising:

sending a first communication via a wireless mesh communication network,

wherein the first communication is configured to inform a smart communication appliance of a presence of an input capture device on the wireless mesh communication network,

wherein the first communication is configured to be sent for delivery to the smart communication appliance through one or more other input capture devices operating on the wireless mesh communication network,

wherein the one or more other input capture devices are configured to capture one or more of;

a first image, first video, first sound, first motion data, first physical presence data, first temperature data, first chemical presence data, first humidity data, first radiation data, or any combination thereof, and

wherein the one or more other input capture devices are different from both the input capture device and the smart communication appliance;

receiving a second communication via the wireless mesh communication network, wherein the second communication is configured to initiate retrieval of environment data from the input capture device, and wherein the second communication is delivered through the one or more other input capture devices;

accessing environment data based at least on the second communication, wherein the environment data is one or more of;

a second image, second video, second sound, second motion data, second physical presence data, second temperature data, second chemical presence data, second humidity data, second radiation data, or any combination thereof; and

sending a third communication via the wireless mesh communication network, wherein the third communication includes at least a portion of the environment data, wherein the third communication is configured to be sent for delivery to the smart communication appliance through the one or more other input capture devices.

2. The method of claim 1, wherein contemporaneously with sending the third communication via the wireless mesh communication network, sending or receiving control data originating from the smart communication appliance or the one or more other input capture devices, wherein the control data is configured to facilitate one or more of:

accessing the environment data, saving the environment data, adjusting the environment data, storing the environment data, retrieving the environment data, capturing the environment data, initiating real-time capture of the environment data, determining a motion and/or audio detection area, configuring triggers, configuring brightness, configuring encryption, or any combinations thereof.

3. The method of claim 1, further comprising, receiving a request to capture the environment data, wherein the request was sent from a remote computing device, wherein the remote computing device is part of a wired or wireless network different from the wireless mesh communication network, and wherein sending the third communication that includes at least the portion of the environment data is in response to the request, and wherein the remote computing device is a mobile phone, tablet, laptop, PDA, watch, or other mobile device.

4. The method of claim 1, wherein the one or more other input capture devices are configured to communicate, (A) directly with another input capture device and (B) directly with the smart communication appliance, to exchange the environment data and control setting data.

5. The method of claim 1, wherein the second communication is configured to initiate retrieval of environment data from the input capture device by causing the input capture device to dynamically capture, in response to receiving the second communication, the environment data from a target environment.

6. The method of claim 1, wherein the second communication is configured to initiate retrieval of environment data from the input capture device by causing the input capture device to retrieve, in response to receiving the second communication, the environment data which was previously captured from a target environment and stored.

7. The method of claim 1, wherein at least a portion of data within the second communication originated at a remote device that is part of a second network that is not the wireless mesh communication network, wherein the remote device is a mobile phone, tablet, laptop, PDA, watch or computing device having a web browser.

8. The method of claim 1, wherein at least a portion of data within the second communication originated at a remote device, and wherein the portion of data was sent, via the Internet to the smart communication appliance, from the remote device.

9. The method of claim 1, wherein at least a portion of data within the second communication originated at a remote device, and wherein the portion of data was sent, via a LAN to the smart communication appliance, from the remote device.

10. The method of claim 1, wherein at least a portion of data within the second communication originated at a remote device, and wherein the portion of data was sent, via a cellular network to the smart communication appliance, from the remote device.

11. The method of claim 1, wherein at least one of the one or more other input capture devices is configured to capture one or more of:

the first physical presence data, the first temperature data, the first chemical presence data, the first humidity data, the first radiation data, or any combination thereof.

12. The method of claim 1, wherein at least one of the one or more other input capture devices includes a camera configured to obtain optical information or motion-based information from a target environment.

13. The method of claim 1, further comprising:

contemporaneously with sending the third communication via the wireless mesh communication network, receiving second environment data originating from at least one additional input capture device other than the input capture device; and

forwarding the second environment data to the smart communication appliance.

14. The method of claim 1, further comprising:

contemporaneously with receiving the second communication via the wireless mesh communication network, receiving second environment data originating from at least one additional input capture device other than the input capture device; and

forwarding the second environment data to the smart communication appliance.

15. The method of claim 1, wherein at least one of the one or more other input capture devices includes one or more recording components configured to detect and record inputs at a target environment.

16. The method of claim 1, further comprising, receiving, via the wireless mesh communication network, control data configured to cause a sensor to capture the environment data.

17. The method of claim 1, wherein at least a plurality of the first communication, the second communication, and the third communication are repeated by the one or more other input capture devices, and wherein the one or more other input capture devices are configured to extend the usable range of the wireless mesh communication network.

18. The method of claim 1, further comprising, in response to receiving the second communication, adjusting a sensitivity level for detecting motion or audio.

19. The method of claim 1, further comprising, receiving a request for controlling a brightness level.

20. The method of claim 1, further comprising triggering an event, rule, notification, or alarm in response to receiving the second communication.

21. The method of claim 1, wherein the environment data is a live video stream captured at a target environment.

22. A computing system comprising:

at least one processor; and

memory having instructions configured to cause the at least one processor to;

send a first communication via a wireless mesh communication network,

wherein the first communication is configured to inform a smart communication appliance of a presence of a first input capture device on the wireless mesh communication network,

wherein the first communication is configured to be sent to the smart communication appliance via one or more hops that traverse at least a second input capture device operating on the wireless mesh communication network,

wherein the second input capture device is configured to capture one or more of;

a first image, first video, first sound, first motion data, first physical presence data, first temperature data, first chemical presence data, first humidity data, first radiation data, or any combination thereof, and

wherein the second input capture device is different from both the first input capture device and the smart communication appliance;

receive a second communication via the wireless mesh communication network, wherein the second communication is configured to control the first input capture device, and wherein the second communication is delivered via one or more hops that traverse at least the second input capture device via the wireless mesh communication network;

in response to the second communication, cause the first input capture device to perform operations including one or more of;

accessing environment data, saving the environment data, adjusting the environment data, storing the environment data, initiating real-time streaming of the environment data to the smart communication appliance, determining a motion and/or audio detection area, configuring brightness settings, configuring encryption of the environment data, or any combinations thereof; and

send a third communication via the wireless mesh communication network, wherein the third communication includes a result from the one or more operations performed by the first input capture device, wherein the third communication is configured to be sent to the smart communication appliance via one or more hops that traverse at least the second input capture device.

23. The computing system of claim 22, wherein the environment data is one or more of:

a second image, second video, second sound, second motion data, second physical presence data, second temperature data, second chemical presence data, second humidity data, second radiation data, or any combination thereof.

24. The computing system of claim 22, wherein the second input capture device is configured to communicate directly with (A) the first input capture device and (B) the smart communication appliance, and wherein the second input capture device is configured to perform the direct communications by exchanging the environment data and control setting data

25. The computing system of claim 22, wherein at least a portion of data within the second communication originated at a remote viewing device that is part of a second network that is not the wireless mesh communication network, and wherein the remote device is a mobile phone, tablet, laptop, PDA, watch or computing device having a web browser.

26. A computer-readable storage device storing instructions that, when executed by a computing system including at least one processor, cause the computing system to perform a method, the method comprising:

sending a first communication via a wireless mesh communication network,

wherein the first communication is configured to inform a smart communication appliance of a presence of a first input capture device on the wireless mesh communication network,

wherein the first communication is configured to be sent to the smart communication appliance via at least one second input capture device operating on the wireless mesh communication network,

wherein the second input capture device is configured to capture one or more of;

a first image, first video, first sound, first motion data, first physical presence data, first temperature data, first chemical presence data, first humidity data, first radiation data, or any combination thereof, and

wherein the second input capture device is different from both the first input capture device and the smart communication appliance;

receiving a second communication via the wireless mesh communication network, wherein the second communication is configured to control the first input capture device, and wherein the second communication is delivered by the smart communication appliance via the second input capture device;

in response to receiving the second communication, capturing environment data and/or controlling the first input capture device, the controlling producing control data; and

sending a third communication via the wireless mesh network, wherein the third communication includes at least a portion of the environment data and/or the control data, wherein the third communication is;

configured to be sent to the smart communication appliance or a remote computing device, wherein the remote computing device is part of a wired or wireless network different from the wireless mesh communication network.

27. The computer-readable storage device of claim 26, wherein the environment data is one or more of:

an image, sound, motion data, physical presence data, temperature data, or any combination thereof, and wherein controlling the first input capture device includes causing a processor of the first input capture device to perform one or more of;

accessing the environment data, saving the environment data, adjusting the environment data, storing the environment data, initiating real-time streaming of the environment data to the smart communication appliance, determining a motion and/or audio detection area, configuring brightness settings, configuring encryption of the environment data, or any combinations thereof.

28. The computer-readable storage device of claim 26, wherein at least a portion of data within the second communication originated at a remote viewing device that is part of a wired or wireless network that is not the wireless mesh communication network, wherein the remote device is a mobile phone, tablet, laptop, PDA, watch or computing device having a web browser.

29. A computing system comprising:

a networking component configured to;

send a first communication via a wireless mesh communication network, wherein the first communication is configured to inform a smart communication appliance of a presence of an input capture device on the wireless mesh communication network, wherein the first communication is configured to be sent to the smart communication appliance via one or more other input capture devices operating on the wireless mesh communication network, wherein the one or more other input capture devices are configured to capture one or more of;

a first image, first video, first sound, first motion data, first physical presence data, first temperature data, first chemical presence data, first humidity data, first radiation data, or any combination thereof, and wherein the one or more other input capture devices are different from both the input capture device and the smart communication appliance; and

receive a second communication via the wireless mesh communication network, wherein the second communication is configured to control a sensor, and wherein the second communication is delivered by the one or more other input capture devices via the wireless mesh communication network; and

in response to the second communication, a processing component configured to cause a sensor to perform operations comprising one or more of;

capturing environment data, determining motion and/or audio settings for the sensor, configuring a brightness level, or any combination thereof;

wherein the networking component is further configured to send a third communication via the wireless mesh communication network, wherein the third communication includes a result from the operations performed by the sensor, wherein the third communication is configured to be sent to the smart communication appliance via the one or more other input capture devices operating on the wireless mesh communication network.

30. A system comprising:

at least one processor; and

memory having instructions configured to cause the processor to;

communicate wireless digital direct communications with a computing appliance on a mesh network, without requiring interaction with a remote server computer for operation, wherein the wireless digital direct communications are configured to at least inform the computing appliance of a presence of a first input capture device on the mesh network, and wherein the wireless digital direct communications are configured to be sent to the computing appliance via one or more second input capture devices in wireless communication with the first input capture device, wherein at least one of the one or more second input capture devices is configured to capture one or more of;

a first image, first video, first sound, first motion data, first physical presence data, first temperature data, first chemical presence data, first humidity data, first radiation data, or any combination thereof, and wherein at least one of the one or more second input capture devices is different from both the first input capture device and the computing appliance;

capture a data input;

receive communication for requesting access to at least portions of the captured data input, wherein the received communication is sent from the computing appliance, wherein at least a portion of the received communication sent from the computing appliance originated from a remote viewing device requesting review of the data input, wherein the remote computing device is a wireless device that is part of a second network that is not the mesh network; and

communicate the portions of the captured data input for delivery to the remote viewing device.

31. The system of claim 30, wherein the computing appliance is configured to make available to the remote viewing device, via the second network, the portions of the captured data.

32. The system of claim 31, wherein at least one of the remote viewing device and an operator of the remote viewing device are authenticated before the remote viewing device receives the portions of captured data.

33. The system of claim 32, wherein the portions of captured data are portions of one or more of:

live video, an image, sound, motion data, physical presence data, temperature data, or any combination thereof.

34. A method performed by an environment capture device for establishing a communication path between a first smart appliance and a second smart appliance, comprising:

sending, to the first smart appliance, an identification of the environment capture device, wherein the first smart appliance establishes a first communication lock with the environment capture device in response to the identification of the environment capture device, and wherein the first communication lock between the first smart appliance and the environment capture device forms a first part of the communication path;

receiving, by the environment capture device from the second smart appliance, an identification of the second smart appliance;

establishing, in response to the identification of the second smart appliance, a second communication lock between the environment capture device and the second smart appliance, and wherein the second communication lock between the environment capture device and the second smart appliance forms a second part of the communication path;

contemporaneously with the receiving and/or the sending, capturing, by the environment capture device, first environment data comprising one or more of a first image, first video, first sound, first motion data, first physical presence data, first temperature data, first chemical presence data, first humidity data, first radiation data, or any combination thereof; and

transmitting, using the second communication lock, at least a portion of the captured first environment data.

35. The method of claim 34 further comprising:

receiving, from the first smart appliance via the first communication lock, second environment data comprising one or more of a second image, second video, second sound, second motion data, second physical presence data, second temperature data, second chemical presence data, second humidity data, second radiation data, or any combination thereof; and

forwarding, to the second smart appliance via the second communication lock, at least a portion of the second environment data.

36. The method of claim 34 further comprising automatically initiating security on the second communication lock.

37. The method of claim 39 wherein the security on the second communication lock comprises one or more of:

digital signing, cipher encryption, public key encryption, hardware based encryption, or any combination thereof.

38. The method of claim 34 wherein the second smart appliance does not accept one or more communications, identified as being from the first smart appliance, based on the one or more communications coming through a source other than the second communication lock.

39. The method of claim 34 wherein the first smart appliance and/or the second smart appliance is an input capture device configured to capture additional environment data.

40. A computer-readable storage medium storing instructions that, when executed by a first smart appliance, cause the first smart appliance to perform operations for establishing a communication path between the first smart appliance and a second smart appliance through an intermediate environment capture device, the operations comprising:

receiving, at the first smart appliance from the intermediate environment capture device, an identification of the intermediate environment capture device;

establishing a first communication lock with the intermediate environment capture device;

wherein the first communication lock between the first smart appliance and the intermediate environment capture device forms a first part of the communication path, wherein the intermediate environment capture device is configured to establish a second communication lock between the intermediate environment capture device and the second smart appliance, and wherein the second communication lock between the intermediate environment capture device and the second smart appliance forms a second part of the communication path; and

wherein, the intermediate environment capture device is further configured to;

(A) capture first environment data comprising one or more of a first image, first video, first sound, first motion data, first physical presence data, first temperature data, first chemical presence data, first humidity data, first radiation data, or any combination thereof, and (B) transmit the first environment data to the second smart appliance via the second communication lock.