Wireless surveillance system and method for 3-D visualization and user-controlled analytics of captured data

• US 8,395,664 B2
• Filed: 03/04/2009
• Issued: 03/12/2013
• Est. Priority Date: 09/13/2006
• Status: Active Grant

• Current Assignee: Tyco Fire & Security GmbH (Johnson Controls International plc)
• Original Assignee: Smartvue Corp. (Johnson Controls International plc)
• Inventors: Renkis, Martin A.
• Primary Examiner(s): Harrell, Robert B
• Application Number:
  US12/380,807
• Publication Number:
  US 20090225164A1
• Time in Patent Office: 1,469 Days
• Field of Search: 348/143
• US Class Current: 348/143
• CPC Class Codes: G08B 13/19656 Network used to communicate with a camera, e.g. WAN, LAN, Internet
• CPC Class Codes: G08B 13/19682 Graphic User Interface [GUI] presenting system data to the user, e.g. information on a screen helping a user interacting with an alarm system
• CPC Class Codes: G08B 13/19693 using multiple video sources viewed on a single or compound screen
• CPC Class Codes: G08B 25/009 Signalling of the alarm condition to a substation whose identity is signalled to a central station, e.g. relaying alarm signals in order to extend communication range
• CPC Class Codes: H04N 23/631 Graphical user interfaces [GUI] specially adapted for controlling image capture or setting capture parameters
• CPC Class Codes: H04N 23/66 Remote control of cameras or camera parts, e.g. by remote control devices
• CPC Class Codes: H04N 23/661 Transmitting camera control signals through networks, e.g. control via the Internet
• CPC Class Codes: H04N 23/90 Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums
• CPC Class Codes: H04N 7/18 Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast

Abstract

Systems and methods having a 3D model of a space provides a 3D context for the inputs from the ICDs; inputs from the ICDs, including direct cross-communication information, location, settings, environment conditions, and inputs (video, audio, temperature, other sensors), being visually represented on a GUI independently and in the 3D context for simultaneous display of all the info, and analytics based on the info, including activity density within the 3D context based on the inputs, for surveillance and analysis of target environment(s).

Claims

1. A surveillance system for wireless communication between components comprising:

a base system including at least two wireless input capture devices (ICDs) and a remote server computer (RSC) having a display with a user interface,

the RSC being operable to transmit and receive information with the ICDs,

the ICDs having at least one sensor and at least one input component for detecting and recording inputs, a microprocessor, a memory, a transmitter/receiver, all ICD components being constructed and configured in electronic connection;

wherein the ICDs are operable for wireless cross-communication with each other independent of the RSC for forming a mesh network of ICDs operable to provide secure surveillance of a target environment;

and an interactive graphic user interface (GUI) providing a visual representation of captured data in an image format and a contextualized image format comprising the visual representation of captured data and coordinated spatial representation of the image format, wherein the coordinated spatial representation of the image format comprises a coordinate system to provide a geospatial context for the captured data.

2. The system of claim 1, wherein the visual representation of the captured data is presented as an interactive 2-dimensional view.

3. The system of claim 2, wherein the 2-dimensional view is an image.

4. The system of claim 2, wherein the image is a still frame of a video image.

5. The system of claim 1, wherein the coordinate system provides an interactive 3-dimensional geospatial view of the captured data.

6. The system of claim 1, wherein the inputs include video.

7. The system of claim 1, wherein the cross-communication of ICDs includes data exchange, wherein the data exchange includes information about the surveillance environment, settings, inputs, and combinations thereof.

8. The system of claim 1, wherein the ICDs are operable to transmit inputs from one ICD to other ICDs, which are configured and operable to communicate with each other to provide a maximum extended range of a surveillance area.

9. The system according to claim 1, wherein the ICDs are operable to compare inputs to reference data for labeling a sensed object for further identification by the system.

10. The system according to claim 1, wherein the interactive GUI includes analytics about the target environment, based upon visual patterns.

12. The method of claim 1, wherein the 2-dimensional data is an image.

13. The method of claim 2, wherein the image is a still frame of a video image.

14. The method of claim 1, wherein the input capture includes video.

11. A method for providing networked communication in a base system including at least one wireless input capture device ICD(s) and a corresponding digital input recorder (DIR) or another ICD forming a base system wherein the ICD(s) are capable of direct smart cross-communication with each other and wherein a user is provided access to the ICD inputs via a remote server computer (RSC) having a display with a user interface, comprising the steps of:

providing the base system;

providing remote access to the DIR or ICD(s) via the remote server computer;

the ICD(s) being operable to process the inputs based upon predetermined settings stored in a memory of the ICD and to directly communicate with each other to transmit input data to the RSC;

representing captured data from the ICDs visually on a graphic user interface (GUI) for a remote user, the user interface including views showing 2-dimensional data and corresponding 3-dimensional data of the same input capture, wherein the 3-dimensional data comprises a coordinate overlay for providing a geospatial context for the 2-dimensional data, and wherein the GUI is interactive so that the remote user can dynamically change the perspective viewable through the GUI.

15. A method for providing networked communication between at least two wireless input capture devices (ICDs) capable of wireless cross-communication, data processing, and communication with a remote server computer (RSC), the ICDs forming a base system, comprising the steps of:

providing the base system;

at least one user accessing the at least one ICD through the RSC via a user interface;

the ICD(s) establishing direct, smart cross-communication with each other independent of the RSC to provide a secure wireless surveillance system for a target environment;

providing a visual representation of the captured data on the user interface in an image format;

and contextualizing the image format with a coordinate system to provide a geospatial context for the captured data, wherein the contextualization includes an interactive 3D model of a space that provides a 3D context for the inputs from the ICDs.

16. The method according to claim 15, wherein the base system further includes a wireless digital input recorder (DIR) operable for wireless communication with the ICDs.

17. The method according to claim 15, wherein the inputs from the ICDs, including direct cross-communication information, location, settings, environment conditions, and inputs are visually represented on an interactive graphic user interface (GUI) independently and in the 3D context for simultaneous display of all the info, and analytics based on the inputs.

18. The method of claim 15, wherein the inputs and analytics further include activity density within the 3D context based on the inputs.

19. The method according to claim 15, further including the step of the ICDs transmitting inputs directly from one ICD to other ICDs configured and operable to communicate with each other to provide a maximum extended range of a surveillance area.

20. The method according to claim 15, wherein the user is capable of accessing the ICDs via a user interface either directly or remotely through the RSC.