Systems and methods for automated cloud-based analytics and 3-dimensional (3D) display for surveillance systems

• US 9,405,979 B2
• Filed: 09/04/2015
• Issued: 08/02/2016
• Est. Priority Date: 04/10/2014
• Status: Active Grant

• Current Assignee: Tyco Fire & Security GmbH (Johnson Controls International plc)
• Original Assignee: Smartvue Corp. (Johnson Controls International plc)
• Inventors: Renkis, Martin A.
• Primary Examiner(s): Perungavoor, Sath V
• Assistant Examiner(s): AYNALEM, NATHNAEL B
• Application Number:
  US14/845,458
• Publication Number:
  US 20150379358A1
• Time in Patent Office: 333 Days
• Field of Search: 348/159, 348/47, 348/143
• US Class Current: 1/1
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G06V 20/41 Higher-level, semantic clustering, classification or understanding of video scenes, e.g. detection, labelling or Markovian modelling of sport events or news items segmenting video sequences G06V20/49
• CPC Class Codes: G06V 20/52 Surveillance or monitoring of activities, e.g. for recognising suspicious objects recognising microscopic objects G06V20/69
• CPC Class Codes: G08B 13/19613 Recognition of a predetermined image pattern or behaviour pattern indicating theft or intrusion
• CPC Class Codes: G08B 13/19641 Multiple cameras having overlapping views on a single scene
• CPC Class Codes: G08B 13/19656 Network used to communicate with a camera, e.g. WAN, LAN, Internet
• CPC Class Codes: H04L 67/10 in which an application is distributed across nodes in the network software deployment G06F8/60; multiprogramming arrangements G06F9/46
• CPC Class Codes: H04N 23/632 for displaying or modifying preview images prior to image capturing, e.g. variety of image resolutions or capturing parameters
• CPC Class Codes: H04N 23/661 Transmitting camera control signals through networks, e.g. control via the Internet
• CPC Class Codes: H04N 7/181 for receiving images from a plurality of remote sources

Abstract

Systems and methods for cloud-computing network with distributed input devices and a cloud-based analytics platform for automatically analyzing received 2-Dimensional (2D) video and/or image inputs for generating 3-Dimensional (3D) surveillance data and providing 3D display for a target surveillance area.

Claims

1. A system of cloud-based surveillance for a target surveillance area, comprising:

at least two input capture devices (ICDs), a cloud-based analytics platform having a processor and a memory, and at least one user device having a display with a user interface;

wherein the cloud-based analytics platform is constructed and configured in network-based communication with the at least two ICDs and the at least one user device;

wherein each of the at least two ICDs has at least one visual sensor and is operable to capture and transmit input data to the cloud-based analytics platform;

wherein the cloud-based analytics platform is operable to;

generate 3-Dimensional (3D) visual data based on 2-Dimensional (2D) visual data captured from the at least two ICDs; and

perform analytics based on the 3D visual data and captured input data;

wherein the at least one user device is operable to display a 3D visual representation of the target surveillance area via the user interface.

2. The system of claim 1, wherein the at least two ICDs are operable for wireless cross-communication with each other independent of the cloud-based analytics platform to form a mesh network of ICDs, wherein the cross-communication of the at least two ICDs includes data exchange, and wherein the data exchange includes information about the surveillance environment, settings, inputs, and combinations thereof.

3. The system of claim 1, wherein the captured input data are selected from live streaming video, real-time images and/or audio, previously recorded video, previously captured images and/or audio, and combinations thereof.

4. The system of claim 1, wherein the cloud-based analytics platform provides data storage.

5. The system of claim 1, wherein the at least one user device is operable to access the cloud-based analytics platform for the target surveillance area with an authorized account via the user interface.

6. The system of claim 1, wherein the at least one user device is selected from the group consisting of smart phones, tablets, personal computers, laptops, and head-mounted displays.

7. The system of claim 1, wherein the 3D visual representation includes 3D playback for a predetermined period of time.

8. The system of claim 1, wherein the 3D visual representation is interactive.

9. The system of claim 1, wherein the 3D visual representation includes real-time or near-real-time streaming.

10. The system of claim 1, wherein the 3D visual representation includes contextualization features and highlighted trajectories for target objects.

20. The method of claim 1, wherein the 3D visual representation includes contextualization features and highlighted trajectories for target objects.

11. A method for cloud-based surveillance for a target surveillance area, comprising:

communicatively connecting at least two input capture devices (ICDs) and at least one user device having a display with a user interface to a cloud-based analytics platform having a processor and a memory via a communication network;

wherein each of the at least two ICDs has at least one visual sensor;

each of the at least two ICDs capturing and transmitting input data to the cloud-based analytics platform;

the cloud-based analytics platform generating 3-Dimensional (3D) visual data based on 2-Dimensional (2D) visual data captured from the at least two ICDs;

the cloud-based analytics platform performing analytics based on the 3D visual data and captured input data;

the at least one user device displaying a 3D visual representation of the target surveillance area via the user interface.

12. The method of claim 11, further comprising the at least two ICDs cross-communicating with each other independent of the cloud platform to form a mesh network of ICDs, wherein the cross-communication of the at least two ICDs includes data exchange, and wherein the data exchange includes information about the surveillance environment, settings, inputs, and combinations thereof.

13. The method of claim 11, wherein the captured input data are selected from live streaming video, real-time images and/or audio, previously recorded video, previously captured images and/or audio, and combinations thereof.

14. The method of claim 11, wherein the cloud-based analytics platform provides data storage.

15. The method of claim 11, further comprising accessing the cloud-based analytics platform for the target surveillance area with an authorized account via the user interface on the at least one user device.

16. The method of claim 11, wherein the at least one user device is selected from the group consisting of smart phones, tablets, personal computers, laptops, and head-mounted displays.

17. The method of claim 11, wherein the 3D visual representation includes 3D playback for a predetermined period of time.

18. The method of claim 11, wherein the 3D visual representation is interactive.

19. The method of claim 11, wherein the 3D visual representation includes real-time or near-real-time streaming.