Systems and methods for automated cloud-based analytics for security surveillance systems with mobile input capture devices

• US 9,438,865 B2
• Filed: 09/04/2015
• Issued: 09/06/2016
• Est. Priority Date: 04/10/2014
• Status: Active Grant

• Current Assignee: Johnson Controls Tyco IP Holdings LLP (Johnson Controls International plc)
• Original Assignee: Smartvue Corp. (Johnson Controls International plc)
• Inventors: Renkis, Martin A.
• Primary Examiner(s): Perungavoor, Sath V
• Assistant Examiner(s): AYNALEM, NATHNAEL B
• Application Number:
  US14/845,480
• Publication Number:
  US 20150381948A1
• Time in Patent Office: 368 Days
• Field of Search: 348/159, 348/47, 348/143, 709/219
• US Class Current: 1/1
• CPC Class Codes: B25J 9/1679 characterised by the tasks executed
• CPC Class Codes: G05D 1/021 specially adapted to land vehicles
• CPC Class Codes: G06T 19/003 Navigation within 3D models or images
• CPC Class Codes: G06V 10/95 structured as a network, e.g. client-server architectures
• CPC Class Codes: G06V 20/52 Surveillance or monitoring of activities, e.g. for recognising suspicious objects recognising microscopic objects G06V20/69
• CPC Class Codes: G08B 13/00 Burglar, theft or intruder alarms
• CPC Class Codes: G08B 13/19656 Network used to communicate with a camera, e.g. WAN, LAN, Internet
• CPC Class Codes: H04L 67/02 based on web technology, e.g. hypertext transfer protocol [HTTP]
• CPC Class Codes: H04L 67/10 in which an application is distributed across nodes in the network software deployment G06F8/60; multiprogramming arrangements G06F9/46
• CPC Class Codes: H04L 67/1097 for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
• CPC Class Codes: H04L 67/12 specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks
• CPC Class Codes: H04L 67/125 involving control of end-device applications over a network
• CPC Class Codes: H04L 67/306 User profiles
• CPC Class Codes: H04L 67/34 involving the movement of software or configuration parameters network booting or remote initial program loading [RIPL] G06F9/4416
• CPC Class Codes: H04L 67/535 Tracking the activity of the user network monitoring arrangements H04L43/00; recording of computer activity G06F11/34
• CPC Class Codes: H04N 13/239 using two 2D image sensors having a relative position equal to or related to the interocular distance H04N13/243 takes precedence
• CPC Class Codes: H04N 13/275 from 3D object models, e.g. computer-generated stereoscopic image signals
• CPC Class Codes: H04N 7/18 Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
• CPC Class Codes: H04N 7/181 for receiving images from a plurality of remote sources
• CPC Class Codes: Y10S 901/01 Mobile robot
• CPC Class Codes: Y10S 901/47 : Optical
• CPC Class Codes: Y10S 901/50 : Miscellaneous

Abstract

Systems and methods for cloud-based surveillance for a target surveillance area are disclosed. At least two input capture devices and at least one user device are communicatively connected to a cloud-based analytics platform. At least one input capture device is a mobile device with visual sensors. The cloud-based analytics platform automatically analyzes received 2-Dimensional (2D) video and/or image inputs for generating 3-Dimensional (3D) surveillance data and providing 3D display for a target surveillance area.

Claims

1. A cloud-based surveillance system for a target surveillance area, comprising:

at least two input capture devices (ICDs), a cloud-based analytics platform having a processor and a memory, at least one user device having a display with a user interface;

wherein the cloud-based analytics platform is constructed and configured in network-based communication with the at least two ICDs and the at least one user device;

wherein the at least two ICDs have visual sensors and are operable to capture and transmit input data to the cloud-based analytics platform;

wherein at least one of the at least two ICDs is a mobile device with a visual sensor;

wherein the cloud-based analytics platform is operable to;

receive and authenticate the input data;

generate 3-Dimensional (3D) visual representation based on input data captured from the at least two ICDs;

perform advanced analytics based on the input data and/or the generated 3D visual representation;

wherein the at least one user device is operable to display the 3D visual representation for the target surveillance area via the user interface.

2. The system of claim 1, wherein the at least two ICDs are selected from the group consisting of security cameras, mobile phones, smart phones, tablets, portable computers, and wearable input capture devices.

3. The system of claim 1, wherein the input data are selected from live streaming video, real-time images and/or audio, previously recorded video, previously captured images and/or audio, and combinations thereof.

4. The system of claim 1, wherein the input data are automatically tagged, combined, grouped, and edited by the cloud-based analytics platform according to the target surveillance area.

5. The system of claim 1, wherein authentication of the input data includes confirming the time for the input data captured by the at least two ICDs.

6. The system of claim 1, wherein authentication of the input data includes confirmation of global positioning system (GPS) location of each of the remote input devices providing inputs and matching the GPS location with that of the target surveillance area.

7. The system of claim 1, wherein authentication of the input data includes confirming that there has been no alteration, editing, and/or modification to the input data prior to its receipt by the cloud-based analytics platform.

8. The system of claim 1, wherein the cloud-based analytics platform is further operable to provide data storage, wherein a time period of storage is selectable on the cloud-based analytics platform.

9. The system of claim 1, wherein the 3D visual representation of the target surveillance area includes 3D playback for a predetermined time period.

10. The system of claim 1, wherein the 3D visual representation of the target surveillance area is interactive.

11. A method for providing cloud-based surveillance for a target surveillance area, comprising:

communicatively connecting at least two input capture devices (ICDs) and at least one user device having a display with a user interface to a cloud-based analytics platform having a processor and a memory via a communication network;

wherein each of the at least two ICDs has at least one visual sensor;

wherein at least one of the at least two ICDs is a mobile device with a visual sensor;

the at least two ICDs capturing and transmitting input data to the cloud-based analytics platform;

the cloud-based analytics platform receiving and authenticating the input data;

the cloud-based analytics platform generating 3-Dimensional (3D) visual representation based on input data captured from the at least two ICDs;

the cloud-based analytics platform performing advanced analytics based on the input data and/or the generated 3D visual representation;

the at least one user device displaying the 3D visual representation for the target surveillance area via the user interface.

12. The method of claim 11, wherein the at least two ICDs are selected from the group consisting of security cameras, mobile phones, smart phones, tablets, portable computers, and wearable input capture devices.

13. The method of claim 11, wherein the input data are selected from live streaming video, real-time images and/or audio, previously recorded video, previously captured images and/or audio, and combinations thereof.

14. The method of claim 11, further comprising the cloud-based analytics platform tagging, combining, grouping, and editing the input data according to the target surveillance area.

15. The method of claim 11, wherein authenticating the input data comprises confirming the time for the input data captured by the at least two ICDs.

16. The method of claim 11, wherein authenticating the input data comprises confirming a global positioning system (GPS) location of each of the at least two ICDs and matching the GPS location with that of the target surveillance area.

17. The method of claim 11, wherein authenticating the input data comprises confirming that there has been no alteration, editing, and/or modification to the input data prior to its receipt by the cloud-based analytics platform.

18. The method of claim 11, further comprising the cloud-based analytics platform providing data storage, wherein a time period of storage is selectable on the cloud-based analytics platform.

19. The method of claim 11, wherein the 3D visual representation of the target surveillance area includes 3D playback for a predetermined time period.

20. The method of claim 11, wherein the 3D visual representation of the target surveillance area is interactive.