Systems and methods for automated cloud-based analytics for security and/or surveillance

• US 10,057,546 B2
• Filed: 04/10/2014
• Issued: 08/21/2018
• Est. Priority Date: 04/10/2014
• Status: Active Grant

• Current Assignee: Johnson Controls Tyco IP Holdings LLP (Johnson Controls International plc)
• Original Assignee: Sensormatic Electronics LLC (Johnson Controls International plc)
• Inventors: Renkis, Martin A.
• Primary Examiner(s): Aynalem, Nathnael
• Application Number:
  US14/249,687
• Publication Number:
  US 20150296186A1
• Time in Patent Office: 1,594 Days
• Field of Search: 348 47, 348143, 348159, 709219
• CPC Class Codes: B25J 9/1679 characterised by the tasks executed
• CPC Class Codes: G05D 1/021 specially adapted to land vehicles
• CPC Class Codes: G06T 19/003 Navigation within 3D models or images
• CPC Class Codes: G06V 10/95 structured as a network, e.g. client-server architectures
• CPC Class Codes: G06V 20/52 Surveillance or monitoring of activities, e.g. for recognising suspicious objects recognising microscopic objects G06V20/69
• CPC Class Codes: G08B 13/00 Burglar, theft or intruder alarms
• CPC Class Codes: G08B 13/19656 Network used to communicate with a camera, e.g. WAN, LAN, Internet
• CPC Class Codes: H04L 67/02 based on web technology, e.g. hypertext transfer protocol [HTTP]
• CPC Class Codes: H04L 67/10 in which an application is distributed across nodes in the network software deployment G06F8/60; multiprogramming arrangements G06F9/46
• CPC Class Codes: H04L 67/1097 for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
• CPC Class Codes: H04L 67/12 specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks
• CPC Class Codes: H04L 67/125 involving control of end-device applications over a network
• CPC Class Codes: H04L 67/306 User profiles
• CPC Class Codes: H04L 67/34 involving the movement of software or configuration parameters network booting or remote initial program loading [RIPL] G06F9/4416
• CPC Class Codes: H04L 67/535 Tracking the activity of the user network monitoring arrangements H04L43/00; recording of computer activity G06F11/34
• CPC Class Codes: H04N 13/239 using two 2D image sensors having a relative position equal to or related to the interocular distance H04N13/243 takes precedence
• CPC Class Codes: H04N 13/275 from 3D object models, e.g. computer-generated stereoscopic image signals
• CPC Class Codes: H04N 7/18 Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
• CPC Class Codes: H04N 7/181 for receiving images from a plurality of remote sources
• CPC Class Codes: Y10S 901/01 Mobile robot
• CPC Class Codes: Y10S 901/47 : Optical
• CPC Class Codes: Y10S 901/50 : Miscellaneous

Abstract

Systems and methods for virtualized computing or cloud-computing network with distributed input devices and at least one remote server computer for automatically analyzing received video, audio and/or image inputs for providing social security and/or surveillance for a surveillance environment, surveillance event, and/or surveillance target.

Claims

1. A cloud-computing surveillance system comprising:

at least one server computer having a processor and a memory, constructed and configured in network-based communication with a multiplicity of remote input devices having input capture mechanisms;

wherein the multiplicity of remote input devices are not registered with the system;

wherein inputs captured by the unregistered remote input devices are transmitted within a secure messaging communicated over the network to the at least one server computer;

wherein the inputs are received, authenticated, and indexed by the at least one server computer and stored in a corresponding database;

wherein an input profile is associated with the inputs for automatically associating the inputs with at least one surveillance environment, surveillance event, or surveillance target;

wherein the inputs are processed and analyzed based upon at least one surveillance profile for the at least one surveillance environment, surveillance event, or surveillance target for providing a near-real-time analysis of the inputs to determine a status of security; and

wherein the at least one surveillance profile comprises at least one of a security level, an alert level, an authorized remote input device, or user information.

2. The system of claim 1, further including a priority associated with the inputs, wherein the priority associated with the inputs and the input profile are used for automatically associating the inputs with the at least one surveillance environment, surveillance event, or surveillance target.

3. The system of claim 1, wherein the secure messaging includes internet protocol (IP) messaging of data packet(s) including the inputs.

4. The system of claim 1, wherein the inputs are selected from images and/or video.

5. The system of claim 1, wherein the remote input devices include mobile phones, smart phones, tablet computers, portable computers, mobile communication devices, wearable input capture devices, and/or security cameras.

6. The system of claim 1, wherein the analysis is performed by a virtualized or cloud-based computing system and provides for remote access of analyzed inputs.

7. The system of claim 1, wherein the analysis involves at least one rules engine for transforming individual inputs into analyzed content.

8. The system of claim 7, wherein the analyzed content includes inputs from more than one remote input device.

9. The system of claim 8, wherein the analyzed content includes automatically assembling input fragments into an integrated content file, and wherein the inputs from the more than one remote input device are stored and associated with the integrated content file.

10. The system of claim 1, wherein the authentication includes confirmation of global positioning system (GPS) location of each of the remote input devices providing inputs and matching the GPS location with the at least one surveillance environment, surveillance event, or surveillance target.

11. The system of claim 1, wherein the analysis includes authentication of the input device with a device identification, a user identification, a geographic location, and a time associated with the input and the at least one surveillance environment, surveillance event, or surveillance target.

12. The system of claim 1, wherein the inputs are automatically tagged, combined, grouped, edited, and analyzed by the cloud-based system according to the at least one surveillance environment, surveillance event, or surveillance target.

13. The system of claim 1, wherein the input is verified by authenticating the at least one input device and/or its corresponding user.

14. The system of claim 1, wherein the input is analyzed to confirm that there has been no alteration, editing, and/or modification to the input prior to its receipt by the at least one server computer.

15. The system of claim 1, wherein the input is selected from live streaming video, real-time images and/or audio, previously recorded video, previously captured images and/or audio, and combinations thereof.

21. The system of claim 1 wherein,

the remote input devices are portable and wearable video capture devices,

the captured inputs are video inputs from more than one video capture device,

the captured video inputs are transmitted by the video capture devices with an email message including the video input as a media attachment within the message,

the video inputs are authenticated at least by authenticating an email address associated with a corresponding video capture device, and

the surveillance profile comprises a security level or an alert level.

16. A method for providing cloud-based surveillance comprising the steps of:

providing at least one server computer having a processor and a memory, constructed and configured in network-based communication with a multiplicity of remote input devices having input capture mechanisms, wherein the multiplicity of remote input devices are not registered with the server computer;

receiving by the at least one server computer inputs from the unregistered remote input devices transmitted within a secure messaging communicated over the network;

authenticating the inputs;

indexing the inputs by the at least one server computer;

storing the inputs in a corresponding database;

automatically associating the inputs with at least one surveillance environment, surveillance event, or surveillance target based on an input profile;

processing and analyzing the inputs by the at least one server computer using at least one surveillance profile for the at least one surveillance environment, surveillance event, or surveillance target, wherein the at least one surveillance profile comprises at least one of a security level, an alert level, an authorized remote input device, or user information;

providing a near-real-time analysis of the inputs; and

determining a status of security based on the near-real-time analysis.

17. The method of claim 16, further including the step of providing a priority for the secure messaging.

18. The method of claim 16, further including the step of analyzing inputs from more than one remote input device in near real time to provide social security surveillance of the surveillance environment, surveillance event, and/or surveillance target.

19. The method of claim 16, further including the step of automatically assembling input fragments into an integrated content file, and wherein the original input is stored and associated with the integrated content file.

20. The method of claim 16, wherein the authenticating step includes automatic authentication of the input device and/or its user based upon the combination of a device identification, a user identification, a geographic location, and a time associated with the input and the at least one surveillance environment, surveillance event, or surveillance target.