Systems and methods for automated cloud-based analytics for security and/or surveillance

• US 10,594,985 B2
• Filed: 08/20/2018
• Issued: 03/17/2020
• Est. Priority Date: 04/10/2014
• Status: Active Grant

• Current Assignee: Johnson Controls Tyco IP Holdings LLP (Johnson Controls International plc)
• Original Assignee: Sensormatic Electronics LLC (Johnson Controls International plc)
• Inventors: Renkis, Martin A.
• Primary Examiner(s): Aynalem, Nathnael
• Application Number:
  US15/999,403
• Publication Number:
  US 20190014289A1
• Time in Patent Office: 575 Days
• CPC Class Codes: B25J 9/1679 characterised by the tasks executed
• CPC Class Codes: G05D 1/021 specially adapted to land vehicles
• CPC Class Codes: G06T 19/003 Navigation within 3D models or images
• CPC Class Codes: G06V 10/95 structured as a network, e.g. client-server architectures
• CPC Class Codes: G06V 20/52 Surveillance or monitoring of activities, e.g. for recognising suspicious objects recognising microscopic objects G06V20/69
• CPC Class Codes: G08B 13/00 Burglar, theft or intruder alarms
• CPC Class Codes: G08B 13/19656 Network used to communicate with a camera, e.g. WAN, LAN, Internet
• CPC Class Codes: H04L 67/02 based on web technology, e.g. hypertext transfer protocol [HTTP]
• CPC Class Codes: H04L 67/10 in which an application is distributed across nodes in the network software deployment G06F8/60; multiprogramming arrangements G06F9/46
• CPC Class Codes: H04L 67/1097 for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
• CPC Class Codes: H04L 67/12 specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks
• CPC Class Codes: H04L 67/125 involving control of end-device applications over a network
• CPC Class Codes: H04L 67/306 User profiles
• CPC Class Codes: H04L 67/34 involving the movement of software or configuration parameters network booting or remote initial program loading [RIPL] G06F9/4416
• CPC Class Codes: H04L 67/535 Tracking the activity of the user network monitoring arrangements H04L43/00; recording of computer activity G06F11/34
• CPC Class Codes: H04N 13/239 using two 2D image sensors having a relative position equal to or related to the interocular distance H04N13/243 takes precedence
• CPC Class Codes: H04N 13/275 from 3D object models, e.g. computer-generated stereoscopic image signals
• CPC Class Codes: H04N 7/18 Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
• CPC Class Codes: H04N 7/181 for receiving images from a plurality of remote sources
• CPC Class Codes: Y10S 901/01 Mobile robot
• CPC Class Codes: Y10S 901/47 : Optical
• CPC Class Codes: Y10S 901/50 : Miscellaneous

Abstract

Systems and methods for virtualized computing or cloud-computing network with distributed input devices and at least one remote server computer for automatically analyzing received video, audio and/or image inputs for providing social security and/or surveillance for a surveillance environment, surveillance event, and/or surveillance target.

Claims

1. A surveillance system, comprising:

at least one server computer configured for network-based communication with a plurality of remote input devices having input capture mechanisms, wherein the plurality of remote input devices are not registered with the at least one server computer; and

wherein the at least one server computer includes at least one processor and a memory storing instructions, wherein the instructions are executable by the at least one processor to cause the at least one server computer to—

receive, via a network, inputs captured by the unregistered remote input devices that correspond, based on time and locations of the unregistered remote, input devices, to at least one predetermined surveillance environment, surveillance event, or surveillance target;

authenticate the inputs; and

analyze the authenticated inputs based on at least one predetermined surveillance profile for at least one surveillance environment, surveillance event, or surveillance target to determine a status of security.

2. The system of claim 1 wherein the instructions are executable by the at least one processor to cause the at least one sever computer to—

receive an input profile;

associate the inputs with the at least one predetermined surveillance environment, surveillance event, or surveillance target based on the received input profile;

receive positional information for the remote input devices; and

analyze the positional information to authenticate the inputs from the unregistered remote input devices located at the at least one predetermined surveillance environment, surveillance event, or surveillance target.

3. The system of claim 1 wherein the instructions are executable by the at least one processor to cause the at least one sever computer to automatically associate the inputs with the at least one predetermined surveillance environment, surveillance event, or surveillance target.

4. The system of claim 3 wherein the association of the inputs is based at least in part on an input profile.

5. The system of claim 1 wherein the authentication of the inputs includes—

confirming global positioning system (GPS) locations of each of the remote input devices providing inputs, and

matching the GPS locations with the at least one predetermined surveillance environment, surveillance event, or surveillance target.

6. The system of claim 1, wherein the authentication of the inputs is based at least in part on (a) at least one of a device identification, a user identification, a geographic location, or a time associated with each input and (b) the at least one predetermined surveillance environment, surveillance event, or surveillance target.

7. The system of claim 1 wherein the instructions are executable by the processor to cause the at least one sever computer to analyze the inputs to verify that the inputs have not been altered prior to their receipt by the at least one server computer.

8. The system of claim 1 wherein the at least one surveillance profile includes at least one of a security level, an alert level, an authorized remote input device, or user information.

9. The system of claim 1 wherein the inputs are received within a secure messaging communicated via the network.

10. The system of claim 1 wherein the inputs are selected from the group consisting of live streaming videos, real-time images, real-time audio, previously recorded videos, previously captured images, and previously recorded audio.

11. The system of claim 1 wherein the remote input devices are selected from the group consisting of mobile phones, smart phones, tablet computers, portable computers, mobile communication devices, wearable input capture devices, and security cameras.

12. The system of claim 1 wherein the instructions are executable by the at least one processor to cause the at least one sever computer to provide access of the analyzed inputs to a remote computing device.

13. A method for providing surveillance, the method comprising:

receiving, at least one server computer, inputs from unregistered remote input devices via the network, the at least one server computer is configured for network-based communication with a plurality of remote input devices having input capture mechanisms, wherein the plurality of remote input devices are not registered with the at least one server computer;

authenticating the inputs from the unregistered remote input devices at locations and time corresponding to at least one predetermined surveillance environment, surveillance event, or surveillance target; and

analyzing the inputs, at the at least one server computer, based on at least one surveillance profile for at least one surveillance environment, surveillance event, or surveillance target to determine a status of security.

14. The method of claim 13 wherein analyzing the inputs includes analyzing the inputs in near-real-time to determine the status of security.

15. The method of claim 13 wherein authenticating the inputs includes automatically authenticating one or more of the remote input devices and/or users associated with the remote input devices based on at least one of a device identification, a user identification, a geographic location, or a time associated with each input.

16. The method of claim 13, further comprising automatically associating the inputs with the at least one surveillance environment, surveillance event, or surveillance target.

17. The method of claim 13, further comprising transmitting an indication of the status of security to a remote computing device.

18. A method for providing surveillance, the method comprising:

capturing one or more inputs via a mobile computing device, wherein the one or more inputs are associated with at least one surveillance environment, surveillance event, or surveillance target; and

transmitting, from the mobile computing device, the one or more inputs to a remote server computer,

wherein the mobile computing device is not registered with the remote server computer, and

wherein the remote server computer is configured to (a) authenticate the one or more inputs from mobile computing devices in which time and location of the mobile computing devices correspond to at least one surveillance environment, surveillance event, or surveillance target, and (b) analyze the one or more inputs based on at least one surveillance profile for the at least one surveillance environment, surveillance event, or surveillance target to determine a status of security.

19. The method of claim 18, further comprising:

transmitting, from the mobile computing device, metadata associated with the one or more inputs to the remote server computer,

wherein the metadata includes at least one of a time associated with the inputs, a location associated with the inputs, geographic information associated with the inputs, a text notation associated with the inputs, an audio notation associated with the inputs, or a priority flag associated with the inputs, and

wherein the remote server computer is configured to associate the one or more inputs with the at least one surveillance environment, surveillance event, or surveillance target based on the metadata.

20. The method of claim 18, further comprising:

automatically verifying, at the mobile computing device, a user of the mobile computing device; and

transmitting, from the mobile computing device, information about the verification to the remote server computer, wherein the remote server computer is configured to authenticate the inputs based at least in part on the verification information.