Systems and methods for automated cloud-based analytics for security and/or surveillance

• US 9,216,509 B2
• Filed: 10/01/2014
• Issued: 12/22/2015
• Est. Priority Date: 04/10/2014
• Status: Active Grant

• Current Assignee: Johnson Controls Tyco IP Holdings LLP (Johnson Controls International plc)
• Original Assignee: Smartvue Corp. (Johnson Controls International plc)
• Inventors: Renkis, Martin A.
• Primary Examiner(s): Jen, Ian
• Application Number:
  US14/504,132
• Publication Number:
  US 20150290808A1
• Time in Patent Office: 447 Days
• Field of Search: 700/257
• US Class Current: 1/1
• CPC Class Codes: B25J 9/1679 characterised by the tasks executed
• CPC Class Codes: G05D 1/021 specially adapted to land vehicles
• CPC Class Codes: G06T 19/003 Navigation within 3D models or images
• CPC Class Codes: G06V 10/95 structured as a network, e.g. client-server architectures
• CPC Class Codes: G06V 20/52 Surveillance or monitoring of activities, e.g. for recognising suspicious objects recognising microscopic objects G06V20/69
• CPC Class Codes: G08B 13/00 Burglar, theft or intruder alarms
• CPC Class Codes: G08B 13/19656 Network used to communicate with a camera, e.g. WAN, LAN, Internet
• CPC Class Codes: H04L 67/02 based on web technology, e.g. hypertext transfer protocol [HTTP]
• CPC Class Codes: H04L 67/10 in which an application is distributed across nodes in the network software deployment G06F8/60; multiprogramming arrangements G06F9/46
• CPC Class Codes: H04L 67/1097 for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
• CPC Class Codes: H04L 67/12 specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks
• CPC Class Codes: H04L 67/125 involving control of end-device applications over a network
• CPC Class Codes: H04L 67/306 User profiles
• CPC Class Codes: H04L 67/34 involving the movement of software or configuration parameters network booting or remote initial program loading [RIPL] G06F9/4416
• CPC Class Codes: H04L 67/535 Tracking the activity of the user network monitoring arrangements H04L43/00; recording of computer activity G06F11/34
• CPC Class Codes: H04N 13/239 using two 2D image sensors having a relative position equal to or related to the interocular distance H04N13/243 takes precedence
• CPC Class Codes: H04N 13/275 from 3D object models, e.g. computer-generated stereoscopic image signals
• CPC Class Codes: H04N 7/18 Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
• CPC Class Codes: H04N 7/181 for receiving images from a plurality of remote sources
• CPC Class Codes: Y10S 901/01 Mobile robot
• CPC Class Codes: Y10S 901/47 : Optical
• CPC Class Codes: Y10S 901/50 : Miscellaneous

Abstract

Systems and methods for cloud-based social surveillance are disclosed. At least one mobile robot patrol a certain surveillance area and capture data content through various function modules. A computing device coupled with each robot collects and sends the data to a cloud-based analytics platform via network for surveillance real-time or near-real-time analysis. A cloud-based analytics platform is comprised of at least one cloud server, at least one cloud database, communication network, and user interface. Authorized users access the information related to their corresponding predetermined surveillance environment inputs and/or analytics of the inputs within the system via a user interface and/or override commands or updates generated based on the analysis.

Claims

1. A cloud-based surveillance system comprising:

at least one mobile robot constructed and configured with input capture mechanisms coupled with a computing device;

at least one customized program application installed on the computing device;

the at least one mobile robot configured to carry out predetermined surveillance tasks;

a cloud-based analytics platform comprising;

a cloud server having software operable thereon providing a profile of a specific surveillance environment, wherein input data from the at least one mobile robot is processed and analyzed, and wherein commands and updates to the at least one mobile robots are generated;

a cloud database for storage, wherein the profile for the specific surveillance environment, input data, and associated processed and analyzed input data, and generated commands and/or updates are stored;

a network operable for communications between the at least one mobile robot and the cloud-based analytics platform;

a user interface provided on a remote communications computing device operable for communications over the network, providing access to information related to the entire surveillance system for authorized users.

2. The cloud-based surveillance system of claim 1, wherein the at least one mobile robot further includes a drive system, a sensing system, and a controller system.

3. The cloud-based surveillance system of claim 2, wherein the sensing system comprises a vison module, an imaging module, at least one sensor module, an intelligence recognition module and a control module.

4. The cloud-based surveillance system of claim 3, wherein the at least one sensor module is operable for detecting noise, temperature, humidity, air quality, light intensity, and/or motion.

5. The cloud-based surveillance system of claim 3, wherein the intelligence recognition module comprises facial recognition, identity card recognition, and/or speech recognition.

6. The cloud-based surveillance system of claim 1, wherein each of the at least one mobile robot has a unique identifier.

7. The cloud-based surveillance system of claim 1, wherein the computing device is a tablet computer or a portable electronic device.

8. The cloud-based surveillance system of claim 1, wherein the computing device has real-time and near real-time communication capabilities.

9. The cloud-based surveillance system of claim 1, wherein the computing device communicates with other computing devices.

10. The cloud-based surveillance system of claim 1, wherein the computing device has a different operating system from that of the robot controller.

11. The cloud-based surveillance system of claim 1, wherein the computing device processes data collected by the sensing system of the at least one robot.

12. The cloud-based surveillance system of claim 11, wherein the processing by the computing device includes filtering, sampling, prioritizing and encoding the input data into a secure message.

13. The cloud-based surveillance system of claim 1, wherein the at least one cloud server processes and analyzes input data from the at least one mobile robot.

14. The cloud-based surveillance system of claim 13, wherein at least one cloud server processes and analyzes input data in real time or near real time.

15. The cloud-based surveillance system of claim 14, wherein the secure message is transmitted over a network via internet protocol (IP) messaging of data packet(s) comprising the input data.

16. The cloud-based surveillance system of claim 14, wherein the processing by the at least one cloud server includes decoding, authenticating, indexing, aggregating, tagging, combining, grouping, editing the input data.

17. The cloud-based surveillance system of claim 14, wherein the at least one cloud server generates commands and updates to the at least one mobile robots based on the processing and analyzing.

18. The cloud-based surveillance system of claim 1, wherein the communication network may be wired networks, direct-wired connections or wireless networks.

19. The cloud-based surveillance system of claim 1, wherein the user interface may be a web browser and/or an application program.

20. The cloud-based surveillance system of claim 1, wherein the user interface may be accessed by a smart phone, a tablet, or a PC.

21. A method for cloud-based surveillance comprising:

providing a cloud-based surveillance system comprising at least one mobile robot and a cloud-based analytics platform, wherein the at least one mobile robot has a computing device attached, and wherein the cloud-based analytics platform comprises a cloud server, a cloud database, communication network and user interface;

predetermining a profile for a certain surveillance environment by the cloud server;

configuring at least one mobile robot dispatched in the surveillance environment;

capturing data of the surveillance environment by the at least one mobile robot;

sending captured data to the cloud-based analytics platform;

processing and analyzing input data on the cloud-based analytics platform; and

generating command and updates to the at least one mobile robots based on the analysis.

22. The method for cloud-based surveillance of claim 21, wherein the profile, captured data, analyzed data, and generated command and updates in the cloud database.

23. The method for cloud-based surveillance of claim 21, further comprising reconfiguring robots based on the commands and updates generated from analyzed data.

24. The method for cloud-based surveillance of claim 21, further comprising filtering, sampling, prioritizing and encoding input data content captured from the at least one mobile robot into secure messaging by the attached computing device.

25. The method for cloud-based surveillance of claim 21, further comprising exchanging information between neighboring or close mobile robots.

26. The method for cloud-based surveillance of claim 25, further comprising generating commands based on the information exchange between robots.

27. The method of cloud-based surveillance of claim 21, further comprising monitoring and intervening the surveillance system by authorized users via user interface.

28. The method for cloud-based surveillance of claim 21, wherein the processing may comprise decoding, authenticating, indexing, aggregating, tagging, combining, grouping, and editing the input data content.

29. The method for cloud-based surveillance of claim 21, further comprising processing input data and generating commands locally at the at least one mobile robot based on the configuration and the captured data.

30. The method for cloud-based surveillance of claim 21, further comprising coordinating the commands generated locally and the command from the server.

31. The method of cloud-based surveillance of claim 30, further comprising making overriding decisions through user interface.

32. The method of cloud-based surveillance of claim 21, wherein the processing and analyzing is in real time or near real time.