Systems and methods for automated 3-dimensional (3D) cloud-based analytics for security surveillance in operation areas

• US 9,407,880 B2
• Filed: 09/04/2015
• Issued: 08/02/2016
• Est. Priority Date: 04/10/2014
• Status: Active Grant

• Current Assignee: Tyco Fire & Security GmbH (Johnson Controls International plc)
• Original Assignee: Smartvue Corp. (Johnson Controls International plc)
• Inventors: Renkis, Martin A.
• Primary Examiner(s): Perungavoor, Sath V
• Assistant Examiner(s): AYNALEM, NATHNAEL B
• Application Number:
  US14/845,475
• Publication Number:
  US 20150381947A1
• Time in Patent Office: 333 Days
• Field of Search: 348/159, 348/47, 348/143
• US Class Current: 1/1
• CPC Class Codes: G06V 20/52 Surveillance or monitoring of activities, e.g. for recognising suspicious objects recognising microscopic objects G06V20/69
• CPC Class Codes: G08B 13/196 using television cameras
• CPC Class Codes: G08B 13/19656 Network used to communicate with a camera, e.g. WAN, LAN, Internet
• CPC Class Codes: H04L 67/10 in which an application is distributed across nodes in the network software deployment G06F8/60; multiprogramming arrangements G06F9/46
• CPC Class Codes: H04N 7/181 for receiving images from a plurality of remote sources

Abstract

Systems and methods for cloud-based surveillance for an operation area are disclosed. At least two input capture devices, at least one safety control device and at least one user device are communicatively connected to a cloud-based analytics platform. The cloud-based analytics platform automatically generates 3-Dimensional (3D) surveillance data based on received 2-Dimensional (2D) video and/or image inputs and perform advanced analytics and activates the at least one safety control device based on analytics data from advanced analytics.

Claims

1. A cloud-based surveillance system for a target surveillance area comprising:

at least two input capture devices (ICDs), a cloud-based analytics platform having a processor and a memory, at least one safety control device, and at least one user device having a display with a user interface;

wherein the cloud-based analytics platform is constructed and configured in network-based communication with the at least two ICDs, the at least one safety control device and the at least one user device;

wherein each of the at least two ICDs has at least one visual sensor and is operable to capture and transmit input data to the cloud-based analytics platform;

wherein the cloud-based analytics platform is operable to;

generate 3-Dimensional (3D) visual representation of the target surveillance area based on the captured input data from the at least two ICDs;

perform analytics based on the captured input data and generated 3D visual representation;

wherein the at least one user device is operable to display the 3D visual representation of the target surveillance area via the user interface;

wherein the at least one safety control device operable to be activated for safe operation by the cloud-based analytics platform based on analytics data from advanced analytics.

2. The system of claim 1, wherein the target surveillance area is an operation area, wherein the analytics comprises personal protective equipment recognition and article movement detection.

3. The system of claim 2, wherein the personal protective equipment is personal protective equipment is selected from the group consisting of:

gloves, safety glasses, safety shoes, earplugs, ear muffs, hard hats, respirators, coveralls, vests, and full body suits.

4. The system of claim 3, wherein the at least one safety device is operable to set off an alarm to notify an individual that a personal protective equipment for the individual is not present or is not property positioned.

5. The system of claim 4, wherein the at least one safety control device is operable to deploy an injury prevention mechanism for the individual in the operation area.

6. The system of claim 2, wherein the article comprises at least one selected from the group consisting of a person, a tool, a machine, a vehicle, and other articles having movement in the operation area.

7. The system of claim 6, wherein the at least one safety control device is operable to set off an alarm to notify that a movement in the operation area is outside of a safety range for a certain time period.

8. The system of claim 7, wherein the at least one safety control device is operable to deploy an injury prevention mechanism and/or a damage prevention mechanism for the article in the operation area.

9. The system of claim 1, wherein cloud-based analytics platform provides storage, and wherein a time period for the storage is selectable.

10. The system of claim 1, wherein the 3D visual presentation includes 3D playback within a selected time period for storage.

11. A method of providing cloud-based surveillance for a target surveillance area comprising:

communicatively connecting at least two input capture devices (ICDs), at least one user device having a display with a user interface, and at least one safety control device to a cloud-based analytics platform having a processor and a memory via a communication network;

wherein each of the at least two ICDs has at least one visual sensor;

the at least two ICDs capturing and transmitting input data to the cloud-based analytics platform;

the cloud-based analytics platform generating 3-Dimensional (3D) visual representation of the target surveillance area based on the captured input data from the at least two ICDs;

the cloud-based analytics platform performing analytics based on the captured input data and generated 3D visual representation;

the cloud-based analytics platform activating the at least one safety control device based on analytics data from the advanced analytics;

the at least one user device displaying the 3D visual representation of the target surveillance area via the user interface.

12. The method of claim 11, wherein the target surveillance area is an operation area, wherein the analytics comprises personal protective equipment recognition and article movement detection.

13. The method of claim 12, wherein the personal protective equipment is selected from the group consisting of:

gloves, safety glasses, safety shoes, earplugs, ear muffs, hard hats, respirators, coveralls, vests, and full body suits.

14. The method of claim 13, further comprising the at least one safety control device setting off an alarm to notify an individual that a personal protective equipment for the individual is not present or is not property positioned.

15. The method of claim 14, further comprising the at least one safety control device deploying an injury prevention mechanism for the individual in the operation area.

16. The method of claim 12, wherein the article comprises at least one selected from the group consisting of a person, a tool, a machine, a vehicle and other articles having movement in the operation area.

17. The method of claim 16, further comprising the at least one safety control device setting off an alarm to notify that a movement in the operation area is outside of a safety range for a certain time period.

18. The method of claim 17, further comprising the at least one safety control device deploying an injury prevention mechanism and/or a damage prevention mechanism for the article in the operation area.

19. The method of claim 11, wherein cloud-based analytics platform provide storage, and wherein a time period for the storage is selectable.

20. The method of claim 11, wherein the 3D visual presentation includes 3D playback within a selected time period for storage.