Monitoring system, monitoring method and storage medium

• US 10,362,274 B2
• Filed: 10/28/2015
• Issued: 07/23/2019
• Est. Priority Date: 10/30/2014
• Status: Active Grant

• Current Assignee: Cloud BYTE LLC
• Original Assignee: NEC Corporation
• Inventors: Arikuma, Takeshi, Tani, Masahiro
• Primary Examiner(s): Elahi, Shan E
• Application Number:
  US15/519,271
• Publication Number:
  US 20170237942A1
• Time in Patent Office: 1,364 Days
• Field of Search: 348159
• CPC Class Codes: G06V 20/52 Surveillance or monitoring of activities, e.g. for recognising suspicious objects recognising microscopic objects G06V20/69
• CPC Class Codes: G08B 13/1672 using sonic detecting means, e.g. a microphone operating in the audio frequency range
• CPC Class Codes: G08B 13/19602 Image analysis to detect motion of the intruder, e.g. by frame subtraction
• CPC Class Codes: G08B 25/08 using communication transmission lines G08B13/19658, G08B21/0286, G08B25/016 take precedence
• CPC Class Codes: H04N 7/18 Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
• CPC Class Codes: H04N 7/181 for receiving images from a plurality of remote sources

Abstract

A monitoring system can detect and react to abnormal events in real-time is disclosed. The system includes: a receiver that receives the event related data from a plurality of sensors; a coverage analyzer that analyses predetermined data and the event related data from the receiver, the predetermined data including sensor coverage information; and a sensor selector coupled to the coverage analyzer that selects one or more of the plurality of sensors based on the analysis by the coverage analyzer.

Claims

1. A monitoring system for event related data from a plurality of sensors, comprising:

receiver that receives the event related data from a plurality of sensors;

coverage analyzer that executes a coverage analysis by comparing sensor coverage information with the event related data from the receiver;

sensor selector, coupled to the coverage analyzer, that selects one or more of the plurality of sensors based on the analysis by the coverage analyze; and

a sensor actuator, coupled to the sensor selector and the plurality of sensors, that actuates the one or more of the plurality of sensors selected by the sensor selector unit.

2. The system in accordance with claim 1, the coverage analyzer takes into account map information concerning wall or other space defining structures to execute the coverage analysis.

3. The system in accordance with claim 1, wherein the sensor coverage information includes information concerning Field of View (FOV) of the plurality of sensors.

4. The system in accordance with claim 1, wherein the sensor coverage information includes information concerning Field of Regard (FOR) for non-directional or movable sensors included in the plurality of sensors.

5. The system in accordance with claim 1, wherein the coverage analyzer analyzes data based on installed configurations of sensors, the sensor coverage information and the map information.

6. The system in accordance with claim 5, wherein the coverage analyzer determines one or more of the plurality of sensors that may capture an object as it moves away from an event location in response to the installed configurations of sensors and the event related data.

7. The system in accordance with claim 5, wherein the coverage analyzer determines one or more of the plurality of sensors that may monitor an unfolding event in response to the installed configurations of sensors, the sensor coverage information, the map information and the event related data.

8. The system in accordance with claim 7, wherein the coverage analyzer determines one or more of the plurality of sensors that may monitor the unfolding event, and wherein the one or more of the plurality of sensors includes at least one of the plurality of sensors that captures a large portion of space defined within the space defining structures of the map information.

9. The system in accordance with claim 7, wherein the coverage analyzer determines one or more of the plurality of sensors that may monitor the unfolding event and outputs selection data to the sensor selector comprising identification of the one or more of the plurality of sensors that may monitor the unfolding event, and wherein the sensor selector selects one or more of the plurality of sensors in response to the selection data for operator monitoring.

10. The system in accordance with claim 9, wherein selection data includes sensor prioritization scores, and wherein the sensor selector selects more than one of the plurality of sensors in response to the selection data for operator monitoring in accordance with the sensor prioritization scores.

11. The system in accordance with claim 10, wherein the sensor selector further outputs a list of the more than one of the plurality of sensors along with corresponding sensor prioritization scores for operator monitoring.

12. The system in accordance with claim 1, wherein the coverage analyzer analyzes the data in accordance with a rule based algorithm method, a machine learning algorithm method and/or a geographical map based algorithm method.

13. The system in accordance with claim 1, wherein the coverage analyzer analyzes the data in accordance with a clustering algorithm in order to cluster the plurality of sensors into one or more suitable sensor clusters and one or more unsuitable sensor clusters.

14. The system in accordance with claim 1, wherein one of the plurality of sensors is a microphone, and wherein the receiver receives the event related data from the microphone including a direction of an audio input.

15. The system in accordance with claim 1, wherein the one of the plurality of sensors is a camera having video properties, and wherein the sensor actuator actuates the camera and the camera'"'"'s video properties in response to the sensor selector'"'"'s selection based on the analysis by the coverage analyzer.

16. The system in accordance with claim 1, further comprising a sensor actuator, coupled to the sensor selector and the plurality of sensors, for actuating the one or more of the plurality of sensors selected by the sensor selector.

17. A monitoring method for event related data from a plurality of sensors, comprising:

receiving the event related data from a plurality of sensors;

executing a coverage analysis by comparing sensor coverage information with the event related data from the receiver;

selecting one or more of the plurality of sensors based on the analysis; and

actuating the selected one or more sensors.

18. The method in accordance with claim 17, wherein the sensor coverage information includes Field of View (FOV) information and/or Field of Regard (FOR) information for non-directional or movable sensors included in the plurality of sensors.

19. A non-transitory computer readable recording medium storing program for monitoring event related data from a plurality of sensors, and the program causes a computer to execute processing of:

receiving the event related data from a plurality of sensors;

executing a coverage analysis by comparing sensor coverage information with the event related data from the receiver;

selecting one or more of the plurality of sensors based on the analysis; and

actuating the one or more sensors.