SYSTEM AND METHOD FOR SEMANTIC VIDEO CONTENT ANALYSIS

• US 20130038737A1
• Filed: 08/10/2011
• Published: 02/14/2013
• Est. Priority Date: 08/10/2011
• Status: Active Grant

• Current Assignee: Qognify Ltd. (PSBU Midco SARL)
• Original Assignee: Guy Blumstein-Koren, Raanan Yonatan Yehezkel
• Inventors: YEHEZKEL, Raanan Yonatan, Blumstein-Koren, Guy, Gurwicz, Yaniv
• Granted Patent: US 8,743,205 B2
• Time in Patent Office: Days
• US Class Current: 348/159
• CPC Class Codes: G08B 13/19693 using multiple video sources viewed on a single or compound screen
• CPC Class Codes: G11B 27/28 by using information signals recorded by the same method as the main recording G11B27/22 takes precedence
• CPC Class Codes: H04N 23/90 Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums
• CPC Class Codes: H04N 7/181 for receiving images from a plurality of remote sources

Abstract

Embodiments of the invention may include generating a description of a monitored scene and creating a plurality of rules related to the monitored scene by using common language. The description of the monitored scene and the plurality of rules may be converted into system parameters and an analysis of the video data may be performed based on the system parameters. The results of the analysis may be converted into one or more output terms from the plurality of predefined terms and may be displayed to a user in a common language.

Claims

1. A method for semantics based video analysis, the method comprising:

accepting a description of a monitored scene, the description comprising one or more terms from a plurality of predefined terms;

accepting a plurality of rules related to the monitored scene, the rules comprising one or more terms from the plurality of predefined terms;

converting the description of the monitored scene into video characterization parameters;

receiving video data from a plurality of cameras located at the monitored scene;

performing video analysis of the video data based on the video characterization parameters and the rules;

converting results of the video analysis into one or more alerts selected from a plurality of predefined alerts; and

presenting to a user the one or more alerts.

2. The method of claim 1, wherein the description of the monitored scene comprises an image of the monitored scene divided into a plurality of segments.

3. The method of claim 2, wherein the description of the monitored scene comprises the plurality of segments each labeled by one or more terms from the plurality of predefined terms.

4. The method of claim 1, wherein the plurality of rules related to the monitored scene comprises a plurality of events to be detected.

5. The method of claim 1, wherein performing the analysis of the video data comprises executing a plurality of computer vision algorithms.

6. The method of claim 4, wherein the analysis of the video data comprises identifying the events.

7. The method of claim 1,furtehr comprising:

converting the plurality of rules into video characterization parameters.

8. The method of claim 2, further comprising:

identifying characteristics of the plurality of segments and refining the plurality of segments based on the characteristics.

9. The method of claim 8, wherein identifying characteristics of the plurality of segments of a first video channel is used to generate a description of a monitored scene of a second video channel.

10. The method of claim 1, further comprising:

identifying characteristics of the plurality of rules and automatically suggest other rules based on the characteristics.

11. A video analytics system comprising:

a workstation to accept a description of a monitored scene and a plurality of rules related to the scene, the description and the rules comprising one or more terms selected by a user from a plurality of predefined terms ;

a computing device to convert the description of the monitored scene into video characterization parameters; and

a data server to save video data recorded by a plurality of cameras, to receive the video characterization parameters and to perform an analysis of the video data based on the video characterization parameters and the rules;

wherein the computing device is to convert results of the analysis into one or more alerts selected from the plurality of predefined alerts to be presented to the user by the workstation.

12. The system of claim 11, wherein the description of the monitored scene comprises a plurality of segments of the monitored scene.

13. The system of claim 12, wherein each of the plurality of segments is labeled with one or more terms from the plurality of predefined terms.

14. The system of claim 11, wherein the plurality of rules related to the monitored scene comprises a plurality of events to be detected.

15. The system of claim 11, wherein the analysis of the video data comprises execution of a plurality of computer vision algorithms.

16. The system of claim 14, wherein the analysis of the video data comprises identifying the events.

17. The system of claim 11, wherein the computing device is to convert the plurality of rules into video characterization parameters.

18. An article comprising a non-transitory computer-readable storage medium, having stored thereon instructions, that when executed on a computer, cause the computer to:

accept a description of a monitored scene, the description comprising one or more terms from a plurality of predefined terms;

accept a plurality of rules related to the monitored scene, the rules comprising one or more terms from the plurality of predefined terms;

convert the description of the monitored scene into video characterization parameters;

receive video data from a plurality of cameras located at the monitored scene;

perform video analysis of the video data based on the video characterization parameters and the rules;

convert results of the video analysis into one or more alerts selected from a plurality of predefined alerts; and

present to a user the one or more alerts.