System and method for capturing, storing, analyzing and displaying data related to the movements of objects

• US 8,964,036 B2
• Filed: 04/03/2013
• Issued: 02/24/2015
• Est. Priority Date: 07/16/2008
• Status: Active Grant

• Current Assignee: Cognyte Technologies Israel Ltd. (Cognyte Software Ltd.)
• Original Assignee: Verint Americas Incorporated (Verint Systems Incorporated)
• Inventors: Golan, Oren, Dudovich, Boaz, Daliyot, Shahar, Horovitz, Itzik, Kiro, Shmuel
• Primary Examiner(s): Golabbakhsh, Ebrahim
• Application Number:
  US13/856,187
• Publication Number:
  US 20130223688A1
• Time in Patent Office: 692 Days
• Field of Search: 348/39, 348150-155, 348/169
• US Class Current: 348/150
• CPC Class Codes: G06F 18/40 Software arrangements specially adapted for pattern recognition, e.g. user interfaces or toolboxes therefor
• CPC Class Codes: G06Q 30/02 Marketing; Price estimation or determination; Fundraising
• CPC Class Codes: G06T 7/70 Determining position or orientation of objects or cameras camera calibration G06T7/80
• CPC Class Codes: G06V 10/945 User interactive design; Environments; Toolboxes
• CPC Class Codes: G06V 20/52 Surveillance or monitoring of activities, e.g. for recognising suspicious objects recognising microscopic objects G06V20/69
• CPC Class Codes: H04N 7/18 Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
• CPC Class Codes: H04N 7/181 for receiving images from a plurality of remote sources

Abstract

A system and method for the capture and storage of data relating to the movements of objects, in a specified area and enables this data to be displayed in a graphically meaningful and useful manner. Video data is collected and video metadata is generated relating to objects (persons) appearing in the video data and their movements over time. The movements of the objects are then analyzed to detect the movements within a region of interest. This detection of movement allows a user, such as a manager of a store, to make informed decisions as to the infrastructure and operation of the store. One detection method relates to the number of people that are present in a region of interest for a specified time period. A second detection method relates to the number of people that remain or dwell in a particular area for a particular time period. A third detection method determines the flow of people and the direction they take within a region of interest. A fourth detection method relates to the number of people that enter a certain area by crossing a virtual line, a tripwire.

Claims

1. A method operable on a computer that is coupled to a memory containing video data of as prescribed physical area, the method responsive to the movement of objects in the prescribed physical area, the method comprising:

receiving video data of the prescribed physical area;

identifying objects in the prescribed physical area by querying the video data, wherein the objects that are identified are moving in the prescribed physical area;

displaying a static visually perceptible report related to the identified objects;

determining video data that is related to the identified objects;

displaying the determined video data simultaneously with the display of the static visually perceptible report, wherein the static visually perceptible report is selectively superimposed upon or displayed adjacent to the determined video data.

2. The method according to claim 1, wherein the received video data is compressed video data.

3. The method according to claim 1, wherein the determined video data is full motion video data.

4. A method operable on a computer to detect and analyze movement of objects in a prescribed physical area, the method comprising:

receiving video data of the prescribed physical area that originated from at least one camera;

detecting movement of at least one object in the prescribed physical area generating video metadata in response to the detection of the at least one object in the prescribed area, the video metadata representing the at least one object and its movement in the prescribed physical area;

storing the video metadata in a database;

identifying a number objects in the prescribed physical area by querying the video metadata;

generating and displaying a static visually perceptible report with respect o the identified objects; and

determining video data that is related to the identified objects;

displaying the determined video data simultaneously with the display of the static visually perceptible report, wherein the static visually perceptible report is selectively superimposed upon or displayed adjacent to the determined video data.

5. A system for detecting and analyzing movement of objects in a prescribed physical area, the system comprising:

an interface that receives video data of the prescribed physical area that originated from at least one camera;

a video management system coupled to the interface, the video management system storing the video data;

a video analytics engine coupled to the video management system, the video analytics engine generating video metadata representing at least one object and its movement in the prescribed physical area;

an object movement analytics engine coupled to the video analytics engine and coupled to the video management system, the object movement analytics engine identifying a number of objects in the prescribed physical area, generating a static visually perceptible report with respect to the identified objects, and determining video data that is related to the identified objects; and

a display coupled to the object movement analytics engine, the display simultaneously displaying the static visually perceptible report and the determined video data, wherein the static visually perceptible report is selectively superimposed upon or displayed adjacent to the determined video data.