System and method for capturing, storing, analyzing and displaying data related to the movements of objects

• US 8,872,922 B2
• Filed: 03/29/2013
• Issued: 10/28/2014
• Est. Priority Date: 07/16/2008
• Status: Active Grant

• Current Assignee: Cognyte Technologies Israel Ltd. (Cognyte Software Ltd.)
• Original Assignee: Verint Americas Incorporated (Verint Systems Incorporated)
• Inventors: Golan, Oren, Dudovich, Boaz, Daliyot, Shahar, Horovitz, Itzik, Kiro, Shmuel
• Primary Examiner(s): Golabbakhsh, Ebrahim
• Application Number:
  US13/853,187
• Publication Number:
  US 20140125805A1
• Time in Patent Office: 578 Days
• Field of Search: 348/39, 348/150, 348/153, 348/155, 348/169
• US Class Current: 348/150
• CPC Class Codes: G06F 18/40 Software arrangements specially adapted for pattern recognition, e.g. user interfaces or toolboxes therefor
• CPC Class Codes: G06Q 30/02 Marketing; Price estimation or determination; Fundraising
• CPC Class Codes: G06T 7/70 Determining position or orientation of objects or cameras camera calibration G06T7/80
• CPC Class Codes: G06V 10/945 User interactive design; Environments; Toolboxes
• CPC Class Codes: G06V 20/52 Surveillance or monitoring of activities, e.g. for recognising suspicious objects recognising microscopic objects G06V20/69
• CPC Class Codes: H04N 7/18 Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
• CPC Class Codes: H04N 7/181 for receiving images from a plurality of remote sources

Abstract

A system and method for the capture and storage of data relating to the movements of objects, in a specified area and enables this data to be displayed in a graphically meaningful and useful manner. Video data is collected and video metadata is generated relating to objects (persons) appearing in the video data and their movements over time. The movements of the objects are then analyzed to detect the movements within a region of interest. This detection of movement allows a user, such as a manager of a store, to make informed decisions as to the infrastructure and operation of the store. One detection method relates to the number of people that are present in a region of interest for a specified time period. A second detection method relates to the number of people that remain or dwell in a particular area for a particular time period. A third detection method determines the flow of people and the direction they take within a region of interest. A fourth detection method relates to the number of people that enter a certain area by crossing a virtual line, a tripwire.

Claims

1. A method operable on a computer that is coupled to a memory containing video data of a prescribed physical area, the method responsive to the movement of objects in the prescribed physical area, the method comprising:

identifying objects in the prescribed physical area by querying video data, wherein the objects that are identified are moving in the prescribed physical area;

determining a number of objects that remain in the prescribed physical area for a first predetermined time period;

generating a visually perceptible output of the number of objects for the first predetermined time period;

determining a respective number of objects that remain in the prescribed physical area for each of a plurality of predetermined periods of time;

generating a visually perceptible output of each of respective number of objects;

generating a still image of the prescribed physical area; and

superimposing representations of at least two of the respective number of objects over the still image, wherein the at least two respective number of objects correspond, respectively, to at least two of the plurality of predetermined periods of time, and wherein the act of superimposing the representation of the at least two of the respective number of objects over the still image further comprises;

generating a contour map, the contour map containing different sections for the at least two of the plurality of predetermined periods of time; and

visually displaying a representation of at least two of the respective number of objects in the contour map.

2. The method according to claim 1, wherein the act of generating the visually perceptible output of the number of objects for the first predetermined time period further comprises:

generating a still image of the prescribed physical area; and

superimposing a representation of the number of objects over the still image for the first predetermined time period.

3. The method according to claim 2, wherein the act of superimposing the representation of the number of objects over the still image for the first predetermined time period further comprises:

plotting the movement of at least one of the objects in the prescribed physical area.

4. The method according to claim 1, wherein the act of generating the visually perceptible output of the number of objects for the first predetermined time period and the plurality of predetermined periods of time further comprises:

generating a bar graph illustrating the number of objects.

5. The method according to claim 1, wherein the act of generating the visually perceptible output of the number of objects for the first predetermined time period and the plurality of predetermined periods of time further comprises:

generating a line graph illustrating the number of objects.

6. The method according to claim 1, wherein the act of visually displaying comprises:

displaying a different color for different ranges of numbers.

7. The method according to claim 1, further comprising:

defining a region of interest in the prescribed physical area,

wherein only objects that remain in the region of interest for the first predetermined time period are determined.

8. The method according to claim 1, wherein there is a plurality of prescribed physical areas, the method further comprising:

receiving video data of the plurality of prescribed physical areas;

identifying the objects in each of the plurality of prescribed physical areas which are moving;

determining a number of objects that remain in each of the prescribed physical areas for the first predetermined time period; and

generating a visually perceptible output which compares the number of objects in each of the plurality of prescribed physical areas.