Method and apparatus for tracking persons and locations using multiple cameras

• US 8,854,469 B2
• Filed: 05/19/2009
• Issued: 10/07/2014
• Est. Priority Date: 05/28/2008
• Status: Active Grant

• Current Assignee: KiwiSecurity Software GmbH
• Original Assignee: KiwiSecurity Software GmbH
• Inventors: Sutor, Stephan, Hrbinger, Oliver, Kraus, Klemens, Rhr, Robert, Matusek, Florian
• Primary Examiner(s): Czekaj, Dave
• Assistant Examiner(s): ABIMBOLA, KEHINDE
• Application Number:
  US12/994,803
• Publication Number:
  US 20120033083A1
• Time in Patent Office: 1,967 Days
• Field of Search: None
• US Class Current: 348/159
• CPC Class Codes: G06T 7/254 involving subtraction of images
• CPC Class Codes: H04N 7/181 for receiving images from a plurality of remote sources

Abstract

In a method for locating patterns of movement in a first digital video signal, wherein the first digital video signal comprising at least indirectly succeeding individual digital images is analyzed in real time, it is proposed for the locating of patterns of movement in a first digital video signal, during the occurrence of larger moving object volumes in real time, to assign at least a first location-changing foreground region in a first individual image in a predefined manner with a predefinable number of first markings, to subsequently determine the relative movement of the first markings between the first individual image and a subsequent second individual image, to subsequently associate each of the first markings with a predefinable first environment, to assign the first and/or at least one second location-changing foreground region in a predefined manner with a predefinable number of second markings, to remove the second markings disposed inside intersecting regions of a predefinable number of intersecting first environments, to subsequently determine the relative movement of the first and second markings between the second individual image and a subsequent third individual image, and to output the relative movements of the first and/or second markings as a first pattern of movement.

Claims

1. A method for identifying movement patterns in a first digital video signal which comprises individual digital images recorded with a plurality of cameras, said digital images arranged at least indirectly in form a sequence, comprising the steps of:

in a central data processing unit, analyzing the first digital video signal in real-time,

assigning a predetermined number of first markings to at least one position-changing foreground region in a first recorded individual image,

determining a relative movement of the first markings between the first recorded individual image and a subsequent second recorded individual image,

associating with each moved first marking a predetermined first environment in the second recorded individual image in one-to-one correspondence,

applying in the so-processed second recorded individual image a predetermined number of second markings to the at least one first position-changing foreground region or to at least one second position-changing foreground region, or both, wherein at least one of the first and second markings are arranged in form of a raster pattern,

removing the second markings arranged within intersecting regions of a predetermined number of intersecting first environments,

determining the relative movements of the first and second markings between the second recorded individual image and a subsequent third recorded individual image, and

outputting via a user interface to at least an event representation display the relative movements of the first markings or the second markings, or both, as a first movement pattern.

2. The method of claim 1, wherein the raster pattern is uniformly distributed or distributed with a predetermined weighting.

3. The method of claim 1, wherein the relative movements of at least one of the first and second markings are determined by determining or estimating an optical flow in the first video signal.

4. The method of claim 3, wherein determining or estimating is performed with an optical-flow-tracker.

5. The method of claim 3, wherein a Horn-Schunk method or a Kanade-Lucas-Tomasi method.

6. The method of claim 1, wherein the first environment is formed as a rectangle, a square, or a sectional plane of a cone.

7. The method of claim 6, wherein the sectional plane of a cone is a circle or an ellipse.

8. The method of claim 6, wherein the first environment is weighted.

9. The method of claim 1, further comprising the steps of:

subdividing at least the second recorded individual image into segments having a predetermined arrangement with a predetermined shape and size,

evaluating at least the first movement pattern within each segment, and

determining a segment movement pattern for each segment.

10. The method of claim 9, further comprising the step of determining at least one first main movement pattern from the first movement pattern or from the segment movement pattern, or both.

11. A computer program product embodied on a non-transitory data carrier and including software code segments, which when loaded into a memory of a computer and executed on the computer, causes the computer to perform the method steps of claim 1.