Methods and apparatuses for monitoring objects of interest in area with activity maps

• US 9,818,203 B2
• Filed: 04/08/2014
• Issued: 11/14/2017
• Est. Priority Date: 04/08/2014
• Status: Active Grant

• Current Assignee: Alcatel-Lucent USA, Inc. (Nokia Corporation)
• Original Assignee: Alcatel-Lucent USA, Inc. (Nokia Corporation)
• Inventors: O'Gorman, Lawrence, Livescu, Dorel
• Primary Examiner(s): Nawaz, Talha M
• Application Number:
  US14/247,565
• Publication Number:
  US 20150287214A1
• Time in Patent Office: 1,316 Days
• Field of Search: None
• CPC Class Codes: G06T 2207/30232 Surveillance
• CPC Class Codes: G06T 2207/30241 Trajectory
• CPC Class Codes: G06T 7/292 Multi-camera tracking
• CPC Class Codes: G06V 10/50 by performing operations within image blocks; by using histograms, e.g. histogram of oriented gradients [HoG]; by summing image-intensity values; Projection analysis
• CPC Class Codes: G06V 20/52 Surveillance or monitoring of activities, e.g. for recognising suspicious objects recognising microscopic objects G06V20/69

Abstract

An apparatus for monitoring movement of objects of interest in an area includes an activity map generation circuit and a unified activity map generation circuit. The activity map generation circuit is configured to: generate a plurality of activity maps based on video content from a plurality of cameras, each of the plurality of activity maps being indicative of relative activity of the objects of interest over time within a field of view of a camera among the plurality of cameras, and each of the plurality of cameras having a different corresponding field of view in the area; and standardize the plurality of activity maps with regard to a single common point of view. The unified spatial activity map generation circuit is configured to combine the plurality of standardized activity maps into a unified activity map.

Claims

1. An apparatus for monitoring movement of objects of interest in an area, the apparatus comprising:

an activity map generation circuit configured to,

generate a plurality of activity maps based on video content from a plurality of cameras, each of the plurality of activity maps being indicative of relative activity of the objects of interest over time within a field of view of a camera among the plurality of cameras, and each of the plurality of cameras having a different corresponding field of view in the area, and

standardize the plurality of activity maps with regard to a single common point of view;

a unified spatial activity map generation circuit configured to combine the plurality of standardized activity maps into a unified activity map; and

wherein the activity map generation circuit is further configured to standardize the plurality of activity maps with regard to the single common point of view by at least one of

modifying a direction feature with respect to tilt of at least one camera among the plurality of cameras,

transforming a spatial perspective of at least one of the plurality of activity maps from image coordinates to coordinates corresponding to the single common point of view,

normalizing an orientation of at least one of the plurality of activity maps,

normalizing probabilities with respect to at least one of the plurality of cameras, and

transforming a perspective spread of at least one of the plurality of activity maps.

2. The apparatus of claim 1, further comprising:

a display configured to display the unified activity map to a user.

3. The apparatus of claim 2, wherein the display is configured to display the unified activity map to the user along with a trajectory graph corresponding to the unified activity map.

4. The apparatus of claim 1, further comprising:

a memory configured to store the unified activity map.

5. The apparatus of claim 1, wherein the activity map generation circuit is further configured to,

generate a set of motion blur images for each of the plurality of cameras based on the video content, and

generate each of the plurality of activity maps based on a corresponding set of motion blur images.

6. The apparatus of claim 5, wherein:

the video content from each of the plurality of cameras includes a sequence of image frames; and

the activity map generation circuit is configured to,

generate each motion blur image in the set of motion blur images based on a motion blur image corresponding to a current image frame in the sequence of image frames and motion blur images corresponding to previous image frames in the sequence of image frames.

7. The apparatus of claim 1, wherein the relative activity of the objects of interest over time is one of density, dwell, direction, bi-direction and velocity of the objects of interest over time.

8. The apparatus of claim 1, wherein each of the plurality of activity maps includes spatial activity feature values for one of density, dwell, direction, bi-direction and velocity.

9. An apparatus for monitoring movement of objects of interest in an area, the apparatus comprising:

an activity map generation circuit configured to

generate, using a single motion blur method, a plurality of activity maps based on video content from a plurality of cameras, each of the plurality of activity maps being indicative of relative activity of the objects of interest over time within a field of view of a camera among the plurality of cameras, and each of the plurality of cameras having a different corresponding field of view in the area, and

standardize the plurality of activity maps with regard to a single common point of view;

a unified spatial activity map generation circuit configured to combine the plurality of standardized activity maps into a unified activity map; and

wherein the activity map generation circuit is further configured to standardize the plurality of activity maps with regard to the single common point of view by at least one of,

modifying a direction feature with respect to tilt of at least one camera among the plurality of cameras,

transforming a spatial perspective of at least one of the plurality of activity maps from image coordinates to coordinates corresponding to the single common point of view,

normalizing an orientation of at least one of the plurality of activity maps,

normalizing probabilities with respect to at least one of the plurality of cameras, and

transforming a perspective spread of at least one of the plurality of activity maps.

10. The apparatus of claim 9, wherein the unified activity map includes spatial and temporal activity feature values for the objects of interest.

11. The apparatus of claim 9, further comprising:

a display configured to display the unified activity map to a user.

12. The apparatus of claim 11, wherein the display is configured to display the unified activity map to the user along with a trajectory graph corresponding to the unified activity map.

13. The apparatus of claim 9, further comprising:

a memory configured to store the unified activity map.

14. The apparatus of claim 9, wherein the activity map generation circuit is further configured to,

generate a set of motion blur images for each of the plurality of cameras based on the video content, and

generate each of the plurality of activity maps based on a corresponding set of motion blur images.

15. The apparatus of claim 14, wherein:

the video content from each of the plurality of cameras includes a sequence of image frames; and

the activity map generation circuit is configured to,

generate each motion blur image in the set of motion blur images based on a motion blur image corresponding to a current image frame in the sequence of image frames and motion blur images corresponding to previous image frames in the sequence of image frames.

16. The apparatus of claim 9, wherein the relative activity of the objects of interest over time is one of density, dwell, direction, bi-direction and velocity of the objects of interest over time.

17. A method for monitoring movement of objects of interest in an area, the method comprising:

generating a plurality of activity maps based on video content from a plurality of cameras, each of the plurality of activity maps being indicative of relative activity of the objects of interest over time within a field of view of a camera among the plurality of cameras, and each of the plurality of cameras having a different corresponding field of view in the area;

standardizing the plurality of activity maps with regard to a single common point of view;

combining the plurality of standardized activity maps into a unified activity map;

at least one of storing and displaying the unified activity map; and

wherein the standardizing the plurality of activity maps with regard to a single common point of view includes at least one of

modifying a direction feature with respect to tilt of at least one camera among the plurality of cameras,

transforming a spatial perspective of at least one of the plurality of activity maps from image coordinates to coordinates corresponding to the single common point of view,

normalizing an orientation of at least one of the plurality of activity maps,

normalizing probabilities with respect to at least one of the plurality of cameras, and

transforming a perspective spread of at least one of the plurality of activity maps.

18. A non-transitory computer-readable medium storing computer-executable instructions that, when executed on a computer device, cause the computer device to execute the method of claim 17.