Human detection and tracking for security applications

• US 20090041297A1
• Filed: 05/31/2005
• Published: 02/12/2009
• Est. Priority Date: 05/31/2005
• Status: Abandoned Application

• Current Assignee: ObjectVideo Incorporated (Alarm.com Holdings, Inc.)
• Original Assignee: ObjectVideo Incorporated (Alarm.com Holdings, Inc.)
• Inventors: Chosak, Andrew J., Myers, Gary W., Haering, Niels, Zhang, Zhong, Brewer, Paul C., Venetianer, Peter L., Lipton, Alan J., Yin, Weihong
• Application Number:
  US11/139,986
• Publication Number:
  US 20090041297A1
• Time in Patent Office: Days
• US Class Current: 382/103
• CPC Class Codes: G06T 2207/30196 Human being; Person
• CPC Class Codes: G06T 7/251 involving models
• CPC Class Codes: G06V 10/46 Descriptors for shape, contour or point-related descriptors, e.g. scale invariant feature transform [SIFT] or bags of words [BoW]; Salient regional features colour feature extraction G06V10/56
• CPC Class Codes: G06V 40/10 Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands

Abstract

A computer-based system for performing scene content analysis for human detection and tracking may include a video input to receive a video signal; a content analysis module, coupled to the video input, to receive the video signal from the video input, and analyze scene content from the video signal and determine an event from one or more objects visible in the video signal; a data storage module to store the video signal, data related to the event, or data related to configuration and operation of the system; and a user interface module, coupled to the content analysis module, to allow a user to configure the content analysis module to provide an alert for the event, wherein, upon recognition of the event, the content analysis module produces the alert.

Claims

1. A computer-based system for performing scene content analysis for human detection and tracking, comprising:

a video input to receive a video signal;

a content analysis module, coupled to the video input, to receive the video signal from the video input, and analyze scene content from the video signal and determine an event from one or more objects visible in the video signal;

a data storage module to store the video signal, data related to the event, or data related to configuration and operation of the system; and

a user interface module, coupled to the content analysis module, to allow a user to configure the content analysis module to provide an alert for the event, wherein, upon recognition of the event, the content analysis module produces the alert.

2. The system of claim 1, wherein the event corresponds to the detection of data related to a human target or movements of the human target in the video signal.

3. The system of claim 1, wherein the content analysis module comprises:

a motion and change detection module to detect motion or a change in the motion of the one or more objects in the video signal, and determine a foreground from the video signal;

a foreground blob extraction module to separate the foreground into one or more blobs; and

a human detection and tracking module to determine one or more human targets from the one or more blobs.

4. The system of claim 3, wherein the human detection and tracking module comprises:

a human component and feature detection module to map the one or more blobs and determine whether one or more object features include human components;

a human detection module to receive data related to the one or more object features that are determined to include human components, and generate one or more human models from the data; and

a human tracking module to receive data relating to the one or more human models and track the movement of one or more of the one or more human models.

5. The system of claim 4, wherein the human component and feature detection module comprises:

a blob tracker module to track the one or more blobs;

a head detector module to detect a human head in said tracked one or more blobs;

a head tracker module to track the detected human head;

a relative size estimator module to provide a relative size of said tracked one or more blobs compared to an average human target;

a human profile extraction module to extract a number of human profiles in said tracked one or more blobs;

a face detector module to detect whether a human face exists in said detected human head; and

a scale invariant feature transform (SIFT) module to extract scale invariant features for said tracked one or more blobs.

6. The system of claim 5, wherein the head detector module comprises:

a head location detection module to detect a potential human head in said tracked one or more blobs;

an elliptical head fit module to detect multiple heads corresponding to the same object as said potential human head;

a consistency verification module to compare said detected multiple heads for consistency and identify a best matching pair of heads; and

a body support verification module to determine whether said best matching pair of heads has sufficient body support to be a human head.

7. The system of claim 6, wherein the head location detection module comprises:

a generate top profile module to identify a top profile of said tracked one or more blobs;

a compute derivative module to perform a derivative operation on said top profile;

a slope module to identify at least one slope in said derivative; and

a head position locator module to locate a potential human head based on said top profile and said slope.

8. The system of claim 6, wherein the elliptical head fit module comprises:

a mask edge detector module to receive at least one input image mask and a bounding box containing at least one potential human head as inputs and to extract an outline edge of said input image mask within said bounding box;

a head outlines determiner module to extract head outline pixels from the outline edge;

a coarse fit module to approximate an elliptical head model from the head outline pixels; and

a refined fit module to refine the elliptical head model and reduce an overall fitting error to a minimum value.

9. The system of claim 8, wherein the refined fit module comprises:

an initial mean fit error module to compute the mean fit error of all the head outline pixels on the elliptical head model obtained by the coarse fit module; and

an adjustment module to make adjustments for each elliptical parameter to determine whether the adjusted model would decrease the mean fit error.

10. The system of claim 5, wherein the head tracker module comprises:

a target model module to track curves in said detected human head;

a target initialization module to select initial states for a head target model;

a dynamic propagation model module to obtain an approximate location of said detected human head;

a posterior probability generation and measurement module to generate posterior probabilities for each sample configuration; and

a computational cost module to determine a number of samples needed to generate said posterior probabilities.

11. The system of claim 5, wherein the relative size estimator module comprises:

a human size training module to chose one or more human target instances and accumulate human size statistics;

a human size statistics lookup module to store and look up an average human height, width and image area data for every pixel location on an image frame; and

a relative size query module to estimate a relative size of a new target to an average human target.

12. The system of claim 5, wherein the human profile extraction module comprises;

a vertical projection profile module to generate a target vertical projection profile of a human profile;

a vertical projection profile normalizer module to normalize the target vertical projection profile over said number of extracted human profiles; and

a human profile detector module to extract a potential human shape project profile by searching peaks and valleys in the target vertical projection profile.

13. The system of claim 4, wherein the human detection module comprises:

a check blob support module to check if an input target has blob support;

a check head and face support module to check if there is human head or face detected in the input blob target;

a check body support module to check if the input blob target contains a human body; and

a human state determiner module to check whether the input blob target is a human target, and if so, to determine the human state of the human target.