Video segmentation using statistical pixel modeling

• US 8,457,401 B2
• Filed: 03/01/2007
• Issued: 06/04/2013
• Est. Priority Date: 03/23/2001
• Status: Active Grant

• Current Assignee: Avigilon Fortress Corporation
• Original Assignee: ObjectVideo Incorporated (Alarm.com Holdings, Inc.)
• Inventors: Lipton, Alan J., Haering, Niels, Rasheed, Zeeshan, Javed, Omar, Zhang, Zhong, Yin, Weihong, Venetianer, Peter L., Myers, Gary W.
• Primary Examiner(s): COUSO, JOSE L
• Application Number:
  US12/297,396
• Publication Number:
  US 20090297023A1
• Time in Patent Office: 2,287 Days
• Field of Search: 382/173, 382/180, 382/190, 382/199, 382/203, 382/205, 382209-210, 382232-233, 382235-236, 382238-239, 382/254, 382/308, 37524001-24002, 37524012-24013, 375/240.24, 375/240.29, 348/384.1, 348/394.1, 3484041-4161, 3484242-4251, 348700-702
• US Class Current: 382/173
• CPC Class Codes: G06V 10/28 Quantising the image, e.g. histogram thresholding for discrimination between background and foreground patterns
• CPC Class Codes: G06V 20/52 Surveillance or monitoring of activities, e.g. for recognising suspicious objects recognising microscopic objects G06V20/69

Abstract

A method for segmenting video data into foreground and background (324) portions utilizes statistical modeling of the pixels Λ statistical model of the background is built for each pixel, and each pixel in an incoming video frame is compared (326) with the background statistical model for that pixel. Pixels are determined to be foreground or background based on the comparisons. The method for segmenting video data may be further incorporated into a method for implementing an intelligent video surveillance system The method for segmenting video data may be implemented in hardware.

Claims

1. A method of video segmentation, for differentiating between foreground and background portions of video, comprising the steps of:

obtaining a frame sequence from a real-time video stream; and

for two or more frames in the frame sequence, performing the following steps;

labeling pixels in the frames;

performing spatial or temporal filtering;

updating a background statistical model, after the pixels are labeled; and

at least one of building or updating at least one foreground statistical model, after the pixels are labeled.

2. A method of video segmentation, for differentiating between foreground and background portions of video, comprising the steps of:

obtaining a frame sequence from a real-time video stream; and

for two or more frames in the frame sequence, performing the following steps;

labeling at least a portion of pixels in the frames;

performing spatial or temporal filtering;

for at least one labeled pixel, determining if the labeled pixel matches a first background statistical model;

updating the first background statistical model if the labeled pixel matches the first background statistical model; and

updating a secondary background statistical model if the labeled pixel does not match the first background statistical model.

3. A method according to claim 2, wherein the secondary background statistical model represents a potential foreground pixel.

4. A method according to claim 3, further comprising:

replacing the first background statistical model with the second background statistical model when the second background statistical model is stable.

5. A method of video segmentation, comprising the steps of:

obtaining a plurality of frames from a video stream; and

for at least two of the obtained frames, performing the following steps;

labeling a portion of the pixels in the frames;

performing spatial or temporal filtering;

updating a background statistical model, after the pixels are labeled; and

at least one of building or updating at least one foreground statistical model, after the pixels are labeled.

6. A method of video segmentation, comprising the steps of:

performing the following with at least one of a computer or circuitry for two or more frames obtained from a video stream;

labeling at least a portion of pixels in the frames;

performing spatial or temporal filtering;

for at least one labeled pixel, determining if the labeled pixel matches a first background statistical model;

updating the first background statistical model if the labeled pixel matches the first background statistical model; and

updating a secondary background statistical model if the labeled pixel does not match the first background statistical model.

7. A method according to claim 6, wherein the secondary background statistical model represents a potential foreground pixel.

8. A method according to claim 7, further comprising:

replacing the first background statistical model with the second background statistical model when the second background statistical model is stable.