FOREGROUND DETECTOR FOR VIDEO ANALYTICS SYSTEM
First Claim
1. A computer-implemented method for generating a background model of a scene depicted in a sequence of video frames captured by a video camera, the method comprising:
- receiving a video frame, wherein the video frame includes one or more appearance values for each of a plurality of pixels;
classifying each pixel as depicting either foreground or background by comparing the one or more appearance values of each pixel to a background model of the scene; and
performing one or more context based evaluations on one or more of the pixels classified as depicting foreground, wherein the context based evaluations selectively reclassifies one or more of the pixels as depicting foreground or background based on the classification of other pixels in the video frame as depicting either foreground or background.
69 Assignments
0 Petitions
Accused Products
Abstract
Techniques are disclosed for creating a background model of a scene using both a pixel based approach and a context based approach. The combined approach provides an effective technique for segmenting scene foreground from background in frames of a video stream. Further, this approach can scale to process large numbers of camera feeds simultaneously, e.g., using parallel processing architectures, while still generating an accurate background model. Further, using both a pixel based approach and context based approach ensures that the video analytics system can effectively and efficiently respond to changes in a scene, without overly increasing computational complexity. In addition, techniques are disclosed for updating the background model, from frame-to-frame, by absorbing foreground pixels into the background model via an absorption window, and dynamically updating background/foreground thresholds.
48 Citations
30 Claims
-
1. A computer-implemented method for generating a background model of a scene depicted in a sequence of video frames captured by a video camera, the method comprising:
-
receiving a video frame, wherein the video frame includes one or more appearance values for each of a plurality of pixels; classifying each pixel as depicting either foreground or background by comparing the one or more appearance values of each pixel to a background model of the scene; and performing one or more context based evaluations on one or more of the pixels classified as depicting foreground, wherein the context based evaluations selectively reclassifies one or more of the pixels as depicting foreground or background based on the classification of other pixels in the video frame as depicting either foreground or background. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10)
-
-
11. A computer-readable storage medium containing a program, which when executed on a processor, performs an operation for generating a background model of a scene depicted in a sequence of video frames captured by a video camera, the operation comprising:
-
receiving a video frame, wherein the video frame includes one or more appearance values for each of a plurality of pixels; classifying each pixel as depicting either foreground or background by comparing the one or more appearance values of each pixel to a background model of the scene; and performing one or more context based evaluations on one or more of the pixels classified as depicting foreground, wherein the context based evaluations selectively reclassifies one or more of the pixels as depicting foreground or background based on the classification of other pixels in the video frame as depicting either foreground or background. - View Dependent Claims (12, 13, 14, 15, 16, 17, 18, 19, 20)
-
-
21. A system, comprising:
-
a video input source configured to provide a sequence of video frames, each depicting a scene; a central processing unit (CPU); a graphics processing unit (GPU); and a memory containing a program, which, when executed on the CPU and GPU is configured to perform an operation for generating a background model of a scene depicted in a sequence of video frames captured by a video camera, the operation comprising; receiving a video frame, wherein the video frame includes one or more appearance values for each of a plurality of pixels, classifying each pixel as depicting either foreground or background by comparing the one or more appearance values of each pixel to a background model of the scene, and performing one or more context based evaluations on one or more of the pixels classified as depicting foreground, wherein the context based evaluations selectively reclassifies one or more of the pixels as depicting foreground or background based on the classification of other pixels in the video frame as depicting either foreground or background. - View Dependent Claims (22, 23, 24, 25, 26, 27, 28, 29, 30)
-
Specification