System for background subtraction with 3D camera
First Claim
1. A system for background image subtraction comprising:
- a computing device having a processor and memory and coupled with a three-dimensional (3D) video camera, the processor programmed to receive a video feed from the camera, the video feed containing colored images of one or more subject that include depth information;
the processor further programmed, for a colored image, to;
segment pixels and corresponding depth information of the images into three different regions including foreground (FG), background (BG), and unclear (UC);
categorize UC pixels as FG or BG using a function that considers the color and background history (BGH) information associated with the UC pixels and the color and BGH information associated with pixels near the UC pixels;
examine the pixels marked as FG and apply temporal and spatial filters to smooth boundaries of the FG regions;
construct a new image by overlaying the FG regions on top of a new background;
display a video feed of the new image in a display device coupled with the computing device; and
continually maintain the BGH.
2 Assignments
0 Petitions
Accused Products
Abstract
A system for background image subtraction includes a computing device coupled with a 3D video camera, a processor of the device programmed to receive a video feed from the camera containing images of one or more subject that include depth information. The processor, for an image: segments pixels and corresponding depth information into three different regions including foreground (FG), background (BG), and unclear (UC); categorizes UC pixels as FG or BG using a function that considers the color and background history (BGH) information associated with the UC pixels and the color and BGH information associated with pixels near the UC pixels; examines the pixels marked as FG and applies temporal and spatial filters to smooth boundaries of the FG regions; constructs a new image by overlaying the FG regions on top of a new background; displays a video feed of the new image in a display device; and continually maintains the BGH.
-
Citations
30 Claims
-
1. A system for background image subtraction comprising:
a computing device having a processor and memory and coupled with a three-dimensional (3D) video camera, the processor programmed to receive a video feed from the camera, the video feed containing colored images of one or more subject that include depth information; the processor further programmed, for a colored image, to; segment pixels and corresponding depth information of the images into three different regions including foreground (FG), background (BG), and unclear (UC); categorize UC pixels as FG or BG using a function that considers the color and background history (BGH) information associated with the UC pixels and the color and BGH information associated with pixels near the UC pixels; examine the pixels marked as FG and apply temporal and spatial filters to smooth boundaries of the FG regions; construct a new image by overlaying the FG regions on top of a new background; display a video feed of the new image in a display device coupled with the computing device; and continually maintain the BGH. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14)
-
15. A computer-implemented method for background subtraction, the method executable by a computing device having a processor and memory, the processor programmed to receive a video feed from the camera, the video feed containing colored images of one or more subject that include depth information, the method comprising:
-
segmenting, by the processor, pixels and corresponding depth information of the images into three different regions including foreground (FG), background (BG), and unclear (UC); categorizing, by the processor, UC pixels as FG or BG using a function that considers the color and background history (BGH) information associated with the UC pixels and the color and BGH information associated with pixels near the UC pixels; deleting, by the processor, the BG region up to and around colored edges of the FG region; applying, by the processor, temporal and spatial filters to smooth the colored edges of the FG regions; constructing, by the processor, a new image by overlaying the FG regions on top of a new background; displaying, by the processor, the new image in a display device coupled with the computing device; and continually maintaining the BGH by the processor. - View Dependent Claims (16, 17, 18, 19, 20, 21, 22)
-
-
23. A non-transitory computer-readable storage medium comprising a set of instructions for background image subtraction executable by a computing device having a processor and memory, the processor programmed to receive a video feed from the camera, the video feed containing colored images of one or more subject that include depth information, the computer-readable medium comprising:
-
instructions to direct the processor to segment pixels and corresponding depth information of the images into three different regions including foreground (FG), background (BG), and unclear (UC); instructions to direct the processor to categorize UC pixels as FG or BG using a function that considers the color and background history (BGH) information associated with the UC pixels and the color and BGH information associated with pixels near the UC pixels; instructions to direct the processor to examine the pixels marked as FG and apply temporal and spatial filters to smooth boundaries of the FG regions; instructions to direct the processor to construct a new image by overlaying the FG regions on top of a new background; instructions to direct the processor to display the new image in a display device coupled with the computing device; and instructions to direct the processor to continually maintain the BGH. - View Dependent Claims (24, 25, 26, 27, 28, 29, 30)
-
Specification