System for background subtraction with 3D camera
First Claim
1. A method comprising:
- receiving a video feed at a computing device having a processor and memory, the video feed comprising at least one color image including depth information of one or more subjects;
categorizing pixels of the at least one color image having a depth thereof less than a predetermined threshold distance as either foreground (FG) or unclear (UC);
recategorizing UC pixels as FG or to remove categorization using a function that considers at least one of (i) color and background history (BGH) information associated with the UC pixels and (ii) color and BGH information associated with pixels near the UC pixels; and
constructing at least one new color image by extracting the FG pixels of the at least one color image.
1 Assignment
0 Petitions
Accused Products
Abstract
A system for background image subtraction includes a computing device coupled with a 3D video camera, a processor o£ the device programmed to receive a video feed from the camera containing images of one or more subject that include depth information. The processor, for an image: segments pixels and corresponding depth information into three different regions including foreground (FG), background (BG), and unclear (UC); categorizes UC pixels as FG or BG using a function that considers the color and background history (BGH) information associated with the UC pixels and the color and BGH information associated with pixels near the UC pixels; examines the pixels marked as FG and applies temporal and spatial filters to smooth boundaries of the FG regions; constructs a new image by overlaying the FG regions on top of a new background; displays a video feed of the new image in a display device; and continually maintains the BGH.
-
Citations
20 Claims
-
1. A method comprising:
-
receiving a video feed at a computing device having a processor and memory, the video feed comprising at least one color image including depth information of one or more subjects; categorizing pixels of the at least one color image having a depth thereof less than a predetermined threshold distance as either foreground (FG) or unclear (UC); recategorizing UC pixels as FG or to remove categorization using a function that considers at least one of (i) color and background history (BGH) information associated with the UC pixels and (ii) color and BGH information associated with pixels near the UC pixels; and constructing at least one new color image by extracting the FG pixels of the at least one color image. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14)
-
-
15. A system comprising a computing device having a processor and memory, the processor programmed to receive video data, via a 3D application programming interface (API), from a camera, the video data containing (i) at least one colored image of one or more subjects and (ii) corresponding depth information;
- the processor further programmed to;
receive video data comprising at least one color image including depth information of one or more subjects; categorize pixels of the at least one color image having a depth thereof less than a predetermined threshold distance as either foreground (FG) or unclear (UC); recategorize UC pixels to FG or to remove categorization using a function that considers at least one of (i) color and background history (BGH) information associated with the UC pixels and (ii) color and BGH information associated with pixels near the UC pixels; and construct at least one new color image by extracting the FG pixels of the at least one color image. - View Dependent Claims (16, 17, 18, 19, 20)
- the processor further programmed to;
Specification