SYSTEM FOR BACKGROUND SUBTRACTION WITH 3D CAMERA
First Claim
1. A system for background image subtraction, the system comprising:
- a computing device having a processor and, the processor programmed to receive video data, via a 3D application programming interface (API), from a camera, the video data containing (i) at least one colored image of one or more subject and (ii) corresponding depth information;
the processor further programmed to;
assign pixels of the video data to one of three different regions including foreground (FG), background (BG), and unclear (UC);
re-assign UC pixels to one of FG or BG using a function that considers (i) the color and background history (BGH) information associated with the UC pixels and (ii) the color and BGH information associated with pixels near the UC pixels;
construct at least one new image by overlaying the FG regions on top of a new background;
1 Assignment
0 Petitions
Accused Products
Abstract
A system for background image subtraction includes a computing device coupled with a 3D video camera, a processor o£ the device programmed to receive a video feed from the camera containing images of one or more subject that include depth information. The processor, for an image: segments pixels and corresponding depth information into three different regions including foreground (FG), background (BG), and unclear (UC); categorizes UC pixels as FG or BG using a function that considers the color and background history (BGH) information associated with the UC pixels and the color and BGH information associated with pixels near the UC pixels; examines the pixels marked as FG and applies temporal and spatial filters to smooth boundaries of the FG regions; constructs a new image by overlaying the FG regions on top of a new background; displays a video feed of the new image in a display device; and continually maintains the BGH.
63 Citations
20 Claims
-
1. A system for background image subtraction, the system comprising:
-
a computing device having a processor and, the processor programmed to receive video data, via a 3D application programming interface (API), from a camera, the video data containing (i) at least one colored image of one or more subject and (ii) corresponding depth information; the processor further programmed to; assign pixels of the video data to one of three different regions including foreground (FG), background (BG), and unclear (UC); re-assign UC pixels to one of FG or BG using a function that considers (i) the color and background history (BGH) information associated with the UC pixels and (ii) the color and BGH information associated with pixels near the UC pixels; construct at least one new image by overlaying the FG regions on top of a new background; - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14)
-
-
15. A computer-implemented method for background subtraction, the method executable by a computing device having at least one processor and memory, the at least one processor programmed to receive video data, via a 3D application programming interface (API), from a camera, the video data containing (i) at least one colored image of one or more subject and (ii) corresponding depth information, the method comprising:
-
assigning, by the at least one processor, pixels of the video data to one of three different regions including foreground (FG), background (BG), and unclear (UC); re-assigning, by the at least one processor, UC pixels to one of FG and BG using a function that considers (i) the color and background history (BGH) information associated with the UC pixels and (ii) the color and BGH information associated with pixels near the UC pixels; and constructing, by the at least one processor, a new image using the FG pixels and a new background; - View Dependent Claims (16, 17, 18, 19, 20)
-
Specification