Systems and methods for accurate user foreground video extraction
First Claim
Patent Images
1. A method for processing a video, the method comprising:
- receiving, using a computer, a depth image and a color image of the video from at least one camera;
identifying a categorization for each pixel of the depth image of the video based on a comparison of a depth value for each pixel and at least one pixel history, the categorization comprises at least one of a user pixel, background pixel, and unknown pixel;
creating a region map based on the categorization for each of the pixels;
identifying an unclear region of the color image based on the region map;
creating an unclear region band of the color image, the unclear region band comprises categorized unclear pixels of the color image; and
distributing the categorized unclear pixels of the unclear region band of the color image into a foreground region and a background region.
4 Assignments
0 Petitions
Accused Products
Abstract
A color image and a depth image of a live video are received. Each of the color image and the depth image are processed to identify a foreground, background, and an unknown region band of the live video. The unknown region band may comprise pixels between the foreground and the background. Further processing is performed to segment the pixels of the unknown region band between the foreground and the background. As such, processing is performed on the unknown region band in order to provide an improved user foreground video.
-
Citations
23 Claims
-
1. A method for processing a video, the method comprising:
-
receiving, using a computer, a depth image and a color image of the video from at least one camera; identifying a categorization for each pixel of the depth image of the video based on a comparison of a depth value for each pixel and at least one pixel history, the categorization comprises at least one of a user pixel, background pixel, and unknown pixel; creating a region map based on the categorization for each of the pixels; identifying an unclear region of the color image based on the region map; creating an unclear region band of the color image, the unclear region band comprises categorized unclear pixels of the color image; and distributing the categorized unclear pixels of the unclear region band of the color image into a foreground region and a background region. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8)
-
-
9. A system, comprising at least one processor and memory, for processing a video, the system comprising:
-
a module for receiving a depth image and a color image of the video from at least one camera; a module for identifying a categorization for each pixel of the depth image of the video based on a comparison of a depth value for each pixel and at least one pixel history, the categorization comprises at least one of a user pixel, background pixel, and unknown pixel; a module for creating a region map based on the categorization for each of the pixels; a module for identifying an unclear region of the color image based on the region map; a module for creating an unclear region band of the color image, the unclear region band comprises categorized unclear pixels of the color image; and a module for distributing the categorized unclear pixels of the unclear region band of the color image into a foreground region and a background region. - View Dependent Claims (10, 11, 12, 13, 14, 15, 16)
-
-
17. A non-transitory computer readable medium carrying one or more instructions for processing a video, wherein the one or more instructions, when executed by one or more processors, causes the one or more processors to perform the steps of:
-
receiving a depth image and a color image of the video from at least one camera; identifying a categorization for each pixel of the depth image of the video based on a comparison of a depth value for each pixel and at least one pixel history, the categorization comprises at least one of a user pixel, background pixel, and unknown pixel; creating a region map based on the categorization for each of the pixels; identifying an unclear region of the color image based on the region map; creating an unclear region band of the color image, the unclear region band comprises categorized unclear pixels of the color image; and distributing the categorized unclear pixels of the unclear region band of the color image into a foreground region and a background region. - View Dependent Claims (18, 19, 20, 21, 22, 23)
-
Specification