System and method for depth-guided filtering in a video conference environment
First Claim
Patent Images
1. A method, comprising:
- generating a depth map that corresponds to a video image;
filtering the depth map with the video image to create a filtered depth map, wherein filtering the depth map includes filling in missing data from the depth map and upsampling when the depth map has a lower resolution than the video image, wherein the video image is a higher resolution image than the depth map, wherein details of objects closer to a viewpoint are preserved preferentially over objects further away;
using the video image to create a pyramid of video images; and
using the depth map to create a pyramid of depth maps, wherein the pyramid of video images are filtered with the pyramid of depth maps, layered into multiple bit streams, and cascaded to create an image.
1 Assignment
0 Petitions
Accused Products
Abstract
A method is provided in one example embodiment that includes generating a depth map that corresponds to a video image and filtering the depth map with the video image to create a filtered depth map. The video image can be filtered with the filtered depth map to create an image. In one example implementation, the video image is filtered using extended depth-guided filtering that is incorporated into a video encoding-decoding loop.
-
Citations
9 Claims
-
1. A method, comprising:
-
generating a depth map that corresponds to a video image; filtering the depth map with the video image to create a filtered depth map, wherein filtering the depth map includes filling in missing data from the depth map and upsampling when the depth map has a lower resolution than the video image, wherein the video image is a higher resolution image than the depth map, wherein details of objects closer to a viewpoint are preserved preferentially over objects further away; using the video image to create a pyramid of video images; and using the depth map to create a pyramid of depth maps, wherein the pyramid of video images are filtered with the pyramid of depth maps, layered into multiple bit streams, and cascaded to create an image. - View Dependent Claims (2, 3, 4, 5, 6)
-
-
7. Logic encoded in non-transitory media that includes instructions for execution and when executed by a processor, is operable to perform operations comprising:
-
generating a depth map that corresponds to a video image, wherein the video image is filtered; filtering the depth map with the video image to create a filtered depth map, wherein filtering the depth map includes filling in missing data from the depth map and upsampling when the depth map has a lower resolution than the video image, wherein the video image is a higher resolution image than the depth map, wherein details of objects closer to a viewpoint are preserved preferentially over objects further away; using the video image to create a pyramid of video images; and using the depth map to create a pyramid of depth maps, wherein the pyramid of video images are filtered with the pyramid of depth maps, layered into multiple bit streams, and cascaded to create an image. - View Dependent Claims (8)
-
-
9. An apparatus, comprising:
-
a memory element for storing data; a processor that executes instructions associated with the data; a manager module configured to interface with the processor and the memory element such that the apparatus is configured to; generate a depth map that corresponds to a video image, wherein the video image is filtered; filter the depth map with the video image to create a filtered depth map, wherein filtering the depth map includes filling in missing data from the depth map and upsampling when the depth map has a lower resolution than the video image, wherein the video image is a higher resolution image than the depth map, wherein details of objects closer to a viewpoint are preserved preferentially over objects further away; using the video image to create a pyramid of video images; and using the depth map to create a pyramid of depth maps, wherein the pyramid of video images are filtered with the pyramid of depth maps, layered into multiple bit streams, and cascaded to create an image.
-
Specification