Systems and methods for embedding a foreground video into a background feed based on a control input
First Claim
Patent Images
1. A method for selectively embedding a foreground video into a background feed, the method comprising:
- receiving, using a computer, depth and color information of a first video from at least one camera;
creating a foreground video by identifying a foreground portion and a background portion of the first video based on the depth and color information of the first video, the creation of the foreground video comprising an inclusion of the foreground portion of the first video and a removal of the background portion of the first video;
receiving the background feed comprising a second background;
detecting, in the foreground video, a control input from a user;
determining, based on the control input, whether or not to embed the foreground video into the second background;
in response to a determination to embed the foreground video, creating an output video by embedding the foreground video into the second background; and
in response to a determination to not embed the foreground video, creating the output video by using the second background without embedding the foreground video.
4 Assignments
0 Petitions
Accused Products
Abstract
A color image and a depth image of a live video are received. Each of the color image and the depth image are processed to identify the foreground and the background of the live video. The background of the live video is removed in order to create a foreground video that comprises the foreground of the live video. A control input may be received to control the embedding of the foreground video into a second background from a background feed. The background feed may also comprise virtual objects such that the foreground video may interact with the virtual objects.
-
Citations
26 Claims
-
1. A method for selectively embedding a foreground video into a background feed, the method comprising:
-
receiving, using a computer, depth and color information of a first video from at least one camera; creating a foreground video by identifying a foreground portion and a background portion of the first video based on the depth and color information of the first video, the creation of the foreground video comprising an inclusion of the foreground portion of the first video and a removal of the background portion of the first video; receiving the background feed comprising a second background; detecting, in the foreground video, a control input from a user; determining, based on the control input, whether or not to embed the foreground video into the second background; in response to a determination to embed the foreground video, creating an output video by embedding the foreground video into the second background; and in response to a determination to not embed the foreground video, creating the output video by using the second background without embedding the foreground video. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9)
-
-
10. A system for selectively embedding a foreground video into a background feed, the system comprising:
-
at least one computer; and a non-transitory computer readable medium having stored thereon one or more programs, which when executed by the at least one computer, cause the at least one computer to; receive depth and color information of a first video from at least one camera; create a foreground video by identifying a foreground portion and a background portion of the first video based on the depth and color information of the first, the creation of the foreground video comprising an inclusion of the foreground portion of the first video and a removal of the background portion of the first video; receive the background feed comprising a second background; detect, in the foreground video, a control input from a user; determine, based on the control input, whether or not to embed the foreground video into the second background; in response to a determination to embed the foreground video, create an output video by embedding the foreground video into the second background; and in response to a determination to not embed the foreground video create the output video by using the second background without embedding the foreground video. - View Dependent Claims (11, 12, 13, 14, 15, 16, 17, 18)
-
-
19. A non-transitory computer readable medium carrying one or more instructions for selectively embedding a foreground video into a background feed, wherein the one or more instructions, when executed by one or more processors, cause the one or more processors to perform the steps of:
-
receiving depth and color information of a first video from at least one camera; creating a foreground video by identifying a foreground portion and a background portion of the first video based on the depth and color information of the first video, the creation of the foreground video comprising an inclusion of the foreground portion of the first video and a removal of the background portion of the first video; receiving the background feed comprising a second background; detecting, in the foreground video, a control input from a user; determining, based on the control input, whether or not to embed the foreground video into the second background; in response to a determination to embed the foreground video, creating an output video by embedding the foreground video into the second background; and in response to a determination to not embed the foreground video, creating the output video by using the second background without embedding the foreground video. - View Dependent Claims (20, 21, 22, 23, 24, 25, 26)
-
Specification