Transmitting video and sharing content via a network using multiple encoding techniques

• US 9,386,303 B2
• Filed: 12/31/2013
• Issued: 07/05/2016
• Est. Priority Date: 12/31/2013
• Status: Active Grant

• Current Assignee: Personify Incorporated (Wilson Human Capital Group, Inc.)
• Original Assignee: Personify Incorporated (Wilson Human Capital Group, Inc.)
• Inventors: Nguyen, Quang, Truong, Long, Do, Minh, Lin, Dennis, Kowshik, Sumant, Patel, Sanjay
• Primary Examiner(s): Patel, Jayesh A
• Application Number:
  US14/145,151
• Publication Number:
  US 20150186744A1
• Time in Patent Office: 917 Days
• Field of Search: None
• US Class Current: 1/1
• CPC Class Codes: H04N 19/00 Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
• CPC Class Codes: H04N 19/124 Quantisation
• CPC Class Codes: H04N 19/162 User input
• CPC Class Codes: H04N 19/17 the unit being an image region, e.g. an object
• CPC Class Codes: H04N 19/186 the unit being a colour or a chrominance component
• CPC Class Codes: H04N 19/21 with binary alpha-plane coding for video objects, e.g. context-based arithmetic encoding [CAE]
• CPC Class Codes: H04N 19/46 Embedding additional information in the video signal during the compression process H04N19/517, H04N19/68, H04N19/70 take precedence

Abstract

Embodiments disclose systems and methods for transmitting user-extracted video and content more efficiently by recognizing that user-extracted video provides the potential to treat parts of a single frame of a user-extracted video differently. An alpha mask of the image part of the user-extracted video is used when encoding the image part so that it retains a higher quality upon transmission than the remainder of the user-extracted video.

Claims

1. A computer-implemented method comprising:

obtaining, with at least one computer, video data that comprises a defined foreground and a defined background;

obtaining, with the at least one computer, an alpha mask for the video data, wherein the alpha mask identifies the defined foreground and the defined background;

selecting, with the at least one computer, a chroma-key color, and modifying the defined background to be the same color as the selected chroma-key color, wherein the selected chroma-key color is a selected color not found in the defined foreground of a first frame of the video data, and when the defined foreground of a later frame of the video data includes the selected color, selecting a new color that is not found in the defined foreground of the later frame to be the chroma-key color;

encoding, with the at least one computer, the video data, wherein the encoding uses the alpha mask to encode the defined foreground using a first encoding type and the defined background using a second encoding type; and

sending, using the at least one computer, the encoded video data to at least one receiving computer.

2. The method of claim 1, further comprising selecting, with the at least one computer, content, wherein the defined background is at least a portion of the selected content.

3. The method of claim 1, further comprising:

decoding, with the at least one receiving computer, the sent encoded video data;

re-generating, with the at least one receiving computer, the alpha mask by dechroma-keying the decoded video data;

determining, with the at least one receiving computer, an alpha value for a pixel of a frame of the decoded video data using the re-generated alpha mask; and

displaying, with the at least one receiving computer, a pixel color of the pixel of the frame based at least in part on the alpha value.

4. The method of claim 3, wherein displaying the pixel color of the pixel of the frame comprises blending the pixel color of the pixel of the frame with a content-pixel color based at least in part on the alpha value.

5. The method of claim 1, wherein the first encoding type comprises quantizing with a first number of bits and the second encoding type comprises quantizing with a second number of bits, and wherein the first number is greater than the second number.

6. The method of claim 1, further comprising:

receiving, using the at least one computer, second encoded video data from the at least one receiving computer;

decoding, with the at least one computer, the second encoded video data; and

displaying, with the at least one computer, the video data combined with the decoded second video data.

7. The method of claim 1, further comprising, sending, with the at least one computer, control information to the at least one receiving computer, the control information indicating at least one of a current chroma-key color, the first encoding type, the second encoding type, display-background preferences, volume preferences, and display-synchronization information.

8. A non-transitory computer readable storage medium storing one or more programs, the one or more programs comprising instructions for:

obtaining, with at least one computer, video data that comprises a defined foreground and a defined background;

obtaining, with the at least one computer, an alpha mask for the video data, wherein the alpha mask identifies the defined foreground and the defined background;

selecting, with the at least one computer, a chroma-key color, and modifying the defined background to be the same color as the selected chroma-key color, wherein the chroma-key color is a selected color that is not found in the defined foreground of a first frame of the video data, and when the defined foreground of a later frame of the video data includes the selected color, selecting a color that is not found in the defined foreground of the later frame to be the chroma-key color;

encoding, with the at least one computer, the video data, wherein the encoding uses the alpha mask to encode the defined foreground using a first encoding type and the defined background using a second encoding type; and

sending, using the at least one computer, the encoded video data to at least one receiving computer.

9. The non-transitory computer readable storage medium of claim 8, further comprising instructions for selecting, with the at least one computer, content, wherein the defined background is at least a portion of the selected content.

10. The non-transitory computer readable storage medium of claim 8, wherein the first encoding type comprises quantizing with a first number of bits and the second encoding type comprises quantizing with a second number of bits, and wherein the first number is greater than the second number.

11. The non-transitory computer readable storage medium of claim 8, the storage medium comprising further instructions for:

receiving, using the at least one computer, second encoded video data from the at least one receiving computer;

decoding, with the at least one computer, the second encoded video data; and

displaying, with the at least one computer, the video data combined with the decoded second video data.

12. The non-transitory computer readable storage medium of claim 8, further comprising instructions for sending, with the at least one computer, control information to the at least one receiving computer, the control information indicating at least one of a current chroma-key color, the first encoding type, the second encoding type, display-background preferences, volume preferences, and display-synchronization information.

13. A system comprising:

at least one computer; and

a non-transitory computer readable medium having stored thereon one or more programs, which when executed by the at least one computer, cause the at least one computer to;

obtain video data that comprises a defined foreground and a defined background;

obtain an alpha mask for the video data, wherein the alpha mask identifies the defined foreground and the defined background;

select a chroma-key color, and modify the defined background to be the same color as the selected chroma-key color, wherein the chroma-key color is a selected color not found in the defined foreground of a first frame of the video data, and when the defined foreground of a later frame of the video data includes the selected color, selecting a color that is not found in the defined foreground of the later frame to be the chroma-key color;

encode the video data, wherein the encoding uses the alpha mask to encode the defined foreground using a first encoding type and the defined background using a second encoding type; and

send the encoded video data to at least one receiving computer.

14. The system of claim 13, further comprising programs, which when executed by the at least one computer, cause the at least one computer to select content, wherein the defined background is at least a portion of the selected content.

15. The system of claim 13, further comprising the at least one receiving computer, the system further comprising programs, which when executed by the at least one receiving computer, cause the at least one receiving computer to:

decode the sent encoded video data;

re-generate the alpha mask by dechroma-keying the decoded video data;

determine an alpha value for a pixel of a frame of the decoded video data using the re-generated alpha mask; and

display a pixel color of the pixel of the frame based at least in part on the alpha value.

16. The system of claim 15, wherein the programs further cause the at least one receiving computer to blend the pixel color of the pixel of the frame with a content-pixel color based at least in part on the alpha value.

17. The system of claim 13, wherein the programs further cause the at least one computer to encode the video data by quantizing the defined foreground with a first number of bits and quantizing the defined background with a second number of bits, and wherein the first number of bits is greater than the second number of bits.

18. The system of claim 13, further comprising programs, which when executed by the at least one computer, cause the at least one computer to send control information to the at least one receiving computer, the control information indicating at least one of a current chroma-key color, the first encoding type, the second encoding type, display-background preferences, volume preferences, and display-synchronization information.