System, method and apparatus for multipoint video transmission

• US 9,210,302 B1
• Filed: 08/10/2011
• Issued: 12/08/2015
• Est. Priority Date: 08/10/2011
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google Inc. (Alphabet Inc.)
• Inventors: Holmer, Stefan, Lundin, Henrik Fahlberg, Westin, Patrik
• Primary Examiner(s): Pe, Geepy
• Assistant Examiner(s): Joisil, Berteau
• Application Number:
  US13/206,791
• Time in Patent Office: 1,581 Days
• Field of Search: 375/240, 370/260, 382/238
• US Class Current: 1/1
• CPC Class Codes: H04N 19/10 using adaptive coding
• CPC Class Codes: H04N 19/102 characterised by the element, parameter or selection affected or controlled by the adaptive coding
• CPC Class Codes: H04N 19/103 Selection of coding mode or of prediction mode
• CPC Class Codes: H04N 19/115 Selection of the code volume for a coding unit prior to coding
• CPC Class Codes: H04N 19/12 Selection from among a plurality of transforms or standards, e.g. selection between discrete cosine transform [DCT] and sub-band transform or selection between H.263 and H.264
• CPC Class Codes: H04N 19/124 Quantisation
• CPC Class Codes: H04N 19/146 Data rate or code amount at the encoder output
• CPC Class Codes: H04N 19/154 Measured or subjectively estimated visual quality after decoding, e.g. measurement of distortion use of rate-distortion criteria H04N19/147
• CPC Class Codes: H04N 19/187 the unit being a scalable video layer
• CPC Class Codes: H04N 19/30 using hierarchical techniques, e.g. scalability H04N19/63 takes precedence
• CPC Class Codes: H04N 19/37 with arrangements for assigning different transmission priorities to video input data or to video coded data
• CPC Class Codes: H04N 19/63 using sub-band based transform, e.g. wavelets
• CPC Class Codes: H04N 5/147 Scene change detection

Abstract

Disclosed herein is a method of transmitting a video bitstream to a first and at least a second endpoint with varying bandwidth capacities including identifying bandwidth capacities of the first and second endpoints, the second endpoint having less bandwidth capacity than the first endpoint, encoding at least a portion of the video bitstream to generate at least one version of a first data partition and a plurality of versions of at least a second data partition, the plurality of versions of the second data partition including at least one high quality version and at least one low quality version of the second data partition, transmitting the at least one version of the first partition and the at least one high quality version of the second partition to the first endpoint and transmitting the at least one low quality version of the second partition to the second endpoint.

Claims

1. A method of transmitting a video bitstream to a first endpoint and at least a second endpoint with varying bandwidth capacities, comprising:

separating a portion of the video bitstream into a first data partition and a second data partition, wherein the first data partition has prediction information for the portion of the video bitstream and the second data partition includes residual data information for the portion of the video bitstream;

encoding the first data partition as encoded common data;

encoding the second data partition as encoded high quality data at a first bitrate;

encoding the second data partition as encoded low quality data at a second bitrate that is less than the first bitrate;

transmitting a single copy of the encoded common data to an intermediary point that duplicates the encoded common data and transmits the encoded common data to the first endpoint and the second endpoint;

transmitting the encoded high quality data to the first endpoint; and

transmitting the encoded low quality data to the second endpoint,

wherein the encoded common data and the encoded high quality data are combinable by a decoding process at the first endpoint to define a high quality representation of the portion of the video bitstream, the encoded common data and the encoded low quality data are combinable by a decoding process at the second endpoint to define a low quality representation of the portion of the video bitstream, and the encoded common data cannot be decoded to define a representation of the video bitstream without at least one of the encoded high quality data or the encoded low quality data.

2. The method of claim 1, wherein the prediction information includes motion vectors and prediction modes.

3. The method of claim 1, wherein the encoded common data is a first version of the first data partition and the first version of the first data partition is the only version of the first data partition generated.

4. The method of claim 1, wherein the encoded common data is a first version of the first data partition, the method further comprising:

down-sampling the first version of the first data partition to form a second version of the first data partition, the second version of the first data partition having a resolution less than an original resolution of the first version of the first data partition; and

using the second version of the first data partition to generate the at least one low quality version of the second data partition.

5. The method of claim 4, further comprising:

transmitting the first version and not the second version of the first data partition to an intermediary point.

6. The method of claim 1, wherein encoding the second data partition as encoded low quality data comprises:

reducing an amount of data in the encoded low quality data.

7. The method of claim 6, wherein reducing the amount of data includes at least one of increasing quantization size, down-sampling and frame-dropping.

8. The method of claim 1, wherein encoding the second data partition as encoded high quality data is performed using a first set of quantization levels and encoding the second data partition as encoded low quality data is performed using a second set of quantization levels, wherein the number of quantization levels in the first set are greater than the number of quantization levels in the second set.

19. The method of claim 1, further comprising:

identifying bandwidth capacities of the first endpoint and the second endpoint, the second endpoint having less bandwidth capacity than the first endpoint.

9. An apparatus for transmitting a video bitstream to a first endpoint and at least a second endpoint with varying bandwidth capacities, comprising:

a memory;

at least one processor configured to execute instructions stored in the memory to;

separate a portion of the video bitstream into a first data partition and a second data partition, wherein the first data partition has prediction information for the portion of the video bitstream and the second data partition includes residual data information for the portion of the video bitstream;

encode the first data partition as encoded common data;

encode the second data partition as encoded high quality data at a first bitrate;

encode the second data partition as encoded low quality data at a second bitrate that is less than the first bitrate;

transmit a single copy of the encoded common data to an intermediary point that duplicates the encoded common data and transmits the encoded common data to the first endpoint and the second endpoint;

transmit and the encoded high quality data to the first endpoint; and

transmit and the encoded low quality data to the second endpoint,

wherein the encoded common data and the encoded high quality data are combinable by a decoding process at the first endpoint to define a high quality representation of the portion of the video bitstream, the encoded common data and the encoded low quality data are combinable by a decoding process at the second endpoint to define a low quality representation of the portion of the video bitstream, and the encoded common data cannot be decoded to define a representation of the video bitstream without at least one of the encoded high quality data or the encoded low quality data.

10. The apparatus of claim 9, wherein the prediction information includes motion vectors and prediction modes.

11. The apparatus of claim 9, wherein the encoded common data is a first version of the first data partition and the first version of the first data partition is the only version of the first data partition generated.

12. The apparatus of claim 9, wherein the encoded common data is a first version of the first data partition, and the at least one processor is further configured to execute instructions stored in the memory to:

down-sample the first version of the first data partition to form a second version of the first data partition, the second version of the first data partition having a resolution less than an original resolution of the first version of the first data partition; and

use the second version of the first data partition to generate the at least one low quality version of the second data partition.

13. The apparatus of claim 9, wherein the at least one processor is further configured to execute instructions stored in the memory to:

reduce an amount of data in the encoded low quality data.

14. The apparatus of claim 9, wherein the processor encodes the second data partition as encoded high quality data using a first set of quantization levels and the processor encodes the second data partition as encoded low quality data using a second set of quantization levels, wherein the number of quantization levels in the first set are greater than the number of quantization levels in the second set.

20. The apparatus of claim 9, wherein the at least one processor is further configured to execute instructions stored in the memory to:

identify bandwidth capacities of the first endpoint and the second endpoint, the second endpoint having less bandwidth capacity than the first endpoint.

15. A method of transmitting a portion of a video bitstream that has been partitioned into a first data partition that includes prediction information for the portion of the video bitstream and at least a second data partition that includes residual data information for the portion of the video bitstream, the video bitstream to be sent to a first endpoint and at least a second endpoint with varying bandwidth capacities, comprising:

receiving, from a sending endpoint, a single copy of an encoded version of the first data partition as encoded common data;

receiving, from the sending endpoint, an encoded version of the second data partition as encoded high quality data at a first bitrate;

receiving, from the sending endpoint, an encoded version of the second data partition as encoded low quality data at a second bitrate that is less than the first bitrate;

duplicating the single copy of the encoded common data as a first copy of the encoded common data and a second copy of the encoded common data;

transmitting the first copy of the encoded common data to the first endpoint;

transmitting the second copy of the encoded common data to the second endpoint;

transmitting the encoded high quality data to the first endpoint; and

transmitting the encoded low quality data to the second endpoint,

wherein the encoded common data and the encoded high quality data are combinable by a decoding process at the first endpoint to define a high quality representation of the portion of the video bitstream, the encoded common data and the encoded low quality data are combinable by a decoding process at the second endpoint to define a low quality representation of the portion of the video bitstream, and the encoded common data cannot be decoded to define a representation of the video bitstream without at least one of the encoded high quality data or the encoded low quality data.

16. The method of claim 15, wherein the encoded common data is a first version of the first data partition, the method further comprising:

down-sampling the first version of the first data partition to form a second version of the first data partition; and

transmitting the second version of the first data partition to the second endpoint.

17. A system for transmitting a video bitstream to endpoints with varying bandwidth capacities, comprising:

a first endpoint;

a second endpoint; and

a third endpoint configured to;

separate a portion of the video bitstream into a first data partition and a second data partition, wherein the first data partition has prediction information for the portion of the video bitstream and the second data partition includes residual data information for the portion of the video bitstream,

encode the first data partition as encoded common data,

encode the second data partition as encoded high quality data at a first bitrate,

encode the second data partition as encoded low quality data at a second bitrate that is less than the first bitrate,

transmit a single copy of the encoded common data to an intermediary point that duplicates the encoded common data and transmits the encoded common data to the first endpoint and the second endpoint,

transmit the encoded high quality data to the first endpoint, and

transmit the encoded low quality data to the second endpoint,

wherein the encoded common data and the encoded high quality data are combinable by a decoding process at the first endpoint to define a high quality representation of the portion of the video bitstream, the encoded common data and the encoded low quality data are combinable by a decoding process at the second endpoint to define a low quality representation of the portion of the video bitstream, and the encoded common data cannot be decoded to define a representation of the video bitstream without at least one of the encoded high quality data or the encoded low quality data.

18. The system of claim 17, wherein the second endpoint has less bandwidth capacity than the first endpoint.