Joint transmission of multiple multimedia streams

• US 9,065,884 B2
• Filed: 05/04/2012
• Issued: 06/23/2015
• Est. Priority Date: 10/28/2002
• Status: Active Grant

• Current Assignee: Qualcomm, Inc.
• Original Assignee: Qualcomm, Inc.
• Inventors: Gardner, William R., Lane, Richard D.
• Primary Examiner(s): Lai, Andrew
• Assistant Examiner(s): LEE, ANDREW CHUNG CHEUNG
• Application Number:
  US13/464,827
• Publication Number:
  US 20120219013A1
• Time in Patent Office: 1,145 Days
• Field of Search: 370/538, 370/235, 370/236, 370/468, 370/469, 370/477, 375/240.1, 375/240.02, 364/514
• US Class Current: 1/1
• CPC Class Codes: H04L 65/70 Media network packetisation
• CPC Class Codes: H04N 21/234327 by decomposing into layers, e.g. base layer and one or more enhancement layers
• CPC Class Codes: H04N 21/2385 Channel allocation H04N21/266 takes precedence; Bandwidth allocation H04N21/24 takes precedence ; allocation of channels according to the instantaneous demands of the users in time-division multiplex systems H04J3/1682; admission control, resource allocation in open networks H04L12/5692; arrangements for maintenance or administration in data switching networks involving bandwidth and capacity management H04L41/0896; negotiating bandwidth in wireless networks H04W28/16
• CPC Class Codes: H04N 7/52 Systems for transmission of a pulse code modulated video signal with one or more other pulse code modulated signals, e.g. an audio signal or a synchronizing signal assembling of a multiplex stream by combining a video stream with other content or additional data, remultiplexing of multiplex streams, insertion of stuffing bits into the multiplex stream, assembling of a packetised elementary stream at server side H04N21/236; disassembling of a multiplex stream, remultiplexing of multiplex streams, extraction or processing of Service Information, disassembling of packetised elementary stream at client side H04N21/434

Abstract

A system and method for multimedia data transmission including pooling, by a computer, at least first and second multimedia data streams together in a single channel, wherein each stream defines a respective sequence of frames and each frame includes at least a base layer and at least one enhancement layer; dynamically establishing, by the computer, first and second bit rates respectively associated with the first and second streams; and transmitting, by a transmitter, the at least first and second streams on the channel.

Claims

1. A method for multimedia data transmission, comprising:

pooling, by a computer, at least first and second multimedia data streams together in a single channel, wherein each of the at least first and second multimedia data streams defines a respective sequence of frames and each frame includes at least a base layer and at least one enhancement layer;

dynamically establishing, by the computer, a first bit rate for the first multimedia data stream comprising a first base layer and at least one first enhancement layer and a second bit rate for the second multimedia data stream comprising a second base layer and at least one second enhancement layer, wherein one of the first bit rate and the second bit rate is established, at each stage of quantization, based on an evaluation of both the first multimedia data stream and the second multimedia data stream, wherein the evaluation of both the first multimedia data stream and the second multimedia data stream comprises evaluating, by the computer, a benefit of adding bits to each of the at least first and second multimedia data streams during the each stage of quantization; and

transmitting, by a transmitter, the at least first and second multimedia data streams on the channel.

2. The method of claim 1, wherein the channel is one of:

a broadcast channel, a multicast channel, and a unicast channel.

3. The method of claim 1, wherein either the first or second multimedia data stream is constituted using an MPEG principle.

4. The method of claim 1, wherein the at least first and second multimedia data streams are quantized jointly.

5. The method of claim 1, wherein dynamically establishing the first and second bit rates is based at least partially on the evaluation.

6. The method of claim 1, wherein the first and second bit rates are established to provide surplus channel bandwidth useful for sending ancillary data.

7. The method of claim 1, wherein the evaluating, by the computer, the benefit of adding bits to each of the at least first and second multimedia data streams during the each stage of quantization is further based on a quality of service metric.

8. The method of claim 1, wherein the evaluating, by the computer, the benefit of adding bits to each of the at least first and second multimedia data streams during the each stage of quantization is further based on a bandwidth of the channel.

9. A non-transitory computer readable storage medium comprising computer-executable instructions for execution by a processor on a computer to perform method steps comprising:

pooling at least first and second multimedia data streams together in a single channel, wherein each of the at least first and second multimedia data streams defines a respective sequence of frames and each frame includes at least a base layer and at least one enhancement layer;

dynamically establishing a first bit rate for the first multimedia data stream comprising a first base layer and at least one first enhancement layer and a second bit rate for the second multimedia data stream comprising a second base layer and at least one second enhancement layer, wherein one of the first bit rate and the second bit rate is established, at each stage of quantization, based on an evaluation of both the first multimedia data stream and the second multimedia data stream, wherein the evaluation of both the first multimedia data stream and the second multimedia data stream comprises an evaluation of a benefit of adding bits to each of the at least first and second multimedia data streams during the each stage of quantization; and

transmitting the at least first and second multimedia data streams on the channel.

10. The non-transitory computer readable storage medium of claim 9, wherein the channel is at least one of:

a broadcast channel, a multicast channel, and a unicast channel.

11. The non-transitory computer readable storage medium of claim 9, wherein either the first or second multimedia data stream is constituted using MPEG principles.

12. The non-transitory computer readable storage medium of claim 9, wherein dynamically establishing the first and second bit rates at least in part depends on the evaluation.

13. The non-transitory computer readable storage medium of claim 9, wherein the first and second bit rates are established to provide surplus channel bandwidth useful for sending ancillary data.

14. The non-transitory computer readable storage medium of claim 9, wherein the method uses at least one relative importance metric.

15. A system for multimedia data transmission, comprising:

a computer configured to pool at least first and second multimedia data streams together in a single channel, wherein each of the at least first and second multimedia data streams defines a respective sequence of frames and each frame includes at least a base layer and at least one enhancement layer, and

dynamically establish a first bit rate for the first multimedia data stream comprising a first base layer and at least one first enhancement layer and a second bit rate for the second multimedia data stream comprising a second base layer and at least one second enhancement layer, wherein one of the first bit rate and the second bit rate is established, at each stage of quantization, based on an evaluation of both the first multimedia data stream and the second multimedia data stream, wherein the evaluation of both the first multimedia data stream and the second multimedia data stream comprises an evaluation of a benefit of adding bits to each of the at least first and second multimedia data streams during the each stage of quantization; and

a transmitter configured to transmit the at least first and second multimedia data streams.

16. The system of claim 15, wherein either the first or second multimedia data stream is constituted using an MPEG principle.

17. The system of claim 15, further comprising a quantizer configured to quantize the at least first and second multimedia data streams jointly.

18. The system of claim 15, wherein the first and second bit rates are established to provide surplus channel bandwidth useful for sending ancillary data.