Joint transmission of multiple multimedia streams

• US 8,204,079 B2
• Filed: 10/28/2002
• Issued: 06/19/2012
• Est. Priority Date: 10/28/2002
• Status: Active Grant

• Current Assignee: Qualcomm, Inc.
• Original Assignee: Qualcomm, Inc.
• Inventors: Gardner, William R., Lane, Richard D.
• Primary Examiner(s): Sam, Phirin
• Assistant Examiner(s): LEE, ANDREW CHUNG CHEUNG
• Application Number:
  US10/282,797
• Publication Number:
  US 20040081198A1
• Time in Patent Office: 3,522 Days
• Field of Search: 370/538, 370/235, 370/236, 370/477, 370/469, 375/240.01, 375/240.02, 364/514, 364/715.02
• US Class Current: 370/469
• CPC Class Codes: H04L 65/70 Media network packetisation
• CPC Class Codes: H04N 21/234327 by decomposing into layers, e.g. base layer and one or more enhancement layers
• CPC Class Codes: H04N 21/2385 Channel allocation H04N21/266 takes precedence; Bandwidth allocation H04N21/24 takes precedence ; allocation of channels according to the instantaneous demands of the users in time-division multiplex systems H04J3/1682; admission control, resource allocation in open networks H04L12/5692; arrangements for maintenance or administration in data switching networks involving bandwidth and capacity management H04L41/0896; negotiating bandwidth in wireless networks H04W28/16
• CPC Class Codes: H04N 7/52 Systems for transmission of a pulse code modulated video signal with one or more other pulse code modulated signals, e.g. an audio signal or a synchronizing signal assembling of a multiplex stream by combining a video stream with other content or additional data, remultiplexing of multiplex streams, insertion of stuffing bits into the multiplex stream, assembling of a packetised elementary stream at server side H04N21/236; disassembling of a multiplex stream, remultiplexing of multiplex streams, extraction or processing of Service Information, disassembling of packetised elementary stream at client side H04N21/434

Abstract

A system and method for partitioning a bandwidth of a single channel among plural multimedia streams in a time varying manner. The partitioning is undertaken by dynamically establishing first and second bit rates respectively associated with first and second multimedia streams.

Claims

1. A method for multimedia data transmission, comprising:

pooling, by a computer, at least first and second multimedia data streams together in a single channel, wherein each stream defines a respective sequence of frames and each frame includes at least a base layer and at least one enhancement layer;

dynamically establishing, by the computer, first and second bit rates respectively associated with the first and second streams;

dynamically selecting, by the computer, from a group of all enhancement layers for all streams, at least one enhancement layer for omission from the channel for at least some frames; and

transmitting, by a transmitter, the at least first and second streams on the channel.

2. The method of claim 1, wherein the channel is one of:

a broadcast channel, a multicast channel, and a unicast channel.

3. The method of claim 1, wherein the act of dynamically selecting is undertaken using at least one quality of service (QOS) metric.

4. The method of claim 3, wherein the at least one QOS metric is a signal-to-noise ratio.

5. The method of claim 3, wherein the enhancement layer selected for omission is selected so as to provide a minimum QOS to each stream.

6. The method of claim 3, wherein the layer selected for omission is selected based on a relative importance of the respective data stream.

7. The method of claim 1, wherein each stream is constituted using an MPEG principle.

8. The method of claim 1, wherein the streams are quantized jointly.

9. The method of claim 8, further comprising evaluating, by the computer, a benefit of adding bits to the stream for each stream during quantization.

10. The method of claim 9, wherein dynamically establishing the first and second bit rates is based at least partially on the evaluating act.

11. The method of claim 1, wherein the bit rates are established to provide surplus channel bandwidth useful for sending ancillary data.

12. A tangible computer readable medium comprising computer-executable instructions for execution on a computer to perform a method comprising:

pooling at least first and second multimedia data streams together in a single channel, wherein each stream defines a respective sequence of frames and each frame includes at least a base layer and at least one enhancement layer;

dynamically establishing first and second bit rates respectively associated with the first and second streams;

dynamically selecting, from a group of all enhancement layers for all streams, at least one enhancement layer for omission from the channel for at least some frames; and

transmitting the at least first and second streams on the channel.

13. The non-transitory computer readable storage medium of claim 12, wherein the channel is at least one of:

a broadcast channel, a multicast channel, and a unicast channel.

14. The non-transitory computer readable storage medium of claim 12, wherein dynamically selecting includes using at least one quality of service (QOS) metric.

15. The non-transitory computer readable storage medium of claim 14, wherein the enhancement layer selected for omission is the layer providing the highest overall QOS to its respective stream among the enhancement layers.

16. The non-transitory computer readable storage medium of claim 12, wherein each stream is constituted using MPEG principles.

17. The non-transitory computer readable storage medium of claim 12, wherein the streams are quantized jointly, and, during quantization, evaluating for each stream a benefit of adding bits to the stream.

18. The non-transitory computer readable storage medium of claim 17, wherein dynamically establishing first and second bit rates at least in part depends on the evaluating of the benefit of adding bits to each stream.

19. The non-transitory computer readable storage medium of claim 12, wherein the bit rates are established to provide surplus channel bandwidth useful for sending ancillary data.

20. The non-transitory computer readable storage medium of claim 12, wherein the method uses at least one relative importance metric.

21. The non-transitory computer readable storage medium of claim 12, wherein the enhancement layer selected for omission is the layer used for enhancing a less important multimedia stream.

22. A system for transmitting at least first and second multimedia streams in a single channel, comprising:

means for establishing a first bit rate for the first stream during a first frame of the first stream;

means for establishing a second bit rate for the first stream during a second frame of the first stream, the first and second bit rates being different from each other;

means for pooling the at least first and second multimedia data streams together in a single channel;

means for dynamically establishing first and second bit rates respectively associated with the first and second streams, wherein each stream defines a respective sequence of frames and each frame includes at least a base layer and at least one enhancement layer;

means for dynamically selecting, from a group of all enhancement layers for all streams, at least one enhancement layer for omission from the channel for at least some frames; and

means for transmitting the at least first and second streams on the channel.

23. The system of claim 22, wherein the means for dynamically selecting includes means for using at least one quality of service (QOS) metric.

24. The system of claim 23, wherein the metric is a signal-to-noise ratio.

25. The system of claim 22, wherein the streams are quantized jointly, and further comprising:

means for, during quantization, evaluating a benefit of adding bits to each stream.

26. The system of claim 22, wherein the bit rates are established to provide surplus channel bandwidth useful for sending ancillary data.

27. The system of claim 22, wherein the means for dynamically selecting comprises means for using at least one relative importance metric.

28. A system for multimedia data transmission, comprising:

a computer configured to pool at least first and second multimedia data streams together in a single channel, wherein each stream defines a respective sequence of frames and each frame includes at least a base layer and at least one enhancement layer, dynamically establish first and second bit rates respectively associated with the first and second streams, and to dynamically select, from a group of all enhancement layers for all streams, at least one enhancement layer for omission from the channel produced by the stream combiner for at least some frames; and

a transmitter configured to transmit the at least first and second streams.

29. The system of claim 28, wherein the computer is configured to select the least one enhancement layer for omission from the channel using at least one quality of service (QOS) metric.

30. The method of claim 28, wherein the computer is configured to select the at least one enhancement layer for omission to provide a minimum QOS to each stream.

31. The system of claim 28, wherein each stream is constituted using an MPEG principle.

32. The system of claim 28, further comprising a quantizer configured to quantize the streams jointly.

33. The system of claim 32, wherein the quantizer is further configured to evaluate benefit of adding bits to each stream.

34. The system of claim 28, wherein the bit rates are established to provide surplus channel bandwidth useful for sending ancillary data.

35. The system of claim 28, wherein the layer selected for omission is selected based on a relative importance of the respective data stream.