Managing video adaptation algorithms

• US 8,537,699 B2
• Filed: 04/08/2010
• Issued: 09/17/2013
• Est. Priority Date: 06/16/2009
• Status: Active Grant

• Current Assignee: Qualcomm, Inc.
• Original Assignee: Qualcomm, Inc.
• Inventors: Leung, Nikolai K.
• Primary Examiner(s): HAN, CLEMENCE S
• Application Number:
  US12/756,495
• Publication Number:
  US 20100316066A1
• Time in Patent Office: 1,258 Days
• Field of Search: None
• US Class Current: 370/252
• CPC Class Codes: H04N 21/44209 Monitoring of downstream path of the transmission network originating from a server, e.g. bandwidth variations of a wireless network arrangements for maintenance or administration in data switching networks involving bandwidth and capacity management H04L41/0896
• CPC Class Codes: H04N 21/6336 directed to decoder
• CPC Class Codes: H04N 21/6373 for rate control , e.g. request to the server to modify its transmission rate flow control in packet networks H04L47/10
• CPC Class Codes: H04N 21/6379 directed to encoder , e.g. for requesting a lower encoding rate
• CPC Class Codes: H04N 21/64738 Monitoring network characteristics, e.g. bandwidth, congestion level data switched network analysis H04L41/14; monitoring functioning in data switched networks H04L43/0817; flow control in packet networks H04L47/10
• CPC Class Codes: H04N 21/64769 for rate control flow control in packet networks H04L47/10
• CPC Class Codes: H04N 21/64792 Controlling the complexity of the content stream, e.g. by dropping packets intermediate media network packet handling H04L65/765; proxy provisioning conversion or adaptation for reducing the amount or size of exchanged application data H04L67/5651; negotiation of resources in wireless networks H04W28/16

Abstract

Techniques are described for controlling the operation of a dynamic rate adaptation algorithm by modifying control parameters exposed by the dynamic rate adaptation algorithm. In one aspect, an apparatus comprises a rate adaptation module comprising a plurality of control parameters. The rate adaptation module monitors conditions of a network and adjusts a coding rate of a media encoder based on the network conditions and the plurality of control parameters. Each of the plurality of control parameters specifies a threshold value or a timing value that controls a response of the rate adaptation algorithm to the network conditions. The apparatus also comprises a client that receives a value for a first one of the plurality of control parameters and sets the first control parameter to the received value.

Claims

1. A method comprising:

receiving, by a media device, a value for a first one of a plurality of control parameters for a rate adaptation algorithm, wherein the rate adaptation algorithm monitors conditions of a network and adjusts a coding rate of a media encoder based on the network conditions and the plurality of control parameters, wherein each of the plurality of control parameters specifies a threshold value or a timing value that controls a response of the rate adaptation algorithm to the network conditions, wherein the first control parameter is one of a first minimum feedback interval value for decreasing a maximum rate limit and a second minimum feedback interval value for increasing a maximum rate limit; and

setting the first control parameter to the received value.

2. The method of claim 1, wherein the media device comprises a Multimedia Telephony Service for Internet Protocol Multimedia Systems (MTSI) client that comprises the rate adaptation algorithm.

3. The method of claim 1, wherein the plurality of control parameters include a plurality of subsets of service-specific control parameters each associated with one of a plurality of service levels, wherein each of the plurality of service levels defines a different quality of service for a user, and wherein the method further comprises:

operating the media device according to a first one of the plurality of service levels, wherein the rate adaptation algorithm adjusts the coding rate of the media encoder based on the network conditions and a subset of service-specific control parameters associated with the first service level.

4. The method of claim 1,

wherein the media device is a media receiver, and

wherein the rate adaptation algorithm comprises a receiver-side rate adaptation algorithm and adjusts the coding rate of the media encoder by sending feedback to a media transmitter that includes the media encoder, wherein the feedback directs the media transmitter to adjust the coding rate of the media encoder.

5. The method of claim 1,

wherein the media device is a media transmitter that includes the media encoder, and

wherein the rate adaptation algorithm comprises a transmitter-side rate adaptation algorithm.

6. The method of claim 1, wherein the media encoder is a video encoder.

7. The method of claim 1, wherein the first control parameter is one of:

a lower packet loss rate threshold;

an upper packet loss rate threshold;

a first packet loss rate measurement window that specifies a duration of a sliding window over which the rate adaptation algorithm measures the lower packet loss rate threshold; and

a second packet loss rate measurement window that specifies a duration of a sliding window over which the rate adaptation algorithm measures the upper packet loss rate threshold.

8. An apparatus comprising:

a rate adaptation module comprising a plurality of control parameters, wherein the rate adaptation module monitors conditions of a network and adjusts a coding rate of a media encoder based on the network conditions and the plurality of control parameters, wherein each of the plurality of control parameters specifies a threshold value or a timing value that controls a response of the rate adaptation module to the network conditions, wherein the first control parameter is one of a first minimum feedback interval value for decreasing a maximum rate limit and a second minimum feedback interval value for increasing a maximum rate limit; and

a client that receives a value for a first one of the plurality of control parameters and sets the first control parameter to the received value.

9. The apparatus of claim 8, wherein the client comprises a Multimedia Telephony Service for Internet Protocol Multimedia Systems (MTSI) client that comprises the rate adaptation module.

10. The apparatus of claim 8,

wherein the plurality of control parameters include a plurality of subsets of service-specific control parameters each associated with one of a plurality of service levels, wherein each of the plurality of service levels defines a different quality of service for a user,

wherein the rate adaptation module adjusts the coding rate of the media encoder based on the network conditions and a subset of service-specific control parameters associated with a first one of the plurality of service levels.

11. The apparatus of claim 8,

wherein the apparatus is a media receiver, and

wherein the rate adaptation module comprises a receiver-side rate adaptation module and adjusts the coding rate of the media encoder by sending feedback to a media transmitter that includes the media encoder, wherein the feedback directs the media transmitter to adjust the coding rate of the media encoder.

12. The apparatus of claim 8, further comprising the media encoder,

wherein the apparatus is a media transmitter, and

wherein the rate adaptation module comprises a transmitter-side rate adaptation module.

13. The apparatus of claim 8, wherein the media encoder is a video encoder.

14. The apparatus of claim 8, wherein the apparatus comprises a wireless communication device handset.

15. The apparatus of claim 8, wherein the apparatus comprises one or more integrated circuit devices.

16. A device comprising:

means for receiving, by a media device, a value for a first one of a plurality of control parameters for a rate adaptation algorithm, wherein the rate adaptation algorithm monitors conditions of a network and adjusts a coding rate of a media encoder based on the network conditions and the plurality of control parameters, wherein each of the plurality of control parameters specifies a threshold value or a timing value that controls a response of the rate adaptation algorithm to the network conditions, wherein the first control parameter is one of a first minimum feedback interval value for decreasing a maximum rate limit and a second minimum feedback interval value for increasing a maximum rate limit; and

means for setting the first control parameter to the received value.

17. The device of claim 16, wherein the device comprises a Multimedia Telephony Service for Internet Protocol Multimedia Systems (MTSI) client.

18. The device of claim 16, wherein the plurality of control parameters include a plurality of subsets of service-specific control parameters each associated with one of a plurality of service levels, wherein each of the plurality of service levels defines a different quality of service for a user, and wherein the device further comprises:

means for operating the device according to a first one of the plurality of service levels, wherein the rate adaptation algorithm adjusts the coding rate of the media encoder based on the network conditions and a subset of service-specific control parameters associated with the first service level.

19. The device of claim 16,

wherein the device is a media receiver, and

wherein the rate adaptation algorithm comprises a receiver-side rate adaptation algorithm and adjusts the coding rate of the media encoder by sending feedback to a media transmitter that includes the media encoder, wherein the feedback directs the media transmitter to adjust the coding rate of the media encoder.

20. The device of claim 16,

wherein the device is a media transmitter that includes the media encoder, and

wherein the rate adaptation algorithm comprises a transmitter-side rate adaptation algorithm.

21. The device of claim 16, wherein the media encoder is a video encoder.

22. A non-transitory computer-readable storage medium having stored thereon instructions that when executed cause one or more programmable processors to:

receive, by a media device, a value for a first one of a plurality of control parameters for a rate adaptation algorithm, wherein the rate adaptation algorithm monitors conditions of a network and adjusts a coding rate of a media encoder based on the network conditions and the plurality of control parameters, wherein each of the plurality of control parameters specifies a threshold value or a timing value that controls a response of the rate adaptation algorithm to the network conditions, wherein the first control parameter is one of a first minimum feedback interval value for decreasing a maximum rate limit and a second minimum feedback interval value for increasing a maximum rate limit; and

set the first control parameter to the received value.

23. The non-transitory computer-readable storage medium of claim 22, wherein the media device comprises a Multimedia Telephony Service for Internet Protocol Multimedia Systems (MTSI) client that comprises the rate adaptation algorithm.

24. The non-transitory computer-readable storage medium of claim 22, wherein the plurality of control parameters include a plurality of subsets of service-specific control parameters each associated with one of a plurality of service levels, wherein each of the plurality of service levels defines a different quality of service for a user, and further comprising instructions to cause a programmable processor to:

operate the media device according to a first one of the plurality of service levels, wherein the rate adaptation algorithm adjusts the coding rate of the media encoder based on the network conditions and a subset of service-specific control parameters associated with the first service level.

25. The non-transitory computer-readable storage medium of claim 22,

wherein the media device is a media receiver, and

wherein the rate adaptation algorithm comprises a receiver-side rate adaptation algorithm and adjusts the coding rate of the media encoder by sending feedback to a media transmitter that includes the media encoder, wherein the feedback directs the media transmitter to adjust the coding rate of the media encoder.

26. The non-transitory computer-readable storage medium of claim 22,

wherein the media device is a media transmitter that includes the media encoder, and

wherein the rate adaptation algorithm comprises a transmitter-side rate adaptation algorithm.

27. The non-transitory computer-readable storage medium of claim 22, wherein the media encoder is a video encoder.

28. A method comprising:

receiving, by a media device, a value for a first one of a plurality of control parameters for a rate adaptation algorithm, wherein the rate adaptation algorithm monitors conditions of a network and adjusts a coding rate of a media encoder based on the network conditions and the plurality of control parameters, wherein each of the plurality of control parameters specifies a threshold value or a timing value that controls a response of the rate adaptation algorithm to the network conditions, wherein the first control parameter is one of;

a minimum target playout margin that specifies a minimum acceptable time between a media packet arrival and its properly scheduled playout time,

a maximum target playout margin that specifies an upper threshold of time between a media packet arrival and its properly scheduled playout time,

a percentile point value for a packet arrival time distribution that specifies a percentile for measuring a playout margin,

a first target playout window that specifies a duration of a sliding window over which the rate adaptation algorithm observes and calculates a margin between media packet arrivals and playout for the minimum target playout margin, and

a second target playout window that specifies a duration of a sliding window over which the rate adaptation algorithm observes and calculates a margin between media packet arrivals and playout for the maximum target playout margin, and

setting the first control parameter to the received value.

29. An apparatus comprising:

a rate adaptation module comprising a plurality of control parameters, wherein the rate adaptation module monitors conditions of a network and adjusts a coding rate of a media encoder based on the network conditions and the plurality of control parameters, wherein each of the plurality of control parameters specifies a threshold value or a timing value that controls a response of the rate adaptation module to the network conditions, wherein the first control parameter is one of;

a minimum target playout margin that specifies a minimum acceptable time between a media packet arrival and its properly scheduled playout time,

a maximum target playout margin that specifies an upper threshold of time between a media packet arrival and its properly scheduled playout time,

a percentile point value for a packet arrival time distribution that specifies a percentile for measuring a playout margin,

a first target playout window that specifies a duration of a sliding window over which the rate adaptation algorithm observes and calculates a margin between media packet arrivals and playout for the minimum target playout margin, and

a second target playout window that specifies a duration of a sliding window over which the rate adaptation algorithm observes and calculates a margin between media packet arrivals and playout for the maximum target playout margin, and

a client that receives a value for a first one of the plurality of control parameters and sets the first control parameter to the received value.

30. A device comprising:

means for receiving, by a media device, a value for a first one of a plurality of control parameters for a rate adaptation algorithm, wherein the rate adaptation algorithm monitors conditions of a network and adjusts a coding rate of a media encoder based on the network conditions and the plurality of control parameters, wherein each of the plurality of control parameters specifies a threshold value or a timing value that controls a response of the rate adaptation algorithm to the network conditions, wherein the first control parameter is one of;

a minimum target playout margin that specifies a minimum acceptable time between a media packet arrival and its properly scheduled playout time,

a maximum target playout margin that specifies an upper threshold of time between a media packet arrival and its properly scheduled playout time,

a percentile point value for a packet arrival time distribution that specifies a percentile for measuring a playout margin,

a first target playout window that specifies a duration of a sliding window over which the rate adaptation algorithm observes and calculates a margin between media packet arrivals and playout for the minimum target playout margin, and

a second target playout window that specifies a duration of a sliding window over which the rate adaptation algorithm observes and calculates a margin between media packet arrivals and playout for the maximum target playout margin, and

means for setting the first control parameter to the received value.

31. A non-transitory computer-readable storage medium having stored thereon instructions that when executed cause one or more programmable processors to:

receive, by a media device, a value for a first one of a plurality of control parameters for a rate adaptation algorithm, wherein the rate adaptation algorithm monitors conditions of a network and adjusts a coding rate of a media encoder based on the network conditions and the plurality of control parameters, wherein each of the plurality of control parameters specifies a threshold value or a timing value that controls a response of the rate adaptation algorithm to the network conditions, wherein the first control parameter is one of;

a minimum target playout margin that specifies a minimum acceptable time between a media packet arrival and its properly scheduled playout time,

a maximum target playout margin that specifies an upper threshold of time between a media packet arrival and its properly scheduled playout time,

a percentile point value for a packet arrival time distribution that specifies a percentile for measuring a playout margin,

a first target playout window that specifies a duration of a sliding window over which the rate adaptation algorithm observes and calculates a margin between media packet arrivals and playout for the minimum target playout margin, and

a second target playout window that specifies a duration of a sliding window over which the rate adaptation algorithm observes and calculates a margin between media packet arrivals and playout for the maximum target playout margin, and

set the first control parameter to the received value.

32. A method comprising:

receiving, by a media device, a value for a first one of a plurality of control parameters for a rate adaptation algorithm, wherein the rate adaptation algorithm monitors conditions of a network and adjusts a coding rate of a media encoder based on the network conditions and the plurality of control parameters, wherein each of the plurality of control parameters specifies a threshold value or a timing value that controls a response of the rate adaptation algorithm to the network conditions, wherein the first control parameter is one of a decongest value and a decongest time value; and

setting the first control parameter to the received value.

33. An apparatus comprising:

a rate adaptation module comprising a plurality of control parameters, wherein the rate adaptation module monitors conditions of a network and adjusts a coding rate of a media encoder based on the network conditions and the plurality of control parameters, wherein each of the plurality of control parameters specifies a threshold value or a timing value that controls a response of the rate adaptation module to the network conditions, wherein the first control parameter is one of a decongest value and a decongest time value; and

a client that receives a value for a first one of the plurality of control parameters and sets the first control parameter to the received value.

34. A device comprising:

means for receiving, by a media device, a value for a first one of a plurality of control parameters for a rate adaptation algorithm, wherein the rate adaptation algorithm monitors conditions of a network and adjusts a coding rate of a media encoder based on the network conditions and the plurality of control parameters, wherein each of the plurality of control parameters specifies a threshold value or a timing value that controls a response of the rate adaptation algorithm to the network conditions, wherein the first control parameter one of a decongest value and a decongest time value; and

means for setting the first control parameter to the received value.

35. A non-transitory computer-readable storage medium having stored thereon instructions that when executed cause one or more programmable processors to:

receive, by a media device, a value for a first one of a plurality of control parameters for a rate adaptation algorithm, wherein the rate adaptation algorithm monitors conditions of a network and adjusts a coding rate of a media encoder based on the network conditions and the plurality of control parameters, wherein each of the plurality of control parameters specifies a threshold value or a timing value that controls a response of the rate adaptation algorithm to the network conditions, wherein the first control parameter is one of a decongest value and a decongest time value; and

set the first control parameter to the received value.

36. A method comprising:

receiving, by a media device, a value for a first one of a plurality of control parameters for a rate adaptation algorithm, wherein the rate adaptation algorithm monitors conditions of a network and adjusts a coding rate of a media encoder based on the network conditions and the plurality of control parameters, wherein each of the plurality of control parameters specifies a threshold value or a timing value that controls a response of the rate adaptation algorithm to the network conditions, wherein the first control parameter is one of;

a ramp up rate that specifies a rate at which the rate adaptation algorithm is to increase a target encoding rate to a higher rate limit, and

a ramp down rate that specifies a rate at which the rate adaptation algorithm is to decrease the target encoding rate to a lower rate limit, and

setting the first control parameter to the received value.

37. An apparatus comprising:

a rate adaptation module comprising a plurality of control parameters, wherein the rate adaptation module monitors conditions of a network and adjusts a coding rate of a media encoder based on the network conditions and the plurality of control parameters, wherein each of the plurality of control parameters specifies a threshold value or a timing value that controls a response of the rate adaptation module to the network conditions, wherein the first control parameter is one of;

a ramp up rate that specifies a rate at which the rate adaptation algorithm is to increase a target encoding rate to a higher rate limit, and

a ramp down rate that specifies a rate at which the rate adaptation algorithm is to decrease the target encoding rate to a lower rate limit, and

a client that receives a value for a first one of the plurality of control parameters and sets the first control parameter to the received value.

38. A device comprising:

means for receiving, by a media device, a value for a first one of a plurality of control parameters for a rate adaptation algorithm, wherein the rate adaptation algorithm monitors conditions of a network and adjusts a coding rate of a media encoder based on the network conditions and the plurality of control parameters, wherein each of the plurality of control parameters specifies a threshold value or a timing value that controls a response of the rate adaptation algorithm to the network conditions, wherein the first control parameter is one of;

a ramp up rate that specifies a rate at which the rate adaptation algorithm is to increase a target encoding rate to a higher rate limit, and

a ramp down rate that specifies a rate at which the rate adaptation algorithm is to decrease the target encoding rate to a lower rate limit, and

means for setting the first control parameter to the received value.

39. A non-transitory computer-readable storage medium having stored thereon instructions that when executed cause one or more programmable processors to:

receive, by a media device, a value for a first one of a plurality of control parameters for a rate adaptation algorithm, wherein the rate adaptation algorithm monitors conditions of a network and adjusts a coding rate of a media encoder based on the network conditions and the plurality of control parameters, wherein each of the plurality of control parameters specifies a threshold value or a timing value that controls a response of the rate adaptation algorithm to the network conditions, wherein the first control parameter is one of;

a ramp up rate that specifies a rate at which the rate adaptation algorithm is to increase a target encoding rate to a higher rate limit, and

a ramp down rate that specifies a rate at which the rate adaptation algorithm is to decrease the target encoding rate to a lower rate limit, and

set the first control parameter to the received value.