MANAGING VIDEO ADAPTATION ALGORITHMS

• US 20100316066A1
• Filed: 04/08/2010
• Published: 12/16/2010
• Est. Priority Date: 06/16/2009
• Status: Active Grant

• Current Assignee: Qualcomm, Inc.
• Original Assignee: Qualcomm, Inc.
• Inventors: Leung, Nikolai K.
• Granted Patent: US 8,537,699 B2
• Time in Patent Office: Days
• US Class Current: 370/468
• CPC Class Codes: H04N 21/44209 Monitoring of downstream path of the transmission network originating from a server, e.g. bandwidth variations of a wireless network arrangements for maintenance or administration in data switching networks involving bandwidth and capacity management H04L41/0896
• CPC Class Codes: H04N 21/6336 directed to decoder
• CPC Class Codes: H04N 21/6373 for rate control , e.g. request to the server to modify its transmission rate flow control in packet networks H04L47/10
• CPC Class Codes: H04N 21/6379 directed to encoder , e.g. for requesting a lower encoding rate
• CPC Class Codes: H04N 21/64738 Monitoring network characteristics, e.g. bandwidth, congestion level data switched network analysis H04L41/14; monitoring functioning in data switched networks H04L43/0817; flow control in packet networks H04L47/10
• CPC Class Codes: H04N 21/64769 for rate control flow control in packet networks H04L47/10
• CPC Class Codes: H04N 21/64792 Controlling the complexity of the content stream, e.g. by dropping packets intermediate media network packet handling H04L65/765; proxy provisioning conversion or adaptation for reducing the amount or size of exchanged application data H04L67/5651; negotiation of resources in wireless networks H04W28/16

Abstract

Techniques are described for controlling the operation of a dynamic rate adaptation algorithm by modifying control parameters exposed by the dynamic rate adaptation algorithm. In one aspect, an apparatus comprises a rate adaptation module comprising a plurality of control parameters. The rate adaptation module monitors conditions of a network and adjusts a coding rate of a media encoder based on the network conditions and the plurality of control parameters. Each of the plurality of control parameters specifies a threshold value or a timing value that controls a response of the rate adaptation algorithm to the network conditions. The apparatus also comprises a client that receives a value for a first one of the plurality of control parameters and sets the first control parameter to the received value.

Claims

1. A method comprising:

receiving, by a media device, a value for a first one of a plurality of control parameters for a rate adaptation algorithm, wherein the rate adaptation algorithm monitors conditions of a network and adjusts a coding rate of a media encoder based on the network conditions and the plurality of control parameters, wherein each of the plurality of control parameters specifies a threshold value or a timing value that controls a response of the rate adaptation algorithm to the network conditions; and

setting the first control parameter to the value.

2. The method of claim 1, wherein the media device comprises a Multimedia Telephony Service for Internet Protocol Multimedia Systems (MTSI) client that comprises the rate adaptation algorithm.

3. The method of claim 1, wherein the plurality of control parameters include a plurality of subsets of service-specific control parameters each associated with one of a plurality of service levels, wherein each of the plurality of service levels defines a different quality of service for a user, and wherein the method further comprises:

operating the media device according to a first one of the plurality of service levels, wherein the rate adaptation algorithm adjusts the coding rate of the media encoder based on the network conditions and a subset of service-specific control parameters associated with the first service level.

4. The method of claim 1,

wherein the media device is a media receiver, and

wherein the rate adaptation algorithm comprises a receiver-side rate adaptation algorithm and adjusts the coding rate of the media encoder by sending feedback to a media transmitter that includes the media encoder, wherein the feedback directs the media transmitter to adjust the coding rate of the media encoder.

5. The method of claim 1,

wherein the media device is a media transmitter that includes the media encoder, and

wherein the rate adaptation algorithm comprises a transmitter-side rate adaptation algorithm.

6. The method of claim 1, wherein the media encoder is a video encoder.

7. The method of claim 1, wherein the first control parameter is selected from a group consisting of:

a lower packet loss rate threshold;

an upper packet loss rate threshold;

a first packet loss rate measurement window that specifies a duration of a sliding window over which the rate adaptation algorithm measures the lower packet loss rate threshold; and

a second packet loss rate measurement window that specifies a duration of a sliding window over which the rate adaptation algorithm measures the upper packet loss rate threshold.

8. The method of claim 1, wherein the first control parameter is selected from a group consisting of:

a minimum target playout margin that specifies a minimum acceptable time between a media packet arrival and its properly scheduled playout time;

a maximum target playout margin that specifies an upper threshold of time between a media packet arrival and its properly scheduled playout time;

a percentile point value for a packet arrival time distribution that specifies a percentile for measuring a playout margin;

a first target playout window that specifies a duration of a sliding window over which the rate adaptation algorithm observes and calculates a margin between media packet arrivals and playout for the minimum target playout margin; and

a second target playout window that specifies a duration of a sliding window over which the rate adaptation algorithm observes and calculates a margin between media packet arrivals and playout for the maximum target playout margin.

9. The method of claim 1, wherein the first control parameter is selected from a group consisting of:

an upper packet loss number threshold;

a packet loss number measurement window that specifies a duration of a sliding window over which the rate adaptation algorithm observes and calculates packet losses for comparison to the upper packet loss number threshold; and

a maximum Real-Time Transmission Protocol (RTP) gap value that is a factor in a duration of time that may pass without receiving a media packet before the rate adaptation algorithm declares a burst condition.

10. The method of claim 1, wherein the first control parameter is selected from a group consisting of a first minimum feedback interval value for decreasing a maximum rate limit, and a second minimum feedback interval value for increasing a maximum rate limit.

11. The method of claim 1, wherein the first control parameter is selected from a group consisting of a decongest value and a decongest time value.

12. The method of claim 1, wherein the first control parameter is selected from a group consisting of a minimum bit rate, a minimum frame rate, and a minimum image quality.

13. The method of claim 1, wherein the first control parameter is selected from a group consisting of:

a ramp up rate that specifies a rate at which the rate adaptation algorithm is to increase a target encoding rate to a higher rate limit; and

a ramp down rate that specifies a rate at which the rate adaptation algorithm is to decrease the target encoding rate to a lower rate limit.

14. The method of claim 1, wherein the first control parameter is selected from a group consisting of an uplink rate adaptation parameter, a drop hold parameter, and an initial codec rate.

29. The apparatus of claim 13, wherein the apparatus comprises a wireless communication device handset.

30. The apparatus of claim 13, wherein the apparatus comprises one or more integrated circuit devices.

15. An apparatus comprising:

a rate adaptation module comprising a plurality of control parameters, wherein the rate adaptation module monitors conditions of a network and adjusts a coding rate of a media encoder based on the network conditions and the plurality of control parameters, wherein each of the plurality of control parameters specifies a threshold value or a timing value that controls a response of the rate adaptation module to the network conditions; and

a client that receives a value for a first one of the plurality of control parameters and sets the first control parameter to the value.

16. The apparatus of claim 15, wherein the client comprises a Multimedia Telephony Service for Internet Protocol Multimedia Systems (MTSI) client that comprises the rate adaptation module.

17. The apparatus of claim 15,

wherein the plurality of control parameters include a plurality of subsets of service-specific control parameters each associated with one of a plurality of service levels, wherein each of the plurality of service levels defines a different quality of service for a user,

wherein the rate adaptation module adjusts the coding rate of the media encoder based on the network conditions and a subset of service-specific control parameters associated with a first one of the plurality of service levels.

18. The apparatus of claim 15,

wherein the apparatus is a media receiver, and

wherein the rate adaptation module comprises a receiver-side rate adaptation module and adjusts the coding rate of the media encoder by sending feedback to a media transmitter that includes the media encoder, wherein the feedback directs the media transmitter to adjust the coding rate of the media encoder.

19. The apparatus of claim 15, further comprising the media encoder,

wherein the apparatus is a media transmitter, and

wherein the rate adaptation module comprises a transmitter-side rate adaptation module.

20. The apparatus of claim 15, wherein the media encoder is a video encoder.

21. The apparatus of claim 15, wherein the first control parameter is selected from a group consisting of:

a lower packet loss rate threshold;

an upper packet loss rate threshold;

a first packet loss rate measurement window that specifies a duration of a sliding window over which the rate adaptation module measures the lower packet loss rate threshold; and

a second packet loss rate measurement window that specifies a duration of a sliding window over which the rate adaptation module measures the upper packet loss rate threshold.

22. The apparatus of claim 15, wherein the first control parameter is selected from a group consisting of:

a minimum target playout margin that specifies a minimum acceptable time between a media packet arrival and its properly scheduled playout time;

a maximum target playout margin that specifies an upper threshold of time between a media packet arrival and its properly scheduled playout time;

a percentile point value for a packet arrival time distribution that specifies a percentile for measuring a playout margin;

a first target playout window that specifies a duration of a sliding window over which the rate adaptation module observes and calculates a margin between media packet arrivals and playout for the minimum target playout margin; and

a second target playout window that specifies a duration of a sliding window over which the rate adaptation module observes and calculates a margin between media packet arrivals and playout for the maximum target playout margin.

23. The apparatus of claim 15, wherein the first control parameter is selected from a group consisting of:

an upper packet loss number threshold;

a packet loss number measurement window that specifies a duration of a sliding window over which the rate adaptation module observes and calculates packet losses for comparison to the upper packet loss number threshold; and

a maximum Real-Time Transmission Protocol (RTP) gap value that is a factor in a duration of time that may pass without receiving a media packet before the rate adaptation module declares a burst condition.

24. The apparatus of claim 15, wherein the first control parameter is selected from a group consisting of a first minimum feedback interval value for decreasing a maximum rate limit, and a second minimum feedback interval value for increasing a maximum rate limit.

25. The apparatus of claim 15, wherein the first control parameter is selected from a group consisting of a decongest value and a decongest time value.

26. The apparatus of claim 15, wherein the first control parameter is selected from a group consisting of a minimum bit rate, a minimum frame rate, and a minimum image quality.

27. The apparatus of claim 15, wherein the first control parameter is selected from a group consisting of:

a ramp up rate that specifies a rate at which the rate adaptation module is to increase a target encoding rate to a higher rate limit; and

a ramp down rate that specifies a rate at which the rate adaptation module is to decrease the target encoding rate to a lower rate limit.

28. The apparatus of claim 15, wherein the first control parameter is selected from a group consisting of an uplink rate adaptation parameter, a drop or hold parameter, and an initial codec rate.

31. A device comprising:

means for receiving, by a media device, a value for a first one of a plurality of control parameters for a rate adaptation algorithm, wherein the rate adaptation algorithm monitors conditions of a network and adjusts a coding rate of a media encoder based on the network conditions and the plurality of control parameters, wherein each of the plurality of control parameters specifies a threshold value or a timing value that controls a response of the rate adaptation algorithm to the network conditions; and

means for setting the first control parameter to the value.

32. The device of claim 31, wherein the device comprises a Multimedia Telephony Service for Internet Protocol Multimedia Systems (MTSI) client.

33. The device of claim 31, wherein the plurality of control parameters include a plurality of subsets of service-specific control parameters each associated with one of a plurality of service levels, wherein each of the plurality of service levels defines a different quality of service for a user, and wherein the device further comprises:

means for operating the device according to a first one of the plurality of service levels, wherein the rate adaptation algorithm adjusts the coding rate of the media encoder based on the network conditions and a subset of service-specific control parameters associated with the first service level.

34. The device of claim 31,

wherein the device is a media receiver, and

wherein the rate adaptation algorithm comprises a receiver-side rate adaptation algorithm and adjusts the coding rate of the media encoder by sending feedback to a media transmitter that includes the media encoder, wherein the feedback directs the media transmitter to adjust the coding rate of the media encoder.

35. The device of claim 31,

wherein the device is a media transmitter that includes the media encoder, and

wherein the rate adaptation algorithm comprises a transmitter-side rate adaptation algorithm.

36. The device of claim 31, wherein the media encoder is a video encoder.

37. A computer-readable storage medium comprising instructions for causing a programmable processor to:

receive, by a media device, a value for a first one of a plurality of control parameters for a rate adaptation algorithm, wherein the rate adaptation algorithm monitors conditions of a network and adjusts a coding rate of a media encoder based on the network conditions and the plurality of control parameters, wherein each of the plurality of control parameters specifies a threshold value or a timing value that controls a response of the rate adaptation algorithm to the network conditions; and

set the first control parameter to the value.

38. The computer-readable storage medium of claim 37, wherein the media device comprises a Multimedia Telephony Service for Internet Protocol Multimedia Systems (MTSI) client that comprises the rate adaptation algorithm.

39. The computer-readable storage medium of claim 37, wherein the plurality of control parameters include a plurality of subsets of service-specific control parameters each associated with one of a plurality of service levels, wherein each of the plurality of service levels defines a different quality of service for a user, and further comprising instructions to cause a programmable processor to:

operate the media device according to a first one of the plurality of service levels, wherein the rate adaptation algorithm adjusts the coding rate of the media encoder based on the network conditions and a subset of service-specific control parameters associated with the first service level.

40. The computer-readable storage medium of claim 37,

wherein the media device is a media receiver, and

wherein the rate adaptation algorithm comprises a receiver-side rate adaptation algorithm and adjusts the coding rate of the media encoder by sending feedback to a media transmitter that includes the media encoder, wherein the feedback directs the media transmitter to adjust the coding rate of the media encoder.

41. The computer-readable storage medium of claim 37,

wherein the media device is a media transmitter that includes the media encoder, and

wherein the rate adaptation algorithm comprises a transmitter-side rate adaptation algorithm.

42. The computer-readable storage medium of claim 37, wherein the media encoder is a video encoder.

43. The computer-readable storage medium of claim 37, wherein the first control parameter is selected from a group consisting of:

a lower packet loss rate threshold;

an upper packet loss rate threshold;

a first packet loss rate measurement window that specifies a duration of a sliding window over which the rate adaptation algorithm measures the lower packet loss rate threshold; and

a second packet loss rate measurement window that specifies a duration of a sliding window over which the rate adaptation algorithm measures the upper packet loss rate threshold.

44. The computer-readable storage medium of claim 37, wherein the first control parameter is selected from a group consisting of:

a minimum target playout margin that specifies a minimum acceptable time between a media packet arrival and its properly scheduled playout time;

a maximum target playout margin that specifies an upper threshold of time between a media packet arrival and its properly scheduled playout time;

a percentile point value for a packet arrival time distribution that specifies a percentile for measuring a playout margin;

a first target playout window that specifies a duration of a sliding window over which the rate adaptation algorithm observes and calculates a margin between media packet arrivals and playout for the minimum target playout margin; and

a second target playout window that specifies a duration of a sliding window over which the rate adaptation algorithm observes and calculates a margin between media packet arrivals and playout for the maximum target playout margin.

45. The computer-readable storage medium of claim 37, wherein the first control parameter is selected from a group consisting of:

an upper packet loss number threshold;

a packet loss number measurement window that specifies a duration of a sliding window over which the rate adaptation algorithm observes and calculates packet losses for comparison to the upper packet loss number threshold; and

a maximum Real-Time Transmission Protocol (RTP) gap value that is a factor in a duration of time that may pass without receiving a media packet before the rate adaptation algorithm declares a burst condition.

46. The computer-readable storage medium of claim 37, wherein the first control parameter is selected from a group consisting of a first minimum feedback interval value for decreasing a maximum rate limit, and a second minimum feedback interval value for increasing a maximum rate limit.

47. The computer-readable storage medium of claim 37, wherein the first control parameter is selected from a group consisting of a decongest value and a decongest time value.

48. The computer-readable storage medium of claim 37, wherein the first control parameter is selected from a group consisting of a minimum bit rate, a minimum frame rate, and a minimum image quality.

49. The computer-readable storage medium of claim 37, wherein the first control parameter is selected from a group consisting of:

a ramp up rate that specifies a rate at which the rate adaptation algorithm is to increase a target encoding rate to a higher rate limit; and

a ramp down rate that specifies a rate at which the rate adaptation algorithm is to decrease the target encoding rate to a lower rate limit.

50. The computer-readable storage medium of claim 37, wherein the first control parameter is selected from a group consisting of an uplink rate adaptation parameter, a drop or hold parameter, and an initial codec rate.