Dynamic bandwidth selection for efficient transmission of multimedia streams in a computer network

• US 6,292,834 B1
• Filed: 03/14/1997
• Issued: 09/18/2001
• Est. Priority Date: 03/14/1997
• Status: Expired due to Term

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Ravi, Hemanth Srinivas, de Val, David, Klemets, Anders Edgar, Chaddha, Navin
• Primary Examiner(s): Maung, Zarni
• Assistant Examiner(s): Cardone, Jason D.
• Application Number:
  US08/818,127
• Time in Patent Office: 1,649 Days
• Field of Search: 370/232, 370/233, 370/234, 370/236, 709/203, 709/207, 709/212, 709/216, 709/217, 709/218, 709/219, 709/223, 709/224, 709/225, 709/231, 709/232, 709/233, 709/102, 709/104, 709/105, 707/10
• US Class Current: 709/233
• CPC Class Codes: H04L 65/1043 Gateway controllers, e.g. media gateway control protocol [MGCP] controllers
• CPC Class Codes: H04L 65/1101 Session protocols
• CPC Class Codes: H04L 65/612 for unicast
• CPC Class Codes: H04L 65/762 at the source reformatting of additional data in video distribution servers H04N21/2355
• CPC Class Codes: H04L 65/765 intermediate
• CPC Class Codes: H04L 65/80 Responding to QoS
• CPC Class Codes: H04N 21/2187 Live feed
• CPC Class Codes: H04N 21/222 Secondary servers, e.g. proxy server, cable television Head-end provisioning of proxy services in data packet switching networks H04L67/56
• CPC Class Codes: H04N 21/23424 involving splicing one content stream with another content stream, e.g. for inserting or substituting an advertisement
• CPC Class Codes: H04N 21/23439 for generating different versions
• CPC Class Codes: H04N 21/2402 Monitoring of the downstream path of the transmission network, e.g. bandwidth available traffic monitoring in data switching networks H04L43/00; monitoring data switching networks utilization H04L43/0876
• CPC Class Codes: H04N 21/2662 Controlling the complexity of the video stream, e.g. by scaling the resolution or bitrate of the video stream based on the client capabilities
• CPC Class Codes: H04N 21/8455 involving pointers to the content, e.g. pointers to the I-frames of the video stream

Abstract

An efficient transmission protocol for transmitting multimedia streams from a server to a client computer over a diverse computer network including local area networks (LANs) and wide area networks (WANs) such as the internet. The client computer includes a playout buffer, and the transmission rate is dynamically matched to the available bandwidth capacity of the network connection between the server and the client computer. If a playtime of the playout buffer, which is one measure of the number of data packets currently in the playout buffer, drops below a dynamically computed Decrease_Bandwidth (DEC_BW) threshold, then the transmission rate is decreased by sending a DEC_BW message to the server. Conversely, if the number of packets remaining in the playout buffer rises above a dynamically computed Upper Increase_Bandwidth (INC_BW) threshold and does not drop below a Lower INC_BW threshold for at least an INC_BW wait period, then the transmission rate is incremented. The transmission rate can be selected from among a predetermined set of discrete bandwidth values or from within a continuous range of bandwidth values. In one variation, in addition to responding to changes in network connection capacity, the client computer also determines an average client computational capacity. Accordingly, if the average client computational capacity is less than the network capacity, the lower of the two capacities is the determining one, thereby avoiding a playout buffer overrun.

Claims

1. In a client computer, a method of dynamically adjusting a data transmission rate of a data stream from a server to the client computer, the client computer coupled to the server via a computer network, the computer network providing a network connection with a variable bandwidth for transmitting the data stream, the data stream including a plurality of data packets, said client computer including a playout buffer for buffering the incoming data packets, the method comprising:

initializing the data transmission rate for said data stream;

dynamically computing a decrement bandwidth (DEC_BW) threshold for the playout buffer; and

decrementing the transmission rate upon determining that a difference between a first time of a first data packet and a last time of a last data packet in said playout buffer drops below said dynamically computed DEC_BW threshold.

2. The method of claim 1 wherein said current number of packets remaining is represented by a current playtime which is set to a duetime of a last data packet in said playout buffer.

3. The method of claim 1 further comprising:

determining a lossrate of the data packets; and

decrementing the transmission rate upon determining the lossrate exceeds a lossrate threshold.

4. The method of claim 1 wherein said data stream is a video data stream.

5. The method of claim 1 further comprising:

determining an average client computational rate of said client computer; and

decrementing the transmission rate upon determining the average client computational rate is less than the transmission rate.

6. The method of claim 1, further comprising decrementing the transmission rate upon determining a difference between the current number of data packets and a previous number of data packets remaining in said playout buffer is less than a first constant, then decrementing the transmission rate.

7. In a client computer, a method of dynamically adjusting a transmission rate of a data stream from a server to the client computer, the client computer coupled to the server via a computer network, the computer network providing a network connection with a variable bandwidth for transmitting the data stream, the data stream including a plurality of data packets, said client computer including a playout buffer for buffering the incoming data packets, the method comprising:

initializing the transmission rate for said data stream;

initializing a Time_Before_Increase;

dynamically computing an upper increment bandwidth (INC_BW) threshold and a lower INC_BW threshold for said playout buffer; and

incrementing the transmission rate upon determining a current number of data packets remaining in the playout buffer rises above the upper INC_BW threshold and does not drop below the lower INC_BW threshold for at least said Time_Before_Increase.

8. The method of claim 7 wherein a Time_Buffer_Full indicates how long the current number of data packets remaining in the playout buffer has risen above the upper INC_BW threshold, and wherein the method further comprising:

resetting the Time_Buffer_Full upon determining the current number of data packets remaining in the playout buffer rises above the upper INC_BW threshold and then drops below the lower INC_BW threshold within said Time_Before_Increase.

9. The method of claim 7 further comprising increasing said Time_Before_Increase upon determining the transmission rate is reduced shortly after it was previously increased.

10. The method of claim 7 wherein said lower INC_BW threshold is initialized to a percentage of an ideal playout buffer size.

11. The method of claim 7 further comprising the steps of:

determining an average client computational rate of said client computer; and

if the average client computational rate is greater than the transmission rate and if the current number of data packets remaining in the playout buffer rises above the upper INC_BW threshold and does not drop below the lower INC_BW threshold for at least said INC_BW wait period, then incrementing the transmission rate.

12. The method of claim 7 wherein said data stream is a video data stream.

13. The method of claim 7 wherein said current number of packets remaining is represented by a current playtime which is set to a duetime of a last data packet in said playout buffer.

14. The method of claim 7 further comprising:

dynamically computing a decrement bandwidth (DEC_BW) threshold for the playout buffer; and

decrementing the transmission rate upon determining the current number of data packets remaining in said playout buffer drops below said dynamically computed DEC_BW threshold, and upon determining a difference between the current number of data packets and a previous number of data packets remaining in said playout buffer is less than a first constant.

15. A client computer useful in association with a server, the client computer coupled to the server via a computer network, the computer network providing a network connection with a variable bandwidth for transmitting a data stream from the server to the client computer, the data stream including a plurality of data packets, the client computer comprising:

a playout buffer for buffering the incoming data packets, wherein a transmission rate for said data stream is decremented upon determining that a difference between a first time of a first data packet and a last time of a last data packet in said playout buffer drops below a dynamically computed decrement bandwidth (DEC_BW) threshold.

16. The client computer of claim 15 wherein said current number of packets remaining is represented by a current playtime which is set to a duetime of a last data packet in said playout buffer.

17. The client computer of claim 15 wherein the transmission rate is decremented upon determining a lossrate of the data packets exceeds a lossrate threshold.

18. The client computer of claim 15 wherein said data stream is a video data stream.

19. The client computer of claim 15 wherein the transmission rate is decremented upon determining an average client computational rate of the client computer is less than the transmission rate.

20. The client computer of claim 15, wherein the transmission rate for said data stream is decremented upon determining a difference between the current number of data packets and a previous number of data packets remaining in said playout buffer is less than a first constant.

21. A client computer useful in association with a server, the client computer coupled to the server via a computer network, the computer network providing a network connection with a variable bandwidth for transmitting a data stream from said server to said client computer, the data stream including a plurality of data packets, the client computer comprising:

a playout buffer for buffering the incoming data packets, wherein a transmission rate of said data stream is incremented upon determining a current number of data packets remaining in the playout buffer rises above a dynamically computed upper increment bandwidth (IN_BW) threshold and does not drop below a dynamically computed lower INC_BW threshold for at least a Time_Before_Increase.

22. The client computer of claim 21 wherein a Time_Buffer_Full indicates how long the current number of data packets remaining in the playout buffer has risen above the upper INC_BW threshold, wherein said Time_Buffer_Full is reset upon determining the current number of data packets remaining in the playout buffer rises above the upper INC_BW threshold and then drops below the lower INC_BW threshold within said Time_Before_Increase.

23. The client computer of claim 21 wherein said Time_Before_Increase is increased upon determining the transmission rate is reduced shortly after it was previously increased.

24. The client computer of claim 21 wherein said lower INC_BW threshold is intialized to a percentage of an ideal playout buffer size.

25. The client computer of claim 21 wherein the transmission rate is incremented upon determining an average computational rate of said client computer is greater than the transmission rate and upon determining the current number of data packets remaining in the playout buffer rises above the upper INC_BW threshold and does not drop below the lower INC_BW threshold for at least said Time_Before_Increase.

26. The client computer of claim 21 wherein said data stream is a video data stream.

27. The client computer of claim 21 wherein said current number of packets remaining is represented by a current playtime which is set to a duetime of a last data packet in said playout buffer.

28. The client computer of claim 21 wherein the transmission rate for said data stream is decremented upon determining the current number of data packets remaining in said playout buffer drops below a dynamically computed decrement bandwidth (DEC_BW) threshold, and upon determining a difference between the current number of data packets and a previous number of data packets remaining in said playout buffer is less than a first constant.

29. A computer-readable medium useful in association with a client computer coupled to a server via a computer network, the computer network providing a network connection with a variable bandwidth for transmitting a data stream from the server to the client computer, the data stream including a plurality of data packets, the client computer having a processor and a playout buffer for buffering said data packets from the server, the computer-readable medium comprising computer-readable code instructions configured to cause said client computer to execute:

initializing a data transmission rate for said data stream;

dynamically computing a decrement bandwidth (DEC_BW) threshold for the playout buffer; and

decrementing the transmission rate upon determining that a difference between a first time of a first data packet and a last time of a last data packet in said playout buffer drops below said dynamically computed DEC_BW threshold.

30. The computer-readable medium of claim 29 wherein said current number of packets remaining is represented by a current playtime which is set to a duetime of a last data packet in said playout buffer.

31. The computer-readable medium of claim 29 further comprising computer-readable code instructions configured to cause said client computer to execute:

determining a lossrate of the data packets; and

decrementing the transmission rate upon determining the lossrate exceeds a lossrate threshold.

32. The computer-readable medium of claim 29 wherein said data stream is a video data stream.

33. The computer-readable medium of claim 29 further comprising computer-readable code instructions configured to cause said client computer to execute:

determining an average client computational rate of said client computer; and

decrementing the transmission rate upon determining the average client computational rate is less than the transmission rate.

34. The computer readable medium of claim 29, further comprising decrementing the transmission rate upon determining a difference between the current number of data packets and a previous number of data packets remaining in said playout buffer is less than a first constant.

35. A computer-readable medium useful in association with a client computer coupled to a server via a computer network, the computer network providing a network connection with a variable bandwidth for transmitting a data stream from the server to the client computer, the data stream including a plurality of data packets, the client computer having a processor and a playout buffer for buffering said data packets from the server, the computer-readable medium comprising computer-readable code instructions configured to cause said client computer to execute:

initializing a data transmission rate for said data stream;

initializing a Time_Before_Increase;

dynamically computing an upper increment bandwidth (INC_BW) threshold and a lower INC_BW threshold for said playout buffer; and

incrementing the transmission rate upon determining a current number of data packets remaining in the playout buffer rises above the upper INC_BW threshold and does not drop below the lower INC_BW threshold for at least said Time_Before_Increase.

36. The computer-readable medium of claim 35 wherein a Time_Buffer_Full indicates how long the current number of data packets remaining in the playout buffer has risen above the upper INC_BW threshold, the computer-readable medium further comprising computer-readable code instructions configured to cause said client computer to execute resetting the Time_Buffer_Full upon determining the current number of data packets remaining in the playout buffer rises above the upper INC_BW threshold and then drops below the lower INC_BW threshold within said Time_Before_Increase.

37. The computer-readable medium of claim 35 further comprising computer-readable code instructions configured to cause said client computer to execute increasing said Time_Before_Increase upon determining the transmission rate is reduced shortly after it was previously increased.

38. The computer-readable medium of claim 35 wherein said lower INC_BW threshold is initialized to a percentage of an ideal playout buffer size.

39. The computer-readable medium of claim 35 further comprising computer-readable code instructions configured to cause said client computer to execute:

determining an average client computational rate of said client computer; and

incrementing the transmission rate upon determining the average client computational rate is greater than the transmission rate and upon determining the current number of data packets remaining in the playout buffer rises above the upper INC_BW threshold and does not drop below the lower INC_BW threshold for at least said Time_Before_Increase.

40. The computer-readable medium of claim 35 wherein said data stream is a video data stream.

41. The computer-readable medium of claim 35 wherein said current number of packets remaining is represented by a current playtime which is set to a duetime of a last data packet in said playout buffer.

42. The computer-readable medium of claim 35 further comprising computer-readable code instructions configured to cause said client computer to execute:

dynamically computing a decrement bandwidth (DEC_BW) threshold for the playout buffer; and

decrementing the transmission rate upon determining the current number of data packets in said playout buffer drops below said dynamically computed DEC_BW threshold, and upon determining a difference between the current number of data packets and a previous number of data packets remaining in said playout buffer is less than a first constant.