Bi-level and full-color video combination for video communication

• US 7,359,004 B2
• Filed: 05/23/2003
• Issued: 04/15/2008
• Est. Priority Date: 05/23/2003
• Status: Expired due to Fees

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Li, Jiang, Yu, Keman, Li, Shipeng
• Primary Examiner(s): PEZZLO, JOHN
• Assistant Examiner(s): PEZZLO, JOHN
• Application Number:
  US10/445,310
• Publication Number:
  US 20040233844A1
• Time in Patent Office: 1,789 Days
• Field of Search: 370230-235, 370252-253, 370260-261, 370/465, 370/468, 370/477, 348/390.1, 348/387.1, 375/240.02, 375/240.29, 375/240.25
• US Class Current: 348/390.1
• CPC Class Codes: H04L 12/5602 Bandwidth control in ATM Networks, e.g. leaky bucket

Abstract

Systems and methods for video communication are described. In one aspect, network bandwidth conditions are estimated. Bi-level or full-color video is then transmitted over the network at transmission bit rates that are controlled as a function of the estimated bandwidth conditions. To this end, network bandwidth capability is periodically probed to identify similar, additional, or decreased bandwidth capabilities as compared to the estimated bandwidth conditions. Decisions to hold, decrease, or increase the video transmission bit rate are made based on the estimated bandwidth conditions in view of the probing operations. When the transmission bit rate is increased or decreased, the transmission bit rate is calculated to target an upper or lower bit rate, both of which are indicated by the estimated bandwidth conditions. Bi-level video communication is switched to full-color video transmission, or vice versa, when the video transmission bit rate respectively reaches the upper bit rate or the lower bit rate.

Claims

1. A method to for video communication, the method comprising operations for:

estimating bandwidth conditions of a network to determine a suitable target bit rate at which to transmit bi-level and full-color video;

transmitting bi-level or full-color video over the network at a transmission bit rate, the transmission bit rate being a function of the bandwidth conditions;

periodically probing bandwidth capability of the network to identify similar, additional, or decreased bandwidth availability as compared to estimated bandwidth conditions, wherein periodically probing bandwidth capability of the network further comprises sending redundant data and bi-level video data across the network at the transmission bit rate;

responsive to the probing operation, holding, decreasing, or increasing the transmission bit rate, the increasing and decreasing operations respectively adjusting the transmission bit rate towards an upper or lower bit rate indicated by the bandwidth conditions, wherein decreasing the transmission bit rate further comprises calculating the transmission bit rate for a next time interval i+1 as follows;

B_aⁱ⁺¹=min{B_oⁱ, (B_oⁱ+B_sⁱ)×

γ

, B_min},

such that B_aⁱ⁺¹ is the allowed bit rate for the next interval, B_oⁱ represents a mean data throughput in an immediately previous time interval, B_s is a redundant data bit rate of a previous probing operation, B_min is the minimum allowed bit rate, and γ

is a factor to adjust the transmission bit rate in view of potential error between estimated bandwidth and actual total available bandwidth; and

switching from bi-level to full-color video transmission, or vice versa, as a function of when the transmission bit rate respectively reaches the upper bit rate or the lower bit rate.

2. A method as recited in claim 1, wherein the full-color video has a color depth of 24 bits.

3. A method as recited in claim 1, wherein estimating bandwidth conditions is a function of packet loss rate and data round-trip-time (RTT) determinations.

4. A method as recited in claim 1, wherein estimating bandwidth conditions consider a lower threshold of packet loss, an upper threshold to indicate congestion if damage done to video quality resulting from packet loss is substantially large, a maximum transmission bit rate that indicates when delay of video will not be easily perceived during video playback, and a loaded zone associated with a hold bit rate decision that is large enough to avoid frequent switching oscillations between bi-level to/from full-color video.

5. A method as recited in claim 1, wherein transmitting further comprises initially transmitting bi-level video.

6. A method as recited in claim 1, wherein estimating further comprises:

calculating a threshold band to indicate congested, loaded, and unloaded states of the network; and

mapping hold, decrease, and increase transmission bit rate decisions to corresponding ones of the congested, loaded, and unloaded states of the network.

7. A method as recited in claim 1, wherein periodically probing bandwidth capability of the network further comprises sending redundant data and bi-level video data across the network to determine any increase or decrease in bandwidth capability of the network.

8. A method as recited in claim 1 wherein the method further comprises:

identifying a consecutive number of probing operations that result in a decision to decrease the transmission bit rate; and

responsive to the identifying, stopping operations of periodically probing such that no redundant data is being transmitted across the network and such that the transmission bit rate is only associated with a bi-level video transmission bit rate.

9. A method as recited in claim 8, wherein the consecutive number of probing operations is two (2).

10. A computer-readable medium comprising computer-program instructions for video communication, the computer-program instructions being executable by a processor and comprising instructions for:

estimating bandwidth conditions of a network to estimate network states at which to transmit bi-level and full-color video;

transmitting bi-level or full-color video over the network at a transmission bit rate, the transmission bit rate being a function of the bandwidth conditions;

periodically probing bandwidth capability of the network to identify similar, additional, or decreased bandwidth availability as compared to estimated bandwidth conditions, wherein the instructions for periodically probing bandwidth capability of the network further comprise instructions for sending redundant data and bi-level video data across the network at the transmission bit rate;

responsive to the probing operation, holding, decreasing, or increasing the transmission bit rate, the increasing and decreasing operations respectively adjusting the transmission bit rate towards an upper or lower bit rate indicated by the bandwidth conditions, wherein the instructions for decreasing the transmission bit rate further comprise instructions for calculating the transmission bit rate for a next time interval i+1 as follows;

B_aⁱ⁺¹=min{B_oⁱ, (B_oⁱ+B_sⁱ)×

γ

, B_min},

such that B_aⁱ⁺¹ is the allowed bit rate for the next interval, B_oⁱ represents a mean data throughput in an immediately previous time interval, B_s is a redundant data bit rate of a previous probing operation, B_min is the minimum allowed bit rate, and γ

is a factor to adjust the transmission bit rate in view of potential error between estimated bandwidth and actual total available bandwidth; and

switching from bi-level to full-color video transmission, or vice versa, as a function of when the transmission bit rate respectively reaches the upper bit rate or the lower bit rate.

11. A computer-readable medium as recited in claim 10, wherein the full-color video has a color depth of 24 bits.

12. A computer-readable medium as recited in claim 10, wherein the instructions for estimating bandwidth conditions consider a lower threshold of packet loss, an upper threshold to indicate congestion if damage done to video quality resulting from packet loss is substantially large, a maximum transmission bit rate that indicates when delay of video will not be easily perceived during video playback, and a loaded zone associated with a hold bit rate decision that is large enough to avoid frequent switching oscillations between bi-level to/from full-color video.

13. A computer-readable medium as recited in claim 10, wherein the instructions for estimating bandwidth conditions further comprise instructions for determining bandwidth conditions as a function of packet loss rate and data round-trip-time (RTT) determinations.

14. A computer-readable medium as recited in claim 10, wherein the instructions for transmitting further comprise instructions for initially transmitting bi-level video.

15. A computer-readable medium as recited in claim 10, wherein the instructions for estimating further comprise instructions for:

calculating a threshold band to indicate congested, loaded, and unloaded states of the network; and

mapping hold, decrease, and increase transmission bit rate decisions to corresponding ones of the congested, loaded, and unloaded states of the network.

16. A computer-readable medium as recited in claim 10, wherein the instructions for periodically probing bandwidth capability of the network further comprises sending redundant data and bi-level video data across the network to determine any increase or decrease in bandwidth capability of the network.

17. A computer-readable medium as recited in claim 10 wherein the computer-program instructions further comprise instructions for:

identifying a consecutive number of probing operations that result in a decision to decrease the transmission bit rate; and

responsive to the identifying, stopping operations of periodically probing such that no redundant data is being transmitted across the network.

18. A computer-readable medium as recited in claim 17, wherein the consecutive number of probing operations is two (2).

19. A computing device for video communication, the computing device comprising:

a processor; and

a memory coupled to the processor, the memory comprising computer-program instructions executable by the processor, the computer-program instructions comprising instructions for;

estimating bandwidth conditions of a network;

transmitting bi-level or full-color video over the network at a transmission bit rate, the transmission bit rate being a function of the bandwidth conditions;

periodically probing bandwidth capability of the network to identify similar, additional, or decreased bandwidth availability as compared to estimated bandwidth conditions, wherein the instructions for periodically probing bandwidth capability of the network further comprise instructions for sending redundant data and bi-level video data across the network at the transmission bit rate;

responsive to the probing operation, holding, decreasing, or increasing the transmission bit rate, the increasing and decreasing operations respectively adjusting the transmission bit rate towards an upper or lower bit rate indicated by the bandwidth conditions, wherein the instructions for decreasing the transmission bit rate further comprise instructions for calculating the transmission bit rate for a next time interval i−

1 as follows;

B_aⁱ⁺¹=min{B_oⁱ, (B_oⁱ+B_sⁱ)×

γ

, B_min},

such that B_aⁱ⁺¹ is the allowed bit rate for the next interval, B_oⁱ represents a mean data throughput in an immediately previous time interval. B_s is a redundant data bit rate of a previous probing operation, B_min is the minimum allowed bit rate, and γ

is a factor to adjust the transmission bit rate in view of potential error between estimated bandwidth and actual total available bandwidth; and

switching from bi-level to full-color video transmission, or vice versa, as a function of when the transmission bit rate respectively reaches the upper bit rate or the lower bit rate.

20. A computing device as recited in claim 19, wherein the full-color video has a color depth of 24 bits.

21. A computing device as recited in claim 19, wherein the instructions for estimating bandwidth conditions further comprise instructions for determining bandwidth conditions as a function of packet loss rate and data round-trip-time (RTT) determinations.

22. A computing device as recited in claim 19, wherein the instructions for transmitting further comprise instructions for initially transmitting bi-level video.

23. A computing device as recited in claim 19, wherein the instructions for estimating further comprise instructions for:

calculating a threshold band to indicate congested, loaded, and unloaded states of the network; and

mapping hold, decrease, and increase transmission bit rate decisions to corresponding ones of the congested, loaded, and unloaded states of the network.

24. A computing device as recited in claim 19, wherein the instructions for periodically probing bandwidth capability of the network further comprises sending redundant data and bi-level video data across the network to determine any increase or decrease in bandwidth capability of the network.

25. A computing device as recited in claim 19 wherein the computer-program instructions further comprise instructions for:

identifying a consecutive number of probing operations that result in a decision to decrease the transmission bit rate; and

responsive to the identifying, stopping operations of periodically probing such that no redundant data is being transmitted across the network and such that the transmission bit rate is only associated with a bi-level video transmission bit rate.

26. A computing device as recited in claim 25, wherein the consecutive number of probing operations is two (2).

27. A method to for video communication, the method comprising operations for:

estimating bandwidth conditions of a network to determine a suitable target bit rate at which to transmit bi-level and full-color video;

transmitting bi-level or full-color video over the network at a transmission bit rate, the transmission bit rate being a function of the bandwidth conditions;

periodically probing bandwidth capability of the network to identify similar, additional, or decreased bandwidth availability as compared to estimated bandwidth conditions, wherein periodically probing bandwidth capability of the network further comprises sending redundant data and bi-level video data across the network at the transmission bit rate;

responsive to the probing operation, holding, decreasing, or increasing the transmission bit rate, the increasing and decreasing operations respectively adjusting the transmission bit rate towards an upper or lower bit rate indicated by the bandwidth conditions, wherein increasing the transmission bit rate further comprises calculating the transmission bit rate for a next time interval i+1 as follows;

B_aⁱ⁺¹=min{B_oⁱ+B_sⁱ+λ

, B_max}; and

wherein B_aⁱ⁺¹ is an allowed bit rate used in a next probing operation, B_oⁱ represents a mean throughput in a time interval just past, B_sⁱ is a redundant data bit rate for a current time interval, B_max is a maximum allowed bit rate; and

λ

is a factor to adjust the transmission bit rate in view of potential error between estimated bandwidth and actual total available bandwidth; and

switching from bi-level to full-color video transmission, or vice versa, as a function of when the transmission bit rate respectively reaches the upper bit rate or the lower bit rate.

28. A method as recited in claim 27, wherein the full-color video has a color depth of 24 bits.

29. A method as recited in claim 27, wherein estimating bandwidth conditions is a function of packet loss rate and data round-trip-time (RTT) determinations.

30. A method as recited in claim 27, wherein estimating bandwidth conditions consider a lower threshold of packet loss, an upper threshold to indicate congestion if damage done to video quality resulting from packet loss is substantially large, a maximum transmission bit rate that indicates when delay of video will not be easily perceived during video playback and a loaded zone associated with a hold bit rate decision that is large enough to avoid frequent switching oscillations between bi-level to/from full-color video.

31. A method as recited in claim 27, wherein transmitting further comprises initially transmitting bi-level video.

32. A method as recited in claim 27, wherein estimating further comprises:

calculating a threshold band to indicate congested, loaded, and unloaded states of the network; and

mapping hold, decrease, and increase transmission bit rate decisions to corresponding ones of the congested, loaded, and unloaded states of the network.

33. A method as recited in claim 27, wherein periodically probing bandwidth capability of the network further comprises sending redundant data and bi-level video data across the network to determine any increase or decrease in bandwidth capability of the network.

34. A method as recited in claim 27, further comprising:

calculating a difference B_sⁱ⁺¹ between a previously allowed bit rate and an actual output bit rate that could have been supported as follows;

B_sⁱ⁺¹=min{B_aⁱ−

(B_oⁱ+B_sⁱ), S_max};

adding B_sⁱ⁺¹ to a target redundant data bit rate in a next probing operation; and

wherein and S_max is a maximum redundant bit rate.

35. A method as recited in claim 27 wherein the method further comprises:

identifying a consecutive number of probing operations that result in a decision to decrease the transmission bit rate; and

responsive to the identifying, flopping operations of periodically probing such that no redundant data is being transmitted across the network and such that the transmission bit rate is only associated with a bi-level video transmission bit rate.

36. A method as recited in claim 35, wherein the consecutive number of probing operations is two (2).

37. A computer-readable medium comprising computer-program instructions for video communication, the computer-program instructions being executable by a processor and comprising instructions for:

estimating bandwidth conditions of a network to estimate network states at which to transmit bi-level and full-color video;

transmitting bi-level or full-color video over the network at a transmission bit rate, the transmission bit rate being a function of the bandwidth conditions;

periodically probing bandwidth capability of the network to identify similar, additional, or decreased bandwidth availability as compared to estimated bandwidth conditions, wherein the instructions for periodically probing bandwidth capability of the network further comprise instructions for sending redundant data and bi-level video data across the network at the transmission bit rate;

responsive to the probing operation, holding, decreasing, or increasing the transmission bit rate, the increasing and decreasing operations respectively adjusting the transmission bit rate towards an upper or lower bit rate indicated by the bandwidth conditions, wherein the instructions for increasing the transmission bit rate further comprise instructions for calculating the transmission bit rate for a next time interval i+1 as follows;

B_aⁱ⁺¹=min{B_oⁱ+B_sⁱ+λ

, B_max},

such that B_aⁱ⁺¹ is an allowed bit rate used in a next probing operation, B_oⁱ represents a mean throughput in a time interval just past, B_sⁱ is a redundant data bit rate for a current time interval, B_max is a maximum allowed bit rate; and

λ

is a factor to adjust the transmission bit rate in view of potential error between estimated bandwidth and actual total available bandwidth; and

switching from bi-level to full-color video transmission, or vice versa, as a function of when the transmission bit rate respectively reaches the upper bit rate or the lower bit rate.

38. A computer-readable medium as recited in claim 37, wherein the full-color video has a color depth of 24 bits.

39. A computer-readable medium as recited in claim 37, wherein the instructions for estimating bandwidth conditions consider a lower threshold of packet loss, an upper threshold to indicate congestion if damage done to video quality resulting from packet loss is substantially large, a maximum transmission bit rate that indicates when delay of video will not be easily perceived during video playback, and a loaded zone associated with a hold bit rate decision that is large enough to avoid frequent switching oscillations between bi-level to/from full-color video.

40. A computer-readable medium as recited in claim 37, wherein the instructions for estimating bandwidth conditions further comprise instructions for determining bandwidth conditions as a function of packet loss rate and data round-trip-time (RTT) determinations.

41. A computer-readable medium as recited in claim 37, wherein the instructions for transmitting further comprise instructions for initially transmitting bi-level video.

42. A computer-readable medium as recited in claim 37, wherein the instructions for estimating further comprise instructions for:

calculating a threshold band to indicate congested, loaded, and unloaded states of the network; and

mapping hold, decrease, and increase transmission bit rate decisions to corresponding ones of the congested, loaded, and unloaded states of the network.

43. A computer-readable medium as recited in claim 37, wherein the instructions for periodically probing bandwidth capability of the network further comprises sending redundant data and bi-level video data across the network to determine any increase or decrease in bandwidth capability of the network.

44. A computer-readable medium as recited in claim 37, wherein the computer-program instructions further comprise instructions for:

calculating a difference B_sⁱ⁺¹ between a previously allowed bit rate and an actual output bit rate that could have been supported as follows;

B_sⁱ⁺¹=min{B_aⁱ−

(B_oⁱ+B_sⁱ), S_max};

adding B_sⁱ⁺¹ to a target redundant data bit rate in a next probing operation; and

wherein and S_max is a maximum redundant bit rate.

45. A computer-readable medium as recited in claim 37 wherein the computer-program instructions further comprise instructions for:

identifying a consecutive number of probing operations that result in a decision to decrease the transmission bit rate; and

responsive to the identifying, stopping operations of periodically probing such that no redundant data is being transmitted across the network.

46. A computer-readable medium as recited in claim 45, wherein the consecutive number of probing operations is two (2).

47. A computing device for video communication, the computing device comprising:

a processor; and

a memory coupled to the processor, the memory comprising computer-program instructions executable by the processor, the computer-program instructions comprising instructions for;

estimating bandwidth conditions of a network;

transmitting bi-level or full-color video over the network at a transmission bit rate, the transmission bit rate being a function of the bandwidth conditions;

periodically probing bandwidth capability of the network to identify similar, additional, or decreased bandwidth availability as compared to estimated bandwidth conditions, wherein the instructions for periodically probing bandwidth capability of the network further comprise instructions for sending redundant data and bi-level video data across the network at the transmission bit rate;

responsive to the probing operation, holding, decreasing, or increasing the transmission bit rate, the increasing and decreasing operations respectively adjusting the transmission bit rate towards an upper or lower bit rate indicated by the bandwidth conditions, wherein the instructions for increasing the transmission bit rate further comprise instructions for calculating the transmission bit rate for a next time interval i+1 as follows;

B_aⁱ⁺¹=min{B_oⁱ+B_sⁱ+λ

, B_max},

such that B_aⁱ⁺¹ is an allowed bit rate used in a next probing operation, B_oⁱ represents a mean throughput in a time interval just past, B_sⁱ is a redundant data bit rate for a current time interval, B_max is a maximum allowed bit rate; and

λ

is a factor to adjust the transmission bit rate in view of potential error between estimated bandwidth and actual total available bandwidth; and

switching from bi-level to full-color video transmission, or vice versa, as a function of when the transmission bit rate respectively reaches the upper bit rate or the lower bit rate.

48. A computing device as recited in claim 47, wherein the full-color video has a color depth of 24 bits.

49. A computing device as recited in claim 47, wherein the instructions for estimating bandwidth conditions further comprise instructions for determining bandwidth conditions as a function of packet loss rate and data round-trip-time (RTT) determinations.

50. A computing device as recited in claim 47, wherein the instructions for transmitting further comprise instructions for initially transmitting bi-level video.

51. A computing device as recited in claim 47, wherein the instructions for estimating further comprise instructions for:

calculating a threshold band to indicate congested, loaded, and unloaded states of the network; and

mapping hold, decrease, and increase transmission bit rate decisions to corresponding ones of the congested, loaded, and unloaded states of the network.

52. A computing device as recited in claim 47, wherein the instructions for periodically probing bandwidth capability of the network further comprises sending redundant data and bi-level video data across the network to determine any increase or decrease in bandwidth capability of the network.

53. A computing device as recited in claim 47, wherein the computer-program instructions further comprise instructions for:

calculating a difference B_sⁱ⁺¹ between a previously allowed bit rate and an actual output bit rate that could have been supported as follows;

B_sⁱ⁺¹=min{B_aⁱ−

(B_oⁱ+B_sⁱ), S_max};

adding B_sⁱ⁺¹ to a target redundant data bit rate in a next probing operation; and

wherein and S_max is a maximum redundant bit rate.

54. A computing device as recited in claim 47 wherein the computer-program instructions further comprise instructions for:

identifying a consecutive number of probing operations that result in a decision to decrease the transmission bit rate; and

responsive to the identifying, stopping operations of periodically probing such that no redundant data is being transmitted across the network and such that the transmission bit rate is only associated with a bi-level video transmission bit rate.

55. A computing device as recited in claim 54, wherein the consecutive number of probing operations is two (2).