Flow control method for quality streaming of audio/video/media over packet networks

• US 7,274,661 B2
• Filed: 09/13/2002
• Issued: 09/25/2007
• Est. Priority Date: 09/17/2001
• Status: Expired due to Fees

• Current Assignee: Altera Corporation (Intel Corporation)
• Original Assignee: Altera Corporation (Intel Corporation)
• Inventors: Prakash, Adityo, Ratner, Edward R., Harrell, Chandlee, Miller, Thomas D., So, Hon Hing
• Primary Examiner(s): Pham; Chi
• Assistant Examiner(s): Jones; Prenell
• Application Number:
  US10/243,628
• Publication Number:
  US 20030067872A1
• Time in Patent Office: 1,838 Days
• Field of Search: 370/218, 370229-237, 370469-472, 370/252, 370/254, 370/328, 370/338, 370/352, 370/389, 370/401, 370/316, 370/463, 370/477, 370/335, 370/468, 370/342, 709231-237, 709/224, 709/238, 709/226, 709/227
• US Class Current: 370/229
• CPC Class Codes: H04L 47/10 Flow control; Congestion control
• CPC Class Codes: H04L 47/12 Avoiding congestion; Recovering from congestion
• CPC Class Codes: H04L 47/18 End to end
• CPC Class Codes: H04L 65/1101 Session protocols
• CPC Class Codes: H04L 65/612 for unicast
• CPC Class Codes: H04L 65/70 Media network packetisation
• CPC Class Codes: H04L 65/752 adapting media to network capabilities
• CPC Class Codes: H04L 65/80 Responding to QoS
• CPC Class Codes: H04N 21/23406 involving management of server-side video buffer
• CPC Class Codes: H04N 21/2343 involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements video transcoding H04N19/40; media packet handling at the source H04L65/762
• CPC Class Codes: H04N 21/23611 Insertion of stuffing data into a multiplex stream, e.g. to obtain a constant bitrate synchronisation arrangements in time-division multiplex systems using bit stuffing for systems with different or fluctuating information rates H04J3/073
• CPC Class Codes: H04N 21/23805 Controlling the feeding rate to the network, e.g. by controlling the video pump
• CPC Class Codes: H04N 21/2662 Controlling the complexity of the video stream, e.g. by scaling the resolution or bitrate of the video stream based on the client capabilities
• CPC Class Codes: H04N 21/44004 involving video buffer management, e.g. video decoder buffer or video display buffer
• CPC Class Codes: H04N 21/44209 Monitoring of downstream path of the transmission network originating from a server, e.g. bandwidth variations of a wireless network arrangements for maintenance or administration in data switching networks involving bandwidth and capacity management H04L41/0896
• CPC Class Codes: H04N 21/4424 Monitoring of the internal components or processes of the client device, e.g. CPU or memory load, processing speed, timer, counter or percentage of the hard disk space used error monitoring in general G06F11/30; arrangements for monitoring conditions of receiving stations in broadcast systems H04H60/32; diagnosis, testing or measuring for television receivers H04N17/04
• CPC Class Codes: H04N 21/47202 for requesting content on demand, e.g. video on demand
• CPC Class Codes: H04N 21/6125 involving transmission via Internet transmission by internet of broadcast information H04H60/82
• CPC Class Codes: H04N 21/6377 directed to server one-way streaming services wherein the source is controlled by the destination H04L65/613
• CPC Class Codes: H04N 21/6379 directed to encoder , e.g. for requesting a lower encoding rate
• CPC Class Codes: H04N 21/658 : Transmission by the client directed to the server

Abstract

A method and apparatus for client-side detection of network congestion in a best-effort packet network comprising streaming media traffic is disclosed. Said method and apparatus provide for quality streaming media services in a congested network with constrained bandwidth over the last-mile link. A client media buffer detects at least one level of congestion and signals a server to enact at least one error mechanism. Preferred error mechanisms include packet retransmissions, stream prioritization, stream acceleration, changes in media compression rate, and changes in media resolution. Said method and apparatus allow distributed management of network congestion for networks comprising multiple clients and carrying significant streaming media traffic.

Claims

1. An apparatus for detecting network congestion in a best-effort packet network, said packet network comprising at least one server and at least one client coupled to the at least one server via a link, said apparatus comprising:

a client media buffer at the at least one client;

a plurality of watermarks dividing said buffer into a plurality of regions depending on a presentation time for data remaining in the buffer; and

a signaling device operatively coupled to the buffer by which said buffer sends signals to the at least one server to enact an error avoidance mechanism when said buffer operates in at least one of the regions,

wherein the client media buffer operates in two modes, and wherein a first mode of the two modes comprises;

an active zone including a resume water mark;

an overflow alert zone above the active zone and separated from the active zone by a high water mark;

a prioritized recovery zone below the active zone and separated from the active zone by a low water mark; and

a stream switch zone below the prioritized recovery zone and separated from the prioritized recovery zone by an ultra low water mark.

2. The apparatus of claim 1, wherein a second mode of the two modes comprises:

a fill zone;

a switch test zone above the fill zone and separated from the fill zone by a resume mark; and

an overflow alert zone above the switch test zone and separated from the switch test zone by a high water mark.

3. The apparatus of claim 2, wherein said signals sent by the signaling device to the server depend upon the zone in which the client media buffer is operating.

4. The apparatus of claim 3, wherein when the overflow alert zone is reached in either said mode, then a pause signal is sent from the signaling device to the server to indicate that serving to that client media buffer is to be paused.

5. The apparatus of claim 4, wherein when the resume mark is crossed after having entered the overflow alert zone, then a resume signal is sent from the signaling device to the server to indicate that serving to that client media buffer is to be resumed.

6. The apparatus of claim 3, wherein when the prioritized recover zone is reached, then an increase priority signal is sent from the signaling device to the server to indicate that serving priority to that client media buffer is to be increased.

7. The apparatus of claim 6, wherein when the resume mark is crossed after having entered the prioritized recovery zone, then a resume signal is sent from the signaling device to the server to indicate that serving priority to that client media buffer is to be decreased.

8. The apparatus of claim 3, wherein when the stream switch zone is reached, then the signaling device sends a switch signal to the server to indicate to the server to begin transmitting to the client media buffer a stream encoded at a lower bit rate.

9. The apparatus of claim 8, wherein when the signaling device sends the switch signal to the server, the client media buffer enters the second mode in the fill zone.

10. The apparatus of claim 3, wherein when the switch test zone is reached, then the signaling device sends a switch test signal to the server to indicate to the server that it should begin to test conditions for switching from a lower-bit-rate stream to a higher-bit-rate stream.