Flow control for media streaming

• US 7,743,183 B2
• Filed: 05/23/2005
• Issued: 06/22/2010
• Est. Priority Date: 05/23/2005
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Klemets, Anders E., Virdi, Gurpratap
• Primary Examiner(s): Patel; Niketa I
• Application Number:
  US11/135,201
• Publication Number:
  US 20060282566A1
• Time in Patent Office: 1,856 Days
• Field of Search: 710/52, 710/17, 710/34, 710/57, 710/60, 709/234, 711/118, 365/189.05
• US Class Current: 710/52
• CPC Class Codes: H04L 47/263 Rate modification at the source after receiving feedback
• CPC Class Codes: H04L 47/30 in combination with information about buffer occupancy at either end or at transit nodes
• CPC Class Codes: H04L 65/1101 Session protocols
• CPC Class Codes: H04L 65/613 for the control of the source by the destination control signals issued by the client directed to the server or network components specially adapted for selective content distribution H04N21/637
• CPC Class Codes: H04L 65/752 adapting media to network capabilities
• CPC Class Codes: H04L 65/756 adapting media to device capabilities
• CPC Class Codes: H04L 65/80 Responding to QoS
• CPC Class Codes: H04N 21/23406 involving management of server-side video buffer
• CPC Class Codes: H04N 21/2401 Monitoring of the client buffer
• CPC Class Codes: H04N 21/438 Interfacing the downstream path of the transmission network originating from a server, e.g. retrieving encoded video stream packets from an IP network
• CPC Class Codes: H04N 21/44004 involving video buffer management, e.g. video decoder buffer or video display buffer
• CPC Class Codes: H04N 21/6373 for rate control , e.g. request to the server to modify its transmission rate flow control in packet networks H04L47/10
• CPC Class Codes: H04N 21/6437 Real-time Transport Protocol [RTP]

Abstract

A client device receives streaming content from a host device. The streaming content is placed in one or more buffers prior to processing. Monitoring as to the capacity and fullness of the buffers is performed at the client device and information is sent to the host device. The host device adjusts the rate or flow of the streaming content based on the information provided by the client device.

Claims

1. A method implemented on a computing device using instructions executable by a processor, the method comprising:

determining maximum capacity of a plurality of buffers at a client playback device, wherein the maximum capacity is described in buffer information, wherein the plurality of buffers receive streaming content from a host device, and the plurality of buffers comprise at least one of;

jitter buffers, content buffers, audio buffers, or video buffers;

calculating available space in the plurality of buffers of the client playback device for a particular instance of time while content is streamed from the host device, wherein the available space is described in the buffer information;

sending the buffer information to the host device which allows the host device to adjust flow of streaming content to the client playback device based on the buffer information,

wherein sending the buffer information comprises sending the maximum capacity and the available space of the plurality of buffers; and

indicating a high percentage of buffer capacity of the plurality of the buffers is used, the host device slows a rate of content streamed to the client playback device, and indicating a low percentage of the buffer capacity of the plurality of the buffers is used, the host device increases the rate of content streamed to the client playback device,

wherein the buffer information for the client playback device is unique to the client playback device and the buffer information instructs the host device as to a fullness of a particular buffer of the plurality of buffers.

2. The method of claim 1 wherein the determining is performed on all buffers that receive the streaming content.

3. The method of claim 1 wherein the calculating the available space resolves in one or more of the following:

used space and free space;

wherein the available space is expressed in bytes or time units.

4. The method of claim 1 wherein the sending the buffer information is in the form of a buffer fullness report.

5. The method of claim 1 further comprising negotiating an exchange of the buffer information.

6. The method of claim 5 wherein the negotiating includes determining frequency as to how often the buffer information is sent to the host device.

7. The method of claim 5 wherein the negotiating includes identifying a communication protocol used to communicate the buffer information.

8. One or more computer-readable storage media comprising computer-executable instructions that, when executed, perform the method as recited in claim 1.

9. A method implemented at a host device using instructions executable by a processor, the method comprising:

negotiating exchange of buffer information with a client playback device, wherein the buffer information comprises maximum capacity of one or more buffers at the client playback device and available space in the one or more buffers of the client playback device for a particular instance of time while content is streamed from the host to the client playback device, and wherein the buffer information is unique to the client playback device;

receiving the buffer information from the client playback device; and

adjusting the rate of content streamed from the host device to the client playback device based on the buffer information, wherein when the buffer information indicates a high percentage of buffer capacity of the one or more buffers at the client playback device is used, the host device slows a rate of content streamed to the client playback device, and when the buffer information indicates a low percentage of the buffer capacity of the one or more buffers at the client playback device is used, the host device increases the rate of content streamed to the client playback device.

10. The method of claim 9 wherein the negotiating includes determining a frequency as to how often the buffer information is received from the client playback device.

11. The method of claim 9 wherein the adjusting is based on a deviation from an optimum buffer usage value.

12. The method of claim 9 wherein the adjusting performs one or more of the following:

adjusting transmission rate on a network and adjusting the encoding bit rate of the content.

13. The method of claim 9 further comprising waiting for a subsequent buffer information or using a prior buffer information in the event the buffer information is not received.

14. The method of claim 9 further comprising streaming content to the client playback device based on a predetermined rate or derived rate from prior buffer information in the event the buffer information is not received.

15. One or more computer-readable storage media comprising computer-executable instructions that, when executed, perform the method as recited in claim 9.

16. A computer comprising:

a processing unit;

a client playback application to consume streamed content;

one or more buffers that are accessible by and operated on by the processing unit, wherein the buffers receive streamed content from one or more sources; and

a buffer monitor that is accessible by and operated on by the processing unit, wherein the buffer monitor monitors the fullness level of the buffers, and generates buffer fullness reports based on the fullness level of the buffers in response to a negotiated frequency as to how often buffer fullness reports are to be sent to a host device by the computer, and

wherein the buffer fullness reports comprise maximum capacity of the one or more buffers and available space in the one or more buffers,

wherein a buffer fullness report is generated for a particular instance of time while content is streamed to the computer,

wherein the buffer fullness report is unique to the computer,

wherein the buffer fullness report instructs the host device as to the fullness level of a particular buffer of the buffers.

17. The computer of claim 16 wherein the buffers comprise an intermediary jitter buffer and a content buffer.

18. The computer of claim 16 wherein the buffers comprise a first buffer that stores encapsulated data content and a second buffer stores de-capsulated data content for decoding.

19. The computer of claim 16 wherein the buffer fullness reports are sent to a host device using a particular communication protocol.

20. The computer of claim 17 further comprising a decoder prior to the content buffer.