Rate adaptation method and device in multimedia streaming

• US 20040193762A1
• Filed: 02/13/2004
• Published: 09/30/2004
• Est. Priority Date: 02/13/2003
• Status: Active Grant

• Current Assignee: Nokia Technologies Oy (Nokia Corporation)
• Original Assignee: Nokia Corporation
• Inventors: Curcio, Igor Danilo Diego, Leon, David, Varsa, Viktor, Wang, Ru-Shang, Aksu, Emre Baris
• Granted Patent: US 7,558,869 B2
• Time in Patent Office: Days
• US Class Current: 710/52
• CPC Class Codes: H04L 47/10 Flow control; Congestion control
• CPC Class Codes: H04L 47/263 Rate modification at the source after receiving feedback
• CPC Class Codes: H04L 47/6255 queue load conditions, e.g. longest queue first
• CPC Class Codes: H04L 49/9078 using an external memory or storage device
• CPC Class Codes: H04L 65/1101 Session protocols
• CPC Class Codes: H04L 65/612 for unicast
• CPC Class Codes: H04L 65/613 for the control of the source by the destination control signals issued by the client directed to the server or network components specially adapted for selective content distribution H04N21/637
• CPC Class Codes: H04L 65/65 Network streaming protocols, e.g. real-time transport protocol [RTP] or real-time control protocol [RTCP]
• CPC Class Codes: H04L 65/70 Media network packetisation
• CPC Class Codes: H04L 65/752 adapting media to network capabilities
• CPC Class Codes: H04L 65/756 adapting media to device capabilities
• CPC Class Codes: H04L 65/80 Responding to QoS
• CPC Class Codes: H04L 67/01 Protocols
• CPC Class Codes: H04L 67/61 taking into account QoS or priority requirements
• CPC Class Codes: H04L 69/24 Negotiation of communication capabilities
• CPC Class Codes: H04L 69/329 in the application layer [OSI layer 7]
• CPC Class Codes: H04N 21/2401 Monitoring of the client buffer
• CPC Class Codes: H04N 21/2662 Controlling the complexity of the video stream, e.g. by scaling the resolution or bitrate of the video stream based on the client capabilities
• CPC Class Codes: H04N 21/41407 embedded in a portable device, e.g. video client on a mobile phone, PDA, laptop constructional details of equipment or arrangements specially adapted for portable computer application G06F1/1626; arrangements specially adapted for mobile receivers in broadcast systems H04H20/57
• CPC Class Codes: H04N 21/44004 involving video buffer management, e.g. video decoder buffer or video display buffer
• CPC Class Codes: H04N 21/6125 : involving transmission via Internet transmission by internet of broadcast information H04H60/82
• CPC Class Codes: H04N 21/6131 : involving transmission via a mobile phone network wireless downlink channel access H04W74/006
• CPC Class Codes: H04N 21/6332 : directed to client
• CPC Class Codes: H04N 21/6373 : for rate control , e.g. request to the server to modify its transmission rate flow control in packet networks H04L47/10
• CPC Class Codes: H04N 21/6375 : for requesting retransmission , e.g. of data packets lost or corrupted during transmission from serverARQ protocols H04L1/18; implementation or adaptation of Internet protocol [IP], of transmission control protocol [TCP] or of user datagram protocol [UDP] H04L69/16
• CPC Class Codes: H04N 21/6377 : directed to server one-way streaming services wherein the source is controlled by the destination H04L65/613
• CPC Class Codes: H04N 21/643 : Communication protocols network streaming protocols, e.g. real-time transport protocol [RTP] or real-time control protocol [RTCP], H04L65/65
• CPC Class Codes: H04N 21/6437 : Real-time Transport Protocol [RTP]
• CPC Class Codes: H04N 21/658 : Transmission by the client directed to the server

Abstract

A method for the client in a multimedia streaming network to control the receiver buffer fullness by way of effectively shifting the transmission clock in the server who provides streaming data to the client. In order to avoid buffer underflow or overflow, the client sends a message to the server requesting the shift of the transmission clock either forward or backward depending on whether the client wants to increase or decrease the receiver buffer. Based on the message, the server adjusts the data transmission amount by effectively shifting its transmission clock. The request from the client can be sent through RTCP or RTSP.

Claims

1. A method for adaptively controlling level of a receiver buffer in a client in a multimedia streaming network, the streaming network comprising a server for providing streaming data to the client, wherein the receiver buffer is used to compensate for difference between data transmission amount by the server and data usage amount by the client so as to allow the client to have sufficient amount of streaming data to play-out in a non-disruptive manner, and wherein the data transmission amount by the server is determined at least partially by a timestamp clock in the server for data transmission scheduling, said method comprising:

signaling to the server a message indicative of the receiver buffer level; and

adjusting at the server the data transmission amount in reference to the timestamp clock, based on the message.

2. The method of claim 1, wherein the message comprises a time-shift message indicative of an effective time-shift on the timestamp clock so as to allow the server to adjust the data transmission amount in reference to the time-shifted timestamp clock.

3. The method of claim 2, wherein the time-shift is in a direction to cause a decrease in the level in the receiver buffer.

4. The method of claim 2, wherein the time-shift is in a direction to cause an increase of the level in the receiver buffer.

5. The method of claim 2, wherein the message is further indicative of when the effective time-shift takes place.

6. The method of claim 2, wherein the message is further indicative of a request for an immediate time-shift.

7. The method of claim 2, wherein the message is further indicative of a period of time for achieving the time-shift.

8. The method of claim 2, wherein the message is further indicative of a maximum amount of the time-shift.

9. The method of claim 1, wherein the data transmission amount is also determined by a sampling rate in the server, and the message is used to change the sampling rate in the server so as to change the data transmission amount provided to the client.

10. The method of claim 1, wherein the message comprises a byte-shift message indicative of a change of streaming data amount so as to allow the server to adjust the data transmission amount.

11. The method of claim 1, wherein the message comprises a request sent via Real Time Control Protocol.

12. The method of claim 1, wherein the message comprises a request sent via Real Time Streaming Protocol.

13. A multimedia streaming network comprising:

at least a client; and

a server for providing streaming data to the client,

the client comprising;

a receiver buffer to compensate for difference between data transmission amount by the server and data usage amount by the client so as to allow the client to have sufficient amount of streaming data to play-out in a non-disruptive manner, and wherein the data transmission amount by the server is determined at least partially by a timestamp clock in the server for data transmission scheduling, and

a signaling mechanism for signaling to the server a message indicative of the receiver buffer level; and

the server comprising;

a further signaling mechanism for receiving the message signaled from the client, and

an adjusting mechanism for adjusting the data transmission amount in reference to the timestamp clock, based on the message.

14. The multimedia streaming network of claim 13, wherein the message comprises a time-shift message indicative of an effective time-shift on the timestamp clock so as to allow the server to adjust the data transmission amount in reference to the time-shifted timestamp clock.

15. The multimedia streaming network of claim 13, wherein the message comprises a byte-shift message indicative of a change of streaming data amount so as to allow the server to adjust the data transmission amount.