Method for enabling packet transfer delay compensation in multimedia streaming

• US 20040057446A1
• Filed: 07/16/2003
• Published: 03/25/2004
• Est. Priority Date: 07/16/2002
• Status: Abandoned Application

• Current Assignee: Nokia Corporation
• Original Assignee: Nokia Corporation
• Inventors: Varsa, Viktor, Wang, Ru-Shang, Aksu, Emre Baris, Guerrero, Durhan
• Application Number:
  US10/623,133
• Publication Number:
  US 20040057446A1
• Time in Patent Office: Days
• US Class Current: 370/412
• CPC Class Codes: H04L 47/10 Flow control; Congestion control
• CPC Class Codes: H04L 47/22 Traffic shaping
• CPC Class Codes: H04L 47/263 Rate modification at the source after receiving feedback
• CPC Class Codes: H04L 47/28 in relation to timing considerations
• CPC Class Codes: H04L 47/283 in response to processing delays, e.g. caused by jitter or round trip time [RTT]
• CPC Class Codes: H04L 65/1101 Session protocols
• CPC Class Codes: H04L 65/70 Media network packetisation
• CPC Class Codes: H04L 65/80 Responding to QoS
• CPC Class Codes: H04N 21/2401 Monitoring of the client buffer
• CPC Class Codes: H04N 21/6332 directed to client
• CPC Class Codes: H04N 21/6336 directed to decoder
• CPC Class Codes: H04N 21/654 Transmission by server directed to the client

Abstract

A method and device for enabling packet transfer delay compensation in multimedia streaming. In order to enable a streaming server to optimally operate its rate-control and rate-shaping algorithms to compensate for packet transfer delay variation, information indicative of jitter buffering capabilities of the streaming client is conveyed to the streaming server. The information contains the client'"'"'s chosen pre-decoding parameters so that the client'"'"'s jitter buffering capabilities can be determined by the server based on the difference between the client'"'"'s chosen pre-decoding parameters and the pre-decoding buffering parameters provided by the streaming server.

Claims

1. A client-server collaboration method for enabling packet transfer delay variation compensation in a multimedia streaming system, in which a signal indicative of pre-decoding buffering parameters is provided by a streaming server to a streaming client, and wherein the pre-decoding buffering parameters indicated by the server are chosen such as to ensure that the client is able to play out a packet stream without client buffer violation if the packet stream is transmitted over a constant delay, reliable channel, said method comprising:

determining client'"'"'s chosen pre-decoding buffering parameters; and

providing information indicative of the client'"'"'s chosen pre-decoding buffering parameters to the server, so that the client'"'"'s jitter buffering capabilities can be determined based on a difference between the pre-decoding buffering parameters provided to the streaming server and the pre-decoding buffering parameters provided by the streaming server.

2. A method according to claim 1, wherein the pre-decoder buffer parameters provided by the server to the client are chosen based on the variable bit-rate characteristics of the transmitted packet stream and the buffering applied by the server.

3. A method according to claim 1, wherein the client provides the information indicative of the client'"'"'s chosen buffering parameters to the server as soon as the client determines the pre-decoding buffering parameters chosen to be used for a particular streaming session.

4. A method according to claim 1, wherein the client provides the information indicative of the client'"'"'s chosen buffering parameters to the server when starting a new streaming session.

5. A method according to any of claim 1, wherein the client is adapted to dynamically change its buffering parameters during a streaming session, said method further comprising

providing further information indicative of the client'"'"'s changed buffering parameters to the server during the streaming session.

6. A method according claim 1, further comprising

applying in the streaming server rate-control and/or rate shaping algorithms that utilize the information indicative of the client'"'"'s chosen pre-decoding buffering parameters to compensate for packet transfer delay and channel rate variations.

7. A method according to claim 1, wherein the streaming server optionally considers the information indicative of the client'"'"'s chosen buffering parameters in rate control and/ or rate shaping.

8. A method according to claim 1, wherein the information indicative of the client'"'"'s chosen buffering parameters includes at least one of the following:

information regarding a size of the client'"'"'s pre-decoder buffer,

information regarding a pre-decoder buffering period, and

information regarding a post-decoder buffering time.

9. A method according to claim 1, wherein the streaming client provides the information indicative of the client'"'"'s chosen pre-decoding buffering parameters to the streaming server in an RTSP OPTIONS request message.

10. A method according to claim 1, wherein the streaming client provides the information indicative of the client'"'"'s chosen pre-decoding buffering parameters to the streaming server in an RTSP PLAY request message.

11. A method according to claim 1, wherein the streaming client provides the information indicative of the client'"'"'s chosen pre-decoding buffering parameters to the streaming server in an RTSP PING request message.

12. A method according to claim 1, further comprising

determining in the streaming client whether the streaming server supports the signaling of client buffering parameters.

13. A streaming client device including at least one buffer, comprising:

means for receiving a packet stream from a streaming server and storing the packet stream in the at least one buffer;

means for playing-out the packet stream; and

means for providing information indicative of the client'"'"'s chosen buffering parameters to the streaming server.

14. A streaming client device according to claim 13, wherein said at least one buffer comprises a pre-decoder buffer and a delay jitter buffer.

15. A streaming client device according to claim 13, wherein said at least one buffer comprises a pre-decoder buffer, a delay jitter buffer and a post-decoder buffer.

16. A streaming client device according to claim 14, wherein the pre-decoder buffer and delay jitter buffer are integrated as a single unit.

17. A streaming client device according to claim 15, wherein the pre-decoder buffer and the delay jitter buffer are integrated as a single unit.

18. A streaming client device according to claim 13, further comprising

means for receiving an indication of pre-decoder buffering parameters chosen by the streaming server.

19. A streaming client device according to claim 13, wherein the client device provides the information indicative of the client'"'"'s chosen buffering parameters to the server as soon as the client determines the buffering parameters chosen to be used for a particular streaming session.

20. A streaming client device according to claim 13, wherein the client device provides the information indicative of the client'"'"'s chosen buffering parameters to the server when starting a new streaming session.

21. A streaming client device according claim 13, wherein the client device is adapted to change its chosen buffering parameters dynamically during a streaming session, and wherein said providing means further providing information indicative of the client'"'"'s changed buffering parameters to the server during the streaming session.

22. A streaming client device according to claim 13, wherein the information indicative of the client'"'"'s chosen buffering parameters includes at least one of the following:

information regarding a size of the client'"'"'s pre-decoder buffer,

information regarding a pre-decoder buffering period, and

information regarding a post-decoder buffering time.

23. A streaming client device according to claim 13, wherein said providing means provides the information indicative of the client'"'"'s chosen buffering parameters to the streaming server in an RTSP OPTIONS request message.

24. A streaming client device according to claim 13, wherein said providing means provides the information indicative of the client'"'"'s chosen buffering parameters to the streaming server in an RTSP PLAY request message.

25. A streaming client device according claim 13, wherein said providing means provides the information indicative of the client'"'"'s chosen buffering parameters to the streaming server in an RTSP PING request message.

26. A streaming client device according to claim 13, wherein the client device is adapted to determine whether the streaming server supports the signaling of client buffering parameters.

27. A streaming server device comprising:

means for transmitting a packet stream to a streaming client device, and

means for receiving information indicative of chosen buffering parameters of the streaming client device.

28. A streaming server device according to claim 27, adapted to provide a signal indicative of pre-decoding buffering parameters to the streaming client, wherein said pre-decoding buffering parameters indicated by the server are chosen such as to ensure that the client device is able to play out the packet stream without client buffer violation if the packet stream is transmitted over a constant delay, reliable channel.

29. A streaming server device according to claim 27, adapted to apply rate-control and/or rate shaping algorithms that utilize the information indicative of the client'"'"'s chosen buffering parameters to compensate for packet transfer delay and channel rate variations occurring during transmission of said packet stream from the streaming server device to the streaming client device.

30. A streaming server device according to claim 27, adapted to optionally consider the information indicative of the client'"'"'s chosen buffering parameters in rate control and/or rate shaping.

31. A streaming server device according to claim 27, wherein the information indicative of the client'"'"'s buffering parameters received by the server includes at least one of the following:

information regarding a size of the client'"'"'s pre-decoder buffer,

information regarding a pre-decoder buffering period, and

information regarding a post-decoder buffering time.

32. A data streaming system comprising:

a streaming client device, and

a streaming server device, wherein the streaming client device comprises;

means for playing-out a packet stream provided by the streaming server device; and

means for providing information indicative of the client'"'"'s chosen buffering parameters to the streaming server device, and wherein the streaming server device comprises

means for transmitting the packet stream to the streaming client device, and

means for receiving the information indicative of the client'"'"'s chosen buffering parameters.