Method and device for determining a jitter buffer level

• US 9,042,261 B2
• Filed: 02/07/2014
• Issued: 05/26/2015
• Est. Priority Date: 09/23/2009
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google Inc. (Alphabet Inc.)
• Inventors: Lundin, Henrik Fahlberg, Holmer, Stefan
• Primary Examiner(s): CHO, HONG SOL
• Application Number:
  US14/174,916
• Publication Number:
  US 20140153431A1
• Time in Patent Office: 473 Days
• Field of Search: None
• US Class Current: 370/252
• CPC Class Codes: H04L 43/0852 Delays
• CPC Class Codes: H04L 43/087 Jitter
• CPC Class Codes: H04L 43/106 using time related information in packets, e.g. by adding timestamps
• CPC Class Codes: H04L 49/90 Buffering arrangements
• CPC Class Codes: H04L 49/9005 using dynamic buffer space allocation
• CPC Class Codes: H04L 49/9023 for implementing a jitter-buffer

Abstract

A buffer level for jitter data buffer is determined. A frame payload size difference is determined for a plurality of video frames encoded into data packets sequentially received from a network. The difference is a difference in a payload size of a current frame and a previous frame. A frame network transit delay is determined as a difference in a transport time between the current frame and the previous frame and an expected transport time between the current frame and the previous frame. A slope and a variance of a linear relationship between the frame payload size difference and the frame network transit delay are determined for the plurality of video frames. Finally, a buffer level of a jitter data buffer is determined using a maximum frame payload size, an average frame payload size, the slope and the variance.

Claims

1. A method, comprising:

determining, using a processing unit, a frame payload size difference for a plurality of video frames encoded into data packets sequentially received from a communications network, wherein a frame payload size difference is a difference in a payload size of a current frame and a payload size of a previous frame;

determining, using the processing unit, a frame network transit delay for the plurality of video frames, wherein the frame network transit delay is a difference in a transport time between the current frame and the previous frame and an expected transport time between the current frame and the previous frame;

determining, using the processing unit, a slope and a variance of a linear relationship between the frame payload size difference and the frame network transit delay for at least some of the plurality of video frames; and

determining a buffer level of a jitter data buffer using a maximum frame payload size, an average frame payload size, the slope and the variance, the jitter data buffer located in memory associated with the processing unit.

2. The method of claim 1, further comprising:

calculating the expected transport time between the current frame and the previous frame by comparing timestamp information of the previous frame with timestamp information of the current frame.

3. The method of claim 2, further comprising:

calculating the transport time between the current frame and the previous frame by comparing a measured arrival time of the current frame with a measured arrival time of the previous frame.

4. The method of claim 1, further comprising:

calculating the transport time between the current frame and the previous frame by comparing a measured arrival time of the current frame with a measured arrival time of the previous frame.

5. The method of claim 1 wherein determining the slope and the variance comprises:

performing an adaptive filter algorithm updated upon arrival of each frame.

6. The method of claim 1, further comprising:

before determining the slope and the variance, identifying whether a frame of the plurality of frames has an absolute value of a difference between its frame network transit delay and a portion of frame network transit delay attributable to payload size variation between previous frames that exceeds a threshold value.

7. The method of claim 6, further comprising:

updating the linear relationship differently based on whether or not the absolute value exceeds the threshold.

8. The method of claim 1, further comprising:

sensing a discontinuous change in a parameter of the communications network, the parameter being indicative of traffic conditions in the communications network; and

adjusting at least one parameter used to determine the slope and the variance of the linear relationship based on the discontinuous change.

9. The method of claim 8 wherein adjusting at least one parameter comprises resetting the at least one parameter.

10. The method of claim 1, further comprising:

determining whether the current frame was transmitted earlier than the previous frame with regards to a transmission order of the plurality of frames.

11. The method of claim 10, further comprising:

omitting the current frame from determining the slope and the variance of the linear relationship when the current frame was transmitted earlier with regards to the transmission order.

12. An apparatus, comprising:

memory; and

a processing unit configured to execute instructions stored in the memory to;

determine a frame payload size difference for a plurality of video frames encoded into data packets sequentially received from a communications network, wherein a frame payload size difference is a difference in a payload size of a current frame and a payload size of a previous frame;

determine a frame network transit delay for the plurality of video frames, wherein the frame network transit delay is a difference in a transport time between the current frame and the previous frame and an expected transport time between the current frame and the previous frame;

determine a slope and a variance of a linear relationship between the frame payload size difference and the frame network transit delay for the plurality of video frames; and

determine a buffer level of a jitter data buffer using a maximum frame payload size, an average frame payload size, the slope and the variance, the jitter data buffer located in the memory.

13. The apparatus of claim 12 wherein the processing unit is configured to:

calculate the expected transport time between the current frame and the previous frame by comparing timestamp information of the previous frame with timestamp information of the current frame.

14. The apparatus of claim 12 wherein the processing unit is configured to:

calculate the transport time between the current frame and the previous frame by comparing a measured arrival time of the current frame with a measured arrival time of the previous frame.

15. The apparatus of claim 12 wherein the processing unit is configured to determine the slope and the variance by:

performing an adaptive filter algorithm updated upon arrival of each frame.

16. The apparatus of claim 12 wherein the processing unit is configured to, before determining the slope and the variance, identify whether a frame of the plurality of frames has an absolute value of a difference between its frame network transit delay and a portion of frame network transit delay attributable to payload size variation between previous frames that exceeds a threshold value.

17. The apparatus of claim 16 wherein the processing unit is configured to:

update the linear relationship differently based on whether or not the absolute value exceeds the threshold.

18. The apparatus of claim 12 wherein the processing unit is configured to:

sense a discontinuous change in a parameter of the communications network, the parameter being indicative of traffic conditions in the communications network; and

reset at least one parameter used to determine the slope and the variance of the linear relationship based on the discontinuous change.

19. The apparatus of claim 12 wherein the processing unit is configured to:

determine whether the current frame was transmitted earlier that the previous frame with regards to a transmission order of the plurality of frames.

20. The apparatus of claim 19 wherein the processing unit is configured to:

omit the current frame from determining the slope and the variance of the linear relationship when the current frame was transmitted earlier with regards to the transmission order.