Systems and methods for performing adaptive bitrate streaming based upon the delay of each stream and the channel rate

• US 9,021,119 B2
• Filed: 12/30/2011
• Issued: 04/28/2015
• Est. Priority Date: 01/06/2011
• Status: Active Grant

• Current Assignee: Sonic IP Incorporated (Endeavor Group Holdings Inc.)
• Original Assignee: Sonic IP Incorporated (Endeavor Group Holdings Inc.)
• Inventors: van der Schaar, Auke Sjoerd, Naderi, Som Vaezzadeh
• Primary Examiner(s): Shin, Kyung H
• Application Number:
  US13/341,667
• Publication Number:
  US 20120179834A1
• Time in Patent Office: 1,215 Days
• Field of Search: 709/231, 709/233, 375/240.21, 375/E7.013
• US Class Current: 709/231
• CPC Class Codes: H04N 19/115 Selection of the code volume for a coding unit prior to coding
• CPC Class Codes: H04N 19/156 Availability of hardware or computational resources, e.g. encoding based on power-saving criteria
• CPC Class Codes: H04N 19/187 the unit being a scalable video layer
• CPC Class Codes: H04N 19/30 using hierarchical techniques, e.g. scalability H04N19/63 takes precedence
• CPC Class Codes: H04N 19/70 characterised by syntax aspects related to video coding, e.g. related to compression standards
• CPC Class Codes: H04N 21/23439 for generating different versions
• CPC Class Codes: H04N 21/26258 for generating a list of items to be played back in a given order, e.g. playlist, or scheduling item distribution according to such list retrieval of multimedia data based on playlists G06F16/40
• CPC Class Codes: H04N 21/6379 directed to encoder , e.g. for requesting a lower encoding rate
• CPC Class Codes: H04N 21/8456 by decomposing the content in the time domain, e.g. in time segments

Abstract

Systems and methods for adaptive bitrate streaming in which playback devices select streams based upon stream delay and channel rate in accordance with embodiments of the invention are disclosed. One embodiment is configured to select a first video stream from a set of alternative streams, where at least a plurality of the alternative streams are encoded to have an upper bound seek delay that is equal to or less than the upper bound seek delay of streams in the set of alternative streams that are encoded at a higher maximum bitrate, request chunks of the first video stream and store the requested chunks in the buffer, playback the buffered chunks, measure the channel data rate, and select a second video stream from the set of alternative streams, where the second video stream has a maximum bitrate that is less than the measured channel data rate.

Claims

1. A playback device configured to perform adaptive bitrate streaming of media including a set of alternative video streams, the playback device comprising:

memory including a client application and a buffer; and

a processor, where the client application configures the processor to;

select a first video stream from a set of alternative video streams provided by a content server, where each stream in the set of alternative video streams is encoded to have an a different maximum bit rate and upper bound seek delay that is equal to or less than the upper bound seek delay of other streams in the set of alternative video streams that are encoded at a higher maximum bitrate;

request chunks of the first video stream from the content server via a network connection;

receive the chunks from the content server via the network connection;

store the requested chunks in the buffer;

playback the buffered chunks of the first video stream;

measure the channel data rate of the network connection; and

select a second video stream from the set of alternative streams, where the second video stream has a maximum bitrate that is less than the measured channel data rate, where the selected second stream has an upper bound seek delay that is less than the streams in the set of alternative streams that are encoded at a higher bit rate.

2. The playback device of claim 1, wherein the client application configures the processor to measure the channel data rate of the network connection by configuring the processor to:

calculate the amount of data downloaded during a predetermined time interval;

observe a duration of any gaps during which no data is downloaded during the predetermined time interval;

calculate an effective time interval by subtracting the duration of any gaps from the predetermined time interval; and

divide the amount of data downloaded by the effective time interval to obtain a data rate measurement.

3. The playback device of claim 2, wherein the client application further configures the processor to obtain a measured channel data rate by subtracting a predetermined safety margin from the data rate measurement.

4. The playback device of claim 1, wherein the client application configures the processor to determine a playback duration for the chunks from the first stream stored in the buffer and select a second video stream having the highest maximum bitrate that is less than the measured channel data rate in response to the buffer containing chunks from the first video stream having a playback duration greater than or equal to the upper bound seek delay of the first video stream.

5. The playback device of claim 1, wherein the client application configures the processor to determine a playback duration for the chunks from the first stream stored in the buffer and select a second video stream having the highest maximum bitrate that is less than the measured channel data rate in response to the buffer containing chunks from the first video stream having a playback duration greater than or equal to the upper bound seek delay of the second video stream.

6. The playback device of claim 5, wherein:

each stream in the set of the alternative streams of video is encoded subject to a maximum buffer size constraint and a maximum bitrate; and

the client application configures the processor to determine the upper bound seek delay of a stream of video based upon the maximum buffer size constraint and a maximum bitrate used in the encoding of the video stream.

7. The playback device of claim 6, wherein the client application configures the processor to determine the upper bound seek delay of a stream of video as:

8. The playback device of claim 1, wherein the client application configures the processor to select a second video stream from the set of alternative streams so that the playback duration of the amount of media downloaded from the second video stream during the time taken to playback buffered chunks of content from the first video stream is greater than or equal to the lower bound seek delay of the second video stream.

9. The playback device of claim 8, wherein:

the lower bound seek delay of each of the alternative video streams is included in each of the alternative video streams; and

the client application further configures the processor to obtain the lower bound seek delay of the second video stream from the first video stream.

10. The playback device of claim 1, wherein:

the set of alternative streams of video are H.264 bitstreams that carry delay information in a SEI buffering message in a initial_cpb_removal_delay field; and

the client application configures the processor to select a second video stream from the set of alternative streams so that the playback duration of the amount of media downloaded from the second video stream during the time taken to playback buffered chunks of content from the first video stream is greater than or equal to a delay calculated using the value specified in the of the SEI buffering message in an initial_cpb_removal_delay field in the second stream.

11. The playback device of claim 1, wherein:

a safe seek delay is included in each of the alternative video streams; and

the client application configures the processor to select a second video stream from the set of alternative streams so that the playback duration of the amount of media downloaded from the second video stream during the time taken to playback buffered chunks of content from the first video stream is greater than or equal to the safe seek delay.

12. The playback device of claim 11, wherein the streams in the set of alternative streams of video are H.264 bitstreams that carry the safe seek delay in a SEI buffering message in a initial_cpb_removal_delay field.

13. The playback device of claim 1, wherein the client application configures the processor to:

select the first video stream from the set of alternative streams so that the first video stream has a maximum bitrate that is a predetermined amount below the measured channel data rate; and

buffer chunks received from the first video stream during playback of the first video stream so that the playback duration of the buffered chunks is greater than or equal to the upper bound seek delay for the first video stream.

14. The playback device of claim 13, wherein the client application configures the processor to select a second video stream having the highest maximum bitrate that is less than the measured channel data rate when the buffer contains chunks from the first video stream having a playback duration greater than or equal to the upper bound seek delay of the first video stream.

15. The playback device of claim 1, wherein the client application configures the processor to select a second video stream having the lowest maximum bitrate when the buffer contains chunks from the first video stream having a playback duration less than the upper bound seek delay of the first video stream and the measured channel data rate is unreliable.

16. The playback device of claim 1, wherein the client application configures the processor to select a second video stream having a maximum bitrate that is greater than the maximum bitrate of the first video stream when the expected time to download a chunk of the first video stream based upon the measured channel data rate is a predetermined amount greater than the actual time taken to download the chunk of the first video stream and the buffer contains chunks from the first video stream having a playback duration greater than or equal to the upper bound seek delay of the first video stream.

17. A method of perform adaptive bitrate streaming of media including a set of alternative video streams, the method comprising:

selecting a first video stream from a set of alternative video streams provided by a content server using a playback device, where each of the streams in the set of alternative video streams is encoded to have a different maximum bitrate and an upper bound seek delay that is equal to or less than the upper bound seek delay of the streams in the set of alternative video streams that are encoded at a higher maximum bitrate;

requesting chunks of the first video stream from the content server via a network connection using the playback device;

receiving the chunks of the first video steam from the content server via the network connection;

storing the requested chunks in a buffer of the playback device;

playing back the buffered chunks of the first video stream using the playback device;

measuring the channel data rate of the network connection using the playback device; and

selecting a second video stream from the set of alternative streams using the playback device, where the second video stream has a maximum bitrate that is less than the measured channel data rate and an upper bound seek delay that is equal to or less than the upper bound seek delay of the streams in the set of alternative video streams that are encoded at a higher maximum bitrate.

18. The method of claim 17, wherein measuring the channel data rate of the network connection using the playback device further comprises:

calculating the amount of data downloaded during a predetermined time interval using the playback device;

observing a duration of any gaps during which no data is downloaded during the predetermined time interval using the playback device;

calculating an effective time interval by subtracting the duration of any gaps from the predetermined time interval using the playback device; and

dividing the amount of data downloaded by the effective time interval to obtain a data rate measurement using the playback device.

19. The method of claim 18, wherein measuring the channel data rate of the network connection using the playback device further comprises obtaining a measured channel data rate by subtracting a predetermined safety margin from the data rate measurement.

20. The method of claim 17, wherein selecting a second video stream from the set of alternative streams using the playback device further comprises determining a playback duration of the chunks contained in the buffer and selecting a second video stream using the playback device, where the second stream has the highest maximum bitrate that is less than the measured channel data rate in response to the buffer containing chunks from the first video stream having a playback duration greater than or equal to the upper bound seek delay of the first video stream.

21. The method of claim 17, wherein selecting a second video stream from the set of alternative streams using the playback device further comprises determining a playback duration of the chunks contained in the buffer and selecting a second video stream using the playback device, where the second stream has the highest maximum bitrate that is less than the measured channel data rate in response to the buffer containing chunks from the first video stream having a playback duration greater than or equal to the upper bound seek delay of the second video stream.

22. The method of claim 21, wherein each steam in the set of alternative streams of video is encoded subject to a maximum buffer size constraint and the method further comprises determining the upper bound seek delay of a stream of video using the playback device based upon the maximum buffer size constraint used in the encoding of the video stream.

23. The method of claim 22, further comprising determining the upper bound seek delay of a stream of video as:

24. The method of claim 17, wherein selecting a second video stream from the set of alternative streams using the playback device further comprises selecting a second video stream from the set of alternative streams using the playback device so that the playback duration of the amount of media downloaded from the second video stream during the time taken to playback buffered chunks of content from the first video stream is greater than or equal to the lower bound seek delay of the second video stream.

25. The method of claim 24, wherein the lower bound seek delay of each stream in the set of alternative video streams is included in each of the alternative video streams and the method further comprises obtaining the lower bound seek delay of the second video stream from the first video stream using the playback device.

26. The method of claim 17, wherein:

the streams in the set of alternative streams of video are H.264 bitstreams that carry delay information in a SEI buffering message in a initial_cpb_removal_delay field; and

selecting a second video stream from the set of alternative streams using the playback device further comprises selecting a second video stream from the set of alternative streams using the playback device so that the playback duration of the amount of media downloaded from the second video stream during the time taken to playback buffered chunks of content from the first video stream is greater than or equal to a delay calculated using the value specified in the of the SEI buffering message in an initial_cpb_removal_delay field in the second stream.

27. The method of claim 17, wherein:

a safe seek delay is included in each of the alternative video streams; and

the selecting of a second video stream from the set of alternative streams using the playback device further comprises selecting a second video stream from the set of alternative streams so that the playback duration of the amount of media downloaded from the second video stream during the time taken to playback buffered chunks of content from the first video stream is greater than or equal to the safe seek delay.

28. The method of claim 27, wherein the streams in the set of alternative streams of video are H.264 bitstreams that carry the safe seek delay in a SEI buffering message in a initial_cpb_removal_delay field.

29. The method of claim 17, wherein selecting a first video stream from the set of alternative streams further comprises:

selecting the first video stream from the set of alternative streams using the playback device so that first video stream has a maximum bitrate that is a predetermined amount below the measured channel data rate; and

buffering chunks of the first video stream during playback of the first video stream so that the playback duration of the amount of the buffered chunks from the first video stream is greater than or equal to the upper bound seek delay for the first video stream.

30. The method of claim 29, wherein selecting a second video stream from the set of alternative streams using the playback device further comprises selecting a second video stream using the playback device, where the second video stream has the highest maximum bitrate that is less than the measured channel data rate when the buffer contains chunks from the first video stream having a playback duration greater than or equal to the upper bound seek delay of the first video stream.

31. The method of claim 30, wherein selecting a second video stream from the set of alternative streams using the playback device further comprises selecting a second video stream using the playback device, where the second video stream has the lowest maximum bitrate when the buffer contains chunks from the first video stream having a playback duration less than the upper bound seek delay of the first video stream and the measured channel data rate is unreliable.

32. The method of claim 17, wherein selecting a second video stream from the set of alternative streams using the playback device further comprises selecting a second video stream using the playback device, where the second video stream has a maximum bitrate that is greater than the maximum bitrate of the first video stream when the expected time to download a chunk of the first video stream based upon the measured channel data rate is a predetermined amount greater than the actual time taken to download the chunk of the first video stream and the buffer contains chunks from the first video stream having a playback duration greater than or equal to the upper bound seek delay of the first video stream.