Systems and methods for encoding alternative streams of video for use in adaptive bitrate streaming

• US 10,326,987 B2
• Filed: 03/08/2017
• Issued: 06/18/2019
• Est. Priority Date: 01/06/2011
• Status: Active Grant

• Current Assignee: Sonic IP Incorporated (Endeavor Group Holdings Inc.)
• Original Assignee: DivX, LLC (f/k/a DivX CF Holdings LLC) (SoftBank Group Corp.)
• Inventors: van der Schaar, Auke Sjoerd
• Primary Examiner(s): Vo, Tung T
• Assistant Examiner(s): Becker, Joseph W
• Application Number:
  US15/453,714
• Publication Number:
  US 20170230655A1
• Time in Patent Office: 832 Days
• Field of Search: None
• CPC Class Codes: H04N 19/115 Selection of the code volume for a coding unit prior to coding
• CPC Class Codes: H04N 19/156 Availability of hardware or computational resources, e.g. encoding based on power-saving criteria
• CPC Class Codes: H04N 19/187 the unit being a scalable video layer
• CPC Class Codes: H04N 19/30 using hierarchical techniques, e.g. scalability H04N19/63 takes precedence
• CPC Class Codes: H04N 19/70 characterised by syntax aspects related to video coding, e.g. related to compression standards
• CPC Class Codes: H04N 21/23439 for generating different versions
• CPC Class Codes: H04N 21/26258 for generating a list of items to be played back in a given order, e.g. playlist, or scheduling item distribution according to such list retrieval of multimedia data based on playlists G06F16/40
• CPC Class Codes: H04N 21/6379 directed to encoder , e.g. for requesting a lower encoding rate
• CPC Class Codes: H04N 21/8456 by decomposing the content in the time domain, e.g. in time segments

Abstract

Systems and methods for encoding alternative streams for use in adaptive bitrate streaming based upon the delay of each stream in accordance with embodiments of the invention are described. One embodiment of the invention includes memory, and a processor configured by a source encoding application to: receive multimedia content, where the multimedia content includes source video data having a primary resolution and a primary sample aspect ratio; and encode the source video data as a set of alternative video streams, where: the alternative video streams have different maximum bitrates; and the alternative video streams are encoded to have an upper bound seek delay that is equal to or less than the upper bound seek delay of streams in the set of alternative video streams that are encoded at a higher maximum bitrate.

Claims

1. A playback device for playing content from a plurality of alternative streams, the playback device comprising:

a set of one or more processors; and

a non-volatile storage containing an application for causing the set of one or more processors to perform steps of;

obtaining a top level index file identifying a plurality of alternative video streams and specifying a maximum bitrate for each of the plurality of alternative video streams, where the plurality of alternative video streams comprises a first and a second alternative video stream and the specified maximum bitrate of the second alternative video stream is higher than the specified maximum bitrate of the first alternative video stream;

during an initial startup period;

obtaining at least one network data rate measurement;

selecting the first alternative video stream based upon a comparison between the specified maximum bitrates for each of the plurality of streams and the at least one network data rate measurement;

requesting at least one chunk of the first alternative video stream;

storing the at least one chunk of the first alternative video stream in a buffer of the playback device; and

playing back at least one chunk of the first alternative stream stored in the buffer;

obtaining at least one additional network data rate measurement;

determining that the network data rate is greater than the specified maximum bitrate for the second alternative video stream based upon the at least one additional network data rate measurement;

when the network data rate is determined to be greater than the specified maximum bitrate for the second alternative video stream, requesting at least one chunk of the second alternative video stream;

when a minimum buffer level criterion is satisfied based upon a playback duration of chunks of video content stored in the buffer of the playback device;

obtaining at least one further network data rate measurement;

selecting a stream from the plurality of alternative video streams based upon a playback duration of chunks of video content stored in the buffer of the playback device by selecting a stream from the plurality of alternative video streams such that the playback duration of chunks of video content stored in the buffer of the playback device is sufficient to prevent buffer underflow during downloading and playback of at least one chunk of the selected video stream based upon the at least one further network data rate measurement;

requesting at least one chunk of the selected stream from the plurality of alternative video streams;

storing the at least one chunk of the selected stream from the plurality of alternative video streams in the buffer of the playback device; and

playing back the at least one chunk of the selected stream from the plurality of alternative video streams stored in the buffer.

2. The playback device of claim 1, wherein the first alternative video stream has a lowest specified maximum bitrate of the plurality of alternative video streams.

3. The playback device of claim 1, wherein the application causes the set of one or more processors to perform a step of determining that the playback duration of chunks of video content stored in the buffer of the playback device is sufficient to prevent buffer underflow during downloading and playback of the at least one chunk of the selected video stream based upon the at least one further network data rate measurement by:

determining that the playback duration of the chunks of video content stored in the buffer of the playback device is greater than a lower bound seek delay of a sequence of a number of chunks of the selected stream.

4. The playback device of claim 3, wherein the application further causes the set of one or more processors to perform step of determining the lower bound seek delay by evaluating:

5. The playback device of claim 1, wherein the application causes the set of one or more processors to perform a step of determining that the playback duration of chunks of video content stored in the buffer of the playback device is sufficient to prevent buffer underflow during downloading and playback of the at least one chunk of the selected video stream based upon the at least one further network data rate measurement by:

determining that the playback duration of chunks of video content stored in the buffer of the playback device is greater than an upper bound seek delay of the selected stream.

6. The playback device of claim 5, wherein the application further causes the set of one or more processors to perform a step of determining the upper bound seek delay of the selected stream by evaluating:

7. The playback device of claim 1, wherein the buffer level criterion further comprises a network data rate reliability criterion.

8. The playback device of claim 1, wherein the application causes the set of one or more processors to perform the step of selecting the stream from the plurality of alternative video streams using a safety margin.

9. The playback device of claim 1, wherein the application causes the set of one or more processors to perform the step of selecting the stream from the plurality of alternative video streams using a hysteresis criterion.

10. A method of playing back media content from a plurality of alternative streams on a playback device, comprising:

obtaining a top level index file identifying a plurality of alternative video streams, and specifying a maximum bitrate for each of the plurality of alternative video streams, where the plurality of alternative video streams comprises a first and a second alternative video stream and the specified maximum bitrate of the second alternative video stream is higher than the specified maximum bitrate of the first alternative video stream;

during an initial startup period;

obtaining at least one network data rate measurement;

selecting the first alternative video stream based upon a comparison between the specified maximum bitrates for each of the plurality of streams and the at least one network data rate measurement;

requesting at least one chunk of the first alternative video stream;

storing the at least one chunk of the first alternative video stream in a buffer of the playback device;

playing back at least one chunk of the first alternative stream stored in the buffer;

obtaining at least one additional network data rate measurement;

determining that the network data rate is greater than the specified maximum bitrate for the second alternative video stream based upon the at least one additional network data rate measurement; and

when the network data rate is determined to be greater than the specified maximum bitrate for the second alternative video stream, requesting at least one chunk of the second alternative video stream; and

when a minimum buffer level criterion is satisfied based upon a playback duration of chunks of video content stored in the buffer of the playback device;

obtaining at least one further network data rate measurement;

selecting a stream from the plurality of alternative video streams based upon a playback duration of chunks of video content stored in the buffer of the playback device by selecting a stream from the plurality of alternative video streams such that the playback duration of chunks of video content stored in the buffer of the playback device is sufficient to prevent buffer underflow during downloading and playback of at least one chunk of the selected video stream based upon the at least one further network data rate measurement;

requesting at least one chunk of the selected stream from the plurality of alternative video streams;

storing the at least one chunk of the selected stream from the plurality of alternative video streams in the buffer of the playback device; and

playing back the at least one chunk of the selected stream from the plurality of alternative video streams stored in the buffer.

11. The method of claim 10, wherein the first alternative stream has a lowest specified maximum bitrate of the plurality of alternative video streams.

12. The method of claim 10, wherein determining that the playback duration of chunks of video content stored in the buffer of the playback device is sufficient to prevent buffer underflow during downloading and playback of the at least one chunk of the selected video stream based upon the at least one further network data rate measurement is performed by:

determining that the playback duration of the chunks of video content stored in the buffer of the playback device is greater than a lower bound seek delay of a sequence of a number of chunks of the selected stream.

13. The method of claim 12, wherein the lower bound seek delay is determined by evaluating:

14. The method of claim 10, wherein determining that the playback duration of chunks of video content stored in the buffer of the playback device is sufficient to prevent buffer underflow during downloading and playback of the at least one chunk of the selected video stream based upon the at least one further network data rate measurement is performed by:

determining that the playback duration of chunks of video content stored in the buffer of the playback device is greater than an upper bound seek delay of the selected stream.

15. The method of claim 14, wherein the upper bound seek delay of the selected stream is determined by evaluating:

16. The method of claim 10, wherein the buffer level criterion further comprises a network data rate reliability criterion.

17. The method of claim 10, wherein selecting the stream from the plurality of alternative video streams is performed using a safety margin.

18. The method of claim 10, wherein selecting the stream from the plurality of alternative video streams is performed using a hysteresis criterion.