ADAPTIVE PLAYBACK WITH LOOK-AHEAD

• US 20130132525A1
• Filed: 01/14/2013
• Published: 05/23/2013
• Est. Priority Date: 12/04/2008
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google Inc. (Alphabet Inc.)
• Inventors: Tippin, Chad A.
• Granted Patent: US 9,112,938 B2
• Time in Patent Office: Days
• US Class Current: 709/219
• CPC Class Codes: H04L 65/60 Network streaming of media packets
• CPC Class Codes: H04N 21/23406 involving management of server-side video buffer
• CPC Class Codes: H04N 21/23424 involving splicing one content stream with another content stream, e.g. for inserting or substituting an advertisement
• CPC Class Codes: H04N 21/23439 for generating different versions
• CPC Class Codes: H04N 21/43072 of multiple content streams on the same device
• CPC Class Codes: H04N 21/44004 involving video buffer management, e.g. video decoder buffer or video display buffer
• CPC Class Codes: H04N 21/44016 involving splicing one content stream with another content stream, e.g. for substituting a video clip
• CPC Class Codes: H04N 21/44209 Monitoring of downstream path of the transmission network originating from a server, e.g. bandwidth variations of a wireless network arrangements for maintenance or administration in data switching networks involving bandwidth and capacity management H04L41/0896
• CPC Class Codes: H04N 21/4621 Controlling the complexity of the content stream or additional data, e.g. lowering the resolution or bit-rate of the video stream for a mobile client with a small screen arrangements for using the results of monitoring on user's side in broadcast systems H04H60/65; flow control in packet networks H04L47/10
• CPC Class Codes: H04N 21/6125 involving transmission via Internet transmission by internet of broadcast information H04H60/82
• CPC Class Codes: H04N 21/6373 for rate control , e.g. request to the server to modify its transmission rate flow control in packet networks H04L47/10
• CPC Class Codes: H04N 21/8456 by decomposing the content in the time domain, e.g. in time segments
• CPC Class Codes: H04N 7/17336 Handling of requests in head-ends

Abstract

The disclosure provides for a download agent executing on a computing device to dynamically select between media files when a portion of the media file that is currently being downloaded has a portion average playback rate that is greater than a throughput rate at which the computing device is receiving media files. During the portion where the portion average playback rate is greater than the throughput rate, the download agent may dynamically transition to a different media file where the portion average playback rate for the portion is less than or equal to the throughput rate. The download agent may then transition back to the original media file after downloading the portion form the different media file.

Claims

1. A method, comprising:

monitoring, by a device including a processor, a download of a first media file from a media server at a throughput rate and a concurrent playback of the first media file, wherein the first media file is a first version of a media asset, the first media file is encoded at a variable bit rate and has a first overall average playback rate less than or equal to the throughput rate, the first media file has a plurality of portions with respective portion average playback rates, wherein at least two portions have different portion average playback rates;

identifying, by the device, an undownloaded portion of the first media file that has a portion average playback rate that is greater than the throughput rate; and

forecasting, by the device, whether an interruption will occur in playback of the first media file during the undownloaded portion, wherein the forecasting comprises;

determining, by the device, an amount of bits buffered in a buffer;

determining, by the device, a duration of the undownloaded portion;

multiplying, by the device, the duration of the undownloaded portion and the portion average playback rate of the undownloaded portion to determine a number of bits that are played in the duration;

determining, by the device, a difference between the amount of bits buffered in the buffer and the number of bits that are played in the duration;

determining, by the device, whether the difference meets a threshold;

in response to a determination that the difference meets the threshold, forecasting, by the device, that the interruption will occur; and

in response to a determination that the difference does not meet the threshold, forecasting, by the device, that the interruption will not occur.

2. The method of claim 1, further comprising, in response to the forecasting that the interruption will occur, selecting, by the device, a second media file where a portion average playback rate of the second media file for a portion that is within the second media file and that corresponds to the undownloaded portion is less than or equal to the throughput rate, wherein the second media file is a second version of the media asset.

3. The method of claim 2, wherein the second media file is encoded at a variable bit rate and has a second overall average playback rate that is lower than the first overall average playback rate, the second media file has a plurality of portions with respective portion average playback rates, wherein at least two portions have different portion average playback rates;

4. The method of claim 2, wherein selecting the second media file comprises:

determining respective portion average playback rates for portions of a plurality of media files corresponding to versions of the media asset, wherein the portions correspond to the undownloaded portion; and

selecting the second media file from the plurality of media files based on the determining.

5. The method of claim 4, wherein the selected second media file has a portion corresponding to the undownloaded portion with a highest portion average playback rate of the portions of the plurality of media files.

6. The method of claim 2, wherein selecting the second media file further comprises:

dividing the portion average playback rate for the undownloaded portion by an overall average playback rate of the first media file to generate a ratio;

dividing the throughput rate by the ratio to generate a desired overall average playback rate; and

selecting the second media file from a plurality of media files corresponding to versions of the media asset, wherein an overall average playback rate for the second media file is closest to the desired overall average playback rate.

7. The method of claim 2, further comprising;

identifying, by the device, a first playback point in the first and second media files correlated to the undownloaded portion;

downloading, by the device, one or more portions of the second media file that include at least the first playback point and the portion within the second media file that corresponds to the undownloaded portion; and

transitioning, by the device, playback of the first media file to playback of the second media file at the identified first playback point.

9. The system of claim 1, wherein the playback controller is further configured to, in response to the forecasting that the interruption will occur, select a second media file where a portion average playback rate of the second media file for a portion that is within the second media file and that corresponds to the undownloaded portion is less than or equal to the throughput rate, wherein the second media file is a second version of the media asset.

10. The system of claim 9, wherein the second media file is encoded at a variable bit rate and has a second overall average playback rate that is lower than the first overall average playback rate, the second media file has a plurality of portions with respective portion average playback rates, wherein at least two portions have different portion average playback rates;

11. The system of claim 9, wherein to select the second media file comprises:

determine respective portion average playback rates for portions of a plurality of media files corresponding to versions of the media asset, wherein the portions correspond to the undownloaded portion; and

select the second media file from the plurality of media files based on the determined respective portion average playback rates.

12. The system of claim 11, wherein the selected second media file has a portion corresponding to the undownloaded portion with a highest portion average playback rate of the portions of the plurality of media files.

13. The system of claim 2, wherein to select the second media file comprises:

divide the portion average playback rate for the undownloaded portion by an overall average playback rate of the first media file to generate a ratio;

divide the throughput rate by the ratio to generate a desired overall average playback rate; and

select the second media file from a plurality of media files corresponding to versions of the media asset, wherein an overall average playback rate for the second media file is closest to the desired overall average playback rate.

14. The system of claim 9, wherein the playback controller is further configured to

identify a first playback point in the first and second media files correlated to the undownloaded portion;

download one or more portions of the second media file that include at least the first playback point and the portion within the second media file that corresponds to the undownloaded portion; and

transition playback of the first media file to playback of the second media file at the identified first playback point.

8. A system, comprising:

a processor;

a memory communicatively coupled to processor, the memory having stored therein computer-executable instructions, comprising;

a playback controller configured to;

monitor a download of a first media file from a media server at a throughput rate and a concurrent playback of the first media file, wherein the first media file is a first version of a media asset, the first media file is encoded at a variable bit rate and has a first overall average playback rate less than or equal to the throughput rate, the first media file has a plurality of portions with respective portion average playback rates, wherein at least two portions have different portion average playback rates;

identify an undownloaded portion of the first media file that has a portion average playback rate that is greater than the throughput rate; and

forecast whether an interruption will occur in playback of the first media file during the undownloaded portion, wherein the forecasting comprises;

determine an amount of bits buffered in a buffer;

determine a duration of the undownloaded portion;

multiplying the duration of the undownloaded portion and the portion average playback rate of the undownloaded portion to determine a number of bits that are played in the duration;

determine a difference between the amount of bits buffered in the buffer and the number of bits that are played in the duration;

determine whether the difference meets a threshold;

in response to a determination that the difference meets the threshold, forecast that the interruption will occur; and

in response to a determination that the difference does not meet the threshold, forecast that the interruption will not occur.

15. A non-transitory computer-readable storage medium comprising instructions that cause one or more processors to perform operations comprising:

monitoring a download of a first media file from a media server at a throughput rate and a concurrent playback of the first media file, wherein the first media file is a first version of a media asset, the first media file is encoded at a variable bit rate and has a first overall average playback rate less than or equal to the throughput rate, the first media file has a plurality of portions with respective portion average playback rates, wherein at least two portions have different portion average playback rates;

identifying an undownloaded portion of the first media file that has a portion average playback rate that is greater than the throughput rate; and

forecasting whether an interruption will occur in playback of the first media file during the undownloaded portion, wherein the forecasting comprises;

determining an amount of bits buffered in a buffer;

determining a duration of the undownloaded portion;

multiplying the duration of the undownloaded portion and the portion average playback rate of the undownloaded portion to determine a number of bits that are played in the duration;

determining a difference between the amount of bits buffered in the buffer and the number of bits that are played in the duration;

determining whether the difference meets a threshold;

in response to a determination that the difference meets the threshold, forecasting that the interruption will occur; and

in response to a determination that the difference does not meet the threshold, forecasting that the interruption will not occur.

16. The non-transitory computer-readable storage medium of claim 15, the operations further comprising, in response to the forecasting that the interruption will occur, selecting a second media file where a portion average playback rate of the second media file for a portion that is within the second media file and that corresponds to the undownloaded portion is less than or equal to the throughput rate, wherein the second media file is a second version of the media asset.

17. The non-transitory computer-readable storage medium of claim 15, wherein the second media file is encoded at a variable bit rate and has a second overall average playback rate that is lower than the first overall average playback rate, the second media file has a plurality of portions with respective portion average playback rates, wherein at least two portions have different portion average playback rates;

18. The non-transitory computer-readable storage medium of claim 16, wherein selecting the second media file comprises:

determining respective portion average playback rates for portions of a plurality of media files corresponding to versions of the media asset, wherein the portions correspond to the undownloaded portion; and

selecting the second media file from the plurality of media files based on the determining.

19. The non-transitory computer-readable storage medium of claim 18, wherein the selected second media file has a portion corresponding to the undownloaded portion with a highest portion average playback rate of the portions of the plurality of media files.

20. The non-transitory computer-readable storage medium of claim 16, wherein selecting the second media file further comprises:

dividing the portion average playback rate for the undownloaded portion by an overall average playback rate of the first media file to generate a ratio;

dividing the throughput rate by the ratio to generate a desired overall average playback rate; and

selecting the second media file from a plurality of media files corresponding to versions of the media asset, wherein an overall average playback rate for the second media file is closest to the desired overall average playback rate.