Pre-buffering audio streams

• US 9,021,537 B2
• Filed: 12/09/2010
• Issued: 04/28/2015
• Est. Priority Date: 12/09/2010
• Status: Active Grant

• Current Assignee: Netflix, Inc.
• Original Assignee: Netflix, Inc.
• Inventors: Funge, John, Peters, Greg
• Primary Examiner(s): Alcon, Fernando
• Application Number:
  US12/964,728
• Publication Number:
  US 20120151539A1
• Time in Patent Office: 1,601 Days
• Field of Search: None
• US Class Current: 725/94
• CPC Class Codes: H04L 43/0864 Round trip delays
• CPC Class Codes: H04L 47/621 Individual queue per connection or flow, e.g. per VC
• CPC Class Codes: H04L 65/61 for supporting one-way streaming services, e.g. Internet radio
• CPC Class Codes: H04L 65/612 for unicast
• CPC Class Codes: H04L 65/80 Responding to QoS
• CPC Class Codes: H04N 21/231 Content storage operation, e.g. caching movies for short term storage, replicating data over plural servers, prioritizing data for deletion
• CPC Class Codes: H04N 21/23406 involving management of server-side video buffer
• CPC Class Codes: H04N 21/2393 involving handling client requests scheduling or organising the servicing of application requests H04L67/60
• CPC Class Codes: H04N 21/43072 of multiple content streams on the same device
• CPC Class Codes: H04N 21/4392 involving audio buffer management
• CPC Class Codes: H04N 21/44004 involving video buffer management, e.g. video decoder buffer or video display buffer
• CPC Class Codes: H04N 21/647 Control signaling between network components and server or clients; Network processes for video distribution between server and clients, e.g. controlling the quality of the video stream, by dropping packets, protecting content from unauthorised alteration within the network, monitoring of network load, bridging between two different networks, e.g. between IP and wireless real-time session protocols H04L65/1101

Abstract

One embodiment of the present invention sets forth a technique for identifying and pre-buffering audio/video stream pairs. The method includes the steps of predictively identifying for pre-buffering at least one audio/video stream pair that may be selected for playback by a user subsequent to a currently playing audio/video stream pair, computing a first rate for pre-buffering an audio portion of the at least one audio/video stream pair and a second rate for pre-buffering a video portion of the at least one audio/video stream pair, downloading the audio portion at the first rate and downloading the video portion at the second rate, and storing the downloaded audio portion and the downloaded video portion in a content buffer.

Claims

1. A computer-implemented method for identifying and pre-buffering audio/video stream pairs, the method comprising:

outputting, for display, identification information for each of a plurality of audio/video stream pairs, each instance of identification information being directly selectable to play the corresponding audio/video stream;

predictively identifying for pre-buffering at least one audio/video stream pair, of the plurality of audio/video stream pairs, that may be selected for playback by a user subsequent to a currently playing audio/video stream pair;

computing a first rate for pre-buffering an audio portion of the predictively identified at least one audio/video stream pair and a second rate for pre-buffering a video portion of the predictively identified at least one audio/video stream pair, wherein the first rate and the second rates are proportional to a probability that the at least one audio/video stream pair may be selected for playback by the user subsequent to the currently playing audio/video stream pair;

initiating a download of the audio portion of the predictively identified at least one audio/video stream pair at the first rate and a download of the video portion of the predictively identified at least one audio/video stream pair at the second rate; and

storing the downloaded audio portion of the predictively identified at least one audio/video stream pair and the downloaded video portion of the predictively identified at least one audio/video stream pair in a content buffer, thereby pre-buffering the predictively identified at least one audio/video stream pair while playing the currently playing audio/video stream pair.

2. The method of claim 1, wherein the second rate is less than the first rate, wherein the download of the predictively identified at least one audio/video stream pair has not started prior to initiation of the download, wherein the identification information comprises:

(i) a title, and (ii) an image representing each respective at least one audio/video stream pair.

3. The method of claim 2, wherein predictively identifying the at least one audio/video stream pair comprises computing an ordering of the audio/video stream pairs computed to indicate which audio/video stream pair is most likely to be played next.

4. The method of claim 3, wherein computing an order comprises computing a probability indicating the likelihood of the at least one audio/video stream pair being selected for playback by the user subsequent to the currently playing audio/video stream pair.

5. The method of claim 4, wherein the probability computed for the at least one audio/video stream pair is greater than a pre-determined threshold.

6. The method of claim 5, wherein computing the first rate and the second rate is based on the probability computed for the predictively identified at least one audio/video stream pair.

7. The method of claim 6, wherein the probability computed for the predictively identified at least one audio/video stream pair is greater than a probability computed for a second audio/video stream pair, wherein the first rate is greater than a third rate computed for pre-buffering an audio portion of the second audio/video stream pair, and wherein the second rate is greater than a fourth rate computed for pre-buffering a video portion of the second audio/video stream pair, wherein the probability computed for the second audio/video stream pair is greater than a probability computed for a third audio/video stream pair, wherein the third rate is greater than a fifth rate computed for pre-buffering an audio portion of the third audio/video stream pair, wherein the fourth rate is greater than a sixth rate computed for pre-buffering a video portion of the third audio/video stream pair, wherein the third, fourth, fifth, and sixth rates are based on the probabilities for each respective audio/video stream pair.

8. The method of claim 7, wherein the probability computed for the predictively identified at least one audio/video stream pair is further based on a rating associated with the currently playing audio/video stream pair.

9. The method of claim 8, wherein the probability computed for the at least one audio/video stream pair is further based on a rating associated with the predictively identified at least one audio/video stream pair.

10. The method of claim 9, wherein the probability computed for the predictively identified at least one audio/video stream pair is further based on:

(i) an interaction with a user-interface performed by the user to select the currently playing audio/video stream pair for playback, and (ii) a number of other users having viewed the currently playing audio/video stream pair and subsequently selecting the predictively identified at least one audio/video stream pair, wherein the method is configured to allow playback of the predictively identified at least one audio/video stream pair to start faster without compromising audio quality.

11. A non-transitory computer-readable medium storing instructions that, when executed by a processor, cause the processor to identify and pre-buffer audio/video stream pairs, by performing the steps of:

outputting, for display, identification information for each of a plurality of audio/video stream pairs, each instance of identification information being directly selectable to play the corresponding audio/video stream;

predictively identifying for pre-buffering at least one audio/video stream pair, of the plurality of audio/video stream pairs, that may be selected for playback by a user subsequent to a currently playing audio/video stream pair;

computing a first rate for pre-buffering an audio portion of the predictively identified at least one audio/video stream pair and a second rate for pre-buffering a video portion of the predictively identified at least one audio/video stream pair, wherein the first rate and the second rates are proportional to a probability that the at least one audio/video stream pair may be selected for playback by the user subsequent to the currently playing audio/video stream pair;

initiating a download of the audio portion of the predictively identified at least one audio/video stream pair at the first rate and a download of the video portion of the predictively identified at least one audio/video stream pair at the second rate; and

storing the downloaded audio portion of the predictively identified at least one audio/video stream pair and the downloaded video portion of the predictively identified at least one audio/video stream pair in a content buffer, thereby pre-buffering the predictively identified at least one audio/video stream pair while playing the currently playing audio/video stream pair.

12. The non-transitory computer-readable medium of claim 11, wherein the second rate is less than the first rate, wherein the download of the at least one audio/video stream pair has not started prior to initiation of the download, wherein the identification information comprises:

(i) a title, and (ii) an image representing each respective at least one audio/video stream pair.

13. The non-transitory computer-readable medium of claim 12, wherein predictively identifying the at least one audio/video stream pair comprises computing an ordering of the audio/video stream pairs computed to indicate which audio/video stream pair is most likely to be played next.

14. The non-transitory computer-readable medium of claim 13, wherein computing an order comprises computing a probability indicating the likelihood of the at least one audio/video stream pair being selected for playback by the user subsequent to the currently playing audio/video stream pair.

15. The non-transitory computer-readable medium of claim 14, wherein the probability computed for the at least one audio/video stream pair is greater than a pre-determined threshold.

16. The non-transitory computer-readable medium of claim 15, wherein computing the first rate and the second rate is based on the probability computed for the predictively identified at least one audio/video stream pair.

17. The non-transitory computer-readable medium of claim 16, wherein the probability computed for the predictively identified at least one audio/video stream pair is greater than a probability computed for a second audio/video stream pair, wherein the first rate is greater than a third rate computed for pre-buffering an audio portion of the second audio/video stream pair, and wherein the second rate is greater than a fourth rate computed for pre-buffering a video portion of the second audio/video stream pair, wherein the probability computed for the second audio/video stream pair is greater than a probability computed for a third audio/video stream pair, wherein the third rate is greater than a fifth rate computed for pre-buffering an audio portion of the third audio/video stream pair, wherein the fourth rate is greater than a sixth rate computed for pre-buffering a video portion of the third audio/video stream pair, wherein the first, second, third, fourth, fifth, and sixth rates are based on the probabilities for each respective audio/video stream pair.

18. The non-transitory computer-readable medium of claim 17, wherein the probability computed for the predictively identified at least one audio/video stream pair is further based on a rating associated with the currently playing audio/video stream pair.

19. The non-transitory computer-readable medium of claim 18, wherein the probability computed for the predictively identified at least one audio/video stream pair is further based on a rating associated with the predictively identified at least one audio/video stream pair.

20. The non-transitory computer-readable medium of claim 19, wherein the probability computed for the predictively identified at least one audio/video stream pair is further based on:

(i) an interaction with a user-interface performed by the user to select the currently playing audio/video stream pair for playback, and (ii) a number of other users having viewed the currently playing audio/video stream pair and subsequently selecting the at predictively identified least one audio/video stream pair, wherein the instructions are configured to allow playback of the predictively identified at least one audio/video stream pair to start faster without compromising audio quality.

21. A system, comprising:

a processor; and

a memory configured to store instructions that, when executed by the processor, cause the processor to;

output, for display, identification information for each of a plurality of audio/video stream pairs, each instance of identification information being directly selectable to play the corresponding audio/video stream;

predictively identify for pre-buffering at least one audio/video stream pair, of the plurality of audio/video stream pairs, that may be selected for playback by a user subsequent to a currently playing audio/video stream pair;

compute a first rate for pre-buffering an audio portion of the predictively identified at least one audio/video stream pair and a second rate for pre-buffering a video portion of the predictively identified at least one audio/video stream pair, wherein the first rate and the second rates are proportional to a probability that the at least one audio/video stream pair may be selected for playback by the user subsequent to the currently playing audio/video stream pair;

initiate a download of the audio portion of the predictively identified at least one audio/video stream pair at the first rate and a download of the video portion of the predictively identified at least one audio/video stream pair at the second rate; and

store the downloaded audio portion of the predictively identified at least one audio/video stream pair and the downloaded video portion of the predictively identified at least one audio/video stream pair in a content buffer, thereby pre-buffering the predictively identified at least one audio/video stream pair while playing the currently playing audio/video stream pair.