System and method for transitioning between receiving different compressed media streams

• US 9,654,531 B2
• Filed: 12/18/2013
• Issued: 05/16/2017
• Est. Priority Date: 08/01/2013
• Status: Active Grant

• Current Assignee: Spotify AB (Spotify Technology SA)
• Original Assignee: Spotify AB (Spotify Technology SA)
• Inventors: Strigeus, Ludvig, Arvidsson, Oskar, Oman, Andreas, Hoffert, Eric
• Primary Examiner(s): Bruckart, Benjamin R
• Assistant Examiner(s): Nguyen, Tien M
• Application Number:
  US14/133,352
• Publication Number:
  US 20150039781A1
• Time in Patent Office: 1,245 Days
• CPC Class Codes: H04L 65/60 Network streaming of media packets
• CPC Class Codes: H04L 65/612 for unicast
• CPC Class Codes: H04L 65/70 Media network packetisation
• CPC Class Codes: H04L 65/752 adapting media to network capabilities
• CPC Class Codes: H04L 65/764 at the destination reformatting of additional data in video clients H04N21/4355
• CPC Class Codes: H04L 65/765 intermediate
• CPC Class Codes: H04L 65/80 Responding to QoS
• CPC Class Codes: H04L 69/04 Protocols for data compression, e.g. ROHC
• CPC Class Codes: H04N 21/23439 for generating different versions
• CPC Class Codes: H04N 21/2353 specifically adapted to content descriptors, e.g. coding, compressing or processing of metadata
• CPC Class Codes: H04N 21/2402 Monitoring of the downstream path of the transmission network, e.g. bandwidth available traffic monitoring in data switching networks H04L43/00; monitoring data switching networks utilization H04L43/0876
• CPC Class Codes: H04N 21/262 Content or additional data distribution scheduling, e.g. sending additional data at off-peak times, updating software modules, calculating the carousel transmission frequency, delaying a video stream transmission, generating play-lists scheduling strategies for dispatcher in multiprogramming arrangements G06F9/4881; arrangements for scheduling broadcast services or broadcast-related services H04H60/06; flow control in packet networks H04L47/10; establishing a time schedule or organising the servicing of application requests H04L67/62
• CPC Class Codes: H04N 21/42623 involving specific decryption arrangements
• CPC Class Codes: H04N 21/4347 Demultiplexing of several video streams
• CPC Class Codes: H04N 21/4383 Accessing a communication channel
• CPC Class Codes: H04N 21/4384 involving operations to reduce the access time, e.g. fast-tuning for reducing channel switching latency
• CPC Class Codes: H04N 21/44004 involving video buffer management, e.g. video decoder buffer or video display buffer
• CPC Class Codes: H04N 21/44008 involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59
• CPC Class Codes: H04N 21/44016 involving splicing one content stream with another content stream, e.g. for substituting a video clip
• CPC Class Codes: H04N 21/4405 involving video stream decryption
• CPC Class Codes: H04N 21/44209 : Monitoring of downstream path of the transmission network originating from a server, e.g. bandwidth variations of a wireless network arrangements for maintenance or administration in data switching networks involving bandwidth and capacity management H04L41/0896
• CPC Class Codes: H04N 21/6125 : involving transmission via Internet transmission by internet of broadcast information H04H60/82
• CPC Class Codes: H04N 21/8458 : involving uncompressed content

Abstract

A computer system receives a first compressed media stream and stores corresponding data in a first compressed buffer. The computer system generates a first decompressed media stream based on the first compressed media stream. While providing the first decompressed media stream to a presentation device, the computer system receives a content-transition indication indicating that a second decompressed media stream is to be provided to the presentation device instead of the first decompressed media stream. While continuing to generate the first decompressed media stream using the first compressed buffer, the computer system receives a second compressed media stream corresponding to the second decompressed media stream and stores corresponding data in a second compressed buffer. After storing the data in the second compressed buffer, the computer system provides a second decompressed media stream, based on the second compressed media stream, to the presentation device instead the first decompressed media stream.

Claims

1. A method comprising:

at a computer system including one or more processors and memory;

receiving a first compressed media stream from a media source;

storing first data corresponding to the first compressed media stream in a first compressed buffer;

generating a first decompressed media stream based on the first compressed media stream;

providing the first decompressed media stream to a presentation device;

while providing the first decompressed media stream to the presentation device, receiving a content-transition indication indicating that a second decompressed media stream is to be provided to the presentation device instead of the first decompressed media stream;

in response to receiving the content-transition indication, ceasing to receive the first compressed media stream from the media source;

after ceasing to receive the first compressed media stream from the media source, continuing to provide the first decompressed media stream using the first data stored in the first compressed buffer;

determining a quantity of data of a second compressed media stream for downloading as buffered media, wherein the second compressed media stream corresponds to the second decompressed media stream and the quantity of data is based on;

a target play time of the buffered media;

and a bit rate of the second compressed media stream;

determining a predicted buffering time that it will take to buffer the second compressed media stream based on;

the quantity of data; and

bandwidth available for receiving the second compressed media stream;

selecting a transition point for the second compressed media stream based on the predicted buffering time;

while continuing to provide the first decompressed media stream using the first data stored in the first compressed buffer;

receiving the second compressed media stream corresponding to the second decompressed media stream starting at the transition point; and

storing second data corresponding to the second compressed media stream in a second compressed buffer; and

after storing the second data corresponding to the second compressed media stream in the second compressed buffer, providing the second decompressed media stream, based on the second compressed media stream, to the presentation device instead of providing the first decompressed media stream to the presentation device.

2. The method of claim 1, wherein generating the first decompressed media stream based on the first compressed media stream includes:

receiving the first compressed media stream;

decrypting the first compressed media stream;

demultiplexing the first compressed media stream;

storing decrypted and demultiplexed first compressed media stream data in the first compressed buffer; and

decompressing the first compressed media stream data using a first codec to generate the first decompressed media stream.

3. The method of claim 1, further including:

prior to receiving the content-transition indication, storing a first amount of decompressed media stream data; and

after receiving the content-transition indication, storing a second amount of decompressed media stream data that is larger than the first amount of decompressed media stream data.

4. The method of claim 1, wherein:

the first decompressed media stream is generated using a first codec;

the second decompressed media stream is generated using a second codec; and

the method further includes initializing the second codec after the first codec has stopped decompressing compressed media so that no more than one codec is decompressing compressed media at a time.

5. The method of claim 1, wherein receiving the content-transition indication includes detecting user input selecting a media content affordance associated with requesting presentation of the second decompressed media stream.

6. The method of claim 1, wherein:

receiving the content-transition indication includes detecting a decrease in the bandwidth available for receiving media streams at the computer system;

the method includes transmitting, to a media source, a request for a lower bandwidth version of content corresponding to the first decompressed media stream; and

the second compressed media stream is received in response to the request.

7. The method of claim 1, wherein:

receiving the content-transition indication includes detecting an increase in the bandwidth available for receiving media streams at the computer system;

the method includes transmitting, to a media source, a request for a higher bandwidth version of content corresponding to the first decompressed media stream; and

the second compressed media stream is received in response to the request.

8. The method of claim 1, further including, after generating at least a portion of the second decompressed media stream, cross fading first content from the first decompressed media stream with second content from the second decompressed media stream.

9. The method of claim 1, wherein the first compressed media stream corresponds to source content and the second compressed media stream corresponds to the same source content.

10. The method of claim 1, wherein the first compressed media stream and the second compressed media stream correspond to different source content.

11. The method of claim 1, wherein:

the transition point is a second transition point;

the method further includes, in response to receiving the content-transition indication, selecting a first transition point in first content corresponding to the first compressed media stream; and

providing the second decompressed media stream to the presentation device instead of providing the first decompressed media stream to the presentation device includes ceasing to provide the first content at the first transition point.

12. The method of claim 11, wherein:

the first transition point is selected based on the second transition point.

13. The method of claim 12, further including:

identifying a plurality of candidate transition points in the second compressed media stream;

wherein selecting the transition point based on the predicted buffering time comprises selecting the second transition point from the plurality of candidate transition points.

14. The method of claim 11, wherein:

the method further includes, after selecting the second transition point, requesting the second compressed media stream starting at the second transition point.

15. The method of claim 11, further including:

after selecting the first transition point, terminating receipt of the first compressed media stream after receiving data corresponding to the first transition point.

16. The method of claim 11, wherein:

the first content includes video content that is divided into a first plurality of groups of frames;

the second transition point is selected in second content that includes video content that is divided into a second plurality of groups of frames;

the first transition point in the first content is selected so as to occur at a boundary of a first group of frames in the first plurality of groups of frames; and

the second transition point in the second content is selected so as to occur at a boundary of a second group of frames in the second plurality of groups of frames.

17. The method of claim 16, wherein:

the first transition point corresponds to an end of a scene in the first decompressed media stream; and

the second transition point corresponds to a beginning of a scene in the second decompressed media stream.

18. A computer system, the computer system comprising:

one or more processors; and

memory storing one or more programs for execution by the one or more processors, the one or more programs including instructions for;

receiving a first compressed media stream from a media source;

storing first data corresponding to the first compressed media stream in a first compressed buffer;

generating a first decompressed media stream based on the first compressed media stream;

providing the first decompressed media stream to a presentation device;

while providing the first decompressed media stream to the presentation device, receiving a content-transition indication indicating that a second decompressed media stream is to be provided to the presentation device instead of the first decompressed media stream;

in response to receiving the content-transition indication, ceasing to receive the first compressed media stream from the media source;

after ceasing to receive the first compressed media stream from the media source, continuing to provide the first decompressed media stream using the first data stored in the first compressed buffer;

determining a quantity of data of a second compressed media stream for downloading as buffered media, wherein the second compressed media stream corresponds to the second decompressed media stream and the quantity of data is based on;

a target play time of the buffered media; and

a bit rate of the second compressed media stream;

determining a predicted buffering time that it will take to buffer the second compressed media stream based on;

the quantity of data; and

bandwidth available for receiving the second compressed media stream;

selecting a transition point for the second compressed media stream based on the predicted buffering time;

while continuing to provide the first decompressed media stream using the first data stored in the first compressed buffer;

receiving the second compressed media stream corresponding to the second decompressed media stream starting at the transition point; and

storing second data corresponding to the second compressed media stream in a second compressed buffer; and

after storing the second data corresponding to the second compressed media stream in the second compressed buffer, providing the second decompressed media stream, based on the second compressed media stream, to the presentation device instead of providing the first decompressed media stream to the presentation device.

19. A non-transitory computer readable storage medium storing one or more programs, the one or more programs comprising instructions, which when executed by a computer system with one or more processors, cause the computer system to:

receive a first compressed media stream from a media source;

store first data corresponding to the first compressed media stream in a first compressed buffer;

generate a first decompressed media stream based on the first compressed media stream;

provide the first decompressed media stream to a presentation device;

while providing the first decompressed media stream to the presentation device, receive a content-transition indication indicating that a second decompressed media stream is to be provided to the presentation device instead of the first decompressed media stream;

in response to receiving the content-transition indication, cease to receive the first compressed media stream from the media source;

after ceasing to receive the first compressed media stream from the media source, continue to provide the first decompressed media stream using the first data stored in the first compressed buffer;

determine a quantity of data of a second compressed media stream for downloading as buffered media, wherein the second compressed media stream corresponds to the second decompressed media stream and the quantity of data is based on;

a target play time of the buffered media; and

a bit rate of the second compressed media stream;

determine a predicted buffering time that it will take to buffer the second compressed media stream based on;

the quantity of data; and

bandwidth available for receiving the second compressed media stream;

select a transition point for the second compressed media stream based on the predicted buffering time;

while continuing to provide the first decompressed media stream using the first data stored in the first compressed buffer;

receive the second compressed media stream corresponding to the second decompressed media stream starting at the transition point; and

store second data corresponding to the second compressed media stream in a second compressed buffer; and

after storing the second data corresponding to the second compressed media stream in the second compressed buffer, provide the second decompressed media stream, based on the second compressed media stream, to the presentation device instead of providing the first decompressed media stream to the presentation device.