System and method for selecting a transition point for transitioning between media streams

• US 10,097,604 B2
• Filed: 12/18/2013
• Issued: 10/09/2018
• Est. Priority Date: 08/01/2013
• Status: Active Grant

• Current Assignee: Spotify AB (Spotify Technology SA)
• Original Assignee: Spotify AB (Spotify Technology SA)
• Inventors: Hoffert, Eric, Strigeus, Ludvig, Oman, Andreas, Arvidsson, Oskar
• Primary Examiner(s): Srivastava, Vivek
• Assistant Examiner(s): Bukhari, Sibte H
• Application Number:
  US14/133,340
• Publication Number:
  US 20150039726A1
• Time in Patent Office: 1,756 Days
• Field of Search: 709219
• CPC Class Codes: H04L 65/60 Network streaming of media packets
• CPC Class Codes: H04L 65/612 for unicast
• CPC Class Codes: H04L 65/70 Media network packetisation
• CPC Class Codes: H04L 65/752 adapting media to network capabilities
• CPC Class Codes: H04L 65/764 at the destination reformatting of additional data in video clients H04N21/4355
• CPC Class Codes: H04L 65/765 intermediate
• CPC Class Codes: H04L 65/80 Responding to QoS
• CPC Class Codes: H04L 69/04 Protocols for data compression, e.g. ROHC
• CPC Class Codes: H04N 21/23439 for generating different versions
• CPC Class Codes: H04N 21/2353 specifically adapted to content descriptors, e.g. coding, compressing or processing of metadata
• CPC Class Codes: H04N 21/2402 Monitoring of the downstream path of the transmission network, e.g. bandwidth available traffic monitoring in data switching networks H04L43/00; monitoring data switching networks utilization H04L43/0876
• CPC Class Codes: H04N 21/262 Content or additional data distribution scheduling, e.g. sending additional data at off-peak times, updating software modules, calculating the carousel transmission frequency, delaying a video stream transmission, generating play-lists scheduling strategies for dispatcher in multiprogramming arrangements G06F9/4881; arrangements for scheduling broadcast services or broadcast-related services H04H60/06; flow control in packet networks H04L47/10; establishing a time schedule or organising the servicing of application requests H04L67/62
• CPC Class Codes: H04N 21/42623 involving specific decryption arrangements
• CPC Class Codes: H04N 21/4347 Demultiplexing of several video streams
• CPC Class Codes: H04N 21/4383 Accessing a communication channel
• CPC Class Codes: H04N 21/4384 involving operations to reduce the access time, e.g. fast-tuning for reducing channel switching latency
• CPC Class Codes: H04N 21/44004 involving video buffer management, e.g. video decoder buffer or video display buffer
• CPC Class Codes: H04N 21/44008 involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59
• CPC Class Codes: H04N 21/44016 involving splicing one content stream with another content stream, e.g. for substituting a video clip
• CPC Class Codes: H04N 21/4405 involving video stream decryption
• CPC Class Codes: H04N 21/44209 : Monitoring of downstream path of the transmission network originating from a server, e.g. bandwidth variations of a wireless network arrangements for maintenance or administration in data switching networks involving bandwidth and capacity management H04L41/0896
• CPC Class Codes: H04N 21/6125 : involving transmission via Internet transmission by internet of broadcast information H04H60/82
• CPC Class Codes: H04N 21/8458 : involving uncompressed content

Abstract

A computer system generates a first decompressed media stream based on a first compressed media stream. While providing the first decompressed media stream to the presentation device, the computer system receives a content-transition indication to switch to a second decompressed media stream. In response to receiving the content-transition indication, the computer system selects a first transition point in first content corresponding to the first compressed media stream and selects a second transition point in second content corresponding to the second compressed media stream. The second transition point is selected in accordance with a bandwidth available for receiving the second compressed media stream and the first transition point is selected based on the second transition point. The computer system requests the second compressed media stream starting at the second transition point and ceases to provide the first decompressed media stream at the first transition point in the first content.

Claims

1. A method comprising:

at a computer system including one or more processors and memory;

generating a first decompressed media stream based on a first compressed media stream;

providing the first decompressed media stream to a presentation device;

while providing the first decompressed media stream to the presentation device;

receiving a content-transition indication indicating that a second decompressed media stream is to be provided to the presentation device instead of the first decompressed media stream, wherein receiving the content-transition indication includes detecting user input selecting a media content affordance associated with requesting presentation of the second decompressed media stream;

in response to receiving the content-transition indication;

determining a predicted buffering time for buffering a second compressed media stream corresponding to the second decompressed media stream based on a bandwidth available for receiving the second compressed media stream;

identifying a plurality of candidate transition points in the second compressed media stream;

selecting a future transition point at which to start buffering the second compressed media stream based on the predicted buffering time, including selecting the future transition point from the plurality of candidate transition points based on the predicted buffering time for buffering the second compressed media stream;

requesting the second compressed media stream starting at the future transition point;

generating the second decompressed media stream based on the second compressed media stream starting at the future transition point; and

after generating the second decompressed media stream;

ceasing to provide the first decompressed media stream; and

starting to provide the second decompressed media stream at the future transition point.

2. The method of claim 1, wherein the first compressed media stream and the second compressed media stream correspond to different source content.

3. The method of claim 1, including:

determining a respective quantity of data corresponding to the second compressed media stream for downloading as buffered media based on;

a target play time of the buffered media; and

a bit rate of the second compressed media stream;

wherein the predicted buffering time for buffering the second compressed media stream is based on;

the respective quantity of data; and

the bandwidth available for receiving the second compressed media stream.

4. The method of claim 1, further including receiving a portion of the second compressed media stream starting at the future transition point.

5. The method of claim 1, wherein:

the future transition point is a second transition point; and

the method further includes;

prior to receiving the content-transition indication, receiving the first compressed media stream;

selecting a first transition point based on the second transition point; and

after selecting the first transition point, terminating receipt of the first compressed media stream after receiving data corresponding to the first transition point.

6. The method of claim 5, wherein:

the first decompressed video stream includes first video content that is divided into a first plurality of groups of frames;

the second decompressed video stream includes second video content that is divided into a second plurality of groups of frames;

the first transition point is selected so as to occur at a boundary of a first group of frames in the first plurality of groups of frames; and

the second transition point is selected so as to occur at a boundary of a second group of frames in the second plurality of groups of frames.

7. The method of claim 6, wherein:

the first transition point corresponds to an end of a scene in the first decompressed media stream; and

the second transition point corresponds to a beginning of a scene in the second decompressed media stream.

8. The method of claim 1, including:

while providing the first decompressed media stream to the presentation device;

storing first buffered data corresponding to the first decompressed media stream; and

receiving the second compressed media stream; and

after receiving the second compressed media stream and prior to starting to provide the second decompressed media stream, providing the first buffered data corresponding to the first decompressed media stream to the presentation device while preparing to generate the second decompressed media stream.

9. The method of claim 8, wherein:

the method further includes, while providing the first decompressed media stream to the presentation device, ceasing to generate the first decompressed media stream; and

the first buffered data corresponding to the first decompressed media stream is provided to the presentation device after ceasing to generate the first decompressed media stream.

10. The method of claim 8, wherein:

the first decompressed media stream is generated using a first codec;

the second decompressed media stream is generated using a second codec; and

the method further includes providing the first buffered data to the presentation device after the first codec has ceased to generate the first decompressed media stream and before the second codec has started to generate the second decompressed media stream.

11. The method of claim 8, wherein:

the first decompressed media stream is generated using a first codec;

the second decompressed media stream is generated using a second codec; and

the method further includes providing the first buffered data to the presentation device after the first codec has ceased to generate the first decompressed media stream and after the second codec has started to generate the second decompressed media stream.

12. The method of claim 8, wherein:

the first decompressed media stream is generated using a first codec;

the first buffered data is stored in a decompressed buffer; and

the method further includes, after the first codec has ceased to generate the first decompressed media stream;

continuing to provide the first buffered data to the presentation device;

storing second buffered data corresponding to the second decompressed media stream in the decompressed buffer; and

in accordance with a determination that an end of the first buffered data has been reached, starting to provide the second buffered data to the presentation device.

13. The method of claim 8, wherein the future transition point is a second transition point;

and

the method further includes;

selecting a first transition point based on the second transition point; and

after selecting the first transition point, ceasing to generate the first decompressed media stream after first buffered data corresponding to the first transition point has been generated.

14. The method of claim 13, further including, after receiving the content-transition indication and prior to ceasing to generate the first decompressed media stream, storing sufficient decompressed media content in the first buffered data to continue providing the first decompressed media stream to the presentation device until the first transition point is reached.

15. A computer system, the computer system comprising:

one or more processors; and

memory storing one or more programs configured to be executed by the one or more processors, the one or more programs including instructions for;

generating a first decompressed media stream based on a first compressed media stream;

providing the first decompressed media stream to a presentation device;

while providing the first decompressed media stream to the presentation device;

receiving a content-transition indication indicating that a second decompressed media stream is to be provided to the presentation device instead of the first decompressed media stream, wherein receiving the content-transition indication includes detecting user input selecting a media content affordance associated with requesting presentation of the second decompressed media stream;

in response to receiving the content-transition indication;

determining a predicted buffering time for buffering a second compressed media stream corresponding to the second decompressed media stream based on a bandwidth available for receiving the second compressed media stream;

identifying a plurality of candidate transition points in the second compressed media stream;

selecting a future transition point at which to start buffering the second compressed media stream based on the predicted buffering time, including selecting the future transition point from the plurality of candidate transition points based on the predicted buffering time for buffering the second compressed media stream;

requesting the second compressed media stream starting at the future transition point;

generating the second decompressed media stream based on the second compressed media stream starting at the future transition point; and

after generating the second decompressed media stream;

ceasing to provide the first decompressed media stream; and

starting to provide the second decompressed media stream at the future transition point.

16. A non-transitory computer readable storage medium storing one or more programs, the one or more programs comprising instructions, which when executed by a computer system with one or more processors, cause the computer system to:

generate a first decompressed media stream based on a first compressed media stream;

provide the first decompressed media stream to a presentation device;

while providing the first decompressed media stream to the presentation device;

receive a content-transition indication indicating that a second decompressed media stream is to be provided to the presentation device instead of the first decompressed media stream, wherein receiving the content-transition indication includes detecting user input selecting a media content affordance associated with requesting presentation of the second decompressed media stream;

in response to receiving the content-transition indication;

determine a predicted buffering time for buffering a second compressed media stream corresponding to the second decompressed media stream based on a bandwidth available for receiving the second compressed media stream;

identify a plurality of candidate transition points in the second compressed media stream;

select a future transition point at which to start buffering the second compressed media stream based on the predicted buffering time, including selecting the future transition point from the plurality of candidate transition points based on the predicted buffering time for buffering the second compressed media stream;

request the second compressed media stream starting at the future transition point;

generate the second decompressed media stream based on the second compressed media stream starting at the future transition point; and

after generating the second decompressed media stream;

cease to provide the first decompressed media stream; and

start to provide the second decompressed media stream at the future transition point.