Apparatus, system, and method for adaptive-rate shifting of streaming content

• US 9,407,564 B2
• Filed: 10/16/2014
• Issued: 08/02/2016
• Est. Priority Date: 04/30/2004
• Status: Active Grant

• Current Assignee: Dish Technologies LLC (Dish Network Corporation)
• Original Assignee: Echostar Technologies LLC (Echostar Corporation)
• Inventors: Major, Robert Drew, Hurst, Mark B.
• Primary Examiner(s): Donabed, Ninos
• Application Number:
  US14/516,303
• Publication Number:
  US 20150039782A1
• Time in Patent Office: 656 Days
• Field of Search: None
• US Class Current: 1/1
• CPC Class Codes: H04L 43/16 Threshold monitoring
• CPC Class Codes: H04L 47/25 with rate being modified by the source upon detecting a change of network conditions
• CPC Class Codes: H04L 65/60 Network streaming of media packets
• CPC Class Codes: H04L 65/75 Media network packet handling
• CPC Class Codes: H04L 65/756 adapting media to device capabilities
• CPC Class Codes: H04L 67/02 based on web technology, e.g. hypertext transfer protocol [HTTP]
• CPC Class Codes: H04L 69/16 Implementation or adaptation of Internet protocol [IP], of transmission control protocol [TCP] or of user datagram protocol [UDP]
• CPC Class Codes: H04N 21/23439 for generating different versions
• CPC Class Codes: H04N 21/25808 Management of client data terminal profiles in network data switching protocols H04L67/303
• CPC Class Codes: H04N 21/2662 Controlling the complexity of the video stream, e.g. by scaling the resolution or bitrate of the video stream based on the client capabilities
• CPC Class Codes: H04N 21/4331 Caching operations, e.g. of an advertisement for later insertion during playback
• CPC Class Codes: H04N 21/44016 involving splicing one content stream with another content stream, e.g. for substituting a video clip
• CPC Class Codes: H04N 21/44204 Monitoring of content usage, e.g. the number of times a movie has been viewed, copied or the amount which has been watched monitoring of user activities for profile generation for accessing a video database G06F16/739; protecting generic digital content where the protection is independent of the precise nature of the content G06F21/10; arrangements for monitoring the use made of the broadcast services in broadcast systems H04H60/31
• CPC Class Codes: H04N 21/44209 Monitoring of downstream path of the transmission network originating from a server, e.g. bandwidth variations of a wireless network arrangements for maintenance or administration in data switching networks involving bandwidth and capacity management H04L41/0896
• CPC Class Codes: H04N 21/643 Communication protocols network streaming protocols, e.g. real-time transport protocol [RTP] or real-time control protocol [RTCP], H04L65/65
• CPC Class Codes: H04N 21/64769 for rate control flow control in packet networks H04L47/10
• CPC Class Codes: H04N 21/64792 Controlling the complexity of the content stream, e.g. by dropping packets intermediate media network packet handling H04L65/765; proxy provisioning conversion or adaptation for reducing the amount or size of exchanged application data H04L67/5651; negotiation of resources in wireless networks H04W28/16
• CPC Class Codes: H04N 21/6587 Control parameters, e.g. trick play commands, viewpoint selection
• CPC Class Codes: H04N 21/84 Generation or processing of descriptive data, e.g. content descriptors systems specially adapted for using meta-information in broadcast systems H04H60/73
• CPC Class Codes: H04N 21/845 Structuring of content, e.g. decomposing content into time segments
• CPC Class Codes: H04N 21/8456 : by decomposing the content in the time domain, e.g. in time segments

Abstract

An apparatus for adaptive-rate shifting of streaming content includes an agent controller module configured to simultaneously request at least portions of a plurality of streamlets. The agent controller module is further configured to continuously monitor streamlet requests and subsequent responses, and accordingly request higher or lower quality streamlets. A staging module is configured to stage the streamlets and arrange the streamlets for playback on a content player. A system includes a data communications network, a content server coupled to the data communications network and having a content module configured to process content and generate a plurality of high and low quality streams, and the apparatus. A method includes simultaneously requesting at least portions of a plurality of streamlets, continuously monitoring streamlet requests and subsequent responses, and accordingly requesting higher or lower quality streamlets, and staging the streamlets and arranging the streamlets for playback on a content player.

Claims

1. An end user station for adaptive-rate content streaming of digital content from a video server over a network, the end user station comprising:

a media player operating on the end user station configured to stream a video from the video server via at least one transmission control protocol (TCP) connection over the network, wherein multiple different copies of the video encoded at different bit rates are stored on the video server as multiple sets of files, wherein each of the files yields a different portion of the video on playback, wherein the files across the different copies yield the same portions of the video on playback, and wherein each of the files comprises a time index such that the files whose playback is the same portion of the video for each of the different copies have the same time index in relation to the beginning of the video, and wherein the media player streams the video by;

requesting a plurality of sequential files of one of the copies from the video server based on the time indexes;

automatically requesting from the video server subsequent portions of the video by requesting for each such portion one of the files from one of the copies dependent upon successive determinations by the media player to shift the playback quality to a higher or lower quality one of the different copies, the automatically requesting including repeatedly generating a factor indicative of the current ability to sustain the streaming of the video using the files from different ones of the copies, wherein the set of one or more factors relate to the performance of the network;

making the successive determinations to shift the playback quality based on the factor to achieve continuous playback of the video using the files of the highest quality one of the copies determined sustainable at that time so that the media player upshifts to a higher quality one of the different copies when the factor is greater than a first threshold and downshifts to a lower quality one of the different copies when the factor is less than a second threshold; and

presenting the video by playing back the requested media files with the media player on the end user station in order of ascending playback time.

2. The end user station of claim 1, wherein the at least one TCP connection comprises multiple Transmission Control protocol (TCP) connections with the content server.

3. The end user station of claim 1, wherein the media player is configured to generate the factor according to the responses to segment requests.

4. The end user station of claim 1, wherein the media player is configured to upshift to the higher quality copy when the factor is greater than the first threshold and the media player determines the higher quality playback can be sustained according to a combination of factors.

5. The end user station of claim 1 wherein the media player is configured to upshift to the higher quality copy when the performance factor is greater than the first threshold and the media player determines that the higher quality playback can be sustained according to an amount of contiguously available files stored by the media player.

6. The end user station of claim 1, wherein the media player is further configured to anticipate file requests and to pre-request files to enable fast-forward, skip randomly, and rewind functionality.

7. The end user station of claim 1, wherein the media player is configured to initially request low quality files to enable instant playback of the video, and to subsequently upshift to a better quality copy of the video according to the performance factor.

8. A method executable by an end user station to present rate-adaptive streams received via at least one transmission control protocol (TCP) connection with a server over a network, the method comprising;

streaming, by a media player operating on the end user station, a video from the server via the at least one TCP connection over the network, wherein multiple different copies of the video encoded at different bit rates are stored as multiple sets of files on the server, wherein each of the files yields a different portion of the video on playback, wherein the files across the different copies yield the same portions of the video on playback, and wherein each of the files comprises a time index such that the files whose playback is the same portion of the video for each of the different copies have the same time index in relation to the beginning of the video, and wherein the streaming comprises;

requesting by the media player a plurality of sequential files of one of the copies from the server based on the time indexes;

automatically requesting by the media player from the server subsequent portions of the video by requesting for each such portion one of the files from one of the copies dependent upon successive determinations by the media player to shift the playback quality to a higher or lower quality one of the different copies, the automatically requesting including repeatedly generating a factor indicative of the current ability to sustain the streaming of the video using the files from different ones of the copies, wherein the factor relates to the performance of the network; and

making the successive determinations to shift the playback quality based on the factor to achieve continuous playback of the video using the files of the highest quality one of the copies determined sustainable at that time, wherein the making the successive determinations to shift comprises upshifting to a higher quality one of the different copies when the at least one factor is greater than a first threshold and downshifting to a lower quality one of the different copies when the at least one factor is less than a second threshold; and

presenting the video by playing back the requested media files with the media player on the end user station in order of ascending playback time.

9. The method of claim 8, wherein the at least one TCP connection comprises a plurality of different TCP connections, and wherein the requesting the plurality of sequential files includes requesting sub-parts of the files over different ones of the plurality of different TCP connections, and wherein said presenting includes reassembling the files from the received sub-parts.

10. The method of claim 8, wherein said making the successive determinations to shift comprises:

determining if the higher quality playback can be sustained.

11. The method of claim 8, wherein the at least one TCP connection comprises a plurality of different TCP connections, and wherein the automatically requesting includes requesting sub-parts of the files over different ones of the plurality of TCP connections, and wherein said presenting includes reassembling the files from the received sub-parts, and wherein the factor is indicative of the available bandwidth of the plurality of TCP connections.

12. The method of claim 8, wherein the factor is indicative of latency of the requested files, wherein the latency is a time measure between when one of the requests is issued and a time that response data of the request begins to arrive at the end user station.

13. The method of claim 8, wherein the factor is indicative of time intervals between successive receive times for each response to the requested files.

14. The method of claim 8, wherein the factor is indicative of delays or losses in one or more of the at least one TCP connection.

15. The method of claim 8, wherein the server is a web server, and wherein the files are requested from the web server using Hyper Text Transfer Protocol (HTTP) messages sent via the at least one TCP connection.

16. The method of claim 8, wherein the server comprises a cache server of a network infrastructure operator.