Apparatus, system, and method for adaptive-rate shifting of streaming content

• US 8,868,772 B2
• Filed: 04/28/2005
• Issued: 10/21/2014
• Est. Priority Date: 04/30/2004
• Status: Active Grant

• Current Assignee: Dish Technologies LLC (Dish Network Corporation)
• Original Assignee: Echostar Technologies LLC (Echostar Corporation)
• Inventors: Major, R. Drew, Hurst, Mark B.
• Primary Examiner(s): Donabed, Ninos
• Application Number:
  US11/116,783
• Publication Number:
  US 20050262257A1
• Time in Patent Office: 3,463 Days
• Field of Search: 709/246
• US Class Current: 709/231
• CPC Class Codes: H04L 43/16 Threshold monitoring
• CPC Class Codes: H04L 47/25 with rate being modified by the source upon detecting a change of network conditions
• CPC Class Codes: H04L 65/60 Network streaming of media packets
• CPC Class Codes: H04L 65/75 Media network packet handling
• CPC Class Codes: H04L 65/756 adapting media to device capabilities
• CPC Class Codes: H04L 67/02 based on web technology, e.g. hypertext transfer protocol [HTTP]
• CPC Class Codes: H04L 69/16 Implementation or adaptation of Internet protocol [IP], of transmission control protocol [TCP] or of user datagram protocol [UDP]
• CPC Class Codes: H04N 21/23439 for generating different versions
• CPC Class Codes: H04N 21/25808 Management of client data terminal profiles in network data switching protocols H04L67/303
• CPC Class Codes: H04N 21/2662 Controlling the complexity of the video stream, e.g. by scaling the resolution or bitrate of the video stream based on the client capabilities
• CPC Class Codes: H04N 21/4331 Caching operations, e.g. of an advertisement for later insertion during playback
• CPC Class Codes: H04N 21/44016 involving splicing one content stream with another content stream, e.g. for substituting a video clip
• CPC Class Codes: H04N 21/44204 Monitoring of content usage, e.g. the number of times a movie has been viewed, copied or the amount which has been watched monitoring of user activities for profile generation for accessing a video database G06F16/739; protecting generic digital content where the protection is independent of the precise nature of the content G06F21/10; arrangements for monitoring the use made of the broadcast services in broadcast systems H04H60/31
• CPC Class Codes: H04N 21/44209 Monitoring of downstream path of the transmission network originating from a server, e.g. bandwidth variations of a wireless network arrangements for maintenance or administration in data switching networks involving bandwidth and capacity management H04L41/0896
• CPC Class Codes: H04N 21/643 Communication protocols network streaming protocols, e.g. real-time transport protocol [RTP] or real-time control protocol [RTCP], H04L65/65
• CPC Class Codes: H04N 21/64769 for rate control flow control in packet networks H04L47/10
• CPC Class Codes: H04N 21/64792 Controlling the complexity of the content stream, e.g. by dropping packets intermediate media network packet handling H04L65/765; proxy provisioning conversion or adaptation for reducing the amount or size of exchanged application data H04L67/5651; negotiation of resources in wireless networks H04W28/16
• CPC Class Codes: H04N 21/6587 Control parameters, e.g. trick play commands, viewpoint selection
• CPC Class Codes: H04N 21/84 Generation or processing of descriptive data, e.g. content descriptors systems specially adapted for using meta-information in broadcast systems H04H60/73
• CPC Class Codes: H04N 21/845 Structuring of content, e.g. decomposing content into time segments
• CPC Class Codes: H04N 21/8456 : by decomposing the content in the time domain, e.g. in time segments

Abstract

An apparatus for adaptive-rate shifting of streaming content includes an agent controller module configured to simultaneously request at least portions of a plurality of streamlets. The agent controller module is further configured to continuously monitor streamlet requests and subsequent responses, and accordingly request higher or lower quality streamlets. A staging module is configured to stage the streamlets and arrange the streamlets for playback on a content player. A system includes a data communications network, a content server coupled to the data communications network and having a content module configured to process content and generate a plurality of high and low quality streams, and the apparatus. A method includes simultaneously requesting at least portions of a plurality of streamlets, continuously monitoring streamlet requests and subsequent responses, and accordingly requesting higher or lower quality streamlets, and staging the streamlets and arranging the streamlets for playback on a content player.

Claims

1. A method for presenting rate-adaptive streams, the method comprising:

streaming by a media player operating on an end user station a video from a set of one or more servers, wherein each of a plurality of different copies of the video encoded at different bit rates is stored as multiple files on the set of servers, wherein each of the multiple files yields a different portion of the video on playback, wherein the multiple files across the different copies yield the same portions of the video on playback, each of said files having a time index such that the files whose playback is the same portion of the video for each of the different copies have the same time index in relation to the beginning of the video, and wherein the streaming comprises;

requesting by the media player a plurality of sequential ones of the files of one of the copies from the set of servers over a plurality of Transmission Control Protocol (TCP) connections based on the time indexes;

automatically requesting by the media player from the set of servers over the plurality of TCP connections subsequent portions of the video by requesting for each such portion one of the files from one of the copies dependent upon successive determinations by the media player to shift the playback quality to a higher or lower quality one of the different copies, said automatically requesting including,

repeatedly generating a set of one or more factors indicative of the current ability to sustain the streaming of the video using the files from different ones of the copies, wherein the set of one or more factors relate to the performance of the network; and

making the successive determinations to shift the playback quality based on at least one of the set of factors to achieve continuous playback of the video using the files of the highest quality one of the copies determined sustainable at that time; and

presenting the video by playing back with the media player on the end user station the requested files in order of ascending playback time.

2. The method of claim 1, wherein said requesting the plurality of sequential ones of the files includes requesting sub-parts of the files over different ones of the plurality of TCP connections, and wherein said presenting includes reassembling the files from the received sub-parts.

3. The method of claim 1, wherein said making the successive determinations to shift comprises:

upshifting to a higher quality one of the different copies when the at least one factor is greater than a first threshold; and

determining if the higher quality playback can be sustained.

4. The method of claim 3, wherein said making the successive determinations to shift comprises downshifting to a lower quality one of the different copies when the at least one factor is less than a second threshold.

5. The method of claim 1, further comprising:

receiving user input to enable one of fast-forward, skip randomly, and rewind functionality; and

requesting files of the video at a specified time index that is not the next sequential time in the current playback.

6. The method of claim 1,

wherein said requesting the plurality of sequential one of the files includes requesting the files from a low quality one of the different copies to enable instant playback of the video, and wherein said automatically requesting includes-upshifting to a higher quality one of the different copies.

7. The method of claim 1, wherein said requesting the plurality of sequential ones of the files includes requesting the plurality of sequential ones of the files over different ones of the plurality of TCP connections.

8. The method of claim 1, wherein said presenting comprises sequentially arranging the requested files from the different copies in the order of ascending playback time for playback with the media player on the end user station.

9. The method of claim 1, wherein said automatically requesting includes requesting sub-parts of the files over different ones of the plurality of TCP connections, and wherein said presenting includes reassembling the files from the received sub-parts.

10. The method of claim 1, wherein the at least one of the set of factors is indicative of the available bandwidth of the plurality of TCP connections.

11. The method of claim 1, wherein the at least one of the set of factors is indicative of latency of the requested files, wherein the latency is a time measure between when one of the requests is issued and a time that response data of the request begins to arrive at the end user station.

12. The method of claim 1, wherein the at least one of the set of factors is indicative of time intervals between successive receive times for each response to the requested files.

13. The method of claim 1, wherein the at least one of the set of factors is indicative of delays or losses in one or more of the plurality of TCP connections.

14. The method of claim 1, wherein at least one of the set of servers is a web server.

15. The method of claim 14, wherein the files are requested from the web server using Hyper Text Transfer Protocol (HTTP), and wherein the web server is without specialized server-side intelligence to respond to said requesting.

16. The method of claim 1, wherein at least one of the set of servers is a cache server of a network infrastructure operator.

17. The method of claim 1, wherein:

said generating the set of factors comprises;

monitoring time intervals between successive receive times for each of the requested files;

calculating a current performance ratio across a current window of the time intervals; and

calculating a current average of the performance ratio to obtain a current performance factor of the set of factors;

said making further comprises;

comparing the current performance factor with a set of one or more trigger thresholds; and

determining whether to upshift or downshift to a higher or lower quality one of the different copies based on said comparing.

18. The method of claim 1, wherein said making comprises:

comparing a current performance factor of the set of factors with a set of one or more trigger thresholds, wherein the set of one or more trigger thresholds is determined by a combination of two of the set of factors relating to a current read ahead margin and a minimum safety margin, wherein the current read ahead margin is an amount of contiguously available, sequentially arranged requested files of video received by the media player for playback at a current playback time index; and

determining whether to upshift or downshift to a higher or lower quality one of the different copies based on said comparing.

19. The method of claim 1, wherein:

said requesting comprises issuing for each of the plurality of sequential ones of the files a request with the filename of that file, and

said automatically requesting comprises issuing for each of the files a request with the filename of that file.

20. The method of claim 1, wherein the set of servers includes a content server storing the multiple files of the different copies, and wherein the set of servers includes one or more cache servers caching at least some of the files.

21. The method of claim 1, wherein the multiple files are independently cacheable by a cache server without specialized server-side intelligence.