Apparatus, system, and method for adaptive-rate shifting of streaming content

• US 10,225,304 B2
• Filed: 07/11/2016
• Issued: 03/05/2019
• Est. Priority Date: 04/30/2004
• Status: Active Grant

• Current Assignee: Dish Technologies LLC (Dish Network Corporation)
• Original Assignee: Dish Technologies LLC (Dish Network Corporation)
• Inventors: Major, Robert Drew, Hurst, Mark B.
• Primary Examiner(s): Donabed, Ninos
• Application Number:
  US15/207,172
• Publication Number:
  US 20160323341A1
• Time in Patent Office: 967 Days
• CPC Class Codes: H04L 43/16 Threshold monitoring
• CPC Class Codes: H04L 47/25 with rate being modified by the source upon detecting a change of network conditions
• CPC Class Codes: H04L 65/60 Network streaming of media packets
• CPC Class Codes: H04L 65/75 Media network packet handling
• CPC Class Codes: H04L 65/756 adapting media to device capabilities
• CPC Class Codes: H04L 67/02 based on web technology, e.g. hypertext transfer protocol [HTTP]
• CPC Class Codes: H04L 69/16 Implementation or adaptation of Internet protocol [IP], of transmission control protocol [TCP] or of user datagram protocol [UDP]
• CPC Class Codes: H04N 21/23439 for generating different versions
• CPC Class Codes: H04N 21/25808 Management of client data terminal profiles in network data switching protocols H04L67/303
• CPC Class Codes: H04N 21/2662 Controlling the complexity of the video stream, e.g. by scaling the resolution or bitrate of the video stream based on the client capabilities
• CPC Class Codes: H04N 21/4331 Caching operations, e.g. of an advertisement for later insertion during playback
• CPC Class Codes: H04N 21/44016 involving splicing one content stream with another content stream, e.g. for substituting a video clip
• CPC Class Codes: H04N 21/44204 Monitoring of content usage, e.g. the number of times a movie has been viewed, copied or the amount which has been watched monitoring of user activities for profile generation for accessing a video database G06F16/739; protecting generic digital content where the protection is independent of the precise nature of the content G06F21/10; arrangements for monitoring the use made of the broadcast services in broadcast systems H04H60/31
• CPC Class Codes: H04N 21/44209 Monitoring of downstream path of the transmission network originating from a server, e.g. bandwidth variations of a wireless network arrangements for maintenance or administration in data switching networks involving bandwidth and capacity management H04L41/0896
• CPC Class Codes: H04N 21/643 Communication protocols network streaming protocols, e.g. real-time transport protocol [RTP] or real-time control protocol [RTCP], H04L65/65
• CPC Class Codes: H04N 21/64769 for rate control flow control in packet networks H04L47/10
• CPC Class Codes: H04N 21/64792 Controlling the complexity of the content stream, e.g. by dropping packets intermediate media network packet handling H04L65/765; proxy provisioning conversion or adaptation for reducing the amount or size of exchanged application data H04L67/5651; negotiation of resources in wireless networks H04W28/16
• CPC Class Codes: H04N 21/6587 Control parameters, e.g. trick play commands, viewpoint selection
• CPC Class Codes: H04N 21/84 Generation or processing of descriptive data, e.g. content descriptors systems specially adapted for using meta-information in broadcast systems H04H60/73
• CPC Class Codes: H04N 21/845 Structuring of content, e.g. decomposing content into time segments
• CPC Class Codes: H04N 21/8456 : by decomposing the content in the time domain, e.g. in time segments

Abstract

An apparatus for adaptive-rate shifting of streaming content includes an agent controller module configured to simultaneously request at least portions of a plurality of streamlets. The agent controller module is further configured to continuously monitor streamlet requests and subsequent responses, and accordingly request higher or lower quality streamlets. A staging module is configured to stage the streamlets and arrange the streamlets for playback on a content player. A system includes a data communications network, a content server coupled to the data communications network and having a content module configured to process content and generate a plurality of high and low quality streams, and the apparatus. A method includes simultaneously requesting at least portions of a plurality of streamlets, continuously monitoring streamlet requests and subsequent responses, and accordingly requesting higher or lower quality streamlets, and staging the streamlets and arranging the streamlets for playback on a content player.

Claims

1. An end user device for adaptive-rate content streaming of digital content from a video server over a network, the end user device comprising:

a media player operating on the end user device configured to stream a video from the video server via at least one transmission control protocol (TCP) connection over the network, wherein multiple different copies of the video encoded at different bit rates are stored on the video server as multiple sets of streamlets, wherein each of the streamlets yields a different portion of the video on playback, wherein the streamlets across the different copies yield the same portions of the video on playback, and wherein each of the streamlets comprises a time index such that the streamlets whose playback is the same portion of the video for each of the different copies have the same time index in relation to the beginning of the video, and wherein the media player streams the video by;

requesting sequential streamlets of one of the copies from the video server based on the time indexes;

automatically requesting subsequent portions of the video from the video server by requesting, for each portion of the video, one of the streamlets from one of the copies of the video dependent upon successive determinations by the media player to shift the playback quality to a higher or lower quality one of the different copies, the automatically requesting including repeatedly generating a factor relating to the performance of the network that is indicative of an ability to sustain the streaming of the video;

making the successive determinations to shift the playback quality based on the factor to achieve continuous playback of the video using the streamlets of the highest quality one of the copies that is determined to be sustainable at that time so that the media player upshifts to a higher quality one of the different copies when the factor is greater than a first threshold and downshifts to a lower quality one of the different copies when the factor is less than a second threshold; and

presenting the video by playing back the requested streamlets with the media player on the end user device in order of ascending playback time.

2. The end user device of claim 1, wherein the at least one TCP connection comprises multiple Transmission Control protocol (TCP) connections with the content server.

3. The end user device of claim 1 wherein each of the streamlets is a portion of a content file that represents one of the multiple different copies of the video content.

4. The end user device of claim 1 wherein each of the streamlets is a portion of a content file that represents one of the multiple different copies of the video content, and wherein each streamlet is encapsulated as an independent media object.

5. The end user device of claim 1 wherein each of the streamlets is a portion of a content file that represents one of the multiple different copies of the video content, and wherein each streamlet is independently-requestable by the end user device according to the time index.

6. The end user device of claim 1 wherein each of the streamlets is a portion of a content file that represents one of the multiple different copies of the video content, and wherein each streamlet is independently-requestable by the end user device sending an hypertext transport protocol (HTTP) GET request via the network that identifies the streamlet to the video server according to the time index.

7. The end user device of claim 1 wherein each of the streamlets is a content file representing the portion of one of the multiple different copies of the video content.

8. The end user device of claim 1 wherein each of the streamlets is a content file representing the portion of one of the multiple different copies of the video content, wherein each content file is independently-requestable by the end user device sending a hypertext transport protocol (HTTP) GET request via the network that identifies the streamlet to the video server according to the time index.

9. A method executable by an end user device to present rate-adaptive streams received via at least one transmission control protocol (TCP) connection with a server over a network, the method comprising;

streaming, by a media player operating on the end user device, a video from the server via the at least one TCP connection over the network, wherein multiple different copies of the video encoded at different bit rates are stored as multiple sets of streamlets on the server, wherein each of the streamlets yields a different portion of the video on playback, wherein the streamlets across the different copies yield the same portions of the video on playback, and wherein each of the streamlets comprises a time index such that the streamlets whose playback is the same portion of the video for each of the different copies have the same time index in relation to the beginning of the video, and wherein the streaming comprises;

requesting by the media player a plurality of sequential streamlets of one of the copies from the server based on the time indexes;

automatically requesting by the media player from the server subsequent portions of the video by requesting for each such portion one of the streamlets from one of the copies dependent upon successive determinations by the media player to shift the playback quality to a higher or lower quality one of the different copies, the automatically requesting including repeatedly generating a factor relating to the performance of the network that is indicative of an ability to sustain the streaming of the video;

making the successive determinations to shift the playback quality based on the factor to achieve continuous playback of the video using the streamlets of the highest quality copy determined sustainable at that time, wherein the making the successive determinations to shift comprises upshifting to a higher quality one of the different copies when the at least one factor is greater than a first threshold and downshifting to a lower quality one of the different copies when the at least one factor is less than a second threshold; and

presenting the video by playing back the requested media streamlets with the media player on the end user device in order of ascending playback time.

10. The method of claim 9, wherein the at least one TCP connection comprises a plurality of different connections, and wherein the requesting the plurality of sequential streamlets includes requesting sub-parts of the streamlets over different ones of the plurality of different TCP connections, and wherein said presenting includes reassembling the streamlets from the received sub-parts.

11. The method of claim 9, wherein the server is a web server, and wherein the streamlets are requested from the web server using Hyper Text Transfer Protocol (HTTP) messages sent via the at least one TCP connection.

12. The method of claim 9, wherein the server comprises a cache server of a network infrastructure operator.

13. The method of claim 9 wherein each of the streamlets is a portion of a content file that represents one of the multiple different copies of the video content.

14. The method of claim 9 wherein each of the streamlets is a portion of a content file that represents one of the multiple different copies of the video content, and wherein each streamlet is encapsulated as an independent media object.

15. The method of claim 9 wherein each of the streamlets is a portion of a content file that represents one of the multiple different copies of the video content, and wherein each streamlet is independently-requestable by the end user device according to the time index.

16. The method of claim 9 wherein each of the streamlets is a portion of a content file that represents one of the multiple different copies of the video content, and wherein each streamlet is independently-requestable by the end user device sending an hypertext transport protocol (HTTP) GET request via the network that identifies the streamlet to the video server according to the time index.

17. The method of claim 9 wherein each of the streamlets is a content file representing the portion of one of the multiple different copies of the video content.

18. The method of claim 9 wherein each of the streamlets is a content file representing the portion of one of the multiple different copies of the video content, wherein each content file is independently-requestable by the end user device sending a hypertext transport protocol (HTTP) GET request via the network that identifies the streamlet to the video server according to the time index.

19. An end user device to present rate-adaptive streams received via at least one transmission control protocol (TCP) connection with a server over a network, the end user device comprising a processor and a memory, wherein the memory comprises computer-executable instructions that, when executed by the processor, perform a method comprising:

streaming, by a media player operating on the end user device, a video from the server via the at least one TCP connection over the network, wherein multiple different copies of the video encoded at different bit rates are stored as multiple sets of streamlets on the server, wherein each of the streamlets yields a different portion of the video on playback, wherein the streamlets across the different copies yield the same portions of the video on playback, and wherein each of the streamlets comprises a time index such that the streamlets whose playback is the same portion of the video for each of the different copies have the same time index in relation to the beginning of the video, and wherein the streaming comprises;

requesting by the media player a plurality of sequential streamlets of one of the copies from the server based on the time indexes;

automatically requesting by the media player from the server subsequent portions of the video by requesting for each such portion one of the streamlets from one of the copies dependent upon successive determinations by the media player to shift the playback quality to a higher or lower quality one of the different copies, the automatically requesting including repeatedly generating a factor relating to the performance of the network that is indicative of an ability to sustain the streaming of the video;

making the successive determinations to shift the playback quality based on the factor to achieve continuous playback of the video using the streamlets of the highest quality copy determined sustainable at that time, wherein the making the successive determinations to shift comprises upshifting to a higher quality one of the different copies when the at least one factor is greater than a first threshold and downshifting to a lower quality one of the different copies when the at least one factor is less than a second threshold; and

presenting the video by playing back the requested media streamlets with the media player on the end user device in order of ascending playback time.

20. The end user device of claim 19 wherein each of the streamlets is a portion of a content file that represents one of the multiple different copies of the video content.

21. The end user device of claim 19 wherein each of the streamlets is a portion of a content file that represents one of the multiple different copies of the video content, and wherein each streamlet is encapsulated as an independent media object.

22. The end user device of claim 19 wherein each of the streamlets is a portion of a content file that represents one of the multiple different copies of the video content, and wherein each streamlet is independently-requestable by the end user device according to the time index.

23. The end user device of claim 19 wherein each of the streamlets is a portion of a content file that represents one of the multiple different copies of the video content, and wherein each streamlet is independently-requestable by the end user device sending an hypertext transport protocol (HTTP) GET request via the network that identifies the streamlet to the video server according to the time index.

24. The end user device of claim 19 wherein each of the streamlets is a content file representing the portion of one of the multiple different copies of the video content.

25. The end user device of claim 19 wherein each of the streamlets is a content file representing the portion of one of the multiple different copies of the video content, wherein each content file is independently-requestable by the end user device sending a hypertext transport protocol (HTTP) GET request via the network that identifies the streamlet to the video server according to the time index.