Enhanced block-request streaming using block partitioning or request controls for improved client-side handling

• US 9,917,874 B2
• Filed: 09/21/2010
• Issued: 03/13/2018
• Est. Priority Date: 09/22/2009
• Status: Active Grant

• Current Assignee: Qualcomm, Inc.
• Original Assignee: Qualcomm, Inc.
• Inventors: Luby, Michael G., Watson, Mark, Vicisano, Lorenzo, Pakzad, Payam, Wang, Bin
• Primary Examiner(s): LEE, BRYAN Y
• Application Number:
  US12/887,483
• Publication Number:
  US 20110231569A1
• Time in Patent Office: 2,730 Days
• Field of Search: 709234
• CPC Class Codes: H04L 65/612 for unicast
• CPC Class Codes: H04L 65/70 Media network packetisation
• CPC Class Codes: H04L 65/752 adapting media to network capabilities
• CPC Class Codes: H04L 65/756 adapting media to device capabilities
• CPC Class Codes: H04L 65/762 at the source reformatting of additional data in video distribution servers H04N21/2355
• CPC Class Codes: H04L 65/764 at the destination reformatting of additional data in video clients H04N21/4355
• CPC Class Codes: H04L 65/80 Responding to QoS
• CPC Class Codes: H04N 21/23106 involving caching operations prefetching while addressing of a memory level in which the access to the desired data or data block requires associative addressing means within memory systems or architectures G06F12/0862; caching at an intermediate stage in a data network H04L67/568
• CPC Class Codes: H04N 21/23406 involving management of server-side video buffer
• CPC Class Codes: H04N 21/234327 by decomposing into layers, e.g. base layer and one or more enhancement layers
• CPC Class Codes: H04N 21/235 Processing of additional data, e.g. scrambling of additional data or processing content descriptors
• CPC Class Codes: H04N 21/2401 Monitoring of the client buffer
• CPC Class Codes: H04N 21/25808 Management of client data terminal profiles in network data switching protocols H04L67/303
• CPC Class Codes: H04N 21/2662 Controlling the complexity of the video stream, e.g. by scaling the resolution or bitrate of the video stream based on the client capabilities
• CPC Class Codes: H04N 21/435 Processing of additional data, e.g. decrypting of additional data, reconstructing software from modules extracted from the transport stream
• CPC Class Codes: H04N 21/44004 involving video buffer management, e.g. video decoder buffer or video display buffer
• CPC Class Codes: H04N 21/440227 by decomposing into layers, e.g. base layer and one or more enhancement layers
• CPC Class Codes: H04N 21/44209 Monitoring of downstream path of the transmission network originating from a server, e.g. bandwidth variations of a wireless network arrangements for maintenance or administration in data switching networks involving bandwidth and capacity management H04L41/0896
• CPC Class Codes: H04N 21/84 Generation or processing of descriptive data, e.g. content descriptors systems specially adapted for using meta-information in broadcast systems H04H60/73
• CPC Class Codes: H04N 21/8456 by decomposing the content in the time domain, e.g. in time segments

Abstract

A block-request streaming system provides for improvements in the user experience and bandwidth efficiency of such systems, typically using an ingestion system that generates data in a form to be served by a conventional file server (HTTP, FTP, or the like), wherein the ingestion system intakes content and prepares it as files or data elements to be served by the file server. A client device can be adapted to take advantage of the ingestion process. The client device might be configured to optimize use of resources, given the information available to it from the ingestion system. This may include configurations to determine the sequence, timing and construction of block requests based on monitoring buffer size and rate of change of buffer size, use of variable sized requests, mapping of block requests to underlying transport connections, flexible pipelining of requests, and/or use of whole file requests based on statistical considerations.

Claims

1. In a communication system wherein a client device receives blocks of media from one or more media ingestion systems, a method comprising:

identifying, at the client device, an amount of media stored in a buffer for storing received blocks of media prior to being consumed by an output of the client device;

identifying, at the client device, a rate of consumption of the media at the output of the client device;

determining a rate of change of the amount of the media stored in the buffer;

determine a current estimate T of a travel time of blocks of media and a current download speed R;

measure a number of bytes B delivered for a previous request, wherein the previous request was for a total number of bytes S; and

determining, for a plurality of block requests corresponding to blocks of the media being consumed by the output of the client device, a block to request and a timing of the request, wherein the block to request is determined based upon the amount of the media stored in the buffer and the rate of change of the amount of the media stored in the buffer, and the timing of the request is determined based in part of whether S minus B is less than a multiple of R multiplied by T, wherein the timing of the request is associated with a time at which a request for a new block will be made.

2. The method of claim 1, further comprising:

determining, at the client device, a number of bytes received from the media ingestion system on a previous request; and

requesting additional media data from the media ingestion system based on the number of bytes received.

3. The method of claim 1, further comprising:

determining, at the client device, an identifier of a media file to be requested, wherein the media file is part of the media being received;

determining a set of IP addresses of servers of the media ingestion system;

ordering the IP addresses based on a calculation involving the identifier; and

selecting a server based on the ordering.

4. The method of claim 1, further comprising:

identifying, at the client device, a range of blocks to be requested from the media ingestion system;

determining if the range of blocks includes a first block in a file stored by the media ingestion system;

calculating a statistical parameter; and

converting the request for a range of blocks to a request for the file, based on the determining and based on the statistical parameter.

5. The method of claim 4, wherein the statistical parameter corresponds to a threshold.

6. The method of claim 4, wherein the statistical parameter corresponds to the output of a hash function that is based on the range of blocks.

7. The method of claim 4, wherein a threshold and value are set so that a desired percentage of requests for the file from multiple receivers are converted.

8. A client device having a network connection allowing for receiving blocks of media from one or more media ingestion systems via a communication system, comprising:

a video display of the client device that is capable of presenting media content in a perceptible form to a user of the client device;

a network interface for making requests, via a communication system, for media and for receiving responses to the requests;

a buffer capable of for storing received blocks of media prior to being consumed by the presentation element;

a processor for processing instructions;

logic for determining an amount of media stored in the buffer;

logic for identifying a rate of consumption of the media at the presentation element;

logic for determining a rate of change of the amount of the media stored in the buffer;

logic for determining a current estimate T of a travel time of blocks of media and a current download speed R;

logic for measuring a number of bytes B delivered for a previous request, wherein the previous request was for a total number of bytes S; and

logic for determining, for a plurality of block requests corresponding to blocks of the media being consumed by the output of the client device, a block to request and a timing of the request, wherein the block to request is determined based upon the amount of the media stored in the buffer and the rate of change of the amount of the media stored in the buffer, and the timing of the request is determined based in part on whether S minus B is less than a multiple of R multiplied by T, wherein the timing of the request is associated with a time at which a request for a new block will be made.

9. The client device of claim 8, wherein the video display comprises a display and an audio output.

10. The client device of claim 8, wherein the network interface includes logic for determining which of a plurality of servers to direct the requests to.

11. The client device of claim 8, wherein at least some of the requests are for forward-error correction (“

FEC”

) data.

12. A client device having a network connection allowing for receiving blocks of media from one or more media ingestion systems via a communication system, comprising:

a video display of the client device that is capable of presenting media content in a perceptible form to a user of the client device;

a network interface for making requests, via a communication system, for media and for receiving responses to the requests;

a buffer capable of for storing received blocks of media prior to being consumed by the presentation element;

a processor for processing instructions;

logic for identifying an amount of media stored in a buffer, wherein the media includes blocks of media received by the buffer prior to being consumed by the video display;

logic for determining a current estimate T of a travel time of blocks of media and a current download speed R;

logic for measuring a number of bytes B delivered for a previous request, wherein the previous request was for a total number of bytes S;

logic for determining a rate of consumption of the stored received blocks;

logic for determining, based on the rate of consumption and the amount of media stored in the buffer, the size of a request to make to the one or more media ingestion systems;

logic for determining, based in part on whether S minus B is less than a multiple of R multiplied by T, the timing of the request to make to the one or more media ingestion systems; and

logic for issuing the request, via the network interface, to the one or more media ingestion systems.

13. The client device of claim 12, wherein the video display comprises a display and an audio output.

14. The client device of claim 12, wherein the network interface includes logic for determining which of a plurality of servers to direct the requests to.

15. The client device of claim 12, wherein at least some of the requests are for forward-error correction (“

FEC”

) data.