Fair adaptive streaming

• US 9,826,016 B2
• Filed: 02/24/2015
• Issued: 11/21/2017
• Est. Priority Date: 02/24/2015
• Status: Active Grant

• Current Assignee: Ghent University, IMEC International, Koninklijke KPN NV
• Original Assignee: Ghent University, IMEC International, Koninklijke KPN NV
• Inventors: Petrangeli, Stefano, Famaey, Jeroen, Latr, Steven
• Primary Examiner(s): Salad, Abdullahi E
• Application Number:
  US14/630,174
• Publication Number:
  US 20160248835A1
• Time in Patent Office: 1,001 Days
• CPC Class Codes: H04L 65/613 for the control of the source by the destination control signals issued by the client directed to the server or network components specially adapted for selective content distribution H04N21/637
• CPC Class Codes: H04L 65/65 Network streaming protocols, e.g. real-time transport protocol [RTP] or real-time control protocol [RTCP]
• CPC Class Codes: H04L 65/765 intermediate
• CPC Class Codes: H04L 65/80 Responding to QoS

Abstract

A method and system for enabling a plurality of adaptive streaming client devices to share network resources includes a network node monitoring chunk request messages of client devices configured to select a quality level of a chunk from a plurality of quality levels and to request a media server for transmission of a chunk of the selected quality level. The quality level in a monitored chunk request message of a client device is used to estimate local quality information associated with the quality performance of the client device. Global quality information, determined based on the estimated local quality information associated with the client devices, and being indicative of the global quality performance of the client devices, is sent to the client devices. The client devices are configured for selecting a quality level for a subsequent chunk based on the global quality information and based on local quality information determined by the client during or after rendering media data of a requested chunk such that deviations between the global quality information and the local quality information is minimized.

Claims

1. Method for enabling adaptive streaming client devices to share network resources during transmission of content to said client devices, comprising:

a network node monitoring chunk request messages of client devices, said client devices being configured to select a quality level of a chunk from a plurality of selectable quality levels and to request a media server for transmission of a chunk of said selected quality level, said chunk comprising media data representing content for transmission to said client device;

determining for each of said client devices estimated local quality information using the quality level of one or more monitored chunk request messages of a client device, said local quality information being indicative of a quality level or a Quality of Experience (QoE) of rendering a plurality of chunks by said client device;

determining global quality information on the basis of said estimated local quality information of said client devices, said global quality information being indicative of an average quality level or an average QoE of rendering said content by said client devices; and

,

transmitting said global quality information to at least one client device, said global quality information configured for being used by said at least one client device for selecting a quality level of one or more chunks to be requested by said client device;

wherein transmitting said global quality information to said at least one client device comprises;

inserting said global quality information in a chunk response message that is transmitted to said client device; and

/or,

transmitting said global quality information over a (bi-directional) control channel to said client device;

wherein said client device is configured to;

select said quality level on the basis of said global quality information, preferably said client device using a manifest file for selecting said quality level, said manifest file defining a plurality of selectable quality levels of said content, each quality level being associated with a sequence of chunks;

request a chunk of said selected quality level on the basis of location information in said manifest file.

2. Method according to claim 1 wherein said global quality information is periodically or repeatedly determined and transmitted to said client devices.

3. Method according to claim 1, wherein said estimated local quality information comprises an average quality level of chunks requested by said client within a predetermined time period;

and/or,

wherein said estimated local quality information comprises a QoE determined on the basis of an average quality level of chunks requested by said client device within a predetermined time period and the spread of the quality levels, preferably a standard deviation, of said chunks requested by said client device within said predetermined time period.

4. Method according to claim 1 wherein said inserting comprises:

inserting said global quality information in the header of said chunk response message.

5. Method according to claim 1 wherein transmitting said global quality information to said at least one client device comprises transmitting said global quality information over a Websocket control channel to said client device.

8. Method according to claim 5 wherein said extracting comprises:

extracting said global quality information from one or more data fields in the header of said chunk response message.

6. Method for enabling adaptive streaming client devices to share network resources during transmission of content to a plurality of client devices, comprising:

at least one of said plurality of client devices transmitting one or more chunk request messages for requesting transmission of at least one chunk of a quality level to a client device, said quality level being selected by said client device from a plurality of selectable quality levels, said chunk comprising media data representing content for transmission to said client device;

receiving global quality information from a network node configured for monitoring said one or more chunk request messages, said global quality information being indicative of an average quality level or an average QoE of rendering of a plurality of chunks by said plurality of client devices;

determining local quality information indicative of an average quality level or an average QoE of content rendered by said at least one client device; and

,

selecting a quality level of one or more chunks on the basis of said global quality information and said local quality information;

wherein receiving said global quality information comprises;

receiving a chunk response message;

extracting said global quality information from said chunk response message that is transmitted to said client device; and

/or,

receiving said global quality information over a (bi-directional) control channel to said client device;

wherein said client device is configured to;

select said quality level on the basis of said global quality information, preferably said client device using a manifest file for selecting said quality level, said manifest file defining a plurality of selectable quality levels of said content, each quality level being associated with a sequence of chunks;

request a chunk of said selected quality level on the basis of location information in said manifest file.

7. Method according to claim 6 wherein said selecting a quality level comprises:

minimizing the difference between said average quality level provided by said global quality information and said average quality level of chunks processed by said client device;

or,

wherein said selecting a quality level comprises minimizing the difference between said average QoE provided by said global quality information and said average QoE associated with content rendered by said client device.

9. Method according to claim 6 wherein receiving said global quality information comprises receiving said global quality information over a Websocket control channel to said client device.

10. Method for enabling adaptive streaming client devices to share network resources during transmission of content to said client devices, comprising:

a network node monitoring chunk request messages of client devices, said client devices being configured to select a quality level of a chunk from a plurality of selectable quality levels and to request a media server for transmission of a chunk of said selected quality level over a data transmission path to said client devices, wherein at least part of said data transmission path is shared by at least part of said client devices;

identifying quality levels qi(k) of a chunk k (k=1, . . . , M) requested by said client devices i (i=1, . . . , N) in said monitored chunk request messages;

determining estimated local quality information ri^f (k) associated with each of said client devices on the basis of a said quality levels q_i(k) and one or more quality levels q_i(k−

1), q_i(k−

2), . . . of one or more earlier requested chunks, and, optionally, a maximum available quality level q_m of chunk k;

determining global quality information gs(k) for said plurality of client devices on the basis said estimated local quality information ri^f (k); and

,

transmitting said global quality information gs(k) to at least one client device, said client device being configured to select a quality level for a subsequent chunk k+1 such that the difference between said global quality information gs(k) and local quality information r_i (k) determined by said client device is minimized;

wherein transmitting said global quality information to said at least one client device comprises;

inserting said global quality information in a chunk response message that is transmitted to said client device; and

/or,

transmitting said global quality information over a (bi-directional) control channel to said client device.

11. Method according to claim 10 wherein said estimated local quality information ri^f is determined on the basis of a first reward algorithm comprising a first term stimulating selection of the highest or at least a high quality level and a second term stimulating selection of a quality level such that switches between quality levels are reduced;

preferably said first reward algorithm being defined by the expression;

r_i^f(k)=−

|q_max−

q_i(k)|−

|q_i(k)−

q_i(k−

1)|

wherein q_max represents a maximum available quality level of a chunk.

12. Network node for enabling a plurality of adaptive streaming client devices to share network resources during transmission of content to said client devices, said network node comprising a computer readable storage medium having computer readable program code associated with a media client embodied therewith, and a processor, preferably a microprocessor, coupled to the computer readable storage medium, wherein responsive to executing the computer readable program code, the processor is configured to perform executable operations comprising:

monitoring chunk request messages of client devices, said client devices being configured to select a quality level of a chunk from a plurality of selectable quality levels and to request a media server for transmission of a chunk of said selected quality level, said chunk comprising media data representing content for transmission to said client device;

determining for each of said client devices estimated local quality information using the quality level of one or more monitored chunk request messages of a client device, said local quality information being indicative of a quality level or a Quality of Experience (QoE) of rendering a plurality of chunks by said client device;

determining global quality information on the basis of said estimated local quality information of said client devices, said global quality information being indicative of an average quality level or an average QoE of rendering said content by said client devices; and

,

transmitting said global quality information to at least one client device, said global quality information configured for being used by said at least one client device for selecting a quality level of one or more chunks to be requested by said client device;

wherein transmitting said global quality information to said at least one client device comprises;

inserting said global quality information in a chunk response message that is transmitted to said client device; and

/or,

transmitting said global quality information over a (bi-directional) control channel to said client device;

wherein said client device is configured to;

select said quality level on the basis of said global quality information, preferably said client device using a manifest file for selecting said quality level, said manifest file defining a plurality of selectable quality levels of said content, each quality level being associated with a sequence of chunks;

request a chunk of said selected quality level on the basis of location information in said manifest file.

13. An adaptive streaming client device configured to share network resources with a plurality of client devices during transmission of content to said client device and said plurality of client devices, said client device comprising:

a computer readable storage medium having computer readable program code associated with a media client embodied therewith, and a processor, preferably a microprocessor, coupled to the computer readable storage medium, wherein responsive to executing the computer readable program code, the processor is configured to perform executable operations comprising;

sending one or more chunk requests messages for requesting transmission of at least one chunk of a quality level to said client device, said quality level being selected from a plurality of selectable quality levels, said chunk comprising media data representing content for transmission to said client device;

receiving global quality information from a network node, said global quality information being indicative of an average quality level or an average QoE of content rendered by said plurality of client devices;

determining local quality information indicative of an average quality level or an average QoE of content rendered by said at least one client device; and

,

selecting a quality level of one or more chunks on the basis of said global quality information and said local quality information;

wherein receiving said global quality information comprises;

receiving a chunk response message;

extracting said global quality information from said chunk response message that is transmitted to said client device; and

/or,

receiving said global quality information over a (bi-directional) control channel to said client device;

wherein said client device is configured to;

select said quality level on the basis of said global quality information, preferably said client device using a manifest file for selecting said quality level, said manifest file defining a plurality of selectable quality levels of said content, each quality level being associated with a sequence of chunks;

request a chunk of said selected quality level on the basis of location information in said manifest file.

14. Client device according to claim 13 wherein said selecting a quality level comprises:

minimizing the difference between said average quality level provided by said global quality information and said average quality level of chunks processed by said client device;

or,

wherein said selecting a quality level comprises minimizing the difference between said average QoE provided by said global quality information and said average QoE associated with content rendered by said client device.

15. Client device according to claim 13 wherein said local quality information is determined by said client device on the basis of a second reward function, said second reward function comprising a first term for configuring the client device to select the highest or a high quality level and said second reward function comprising a second term for configuring the client device to select a quality level such that switches between quality levels are reduced;

and, optionally, said second reward function comprising a third term for configuring the client device to keep a buffer of a video player at a filling level such that artefacts, preferably video freezes, are reduced during rendering of media data of requested chunks, preferably said second reward function being defined by the expression;

r_i(k)=—

|q_max−

q_i(k)|−

|q_i(k)−

q_i(k−

1)|+−

|b_max−

b_i(k)|

wherein q_max represents a maximum available quality level of the requested chunk, q_i(k) represents the quality level of the requested chunk q_i(k−

1) represents the quality level of at least on earlier requested chunk, b_i(k) represents the video player buffer filling level when chunk k is received and b_max the buffer saturation level.

16. Client device according to claim 15 wherein said selecting a quality level is based on a quality level selection function comprising:

a first function that is identical or similar to the reward function r_i(k) according to claim 15; and

,

a second function that reaches an extremum when local quality information matches said global quality information, preferably said quality level selection function being given by the expression;

r_i^he(k)=r_i(k)−

α

max(r_i^f(k)−

gs(k),0)+−

β

max(gs(k)−

r_i^f(k),0)