Quality of experience aware multimedia adaptive streaming

• US 10,455,404 B2
• Filed: 10/29/2018
• Issued: 10/22/2019
• Est. Priority Date: 03/29/2013
• Status: Active Grant

• Current Assignee: Apple Inc.
• Original Assignee: Intel IP Corporation (Intel Corporation)
• Inventors: Rehan, Mohamed, Morsi, Rana, Oyman, Ozgur
• Primary Examiner(s): Coulter, Kenneth R
• Application Number:
  US16/174,128
• Publication Number:
  US 20190075446A1
• Time in Patent Office: 358 Days
• Field of Search: 709235, 709233, 709232, 709231, 709230, 709226, 709203
• CPC Class Codes: H04B 1/56 with provision for simultaneous communication in two directions
• CPC Class Codes: H04B 7/0417 Feedback systems
• CPC Class Codes: H04B 7/0452 Multi-user MIMO systems
• CPC Class Codes: H04B 7/0617 for beam forming
• CPC Class Codes: H04B 7/0619 using feedback from receiving side feedback signaling for adaptive modulation/coding H04L1/0001
• CPC Class Codes: H04B 7/063 Parameters other than those covered in groups H04B7/0623 - H04B7/0634, e.g. channel matrix rank or transmit mode selection
• CPC Class Codes: H04B 7/0695 using beam selection
• CPC Class Codes: H04B 7/088 using beam selection
• CPC Class Codes: H04L 1/1864 ARQ related signaling H04L1/1607 takes precedence
• CPC Class Codes: H04L 2025/03426 transmission using multiple-input and multiple-output channels
• CPC Class Codes: H04L 25/0204 of multiple channels
• CPC Class Codes: H04L 25/03305 Joint sequence estimation and interference removal joint detection of several desired signals H04L25/03331
• CPC Class Codes: H04L 47/803 Application aware
• CPC Class Codes: H04L 47/83 based on usage prediction
• CPC Class Codes: H04L 5/0007 the frequencies being orthogonal, e.g. OFDM(A), DMT
• CPC Class Codes: H04L 5/0048 Allocation of pilot signals, i.e. of signals known to the receiver
• CPC Class Codes: H04L 5/0051 of dedicated pilots, i.e. pilots destined for a single user or terminal
• CPC Class Codes: H04L 5/0053 Allocation of signaling, i.e. of overhead other than pilot signals
• CPC Class Codes: H04L 5/0055 Physical resource allocation for ACK/NACK for physical mapping arrangements in ARQ protocols H04L1/1861
• CPC Class Codes: H04L 5/0057 Physical resource allocation for CQI
• CPC Class Codes: H04L 5/0085 : when channel conditions change
• CPC Class Codes: H04L 5/1469 : using time-sharing
• CPC Class Codes: H04L 65/613 : for the control of the source by the destination control signals issued by the client directed to the server or network components specially adapted for selective content distribution H04N21/637
• CPC Class Codes: H04L 65/65 : Network streaming protocols, e.g. real-time transport protocol [RTP] or real-time control protocol [RTCP]
• CPC Class Codes: H04L 65/70 : Media network packetisation
• CPC Class Codes: H04L 65/75 : Media network packet handling
• CPC Class Codes: H04L 65/752 : adapting media to network capabilities
• CPC Class Codes: H04L 65/756 : adapting media to device capabilities
• CPC Class Codes: H04L 65/762 : at the source reformatting of additional data in video distribution servers H04N21/2355
• CPC Class Codes: H04L 65/764 : at the destination reformatting of additional data in video clients H04N21/4355
• CPC Class Codes: H04L 65/80 : Responding to QoS
• CPC Class Codes: H04M 1/72457 : according to geographic location
• CPC Class Codes: H04N 21/2402 : Monitoring of the downstream path of the transmission network, e.g. bandwidth available traffic monitoring in data switching networks H04L43/00; monitoring data switching networks utilization H04L43/0876
• CPC Class Codes: H04N 21/8456 : by decomposing the content in the time domain, e.g. in time segments
• CPC Class Codes: H04N 21/8543 : using a description language, e.g. Multimedia and Hypermedia information coding Expert Group [MHEG], eXtensible Markup Language [XML] information retrieval of semistructured data, the underlying structure being taken into account, e.g. mark-up language structure data G06F16/80
• CPC Class Codes: H04W 24/00 : Supervisory, monitoring or testing arrangements
• CPC Class Codes: H04W 24/02 : Arrangements for optimising operational condition
• CPC Class Codes: H04W 28/02 : Traffic management, e.g. flow control or congestion control
• CPC Class Codes: H04W 28/0226 : based on location or mobility handoff or reselection H04W36/00; mobile application services making use of the location of users or terminals H04W4/02
• CPC Class Codes: H04W 28/0289 : Congestion control load shedding arrangements in network planning H04W16/08; performing reselection for handling the traffic H04W36/22; wireless traffic scheduling H04W72/12
• CPC Class Codes: H04W 28/082 : among bearers or channels
• CPC Class Codes: H04W 28/20 : Negotiating bandwidth
• CPC Class Codes: H04W 36/0011 : for data sessions of end-to-end connection
• CPC Class Codes: H04W 36/0022 : for transferring data sessions between adjacent core network technologies
• CPC Class Codes: H04W 36/0072 : of resource information of target access point
• CPC Class Codes: H04W 36/08 : Reselecting an access point
• CPC Class Codes: H04W 36/125 : involving different types of service backbones
• CPC Class Codes: H04W 36/22 : for handling the traffic
• CPC Class Codes: H04W 36/26 : by agreed or negotiated communication parameters
• CPC Class Codes: H04W 4/021 : Services related to particular areas, e.g. point of interest [POI] services, venue services or geofences
• CPC Class Codes: H04W 48/06 : based on traffic conditions
• CPC Class Codes: H04W 48/12 : using downlink control channel
• CPC Class Codes: H04W 48/16 : Discovering, processing access restriction or access information
• CPC Class Codes: H04W 48/18 : Selecting a network or a communication service
• CPC Class Codes: H04W 56/001 : Synchronization between nodes
• CPC Class Codes: H04W 72/0446 : Resources in time domain, e.g. slots or frames
• CPC Class Codes: H04W 72/046 : the resource being in the space domain, e.g. beams
• CPC Class Codes: H04W 72/541 : using the level of interference
• CPC Class Codes: H04W 76/15 : Setup of multiple wireless link connections
• CPC Class Codes: H04W 8/02 : Processing of mobility data, e.g. registration information at HLR [Home Location Register] or VLR [Visitor Location Register]; Transfer of mobility data, e.g. between HLR, VLR or external networks
• CPC Class Codes: H04W 8/06 : Registration at serving network Location Register, VLR or user mobility server
• CPC Class Codes: H04W 8/082 : for traffic bypassing of mobility servers, e.g. location registers, home PLMNs or home agents
• CPC Class Codes: H04W 84/042 : Public Land Mobile systems, e.g. cellular systems
• CPC Class Codes: H04W 84/045 : using private Base Stations, e.g. femto Base Stations, home Node B
• CPC Class Codes: H04W 84/12 : WLAN [Wireless Local Area Networks]
• CPC Class Codes: H04W 88/02 : Terminal devices
• CPC Class Codes: H04W 88/08 : Access point devices
• CPC Class Codes: H04W 88/10 : adapted for operation in multiple networks, e.g. multi-mode access points
• CPC Class Codes: Y02D 30/70 : in wireless communication networks

Abstract

Technology to provide quality of experience aware multimedia streaming is disclosed. In an example, a server operable to provide hyper-text transfer protocol (HTTP) adaptive streaming, can include computer circuitry configured to: determine a bandwidth available to the server for transmitting HTTP adaptive streaming content to a plurality of clients; receive HTTP requests from the plurality of clients for representations offered by the server in a manifest file for the HTTP adaptive streaming; and calculate an availability of each representation that is offered in the manifest file for the server. The availability can be calculated, at least in part, based on the determined bandwidth. The availability of each representation can be communicated from the server to the plurality of clients.

Claims

1. An apparatus contained within a user equipment (UE) operable to decode dynamic adaptive streaming over HTTP (DASH) content received from a server, the apparatus comprising one or more processors and memory configured to:

decode, at the UE, a network assistance message received from the server for a client operating at the UE, the network assistance message including an indication of a bandwidth allocation assigned for the client operating at the UE;

decode a media presentation description (MPD) file received from the server that includes a bandwidth associated with each of a plurality of representations;

select a representation, from the plurality of representations of DASH content from the MPD with a bandwidth that is within the assigned bandwidth allocation indicated in the network assistance message for the client operating at the UE;

encode a request for transmission to the server for the selected representation of DASH content from the server; and

decode the selected representation of DASH content received from the server.

2. The apparatus of claim 1, further comprising a transceiver configured to:

receive, from the server, the network assistance message that includes the indication of the bandwidth allocation assigned to the client operating at the UE; and

receive the selected representation of DASH content from the server.

3. The apparatus of claim 1, wherein the one or more processors and memory are further configured to decode the network assistance message received from the server that includes a recommended choice of bitrate for a next segment of the selected representation of DASH content being accessed at the client operating at the UE.

4. The apparatus of claim 1, wherein the one or more processors include one or more of a baseband processor or an application processor.

5. An apparatus of a server operable to provide dynamic adaptive streaming over HTTP (DASH) content to a client operating at a user equipment (UE), the apparatus comprising one or more processors and memory configured to:

determine, at the server, a bandwidth allocation for the client operating at the UE;

encode, at the server, a network assistance message for transmission to the client operating at the UE, the network assistance message including an indication of the bandwidth allocation for the client;

encode, at the server, a media presentation description (MPD) file for transmission to the client operating at the UE that includes a bandwidth associated with each of a plurality of representations; and

encode, at the server, a representation, from the plurality of representations, of DASH content selected from the MPD for transmission to the client operating at the UE, wherein the selected representation of DASH content is associated with a bandwidth that is within the bandwidth allocation for the client.

6. The apparatus of claim 5, further comprising a transceiver configured to:

transmit the network assistance message that includes the indication of the bandwidth allocation for the client operating at the UE; and

transmit the representation of DASH content to the client operating at the UE.

7. The apparatus of claim 5, wherein the one or more processors and memory are further configured to:

determine the bandwidth allocation for each of a plurality of clients operating at UEs; and

encode the network assistance message for transmission to the plurality of clients that includes the indication of the bandwidth allocation.

8. The apparatus of claim 5, wherein the one or more processors and memory are further configured to encode a second network assistance message for transmission to the client operating at the UE that includes a recommended bitrate for a next segment of the representation of DASH content being accessed at the client.

9. The apparatus of claim 5, wherein the one or more processors and memory are further configured to decode a request received from the client operating at the UE for the selected representation of DASH content.

10. The apparatus of claim 5, wherein the server is configured for quality of experience (QoE) aware dynamic adaptive streaming over hyper-text transfer protocol (HTTP) (DASH).

11. The apparatus of claim 5, wherein the MPD file is a media presentation description for a DASH adaptation set.

12. The apparatus of claim 5, wherein the one or more processors and memory are further configured to decode a quality of experience (QOE) received from the UE, the QoE of the selected representation of DASH content transmitted from the server.

13. At least one non-transitory machine readable storage medium having instructions embodied thereon for decoding dynamic adaptive streaming over HTTP (DASH) content received at a user equipment (UE) from a server, the instructions when executed by one or more processors perform the following:

decoding, at a client operating at the UE, a network assistance message received from the server that includes an indication of a bandwidth allocation for the client operating at the UE;

decoding a media presentation description (MPD) file received from the server that includes a bandwidth associated with each of a plurality of representations; and

selecting a representation, from the plurality of representations, of DASH content from the MPD with a bandwidth that is within the bandwidth allocation for the client operating at the UE.

14. The at least one non-transitory machine readable storage medium of claim 13, further comprising instructions when executed perform the following:

decoding the selected representation of DASH content received from the server.

15. The at least one non-transitory machine readable storage medium of claim 13, further comprising instructions when executed perform the following:

decoding a second network assistance message received from the server that includes a recommended bitrate for a next segment of the selected representation of DASH content being accessed at the client operating at the UE.

16. The at least one non-transitory machine readable storage medium of claim 13, further comprising instructions when executed perform the following:

encoding a request for transmission to the server for the selected representation of DASH content from the server.

17. The at least one non-transitory machine readable storage medium of claim 13, wherein the client operating at the UE is a Third Generation Partnership Project (3GPP) DASH client.

18. The at least one non-transitory machine readable storage medium of claim 13, wherein the MPD file is a media presentation description for a DASH adaptation set.

19. The at least one non-transitory machine readable storage medium of claim 13, further comprising instructions when executed perform the following:

determining a quality of experience (QOE) of the selected representation of DASH content received from the server;

encoding the QOE for transmission to the server.

20. The at least one non-transitory machine readable storage medium of claim 19, further comprising instructions when executed perform the following:

determining the QoE based, at least in part, on a number of rebuffering events that have occurred at the UE while receiving the selected representation of DASH content.