Decoding complexity for mobile multimedia streaming

• US 10,237,321 B2
• Filed: 10/18/2013
• Issued: 03/19/2019
• Est. Priority Date: 10/18/2012
• Status: Active Grant

• Current Assignee: VID SCALE Inc. (InterDigital, Inc.)
• Original Assignee: VID SCALE Inc. (InterDigital, Inc.)
• Inventors: Lotfallah, Osama, Asbun, Eduardo, Liu, Hang, Reznik, Yuriy
• Primary Examiner(s): Lonsberry, Hunter B
• Application Number:
  US14/435,434
• Publication Number:
  US 20150237103A1
• Time in Patent Office: 1,978 Days
• Field of Search: 725 62
• CPC Class Codes: H04B 17/373 Predicting channel quality or other radio frequency [RF] parameters
• CPC Class Codes: H04L 65/612 for unicast
• CPC Class Codes: H04L 65/613 for the control of the source by the destination control signals issued by the client directed to the server or network components specially adapted for selective content distribution H04N21/637
• CPC Class Codes: H04L 65/70 Media network packetisation
• CPC Class Codes: H04L 65/756 adapting media to device capabilities
• CPC Class Codes: H04L 65/762 at the source reformatting of additional data in video distribution servers H04N21/2355
• CPC Class Codes: H04L 65/764 at the destination reformatting of additional data in video clients H04N21/4355
• CPC Class Codes: H04L 65/765 intermediate
• CPC Class Codes: H04L 65/80 Responding to QoS
• CPC Class Codes: H04N 21/2662 Controlling the complexity of the video stream, e.g. by scaling the resolution or bitrate of the video stream based on the client capabilities
• CPC Class Codes: H04N 21/4621 Controlling the complexity of the content stream or additional data, e.g. lowering the resolution or bit-rate of the video stream for a mobile client with a small screen arrangements for using the results of monitoring on user's side in broadcast systems H04H60/65; flow control in packet networks H04L47/10
• CPC Class Codes: H04W 52/0251 using monitoring of local events, e.g. events related to user activity
• CPC Class Codes: H04W 52/223 predicting future states of the transmission
• CPC Class Codes: H04W 52/367 Power values between minimum and maximum limits, e.g. dynamic range

Abstract

A decoding complexity may be used to predict power consumption for receiving, decoding, and/or displaying multimedia content at a wireless transmit/receive unit (WTRU). The decoding complexity may be based on decoding complexity feedback received from a reference device, such as another WTRU. The decoding complexity feedback may be based on measurements performed at the reference device for receiving decoding, and/or displaying the multimedia content. A content providing device may indicate the decoding complexity of requested media content to a WTRU, or another network entity. The decoding complexity may be indicated in a streaming protocol or file associated with the media content. The WTRU, or other network entity, may use the decoding complexity determine its preferences regarding transmission of the media content. The content providing device may determine whether to transmit the media content based on the decoding complexity and/or the preferences of the WTRU or other network entity.

Claims

1. A method for determining a decoding complexity associated with media content, the method comprising:

receiving decoding complexity feedback from a plurality of reference wireless transmit/receive units (WTRUs), wherein the decoding complexity feedback received from each reference WTRU of the plurality of reference WTRUs is based on at least one of an amount of power, an amount of time, or an amount of computing resources associated with decoding or displaying the media content at the reference WTRU;

receiving a request for the media content;

determining a decoding complexity associated with the media content, wherein the decoding complexity is based on the decoding complexity feedback received from the plurality of reference WTRUs;

inserting the decoding complexity that is determined based on the decoding complexity feedback received from the plurality of reference WTRUs into a media presentation descriptor (MPD) file associated with the media content; and

sending the MPD file that comprises the determined decoding complexity to a WTRU.

2. The method of claim 1, wherein the media content comprises a plurality of different types of media content, and wherein the decoding complexity includes a corresponding decoding complexity for each of the plurality of different types of media content.

3. The method of claim 2, further comprising sending, to the WTRU, an indication of each of the plurality of different types of media content and the corresponding decoding complexity for the each of the plurality of different types of media content.

4. The method of claim 3, further comprising:

receiving a selection of at least one of the plurality of different types of media content from the WTRU; and

sending the selected at least one of the plurality of different types of media content to the WTRU.

5. The method of claim 2, further comprising determining, based on the corresponding decoding complexity for the each of the plurality of different types of media content, at least one of the plurality of different types of media content for being transmitted to the WTRU.

6. The method of claim 1, wherein the media content comprises a plurality of segments, wherein each segment of the plurality of segments has a corresponding decoding complexity.

7. The method of claim 1, wherein the decoding complexity feedback received from each reference WTRU of the plurality of reference WTRUs indicates measurements taken at the reference WTRU from which the decoding complexity feedback is received.

8. The method of claim 1, wherein the decoding complexity indicates at least one of a maximum amount of power, a minimum amount of power, or an average amount of power used to decode or display the media content.

9. The method of claim 1, further comprising including an indication of the decoding complexity in a streaming protocol or file associated with the media content.

10. The method of claim 1, wherein the decoding complexity is included in at least one of a dynamic adaptive streaming over HTTP (DASH) protocol, a session description protocol (SDP), or a 3GP file.

11. A content providing device for determining a decoding complexity associated with media content, the content providing device comprising:

a processor configured to;

receive decoding complexity feedback from a plurality of reference wireless transmit/receive units (WTRUs), wherein the decoding complexity feedback received from each reference WTRU of the plurality of reference WTRUs is based on at least one of an amount of power, an amount of time, or an amount of computing resources associated with decoding or displaying the media content at the reference WTRU;

receive a request for the media content;

determine a decoding complexity associated with the media content, wherein the decoding complexity is based on the decoding complexity feedback received from the plurality of reference WTRUs;

insert the decoding complexity that is determined based on the decoding complexity feedback received from the plurality of reference WTRUs into a media presentation descriptor (MPD) file associated with the media content; and

send the MPD file that comprises the determined decoding complexity to a WTRU.

12. The content providing device of claim 11, wherein the media content comprises a plurality of different types of media content, and wherein the decoding complexity includes a corresponding decoding complexity for each of the plurality of different types of media content.

13. The content providing device of claim 12, wherein the processor is further configured to send, to the WTRU, an indication of each of the plurality of different types of media content and the corresponding decoding complexity for the each of the plurality of different types of media content.

14. The content providing device of claim 13, wherein the processor is further configured to:

receive a selection of at least one of the plurality of different types of media content from the WTRU; and

send the selected at least one of the plurality of different types of media content to the WTRU.

15. The content providing device of claim 12, wherein the processor is further configured to determine, based on the corresponding decoding complexity for the each of the plurality of different types of media content, at least one of the plurality of different types of media content for being transmitted to the WTRU.

16. The content providing device of claim 11, wherein the media content comprises a plurality of segments, wherein each segment of the plurality of segments has a corresponding decoding complexity.

17. The content providing device of claim 11, wherein the decoding complexity feedback received from each reference WTRU of the plurality of reference WTRUs indicates measurements taken at the reference WTRU from which the decoding complexity feedback is received.

18. The content providing device of claim 11, wherein the decoding complexity indicates at least one of a maximum amount of power, a minimum amount of power, or an average amount of power used to decode or display the media content.

19. The content providing device of claim 11, wherein the processor is further configured to include an indication of the decoding complexity in a streaming protocol or file associated with the media content.

20. The content providing device of claim 11, wherein the decoding complexity is included in at least one of a dynamic adaptive streaming over HTTP (DASH) protocol, a session description protocol (SDP), or a 3GP file.