Technologies for adaptive real-time media streaming

• US 10,389,788 B2
• Filed: 12/27/2014
• Issued: 08/20/2019
• Est. Priority Date: 12/27/2014
• Status: Active Grant

• Current Assignee: Intel Corporation
• Original Assignee: Intel Corporation
• Inventors: Poornachandran, Rajesh, Smith, Ned M., Rosenzweig, Michael D., Zimmer, Vincent J., Bian, Qixiong J.
• Primary Examiner(s): Dalencourt, Yves
• Application Number:
  US14/583,668
• Publication Number:
  US 20160191595A1
• Time in Patent Office: 1,697 Days
• Field of Search: 709219, 709228, 709230, 709231, 709232
• CPC Class Codes: H04L 65/70 Media network packetisation
• CPC Class Codes: H04L 65/80 Responding to QoS

Abstract

Technologies for adaptive real-time media streaming include a computing device to determine, by a trusted execution environment of the computing device, a current workload of the computing device based on at least one activity counter. The at least one activity counter is to record counter data associated with performance of the computing device. Further, the computing device determines a residual workload capable of being supported by the computing device based on the determined current workload and a new content playback characteristics for streaming media content based on the determined residual workload. The computing device streams media content received from a trusted server based on the determined new content playback characteristics.

Claims

1. A computing device for adaptive real-time media streaming, the computing device comprising:

a processor;

at least one activity counter to record data associated with performance of the computing device;

a hardware-based trusted execution environment module to provide an execution environment isolated from execution of the processor to (i) determine a current workload of the computing device based on at least one activity counter, wherein the at least one activity counter is to record counter data associated with performance of the computing device, (ii) determine a residual workload capable of being supported by the computing device based on the determined current workload, (iii) determine new content playback characteristics for streaming media content based on the determined residual workload, (iv) establish a secure connection between the computing device and a trusted server with use of secure credentials, wherein the processor does not have access to the secure credentials; and

a media streaming module to stream media content received from the trusted server through the secure connection, wherein the streamed media content is based on the determined new content playback characteristics.

2. The computing device of claim 1, wherein to determine the current workload of the computing device comprises to determine the current workload in response to a determination to stream the media content.

3. The computing device of claim 2, wherein to determine to stream the media content comprises to determine to stream the media content at a low quality.

4. The computing device of claim 3, wherein to determine to stream the media content at a low quality comprises to determine to stream the media content at one or more of a low resolution, a low bitrate, or a low frame rate.

5. The computing device of claim 2, wherein to determine to stream the media content comprises to determine to stream the media content in response to a change in media playback.

6. The computing device of claim 1, wherein to determine the current workload of the computing device comprises to receive playback session data of the computing device, wherein the playback session data identifies a current number of playback sessions of the computing device and associated media parameters of the playback sessions.

7. The computing device of claim 6, wherein to determine the current workload of the computing device comprises to determine a current workload of the computing device based on the counter data of the at least one activity counter and the playback session data.

8. The computing device of claim 1, wherein to determine the residual workload comprises to determine a maximum workload capable of being supported by the computing device.

9. The computing device of claim 8, wherein to determine the residual workload comprises to determine the residual workload as a difference between the maximum workload and the current workload of the computing device.

10. The computing device of claim 1, wherein to determine the new content playback characteristics comprises to determine a new bitrate for streaming media content based on the determined residual workload.

11. The computing device of claim 10, wherein to determine the new bitrate comprises to determine a maximum bitrate capable of being supported by the computing device based on the determined residual workload.

12. The computing device of claim 1, further comprising a communication module to transmit the determined new content playback characteristics to the trusted server over a secure back channel established between the computing device and the trusted server.

13. The computing device of claim 1, further comprising a communication module to inform the trusted server of at least one of the counter data recorded by the at least one activity counter, the determined current workload, or the determined residual workload.

14. The computing device of claim 1, wherein the trusted execution environment module is to receive the counter data over a secure communication channel.

15. The computing device of claim 14, further comprising a dedicated electrical trace between the trusted execution environment module and the at least one activity counter;

wherein to receive the counter data comprises to receive the counter data over the dedicated electrical trace.

16. The computing device of claim 1, wherein to establish the secure connection comprises to share secure credentials with the trusted server by the hardware-based trusted execution environment module of the computing device.

17. One or more non-transitory machine-readable storage media comprising a plurality of instructions stored thereon that, in response to execution by a computing device, cause the computing device to:

determine, by a hardware-based trusted execution environment of the computing device, a current workload of the computing device based on at least one activity counter, wherein the at least one activity counter is to record counter data associated with performance of the computing device, wherein the hardware-based trusted execution environment provides an execution environment isolated from execution of the computing device;

determine a residual workload capable of being supported by the computing device based on the determined current workload;

determine new content playback characteristics for streaming media content based on the determined residual workload;

establish a secure connection between the computing device and a trusted server with use of secure credentials, wherein a processor of the computing device does not have access to the secure connection; and

stream media content received from the trusted server through the secure connection, wherein the streamed media content is based on the determined new content playback characteristics.

18. The one or more non-transitory machine-readable storage media of claim 17, wherein to determine the current workload of the computing device comprises to determine the current workload in response to a determination to stream the media content;

and

wherein to determine to stream the media content comprises to determine to stream the media content in response to a change in media playback.

19. The one or more non-transitory machine-readable storage media of claim 17, wherein to determine the current workload of the computing device comprises to receive counter data associated with at least one of a video encoder, a video decoder, a security processor, or a graphics processor of the computing device.

20. The one or more non-transitory machine-readable storage media of claim 17, wherein to determine the current workload of the computing device comprises to:

receive playback session data of the computing device, wherein the playback session data identifies a current number of playback sessions of the computing device and associated media parameters of the playback sessions; and

determine a current workload of the computing device based on the counter data of the at least one activity counter and the playback session data.

21. The one or more non-transitory machine-readable storage media of claim 17, wherein to determine the residual workload comprises to:

determine a maximum workload capable of being supported by the computing device; and

determine the residual workload as a difference between the maximum workload and the current workload of the computing device.

22. The one or more non-transitory machine-readable storage media of claim 17, wherein the plurality of instructions further cause the computing device to transmit the determined new content playback characteristics to the trusted server over a secure back channel established between the computing device and the trusted server.

23. A method for adaptive real-time media streaming by a computing device, the method comprising:

determining, by a hardware-based trusted execution environment of the computing device, a current workload of the computing device based on at least one activity counter, wherein the at least one activity counter is to record counter data associated with performance of the computing device, wherein the hardware-based trusted execution environment provides an execution environment isolated from execution of the computing device;

determining, by the computing device, a residual workload capable of being supported by the computing device based on the determined current workload;

determining, by the computing device, new content playback characteristics for streaming media content based on the determined residual workload;

establishing, by the computing device, a secure connection between the computing device and a trusted server with use of secure credentials, wherein a processor of the computing device does not have access to the secure credentials; and

performing, by the computing device, streaming of media content received from the trusted server through the secure connection, wherein the streamed media content is based on the determined new content playback characteristics.

24. The method of claim 23, wherein determining the current workload of the computing device comprises receiving counter data associated with at least one of a video encoder, a video decoder, a security processor, or a graphics processor of the computing device.

25. The method of claim 23, wherein determining the current workload of the computing device comprises (i) receiving playback session data of the computing device, wherein the playback session data identifies a current number of playback sessions of the computing device and associated media parameters of the playback sessions and (ii) determining a current workload of the computing device based on the counter data of the at least one activity counter and the playback session data;

and

wherein determining the residual workload comprises (i) determining a maximum workload capable of being supported by the computing device and (ii) determining the residual workload as a difference between the maximum workload and the current workload of the computing device.