Method and system for remote computing session management

• US 9,582,272 B1
• Filed: 06/14/2012
• Issued: 02/28/2017
• Est. Priority Date: 01/26/2009
• Status: Active Grant

• Current Assignee: Teradici Corporation (HP Inc.)
• Original Assignee: Teradici Corporation (HP Inc.)
• Inventors: Doucette, Daniel Jean Donat, Fennig, Kurt Rien, Hobbs, David Victor
• Primary Examiner(s): MACILWINEN, JOHN MOORE JAIN
• Application Number:
  US13/523,407
• Time in Patent Office: 1,720 Days
• US Class Current: 1/1
• CPC Class Codes: G06F 2009/4557 Distribution of virtual machine instances; Migration and load balancing
• CPC Class Codes: G06F 2209/503 Resource availability
• CPC Class Codes: G06F 2209/509 Offload
• CPC Class Codes: G06F 3/1438 using more than one graphics controller
• CPC Class Codes: G06F 9/00 Arrangements for program control, e.g. control units program control for peripheral devices G06F13/10
• CPC Class Codes: G06F 9/452 Remote windowing, e.g. X-Window System, desktop virtualisation protocols for virtual reality H04L67/131
• CPC Class Codes: G06F 9/5044 considering hardware capabilities

Abstract

A method and apparatus for image encoding. In one embodiment, the method comprises encoding a first image portion by a first encoder associated with a first processor at a host system; dynamically determining a requirement to encode a second image portion by the first encoder or by a second encoder associated with a second processor at the host system; and encoding, based on the requirement, the second image portion by the first encoder or the second encoder.

Claims

1. A method for image encoding, comprising:

encoding a first image portion by a first encoder associated with a first processor at a host system;

dynamically determining a requirement to encode a second image portion by the first encoder associated with the first processor or by an offload encoder associated with a User Interface (UI) session processor at the host system, wherein the UI session processor comprises a hardware-optimized image encoding pipeline; and

encoding, based on the requirement, the second image portion by the first encoder or the offload encoder; and

transferring, when the offload encoder is used, compressed data representing the encoded second image portion from the UI session processor to the first processor, for network transmission,

wherein the requirement indicates which of using the first encoder or the offload encoder for encoding the second image portion maximizes resource utilization of the host system.

2. The method of claim 1, wherein the second image portion is encoded by the offload encoder to generate an encoded second image portion, and wherein the second encoded image portion is transmitted via the first processor to a remote system remotely located from the host system.

3. The method of claim 1, wherein the requirement is determined based on usage of at least one resource associated with the UI session processor.

4. The method of claim 1, wherein the requirement is determined based on at least one of (i) an assigned priority of a virtual machine (VM) with respect to a plurality of VMs at the host system, wherein the VM comprises the first encoder, or (ii) an image rendering activity level.

5. The method of claim 1, further comprising monitoring the first processor, wherein the requirement is determined based on data obtained by monitoring the first processor.

6. The method of claim 1, wherein the requirement is further determined based on at least one of characteristics of a network coupling the host system to a remotely located remote system, or administrator settings.

7. The method of claim 1, wherein the requirement is determined based on ongoing statistics of the UI session processor.

8. The method of claim 7, wherein the statistics comprise at least one of queue lengths, frame update rates, aggregate encoded image quality information, power consumption information, or retransmission statistics.

9. The method of claim 1, wherein the first encoder is a software encoder and the offload encoder comprises hardware-optimized imaging functions not found in the first encoder.

10. The method of claim 1, further comprising:

dynamically determining, when the second image portion is encoded by the offload encoder, a second requirement to encode a third image portion by the first encoder; and

encoding the third image portion by the first encoder.

11. The method of claim 10, wherein the second requirement is determined based on at least one of a change in update rate of an image stream, reduced availability of at least one resource associated with the UI session processor, a need for a second virtual machine (VM) having a higher priority than a first VM comprising the first encoder to utilize the offload encoder, or receipt of a status parameter of the offload encoder.

12. The method of claim 1, wherein the requirement is determined by management software managing a plurality of virtual machines (VMs) at the host system, wherein a first VM of the plurality of VMs comprises the first encoder.

13. The method of claim 12, further comprising notifying, by the management software, the first VM of the requirement.

14. The method of claim 1, wherein the first image portion and the second image portion are rendered, encoded and communicated to a remote computer as part of a remote computing session with the remote computer.

15. The method of claim 1, wherein the first processor comprises at least one core of a Central Processing Unit (CPU) and a Graphics Processing Unit (GPU), the first processor executing instructions to render the first image portion, and the UI session processor comprises a hardware-optimized image encoder in the hardware optimized image encoding pipeline.

16. The method of claim 1, wherein the first image portion and the second image portion are display images from a software application of a Virtual Machine (VM).

17. The method of claim 1, wherein the first processor comprises a plurality of processing cores of a server.

18. An apparatus for image encoding, comprising:

a first encoder, associated with a first processor at a host system, for encoding a first image portion;

an offload encoder associated with a User Interface (UI) session processor at the host system, wherein the UI session processor comprises a hardware-optimized image encoding pipeline; and

an application, associated with the first processor, for;

dynamically determining a requirement to encode a second image portion by the first encoder or by the offload encoder, wherein the second image portion is subsequently encoded, based on the requirement, by the first encoder or the offload encoder; and

transferring, when the offload encoder is used, compressed data representing the encoded second image portion from the UI session processor to the first processor, for network transmission,

wherein the requirement indicates which of using the first encoder or the offload encoder for encoding the second image portion maximizes resource utilization of the host system.

19. The apparatus of claim 18, wherein the second image portion is encoded by the offload encoder to generate an encoded second image portion, and wherein the second encoded image portion is transmitted via the first processor to a remote system remotely located from the host system.

20. The apparatus of claim 18, wherein the requirement is determined based on usage of at least one resource associated with the UI session processor.