Methods for Interfacing with a Virtualized Computing Service over a Network using a Lightweight Client

• US 20110126198A1
• Filed: 05/20/2010
• Published: 05/26/2011
• Est. Priority Date: 11/25/2009
• Status: Active Grant

• Current Assignee: Citrix Systems, Inc. (Cloud Software Group)
• Original Assignee: Framehawk LLC
• Inventors: Roncadin, Dan, Badger, Peter, Vilke, Stephen D., Willis, Rudy, Selvidge, James
• Granted Patent: US 8,676,949 B2
• Time in Patent Office: Days
• US Class Current: 718/1
• CPC Class Codes: G06F 15/163 Interprocessor communication
• CPC Class Codes: G06F 2009/45595 Network integration; Enabling network access in virtual machine instances
• CPC Class Codes: G06F 9/452 Remote windowing, e.g. X-Window System, desktop virtualisation protocols for virtual reality H04L67/131
• CPC Class Codes: G06F 9/45533 Hypervisors; Virtual machine monitors
• CPC Class Codes: G06F 9/45558 Hypervisor-specific management and integration aspects
• CPC Class Codes: G06F 9/54 Interprogram communication
• CPC Class Codes: H04L 67/01 Protocols
• CPC Class Codes: H04L 67/133 Protocols for remote procedure calls [RPC]

Abstract

Methods for controlling a virtualized computer service remotely through a client includes receiving a connection request from the client for controlling the virtual service available at a virtual machine. The request includes a plurality of connection parameters that describe the connection requirements of the client and is received at a virtual machine that is equipped with an image processor algorithm. The connection parameters are interrogated using the image processor algorithm to identify a specific virtual machine that provides the requested virtualized computer service. A framebuffer data for the identified virtual machine located in virtual memory is accessed and read directly through a hypervisor. The framebuffer data is processed into a plurality of image data packets using the image processor algorithm and transmitted to the client for presenting on a display device associated with the client. The image data packet grammar is tailored to the client and represents an image of the virtual machine display for the specific virtual machine.

Claims

1. A method for providing a service to a client over a network, comprising:

receiving a connection request from the client for controlling a virtualized computer service available on a specific virtual machine, the connection request including a plurality of connection parameters that define connection requirements of the client, the connection request received at a virtual machine that executes an image processor algorithm;

interrogating the connection parameters using the image processor algorithm to identify the specific virtual machine providing the virtualized computer service that satisfies the request from the client;

accessing framebuffer data for the specific virtual machine from a predetermined location in virtual memory through a hypervisor, the framebuffer data being read from the predetermined location in virtual memory, the framebuffer data defining graphical output representing an image associated with a virtual machine display of the specific virtual machine;

processing the framebuffer data into a plurality of image data packets using the image processor algorithm based on the plurality of connection parameters; and

transmitting the image data packets to the client for presenting on a display device associated with the client, the image data packets being specific for the client and represents the image of the virtual machine display.

2. The method of claim 1, wherein the image data packets includes packaging information related to image processor algorithm and packaging information related to networking.

3. The method of claim 1, wherein processing the framebuffer data further includes,

analyzing the framebuffer data of the specific virtual machine to determine context;

associating appropriate contextual information to the framebuffer data of the specific virtual machine based on the analysis; and

storing the framebuffer data of the specific virtual machine along with the contextual information.

4. The method of claim 3, further includes,

scanning the framebuffer data of the specific virtual machine periodically;

determining areas of change by comparing scanned framebuffer data against the stored framebuffer data for the specific virtual machine; and

storing the areas of change in a time-based storage array associated with the specific virtual machine for analysis and transmission, wherein storing of the areas of change includes storing of the contextual information associated with the areas of change.

5. The method of claim 4, wherein scanning the framebuffer data further includes,

interrogating a sync-signal associated with the framebuffer data of the specific virtual machine, the sync-signal identifying status of a refresh of the framebuffer data of the specific virtual machine;

and

performing the scanning of the framebuffer data of the specific virtual machine based on the interrogation of the sync-signal.

6. The method of claim 5, further includes,

setting the sync-signal prior to a refresh of the framebuffer data for the specific virtual machine;

and

re-setting the sync-signal upon completion of the refresh of the framebuffer data for the specific virtual machine.

7. The method of claim 5, wherein the periodic scanning of the framebuffer data at the virtual machine is conducted at one of a refresh frequency of the framebuffer data at the virtual machine or a frequency driven by the connection parameters associated with the client.

8. The method of claim 5, wherein the scanning of the framebuffer data at the virtual machine further includes,

receiving a notification informing of a change in the framebuffer data of the specific virtual machine, the notification received from a graphics driver associated with the specific virtual machine;

and

scanning the framebuffer data of the specific virtual machine based on the notification.

9. The method of claim 4, wherein processing the read framebuffer data further includes,

analyzing the time-based storage array to determine areas of high activity within the framebuffer data;

determining contiguous areas of activity within the areas of high activity of the framebuffer data;

grouping transmission technique friendly traits within the contiguous areas of activity into groups of framebuffer data within the time-based storage array; and

transmitting the groups of contiguous areas of activity from the time-based storage array in a time-based framebuffer data stream to the client based on the connection parameters associated with the client, the transmission of the groups of contiguous areas of activity includes derived contextual information associated with the framebuffer data.

10. The method of claim 9, wherein the transmitting of the image data packets further includes,

determining a format that is compatible with the display device associated with the client based on the connection parameters;

identifying one or more conversion techniques based on the context associated with the framebuffer data, the one or more conversion techniques used in converting the framebuffer data to the format compatible with the display device associated with the client;

converting the framebuffer data into image data packets that comply with the identified format using the one or more conversion techniques, wherein the image data packets include the contextual information associated with the framebuffer data; and

transmitting the formatted image data packets to the client for rendering at the display device of the client.

11. The method of claim 9, further includes,

examining one or more characteristics associated with an area of change of the framebuffer data;

extracting a portion of the framebuffer data related with the area of change based on the one or more characteristics using the identified conversion technique; and

transmitting the extracted portion of the framebuffer data to the client as an out-of-band stream using the identified conversion technique, wherein the out-of-band stream including the contextual information of the framebuffer data,

wherein the extracted portion of the framebuffer data is a video clip.

12. The method of claim 9, further includes,

dynamically detecting changes to connection parameters associated with the client, the changes to connection parameters identifying a change in the display device associated with the client;

dynamically re-sampling and re-sizing the framebuffer data of the specific virtual machine into appropriate image data packets based on the changes to the connection parameters detected at the client, the dynamic re-sampling and re-sizing of the framebuffer data enabling rendering of the framebuffer data at the display device of the client.

13. The method of claim 9, further includes,

detecting a plurality of display devices associated with the client, wherein each of the plurality of display devices is of a distinct type;

determining a format compatible with each type of display device of the client;

generating multiple sets of image data packets using the one or more conversion techniques, each set of image data packets generated by converting the framebuffer data using the format that is compatible with a specific type of display device associated with the client, wherein each set of image data packets includes contextual information associated with the framebuffer data; and

transmitting each set of the image data packets to the client for rendering at the respective display devices of the client.

14. The method of claim 1, wherein each image data packet includes data that is assigned to define and render a specific portion of the image of the virtual machine display at the client and wherein the specific portion of the image is defined by at least one pixel.

15. The method of claim 1, wherein the framebuffer data is created by an operating system of the virtual machine and wherein access to the framebuffer data is provided by a hypervisor, the hypervisor providing an interface between the client and the virtual machine.

16. A method for providing a service to a client over a network, comprising:

receiving a connection request from the client for controlling a virtualized computer service, the connection request including a plurality of connection parameters that defines the connection requirements of the client, the connection request received at a virtual machine executing an image processor algorithm;

interrogating the connection parameters using the image processor algorithm to identify a specific service layer providing a type of service requested and a specific virtual machine within the specific service layer for providing the virtualized computer service that satisfies the connection request from the client, wherein each service layer hosts a distinct type of service;

connecting to the specific service layer that provides the specific virtualized computer service;

accessing framebuffer data for the specific virtual machine from a predetermined location in virtual memory through a hypervisor in the specific service layer, the framebuffer data being read from the predetermined location in virtual memory, the framebuffer data defining a graphical output representing an image associated with a virtual machine display of the specific virtual machine within the identified service layer;

processing the framebuffer data into a plurality of image data packets using the image processor algorithm based on the plurality of connection parameters; and

transmitting the image data packets to the client for presenting on a display device associated with the client, the image data packets being specific for the client and represents the image of the virtual machine display.

17. The method of claim 16, wherein each image data packet includes data that is assigned to define and render a specific portion of the image of the virtual machine display at the client and wherein the specific portion of the image is defined by at least one pixel.

18. The method of claim 16, further includes,

detecting a change in connection parameters at the client, the change in connection parameters defining a new virtualized computer service requested by the client;

disconnecting the connection to the identified virtual machine;

interrogating the changed connection parameters using the image processor algorithm to identify a specific new virtual machine providing the new virtualized computer service requested by the client;

establishing connection to the specific new virtual machine based on the interrogation of the changed connection parameters, the connection to the specific new virtual machine enabling access to a framebuffer data for the specific new virtual machine at a predetermined location in virtual memory associated with the specific new virtual machine;

accessing the framebuffer data for the specific new virtual machine from the predetermined location in virtual memory associated with the specific new virtual machine, the accessed framebuffer data read from the predetermined location in virtual memory for the specific virtual machine and processed into a plurality of image data packets for transmission using the image processor algorithm and presentation on a display device of the client, the image data packets being specific for the client and represents the image of the specific new virtual display associated with the new virtual machine on which the new virtualized computer service is executing.

19. The method of claim 18, wherein disconnecting the connection further includes disconnecting from the identified service layer.

20. A method for providing a service to a client over a network, comprising:

providing an image processor algorithm on at least one virtual machine, the virtual machine with the image processor algorithm executing on a hypervisor on which a plurality of virtual machines are executing;

processing a connection request at the image processor algorithm of the at least one virtual machine, the connection request received from the client, wherein the processing of the connection request identifying a plurality of connection parameters defining connection requirements associated with the client and a specific virtual machine having a virtualized computer service that can satisfy the connection request;

accessing framebuffer data for the specific virtual machine from a predetermined location in virtual memory through the hypervisor, the framebuffer data being read from the predetermined location in the virtual memory, the framebuffer data defining graphical output representing an image associated with a virtual machine display of the specific virtual machine;

processing the framebuffer data into a plurality of image data packets using the image processor algorithm based on the plurality of connection parameters, wherein the plurality of image data packets includes contextual information associated with the read framebuffer data; and

transmitting the image data packets with the contextual information to the client for presenting on a display device associated with the client, the image data packets being specific for the client and represents the image of the VM display.

21. The method of claim 20, further includes providing an image processor algorithm independently in a plurality of virtual machines, each virtual machine with the image processor algorithm configured to access and read corresponding framebuffer data of other virtual machines.

22. The method of claim 20, further includes providing an image processor algorithm independently in each of the plurality of virtual machines executing on the hypervisor, each of the plurality of virtual machines with the image processor algorithm configured to access and read corresponding framebuffer data of other virtual machines.

23. The method of claim 20, wherein processing the read framebuffer data further includes,

analyzing the framebuffer data of the specific virtual machine providing the virtualized computer service;

determining context for the framebuffer data based on the analysis;

associating appropriate contextual information for the framebuffer data; and

generating a plurality of image data packets for the framebuffer data, each of the image data packets including at least a portion of the framebuffer data and the associated contextual information for the portion of framebuffer data.

24. A method for providing a user access to a computing profile, the computing profile defining a desktop for the user, the desktop providing access to applications and data of the user, the method comprising:

a) requesting connection to the computing profile through an Internet connection from a client;

b) identifying a virtual machine for the computing profile in response to the requested connection;

c) identifying framebuffer data for the identified virtual machine;

d) reading the framebuffer data;

e) processing the framebuffer data based on characteristics of the client from which the connection request is made, the processing producing image data packets;

f) forwarding the image data packets to the client, the image data packets being processed at the client and presented on a display of the client;

g) repeating (d)-(f) during a session, while exchanging backchannel communication between the client and the virtual machine.

25. The method of claim 24, wherein each image data packet includes data that is assigned to define and render a specific portion of the image of the virtual machine display at the client and wherein the specific portion of the image is defined by at least one pixel.

26. The method of claim 24, wherein processing the framebuffer data further includes,

analyzing the framebuffer data to determine context;

associating contextual information to the framebuffer data based on the analysis;

generating image data packets for the framebuffer data using one or more conversion techniques, the image data packets being compatible with the display device associated with the client.

27. The method of claim 24, wherein the backchannel communication between the client and the virtual machine includes data to one or more applications executing on the virtual machine.

28. The method of claim 24, wherein processing of image data packets at the client further includes removing packaging information and mapping the data to a specific portion of the display of the client.

29. A method for providing access to a session of a virtual machine (VM), comprising:

(a) obtaining access to the session of the VM;

(b) identifying framebuffer data for the VM;

(c) reading the framebuffer data;

(d) processing the framebuffer data based on characteristics of the client to produce image data packets;

(e) forwarding the image data packets, produced for the characteristics of the client, to the client;

(f) repeating (c)-(e) during a time when accessing the session of the VM while exchanging backchannel communication between the client and the VM.

30. The method of claim 29, wherein each image data packet includes data that is assigned to define and render a specific portion of the image of the virtual machine display at the client and wherein the specific portion of the image is defined by at least one pixel.

31. The method of claim 30, where in the characteristics of the client are defined by one or more connection parameters that include any one or more of location of the client, location of virtual service to connect, type of client, type of display, quality of connection, communication connection bandwidth, type of data requested, configuration of display associated with the client including resolution, bit depth, refresh rate.

32. The method of claim 30, wherein obtaining access to the session is through a service broker and an image processor algorithm executing on a VM running on a hypervisor, the service broker providing information associated with mapping of clients to the VM and the image processor algorithm providing API to access the framebuffer data associated with the VM.

33. The method of claim 32, wherein the image processor algorithm is executing independently on any one of the same VM running the session or on a VM different than the VM running the session.

34. The method of claim 32, wherein the image data packets at the client are processed to remove packaging information and map the data in the image data packets to specific portions of the display of the client.