Server-side computing from a remote client device

• US 9,448,815 B2
• Filed: 08/24/2009
• Issued: 09/20/2016
• Est. Priority Date: 04/15/2009
• Status: Active Grant

• Current Assignee: Dell Marketing Corporation (Dell Technologies Inc.)
• Original Assignee: Wyse Technology L.L.C. (Dell Technologies Inc.)
• Inventors: Pahlavan, Babak, Barreto, Daniel Ernesto, Schwebke, Curtis
• Primary Examiner(s): PITARO, RYAN F
• Application Number:
  US12/546,663
• Publication Number:
  US 20100269046A1
• Time in Patent Office: 2,584 Days
• Field of Search: 715/751, 715/740
• US Class Current: 1/1
• CPC Class Codes: G06F 3/1462 with means for detecting differences between the image stored in the host and the images displayed on the remote displays
• CPC Class Codes: G06F 9/452 Remote windowing, e.g. X-Window System, desktop virtualisation protocols for virtual reality H04L67/131
• CPC Class Codes: G09G 2340/045 Zooming at least part of an image, i.e. enlarging it or shrinking it
• CPC Class Codes: G09G 2360/18 Use of a frame buffer in a display terminal, inclusive of the display panel
• CPC Class Codes: G09G 2370/027 Arrangements and methods specific for the display of internet documents
• CPC Class Codes: G09G 5/003 Details of a display terminal, the details relating to the control arrangement of the display terminal and to the interfaces thereto specific for a CRT G09G1/165; for a flat panel G09G3/2092
• CPC Class Codes: G09G 5/42 characterised by the display of patterns using a display memory without fixed position correspondence between the display memory contents and the display position on the screen

Abstract

Examples of systems and methods are provided for server-side computing from a remote client device. A system may allow rendering at a local client side a composite view including a local graphical user interface and a remote application view associated with a remote application running at a remote server. The system may comprise a local view module configured to generate a local graphical user interface (GUI) for controlling the remote application remotely from the local client side, configured to receive one or more user inputs to the local GUI, configured to determine a function corresponding to the one or more user inputs, configured to generate a command message based on the determined function, and configured to direct the command message to the remote server. A composite view comprising the local GUI and the remote application view may be provided to a local display at the client device.

Claims

1. A system for rendering at a local client side a composite view including a local graphical user interface and a remote application view associated with a remote application of a remote server, comprising:

a network interface;

a processor; and

a memory communicatively coupled to the processor, the memory comprising instructions operable, when executed by the processor, to cause the processor to;

generate a local graphical user interface (GUI) for controlling the remote application remotely from the local client side, the local client side is a mobile device,

receive one or more user inputs to the local GUI,

determine a function to be performed by the remote application of the remote server based on the one or more user inputs to the local GUI,

generate a command message identifying the determined function, direct the command message to the remote server via the network interface;

generate a remote application view of the remote application based on display output data of the remote application received at the local client side from the remote server via the network interface, where the remote application view only includes the display output data, the display output data including an image of the display output of the remote application and is used by the local client side to create a composite view, where a remote GUI of the remote application is deactivated in the display output data; and

provide, to a local display at the local client side, the composite view comprising the local GUI and the remote application view of the remote application.

2. The system of claim 1, wherein the instructions further cause the processor to receive, via the network interface, a message identifying a type of application of the remote server and to select the local GUI from a plurality of local GUIs based on the received message.

3. The system of claim 1, wherein the instructions further cause the processor to be controlled dynamically by the remote server to generate the local GUI based on the application of the remote server.

4. The system of claim 1, wherein the instructions further cause the processor to direct user inputs within the remote application view to the remote server.

5. The system of claim 4, wherein the user inputs comprise pointer inputs, keyboard inputs or finger inputs.

6. The system of claim 1, wherein the display output data includes an image or drawing commands of a display output of the remote application.

7. The system of claim 1, wherein the one or more user inputs to the local GUI include coordinates of a pointer or a user'"'"'s touch on the local display, and the instructions further cause the processor to determine the function based on a graphical control object of the local GUI corresponding to the coordinates of the pointer or the user'"'"'s touch on the local display.

8. The system of claim 1, wherein the instructions further cause the processor to control a size and a location of the local GUI on the local display independently from the remote application view of the remote application.

9. The system of claim 1, wherein the instructions further cause the processor to direct the command message to the remote server through a remote access module at the local client side.

10. The system of claim 9, wherein the instructions further cause the processor to communicate with the remote server over a first connection and a second connection via different socket connections, to receive the display output data of the remote application and to send user inputs over the first connection and to send the command message over the second connection.

11. The system of claim 9, wherein the instructions further cause the processor to communicate with the remote server over a plurality of virtual channels, to send user inputs over a first one of the plurality of virtual channels and to send the command message over a second one of the plurality of virtual channels.

21. The system of claim 1, wherein the remote application of the remote server comprises a browser application of the remote server, and the determined function comprises one of a page reload function, a page forward function, and a page backwards function.

12. A method for rendering at a local client side a composite view including a local graphical user interface and a remote application view associated with a remote application of a remote server, comprising:

generating a local graphical user interface (GUI) for remotely controlling the remote application from the local client device, the local client device is a mobile device;

generating a remote view of the remote application based on display output data of the remote application received at the local client device from the remote server, where the remote application view only includes the display output data, the display output data including an image of the display output of the remote application and is used by the local client device to create a composite view, where a remote GUI of the remote application is deactivated in the display output data;

providing, to a local display, the composite view comprising the local GUI and the remote view of the remote application;

determining a function to be performed by the remote application of the remote server based on one or more user inputs to the local GUI;

generating a command message identifying the determined function; and

directing the command message to the remote server.

13. A non-transitory machine-readable medium encoded with instructions for rendering at a local client side a composite view including a local graphical user interface and a remote application view associated with a remote application of a remote server, the instructions comprising code for:

generating a local graphical user interface (GUI) for remotely controlling the remote application from the local client device, the local client device is a mobile device;

generating a remote view of the remote application based on display output data of the remote application received at the local client device from the remote server, where the remote application view only includes the display output data, the display output data including an image of the display output of the remote application and is used by the local client device to create a composite view, where a remote GUI of the remote application is deactivated in the display output data;

providing, to a local display, the composite view comprising the local GUI and the remote view of the remote application;

determining a function to be performed by the remote application of the remote server based on one or more user inputs to the local GUI;

generating a command message identifying the determined function; and

directing the command message to the remote server.

14. The non-transitory machine-readable medium of claim 13, wherein the instructions further comprise code for:

receiving, via a network interface, a message identifying a type of application of the remote server; and

selecting the local GUI from a plurality of local GUIs based on the received message.

15. The non-transitory machine-readable medium of claim 13, wherein the instructions further comprise code for directing user inputs within the remote application view to the remote server.

16. The non-transitory machine-readable medium of claim 15, wherein the user inputs from the remote application view comprise pointer inputs, keyboard inputs or finger inputs.

17. The non-transitory machine-readable medium of claim 13, wherein the display output data includes an image or drawing commands of a display output of the remote application.

18. The non-transitory machine-readable medium of claim 13, wherein the one or more user inputs to the local GUI include coordinates of a pointer or a user'"'"'s touch on the local display, and determining the function based on the one or more user inputs comprises:

determining the function based on a graphical control object of the local GUI

corresponding to the coordinates of the pointer or the user'"'"'s touch on the local display.

19. The non-transitory machine-readable medium of claim 13, wherein the instructions further comprise code for controlling a size and a location of the local GUI on the display independently from the remote application view of the remote application.

20. An apparatus for rendering at a local client side a composite view including a local graphical user interface and a remote application view associated with a remote application of a remote server, comprising:

means for generating a local graphical user interface (GUI) for remotely controlling the remote application from the local client device, the local client device is a mobile device;

means for generating a remote view of the remote application based on display output data of the remote application received at the local client device from the remote server, where the remote application view only includes the display output data, the display output data including an image of the display output of the remote application and is used by the local client device to create a composite view, where a remote GUI of the remote application is deactivated in the display output data;

means for providing, to a local display, the composite view comprising the local GUI and the remote view of the remote application;

means for determining a function to be performed by the remote application of the remote server based on one or more user inputs to the local GUI;

means for generating a command message identifying the determined function; and

means for directing the command message to the remote server.