Methods and systems for accessing and controlling a remote desktop of a remote machine in real time by a web browser at a client device via HTTP API utilizing a transcoding server

• US 10,237,327 B2
• Filed: 11/13/2013
• Issued: 03/19/2019
• Est. Priority Date: 12/10/2010
• Status: Active Grant

• Current Assignee: Dell Marketing Corporation (Dell Technologies Inc.)
• Original Assignee: Wyse Technology L.L.C. (Dell Technologies Inc.)
• Inventors: Kominac, Stevan, Stanley, Jeremy Michael, Schwebke, Curtis J.
• Primary Examiner(s): Xiao, Di
• Application Number:
  US14/078,972
• Publication Number:
  US 20140068453A1
• Time in Patent Office: 1,952 Days
• CPC Class Codes: G06F 9/452 Remote windowing, e.g. X-Window System, desktop virtualisation protocols for virtual reality H04L67/131
• CPC Class Codes: H04L 67/02 based on web technology, e.g. hypertext transfer protocol [HTTP]
• CPC Class Codes: H04L 67/025 for remote control or remote monitoring of applications
• CPC Class Codes: H04L 67/08 specially adapted for terminal emulation, e.g. Telnet
• CPC Class Codes: H04L 67/565 Conversion or adaptation of application format or content adding application control or application functional data H04L67/561

Abstract

Examples of methods, systems, apparatus, and machine-readable storage media are provided to facilitate access and control of a remote desktop of a remote machine by a web browser at a client device through a transcoding server without installing proprietary plug-ins or protocols on the client device. A transcoding server may translate user input requests from a web browser into input calls compatible with a remote desktop display protocol. The transcoding server may receive remote desktop drawing commands from the remote machine and translate the remote desktop drawing commands into web browser drawing updates compatible with the web browser. A transcoding server may communicate with a web browser via HTTP and communicate with a remote machine via a remote desktop display protocol. A web browser may be an HTML5 browser. A transcoding server may send drawing coordinates to the web browser via an HTTP header and may use long polling.

Claims

1. A method of facilitating accessing and controlling a remote desktop of a remote machine in real time by a web browser at a client device via a hypertext transfer protocol (HTTP) utilizing a transcoding server, the method comprising:

receiving a connection request from the web browser;

authenticating, by the transcoding server, the connection between the remote machine and the client device;

establishing the connection between the remote machine and the client device;

rendering, by the transcoding server, the remote desktop;

transmitting the rendering to the web browser;

receiving, at the transcoding server, a remote desktop drawing command from the remote machine via the client device based on an image of the remote desktop of the remote machine, wherein the remote desktop drawing command is compatible with a remote desktop display protocol utilized by the remote machine, wherein the remote desktop drawing command comprises a pointer to a memory location where bitmap data associated with the image is located;

interfacing with the remote machine via a remote desktop client adapter of the transcoding server, wherein the remote desktop client adapter provides a common interface between the client device and a drawing commands queue, wherein the drawing commands queue stores one or more off-screen images and serves as a drawing coordinates pool;

translating, at the transcoding server, the remote desktop drawing command into a web browser drawing update that is compatible with the web browser, wherein translating the remote desktop drawing command into the web browser drawing update comprises;

translating the remote desktop drawing command into a Java graphics drawing command;

updating a portion of a Java bitmap using the Java graphics drawing command, wherein the updated portion represents a portion of an entire image of the remote desktop;

creating an image file from the Java bitmap;

generating drawing coordinates from the image file; and

generating the web browser drawing update including the image file and the drawing coordinates for the image file;

facilitating providing the web browser drawing update from the transcoding server to the web browser of the client device utilizing HTTP during a remote desktop session between the client device and the remote machine;

wherein the remote desktop display protocol is a push protocol; and

wherein HTTP is a pull protocol.

2. The method of claim 1, wherein the web browser drawing update comprises an image file and drawing coordinates for the image file that are recognizable and processable by the web browser.

3. The method of claim 1, wherein the translating comprises:

translating the remote desktop drawing command into a Java graphics drawing command;

updating a portion of a Java bitmap using the Java graphics drawing command, wherein the updated portion of the Java bitmap represents a portion of an entire image of the remote desktop;

creating an image file from the Java bitmap; and

generating drawing coordinates for the image file,

wherein the web browser drawing update comprises the image file and the drawing coordinates for the image file,

wherein the facilitating providing comprises placing the drawing coordinates into an HTTP header,

wherein utilizing HTTP comprises using an HTTP handler,

wherein the transcoding server is a Java transcoding server that is configured to provide an application framework for hosting one or more web applications.

4. The method of claim 1, wherein the translating comprises:

translating the remote desktop drawing command into a graphics drawing command that is compatible with the transcoding server, wherein the graphics drawing command includes coordinates;

extracting the coordinates from the graphics drawing command;

updating at least a portion of an off-screen bitmap based on the graphics drawing command, wherein the at least a portion of the off-screen bitmap is associated with the coordinates,

wherein the off-screen bitmap is based on the image of the remote desktop;

creating an image file based on the at least a portion of the off-screen bitmap; and

wherein the web browser drawing update comprises the image file and the coordinates.

5. The method of claim 1, wherein the web browser is an HTML5 compatible web browser.

6. The method of claim 1, further comprising:

receiving a user input request from the web browser, using HTTP;

translating the user input request into an input command compatible with the remote desktop display protocol; and

providing the input command to the remote desktop client for accessing and controlling the remote desktop of the remote machine during the remote desktop session,

wherein the web browser drawing update comprises an image file and drawing coordinates for the image file that are recognizable and processable by the web browser,

wherein the image file and the drawing coordinates represent a portion of an entire image of the remote desktop that has been changed in response to the input command.

7. The method of claim 6, wherein the user input request comprises at least one of a mouse event, a keyboard event, and a touch event.

8. The method of claim 1, wherein the remote desktop drawing command comprises remote desktop drawing command parameters and bitmap data received from a remote desktop server of the remote machine,

wherein the translating comprises one or more of:

calculating new drawing command parameters based on the remote desktop drawing command parameters;

adjusting the remote desktop drawing command parameters; and

making adjustments to the bitmap data.

9. The method of claim 1, wherein the remote desktop drawing command comprises remote desktop drawing command parameters and bitmap data received from a remote desktop server of the remote machine,

wherein the translating comprises making adjustments to the bitmap data,

wherein the making adjustments comprises converting a 16-bit red-green-blue (RGB) 5-6-5 color format into a 32-bit alpha-red-green-blue (ARGB) 8-8-8-8 format.

10. The method of claim 1, wherein the transcoding server is an intermediary between the remote machine and the client device, wherein the transcoding server is physically separate from the remote machine, and wherein the transcoding server comprises a long polling handler that is operable to receive and handle HTTP requests from the web browser.

11. A machine-readable non-transitory storage medium encoded with instructions executable by a processing system to perform a method of facilitating accessing and controlling a remote desktop of a remote machine in real time by a web browser at a client device via a hypertext transfer protocol (HTTP) utilizing a transcoding server, the instructions comprising code for:

receiving a connection request from the web browser;

authenticating, by the transcoding server, the connection between the remote machine and the client device;

establishing the connection between the remote machine and the client device;

rendering, by the transcoding server, the remote desktop;

transmitting the rendering to the web browser;

receiving, at the transcoding server, a remote desktop drawing command from the remote machine via the client device based on an image of the remote desktop of the remote machine, wherein the remote desktop drawing command is compatible with a remote desktop display protocol utilized by the remote machine and wherein the remote desktop drawing command comprises a pointer to a memory location where bitmap data associated with the image is located;

interfacing with the remote machine via a remote desktop client adapter of the transcoding server, wherein the remote desktop client adapter provides a common interface between the client device and a drawing commands queue, wherein the drawing commands queue stores one or more off-screen images and serves as a drawing coordinates pool;

translating, at the transcoding server, the remote desktop drawing command into a web browser drawing update that is compatible with the web browser, wherein translating the remote desktop drawing command into the web browser drawing update comprises;

translating the remote desktop drawing command into a Java graphics drawing command;

updating a portion of a Java bitmap using the Java graphics drawing command, wherein the updated portion represents a portion of an entire image of the remote desktop;

creating an image file from the Java bitmap;

generating drawing coordinates from the image file; and

generating the web browser drawing update including the image file and the drawing coordinates for the image file;

facilitating providing the web browser drawing update from the transcoding server to the web browser of the client device utilizing HTTP during a remote desktop session between the client device and the remote machine,

wherein the remote desktop display protocol is a push protocol, and

wherein HTTP is a pull protocol.

12. The machine-readable storage medium of claim 11, wherein the web browser drawing update comprises an image file and drawing coordinates for the image file that are recognizable and processable by the web browser.

13. The machine-readable storage medium of claim 11, wherein the translating comprises:

translating the remote desktop drawing command into a Java graphics drawing command;

updating a portion of a Java bitmap using the Java graphics drawing command, wherein the updated portion of the Java bitmap represents a portion of an entire image of the remote desktop;

creating an image file from the Java bitmap; and

generating drawing coordinates for the image file,

wherein the web browser drawing update comprises the image file and the drawing coordinates for the image file,

wherein the facilitating providing comprises placing the drawing coordinates into an HTTP header,

wherein utilizing HTTP comprises using an HTTP handler,

wherein the transcoding server is a Java transcoding server that is configured to provide an application framework for hosting one or more web applications.

14. The machine-readable storage medium of claim 11, wherein the translating comprises:

translating the remote desktop drawing command into a graphics drawing command that is compatible with the transcoding server, wherein the graphics drawing command includes coordinates;

extracting the coordinates from the graphics drawing command;

updating at least a portion of an off-screen bitmap based on the graphics drawing command, wherein the at least a portion of the off-screen bitmap is associated with the coordinates,

wherein the off-screen bitmap is based on the image of the remote desktop;

creating an image file based on the at least a portion of the off-screen bitmap; and

wherein the web browser drawing update comprises the image file and the coordinates.

15. The machine-readable storage medium of claim 11, wherein the web browser is an HTML5 compatible web browser.

16. The machine-readable storage medium of claim 11, wherein the instructions further comprise code for:

receiving a user input request from the web browser, using HTTP;

translating the user input request into an input command compatible with the remote desktop display protocol; and

providing the input command to the remote desktop client for accessing and controlling the remote desktop of the remote machine during the remote desktop session;

wherein the web browser drawing update comprises an image file and drawing

coordinates for the image file that are recognizable and processable by the web browser; and

wherein the image file and the drawing coordinates represent a portion of an entire image of the remote desktop that has been changed in response to the input command.

17. The machine-readable storage medium of claim 16, wherein the user input request comprises at least one of a mouse event, a keyboard event, and a touch event.

18. The machine-readable storage medium of claim 11, wherein the remote desktop drawing command comprises remote desktop drawing command parameters and bitmap data received from a remote desktop server of the remote machine,

wherein the translating comprises one or more of:

calculating new drawing command parameters based on the remote desktop drawing command parameters;

adjusting the remote desktop drawing command parameters; and

making adjustments to the bitmap data.

19. The machine-readable storage medium of claim 11, wherein the remote desktop drawing command comprises remote desktop drawing command parameters and bitmap data received from a remote desktop server of the remote machine,

wherein the translating comprises making adjustments to the bitmap data,

wherein the making adjustments comprises converting a 16-bit red-green-blue (RGB) 5-6-5 color format into a 32-bit alpha-red-green-blue (ARGB) 8-8-8-8 format.

20. The machine-readable storage medium of claim 11, wherein the transcoding server is an intermediary between the remote machine and the client device, wherein the transcoding server is physically separate from the remote machine, and wherein the transcoding server comprises a long polling handler that is operable to receive and handle HTTP requests from the web browser.

21. A computing machine comprising the machine-readable storage medium of claim 11, wherein the computing machine is the transcoding server.

22. An apparatus for facilitating accessing and controlling a remote desktop of a remote machine in real time by a web browser at a client device via a hypertext transfer protocol (HTTP) utilizing a transcoding server, the apparatus comprising:

receiving a connection request from the web browser;

authenticating, by the transcoding server, the connection between the remote machine and the client device;

establishing the connection between the remote machine and the client device;

rendering, by the transcoding server, the remote desktop;

transmitting the rendering to the web browser;

means for receiving a remote desktop drawing command from the remote machine via the client device based on an image of the remote desktop of the remote machine, wherein the remote desktop drawing command is compatible with a remote desktop display protocol utilized by the remote machine, and wherein the remote desktop drawing command comprises a pointer to a memory location where bitmap data associated with the image is located;

means for interfacing with the remote machine via a remote desktop client adapter of the transcoding server, wherein the remote desktop client adapter provides a common interface between the client device and a drawing commands queue, wherein the drawing commands queue stores one or more off-screen images and serves as a drawing coordinates pool;

means for translating the remote desktop drawing command into a web browser drawing update that is compatible with the web browser, wherein translating the remote desktop drawing command into the web browser drawing update comprises;

translating the remote desktop drawing command into a Java graphics drawing command;

updating a portion of a Java bitmap using the Java graphics drawing command, wherein the updated portion represents a portion of an entire image of the remote desktop;

creating an image file from the Java bitmap;

generating drawing coordinates from the image file; and

generating the web browser drawing update including the image file and the drawing coordinates for the image file;

means for facilitating providing the web browser drawing update from the transcoding server to the web browser of the client device utilizing HTTP during a remote desktop session between the client device and the remote machine;

wherein the remote desktop display protocol is a push protocol; and

wherein HTTP is a pull protocol.

23. The apparatus of claim 22, wherein the web browser drawing update comprises an image file and drawing coordinates for the image file that are recognizable and processable by the web browser.

24. The apparatus of claim 22, wherein the means for translating comprises:

means for translating the remote desktop drawing command into a Java graphics drawing command;

means for updating a portion of a Java bitmap using the Java graphics drawing command, wherein the updated portion of the Java bitmap represents a portion of an entire image of the remote desktop;

means for creating an image file from the Java bitmap; and

means for generating drawing coordinates for the image file,

wherein the web browser drawing update comprises the image file and the drawing coordinates for the image file,

wherein the means for facilitating providing comprises means for placing the drawing coordinates into an HTTP header,

wherein utilizing HTTP comprises utilizing an HTTP handler, and

wherein the transcoding server is a Java transcoding server that is configured to provide an application framework for hosting one or more web applications.

25. The apparatus of claim 22, wherein the means for translating comprises:

means for translating the remote desktop drawing command into a graphics drawing command that is compatible with the transcoding server, wherein the graphics drawing command includes coordinates;

means for extracting the coordinates from the graphics drawing command;

means for updating at least a portion of an off-screen bitmap based on the graphics drawing command, wherein the at least a portion of the off-screen bitmap is associated with the coordinates, wherein the off-screen bitmap is based on the image of the remote desktop; and

means for creating an image file based on the at least a portion of the off-screen bitmap;

wherein the web browser drawing update comprises the image file and the coordinates.

26. The apparatus of claim 22, wherein the web browser is an HTML5 compatible web browser.

27. The apparatus of claim 22, further comprising:

means for receiving a user input request from the web browser, using HTTP;

means for translating the user input request into an input command compatible with the remote desktop display protocol; and

means for providing the input command to the remote desktop client for accessing and controlling the remote desktop of the remote machine during the remote desktop session;

wherein the web browser drawing update comprises an image file and drawing coordinates for the image file that are recognizable and processable by the web browser; and

wherein the image file and the drawing coordinates represent a portion of an entire image of the remote desktop that has been changed in response to the input command.

28. The apparatus of claim 27, wherein the user input request comprises at least one of a mouse event, a keyboard event, and a touch event.

29. The apparatus of claim 22, wherein the remote desktop drawing command comprises remote desktop drawing command parameters and bitmap data received from a remote desktop server of the remote machine,

wherein the means for translating comprises one or more of:

means for calculating new drawing command parameters based on the remote desktop drawing command parameters;

means for adjusting the remote desktop drawing command parameters; and

means for making adjustments to the bitmap data.

30. The apparatus of claim 22, wherein the remote desktop drawing command comprises remote desktop drawing command parameters and bitmap data received from a remote desktop server,

wherein the means for translating comprises means for making adjustments to the bitmap data of the remote machine,

wherein the means for planning comprises means for converting a 16-bit red-green-blue (RGB) 5-6-5 color format into a 32-bit alpha-red-green-blue (ARGB) 8-8-8-8 format.

31. The apparatus of claim 22, wherein the transcoding server is an intermediary between the remote machine and the client device, wherein the transcoding server is physically separate from the remote machine, and wherein the transcoding server comprises a long polling handler that is operable to receive and handle HTTP requests from the web browser.

32. The apparatus of claim 22, wherein the apparatus comprises the transcoding server.

33. The apparatus of claim 22, wherein the apparatus comprises a processing system and a memory.