User interface virtualization for remote devices
First Claim
1. A method of generating a local graphical user interface (GUI) on a client device that is connected to a server device having a remote GUI, the method comprising:
- receiving, from the server device, a base image of the remote GUI and UI metadata describing a GUI element in the remote GUI;
generating the local GUI to be displayed on the touch screen of the client device, the local GUI including the base image received from the server device and a native GUI element to be displayed on the touch screen, the native GUI element generated according to the received UI metadata, the native GUI element corresponding to the GUI element in the remote GUI;
receiving, at the client device, a voice input through an input device of the client device;
processing the voice input to determine a command input to manipulate the remote GUI of the server device; and
transmitting, to the server device, information indicating the command input configured to manipulate the remote GUI.
4 Assignments
0 Petitions
Accused Products
Abstract
User interface virtualization describes a technique for providing a user with access to one computing device from another computing device, while translating the ergonomics of one computer'"'"'s user interface style into the ergonomics of the other'"'"'s. An agent running on a remote desktop collaborates with a corresponding client running on a client machine that accepts a “touch and swipe” style input. The agent and client exchange user interface metadata and user interface input events and translate the exchanged information to provide native graphical user interface elements (at the client machine) and simulated user actions (at the remote desktop). The agent running on the remote desktop may use an interface interaction API or library to programmatically manipulate the user interface of the remote desktop responsive and act as a proxy for the corresponding client.
-
Citations
20 Claims
-
1. A method of generating a local graphical user interface (GUI) on a client device that is connected to a server device having a remote GUI, the method comprising:
-
receiving, from the server device, a base image of the remote GUI and UI metadata describing a GUI element in the remote GUI; generating the local GUI to be displayed on the touch screen of the client device, the local GUI including the base image received from the server device and a native GUI element to be displayed on the touch screen, the native GUI element generated according to the received UI metadata, the native GUI element corresponding to the GUI element in the remote GUI; receiving, at the client device, a voice input through an input device of the client device; processing the voice input to determine a command input to manipulate the remote GUI of the server device; and transmitting, to the server device, information indicating the command input configured to manipulate the remote GUI. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9)
-
-
10. A client device system for generating a local graphical user interface (GUI), the client device system comprising:
-
a touch screen configured to display graphical data; an input device configured to receive input data; a processor; and a memory storing instructions that, when executed by the processor cause the processor to perform a method, the method comprising; receiving, from a server device connected to the client device, a base image of the remote GUI and UI metadata describing a GUI element in the remote GUI; generating the local GUI to be displayed on the touch screen of the client device, the local GUI including the base image received from the server device and a native GUI element to be displayed on the touch screen, the native GUI element generated according to the received UI metadata, the native GUI element corresponding to the GUI element in the remote GUI; receiving, at the client device, a voice input through the input device of the client device; processing the voice input to determine a command input to manipulate the remote GUI of the server device; and transmitting, to the server device, information indicating the command input configured to manipulate the remote GUI. - View Dependent Claims (11, 12, 13, 14, 15, 16, 17, 18)
-
-
19. A non-transitory computer-readable medium storing instructions that, when executed by a processor, cause the processor to perform a method of generating a local graphical user interface (GUI) on a client device that is connected to a server device having a remote GUI, the method comprising:
-
receiving, from the server device, a base image of the remote GUI and UI metadata describing a GUI element in the remote GUI; generating the local GUI to be displayed on the touch screen of the client device, the local GUI including the base image received from the server device and a native GUI element to be displayed on the touch screen, the native GUI element generated according to the received UI metadata, the native GUI element corresponding to the GUI element in the remote GUI; receiving, at the client device, a voice input through an input device of the client device; processing the voice input to determine a command input to manipulate the remote GUI of the server device; and transmitting, to the server device, information indicating the command input configured to manipulate the remote GUI. - View Dependent Claims (20)
-
Specification