Navigation of Virtual Desktop Content on Devices

• US 20150334162A1
• Filed: 05/13/2014
• Published: 11/19/2015
• Est. Priority Date: 05/13/2014
• Status: Abandoned Application

• Current Assignee: Citrix Systems, Inc. (Cloud Software Group)
• Original Assignee: Citrix Systems, Inc. (Cloud Software Group)
• Inventors: Krishnamurthy, ShivaKumar
• Application Number:
  US14/276,724
• Publication Number:
  US 20150334162A1
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 1/1694 the I/O peripheral being a single or a set of motion sensors for pointer control or gesture input obtained by sensing movements of the portable computer
• CPC Class Codes: G06F 2200/1637 Sensing arrangement for detection of housing movement or orientation, e.g. for controlling scrolling or cursor movement on the display of an handheld computer
• CPC Class Codes: G06F 2203/04806 Zoom, i.e. interaction techniques or interactors for controlling the zooming operation
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0485 Scrolling or panning
• CPC Class Codes: G06F 3/14 Digital output to display device ; Cooperation and interconnection of the display device with other functional units
• CPC Class Codes: G06F 3/1454 involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay
• CPC Class Codes: G06F 9/452 Remote windowing, e.g. X-Window System, desktop virtualisation protocols for virtual reality H04L67/131
• CPC Class Codes: G09G 2340/145 related to small screens
• CPC Class Codes: G09G 2354/00 Aspects of interface with display user
• CPC Class Codes: H04L 67/025 for remote control or remote monitoring of applications
• CPC Class Codes: H04L 67/10 in which an application is distributed across nodes in the network software deployment G06F8/60; multiprogramming arrangements G06F9/46

Abstract

Methods and systems for navigating virtual desktop content on client devices (e.g., mobile devices) are disclosed. Virtual desktop navigation may be responsive to physical movement of the client device, such that virtual desktop content is panned and/or zoomed based on the user physically moving the client device in 3D space. A client device launches a graphical user interface for a virtual desktop on a display. Display resolution is determined, and movement information is generated based on physical movement of the client device. The display resolution and movement information are sent to a server. The client device receives, from the server, a portion of the graphical user interface based on the display resolution, a resolution of the graphical user interface, and the movement information. The portion of the graphical user interface is presented on the display, such that the displayed portion appears to change responsive to the movement of the device.

Claims

1. A method, comprising:

sending a graphical user interface for a virtual application to a client device for display by the client device;

receiving, from the client device, a display resolution of the client device and movement information identifying a detected physical movement of the client device in at least one of an x, y, and z axis;

determining a portion of the graphical user interface to send to the client device based on the display resolution, a resolution of the graphical user interface, and the movement information; and

sending the portion of the graphical user interface to the client device.

2. The method of claim 1, further comprising:

buffering additional portions of the graphical user interface to send to the client device based on anticipated physical movements of the client device in at least one of an x, y, and z axis.

3. The method of claim 2, wherein the movement information identifies anticipated movement in an x axis, and the additional portion of the graphical user interface is buffered along the x axis.

4. The method of claim 2, wherein the movement information identifies anticipated movement in a y axis, and the additional portion of the graphical user interface is buffered along the y axis.

5. The method of claim 2, wherein the movement information identifies anticipated movement in a z axis, and the additional portion of the graphical user interface is buffered along the z axis.

6. The method of claim 1, further comprising:

determining that the portion of the graphical user interface comprises video content;

compressing the video content to send to the client device; and

buffering additional portions of the graphical user interface to send to the client device based on anticipated physical movements of the client device in at least one of an x, y, and z axis.

7. The method of claim 1, further comprising:

upon determining the portion of the graphical user interface to send to the client device, scaling the portion of the graphical user interface according to the display resolution of the client device.

8. The method of claim 1, further comprising:

receiving, from the client device, a lock message indicating for the server to stop sending, to the client device, additional portions of the graphical user interface to the client device; and

stopping transmission of the additional portions of the graphical user interface to the client device.

9. A method, comprising:

launching a virtual application on a client device, wherein the virtual application is accessible through a user interface shown on a display of the client device, and wherein the virtual application has an associated graphical user interface;

determining a display resolution of the client device;

generating movement information based on detecting a physical movement of the client device in at least one of an x, y, and z axis;

sending, to a server, the display resolution and the movement information;

receiving, from the server, a portion of the graphical user interface based on the display resolution, a resolution of the graphical user interface, and the movement information; and

displaying the portion of the graphical user interface on the display of the client device.

10. The method of claim 9, further comprising:

generating a lock message based on a user input for the client device to stop sending movement information to the server; and

sending, to the server, the lock message indicating for the server to stop sending additional portions of the graphical user interface to the client device, wherein the client device does not receive additional portions of the graphical user interface from the server.

11. The method of claim 9, wherein the movement information comprises data received from at least one of an accelerometer or gyroscope of the client device.

12. The method of claim 9, wherein the movement information comprises eye movement data based on one or more user eye movements detected by a camera of the client device.

13. The method of claim 9, wherein the movement information identifies physical movement in an x or y axis, and the portion of the graphical user interface is panned left, right, up, or down based on the movement information.

14. The method of claim 9, wherein the movement information identifies physical movement in a z axis, and the portion of the graphical user interface is displayed at a zoom level based on the movement information.

15. The method of claim 9, wherein the movement information is sent to the server by a client agent executing on the client device.

16. A system comprising:

at least one processor; and

at least one memory storing computer-readable instructions that, when executed by the at least one processor, cause the system to;

send a graphical user interface for a virtual application to a client device for display by the client device;

receive, from the client device, a display resolution of the client device and movement information identifying a detected physical movement of the client device in at least one of an x, y, and z axis;

determine a portion of the graphical user interface to send to the client device based on the display resolution, a resolution of the graphical user interface, and the movement information; and

send the portion of the graphical user interface to the client device.

17. The system of claim 16, wherein the graphical user interface is a graphical environment or space providing the user interface for an instance of an operating system in which local applications and remote applications are integrated.

18. The system of claim 16, wherein the display resolution comprises a number of pixels in each dimension of the display of the client device.

19. The system of claim 16, wherein the portion of the graphical user interface comprises at least one of the following content:

web services, web pages, applications, text, images, audio, and video.

20. The system of claim 16, wherein the portion of the graphical user interface is scaled according to the display resolution of the client device.