Optimizing window move actions for remoted applications

• US 10,082,941 B2
• Filed: 05/20/2015
• Issued: 09/25/2018
• Est. Priority Date: 05/20/2015
• Status: Active Grant

• Current Assignee: Omnissa, LLC
• Original Assignee: VMware, Inc. (Broadcom, Inc.)
• Inventors: Gross, Adam Gregory, Dunn, Michael, Rude, Christopher, Kwan, Joshua
• Primary Examiner(s): Theriault, Steven B
• Application Number:
  US14/717,898
• Publication Number:
  US 20160342313A1
• Time in Patent Office: 1,224 Days
• CPC Class Codes: G06F 2203/0383 Remote input, i.e. interface arrangements in which the signals generated by a pointing device are transmitted to a PC at a remote location, e.g. to a PC in a LAN
• CPC Class Codes: G06F 3/03543 Mice or pucks G06F3/03541 takes precedence
• CPC Class Codes: G06F 3/038 Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
• CPC Class Codes: G06F 3/04845 for image manipulation, e.g. dragging, rotation, expansion or change of colour
• CPC Class Codes: G06F 3/1415 with means for detecting differences between the image stored in the host and the images displayed on the displays
• CPC Class Codes: G06F 3/1454 involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay
• CPC Class Codes: G06F 9/452 Remote windowing, e.g. X-Window System, desktop virtualisation protocols for virtual reality H04L67/131
• CPC Class Codes: G09G 2340/0464 Positioning
• CPC Class Codes: G09G 2350/00 Solving problems of bandwidth in display systems
• CPC Class Codes: G09G 5/14 Display of multiple viewports
• CPC Class Codes: G09G 5/377 for mixing or overlaying two or more graphic patterns G09G5/02, G09G5/397 take precedence
• CPC Class Codes: H04L 67/10 in which an application is distributed across nodes in the network software deployment G06F8/60; multiprogramming arrangements G06F9/46

Abstract

Techniques for optimizing window move actions for a remoted application are provided, where the remoted application has an application window running within a remote desktop of a server system, and where the application window is made accessible to a user of a client system in the form of a client-side application window displayed in a client desktop of the client system. In one embodiment, the client system can receive from the server system a notification that the application window has begun moving in the remote desktop, and can determine that the user is currently entering one or more input commands for moving the client-side application window in the client desktop. The client system can further send a command to the server system for stopping the movement of the application window in the remote desktop, such that the application window is fixed in a stationary position. The client system can then allow the user to continue moving the client-side application window in the client desktop, while the application window remains in the stationary position in the remote desktop.

Claims

1. A method for optimizing window move actions for a remoted application, wherein the remoted application has an application window running within a remote desktop of a server system, and wherein the application window is made accessible to a user of a client system in the form of a client-side application window displayed in a client desktop of the client system, the method comprising:

receiving, by the client system from the server system, a notification that the application window has begun moving in the remote desktop, wherein the notification is generated by a server-side application remoting agent that;

sets, on the server system, an operating system (OS) level hook pertaining to the application window or an OS level application programming interface (API) pertaining to the application window;

detects movement of the application window in the remote desktop by receiving one or more OS messages regarding state or status changes of the application window via the OS level hook or OS level API; and

generates the notification in response to receiving the one or more OS messages;

upon receiving the notification, determining, by the client system, that the user is currently entering one or more input commands for moving the client-side application window in the client desktop;

sending, by the client system to the server system, a command for stopping the moving of the application window in the remote desktop, such that the application window is fixed in a stationary position; and

allowing, by the client system, the user to continue moving the client-side application window in the client desktop, while the application window remains in the stationary position in the remote desktop.

2. The method of claim 1 wherein determining that the user is currently entering one or more input commands for moving the client-side application window in the client desktop comprises determining that the user is performing a left-click-and-drag operation on the client-side application window.

3. The method of claim 2 wherein the user performs the left-click-and-drag operation on a non-titlebar area of the client-side application window.

4. The method claim 1 wherein the command for stopping the moving of the application window in the remote desktop window comprises a left-mouse-button-up event.

5. The method of claim 1 further comprising:

determining that the user has finished moving the client-side application window;

determining a final position of the client-side application window in the client desktop; and

sending a request to the server system for moving the application window in the remote desktop to the final position.

6. The method of claim 5 wherein determining that the user has finished moving the client-side application window comprises determining that the user has released a left mouse button.

7. The method of claim 1 further comprising, while the user is allowed to continue moving the client-side window in the client desktop:

receiving a remote desktop framebuffer from the server system;

determining a fixed source rectangle in the remote desktop framebuffer, the fixed source rectangle corresponding to the stationary position of the application window in the remote desktop; and

copying contents of the fixed source rectangle in the remote desktop framebuffer to the client-side application window in the client desktop.

8. The method of claim 1 wherein another remoted application has another application window running within the remote desktop,

wherein the another application window is made accessible to the user in the form of another client-side application window displayed in the client desktop, and

wherein the method further comprises, while the user is allowed to continue moving the client-side window in the client desktop:

determining that the another application window is overlapped by the application window in the remote desktop;

determining an overlap rectangle for the another client-side application window that corresponds to a region of the another application window overlapped by the application window; and

causing the overlap rectangle to be filled in with an overlay color or pattern each time the another client-side application window is updated in the client desktop.

25. The method of claim 1 wherein the receiving, sending, determining, and allowing are performed by a client-side application remoting agent running on a processor of the client system.

9. A non-transitory computer readable storage medium having stored thereon program code executable by a client system, the program code embodying a method for optimizing window move actions for a remoted application, wherein the remoted application has an application window running within a remote desktop of a server system, and wherein the application window is made accessible to a user of the client system in the form of a client-side application window displayed in a client desktop of the client system, the method comprising:

receiving, from the server system, a notification that the application window has begun moving in the remote desktop, wherein the notification is generated by a server-side application remoting agent that;

sets, on the server system, an operating system (OS) level hook pertaining to the application window or an OS level application programming interface (API) pertaining to the application window;

detects movement of the application window in the remote desktop by receiving one or more OS messages regarding state or status changes of the application window via the OS level hook or OS level API; and

generates the notification in response to receiving the one or more OS messages;

upon receiving the notification, determining that the user is currently entering one or more input commands for moving the client-side application window in the client desktop;

sending, to the server system, a command for stopping the moving of the application window in the remote desktop, such that the application window is fixed in a stationary position; and

allowing the user to continue moving the client-side application window in the client desktop, while the application window remains in the stationary position in the remote desktop.

10. The non-transitory computer readable storage medium of claim 9 wherein determining that the user is currently entering one or more input commands for moving the client-side application window in the client desktop comprises determining that the user is performing a left-click-and-drag operation on the client-side application window.

11. The non-transitory computer readable storage medium of claim 10 wherein the user performs the left-click-and-drag operation on a non-titlebar area of the client-side application window.

12. The non-transitory computer readable storage medium of claim 9 wherein the command for stopping the moving of the application window in the remote desktop window comprises a left-mouse-button-up event.

13. The non-transitory computer readable storage medium of claim 9 wherein the method further comprises:

determining that the user has finished moving the client-side application window;

determining a final position of the client-side application window in the client desktop; and

sending a request to the server system for moving the application window in the remote desktop to the final position.

14. The non-transitory computer readable storage medium of claim 13 wherein determining that the user has finished moving the client-side application window comprises determining that the user has released a left mouse button.

15. The non-transitory computer readable storage medium of claim 9 wherein the method further comprises, while the user is allowed to continue moving the client-side window in the client desktop:

receiving a remote desktop framebuffer from the server system;

determining a fixed source rectangle in the remote desktop framebuffer, the fixed source rectangle corresponding to the stationary position of the application window in the remote desktop; and

copying contents of the fixed source rectangle in the remote desktop framebuffer to the client-side application window in the client desktop.

16. The non-transitory computer readable storage medium of claim 9 wherein another remoted application has another application window running within the remote desktop,

wherein the another application window is made accessible to the user in the form of another client-side application window displayed in the client desktop, and

wherein the method further comprises, while the user is allowed to continue moving the client-side window in the client desktop:

determining that the another application window is overlapped by the application window in the remote desktop;

determining an overlap rectangle for the another client-side application window that corresponds to a region of the another application window overlapped by the application window; and

causing the overlap rectangle to be filled in with an overlay color or pattern each time the another client-side application window is updated in the client desktop.

17. A client system comprising:

a processor; and

a non-transitory computer readable medium having stored thereon program code for optimizing window move actions for a remoted application, wherein the remoted application has an application window running within a remote desktop of a server system, and wherein the application window is made accessible to a user of the client system in the form of a client-side application window displayed in a client desktop of the client system,

the program code causing the processor to;

receive, from the server system, a notification that the application window has begun moving in the remote desktop, wherein the notification is generated by a server-side application remoting agent that;

sets, on the server system, an operating system (OS) level hook pertaining to the application window or an OS level application programming interface (API) pertaining to the application window;

detects movement of the application window in the remote desktop by receiving one or more OS messages regarding state or status changes of the application window via the OS level hook or OS level API; and

generates the notification in response to receiving the one or more OS messages;

upon receiving the notification, determine that the user is currently entering one or more input commands for moving the client-side application window in the client desktop;

send, to the server system, a command for stopping the moving of the application window in the remote desktop, such that the application window is fixed in a stationary position; and

allow the user to continue moving the client-side application window in the client desktop, while the application window remains in the stationary position in the remote desktop.

18. The client system of claim 17 wherein determining that the user is currently entering one or more input commands for moving the client-side application window in the client desktop comprises determining that the user is performing a left-click-and-drag operation on the client-side application window.

19. The client system of claim 18 wherein the user performs the left-click-and-drag operation on a non-titlebar area of the client-side application window.

20. The client system of claim 17 wherein the command for stopping the moving of the application window in the remote desktop window comprises a left-mouse-button-up event.

21. The client system of claim 17 wherein the program code further causes the processor to:

determine that the user has finished moving the client-side application window;

determine a final position of the client-side application window in the client desktop; and

send a request to the server system for moving the application window in the remote desktop to the final position.

22. The client system of claim 21 wherein determining that the user has finished moving the client-side application window comprises determining that the user has released a left mouse button.

23. The client system of claim 17 wherein the program code further causes the processor to, while the user is allowed to continue moving the client-side window in the client desktop:

receive a remote desktop framebuffer from the server system;

determine a fixed source rectangle in the remote desktop framebuffer, the fixed source rectangle corresponding to the stationary position of the application window in the remote desktop; and

copy contents of the fixed source rectangle in the remote desktop framebuffer to the client-side application window in the client desktop.

24. The client system of claim 17 wherein another remoted application has another application window running within the remote desktop,

wherein the another application window is made accessible to the user in the form of another client-side application window displayed in the client desktop, and

wherein the program code further causes the processor to, while the user is allowed to continue moving the client-side window in the client desktop:

determine that the another application window is overlapped by the application window in the remote desktop;

determine an overlap rectangle for the another client-side application window that corresponds to a region of the another application window overlapped by the application window; and

cause the overlap rectangle to be filled in with an overlay color or pattern each time the another client-side application window is updated in the client desktop.