Method for interception and blocking of mouse move and resize events on mobile device

• US 9,225,611 B1
• Filed: 10/10/2013
• Issued: 12/29/2015
• Est. Priority Date: 10/10/2013
• Status: Active Grant

• Current Assignee: Parallels International GmbH (Corel Holdings LP)
• Original Assignee: Parallels Holdings Limited (HNA Technology Co. Ltd.)
• Inventors: Protassov, Stanislav S., Beloussov, Serguei M., Bagrinovskiy, Kirill
• Primary Examiner(s): Nguyen, Kevin
• Application Number:
  US14/051,083
• Time in Patent Office: 810 Days
• Field of Search: 715/733, 715/744, 715/767, 715/788, 715/738, 715/762, 715/740, 715/765
• US Class Current: 1/1
• CPC Class Codes: G06F 3/038 Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
• CPC Class Codes: G06F 3/048 Interaction techniques based on graphical user interfaces [GUI]
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06F 9/452 Remote windowing, e.g. X-Window System, desktop virtualisation protocols for virtual reality H04L67/131
• CPC Class Codes: H04L 67/04 specially adapted for terminals or networks with limited capabilities; specially adapted for terminal portability
• CPC Class Codes: H04L 67/08 specially adapted for terminal emulation, e.g. Telnet
• CPC Class Codes: H04W 4/00 Services specially adapted for wireless communication networks; Facilities therefor

Abstract

A method and computer program product for intercepting and blocking the mouse move and resize events on mobile devices transmitting remote application. The remote access client installed on the mobile device send the coordinates of user'"'"'s touches to remote computer. The remote access agent, running on a remote host, blocks the consequences of user finger (or stylus) actions performed on a captured window of the remote application. The method defines the areas and elements of a captured remote application window that are not affected by the move/resize commands emulated by a mobile device user. This functionality is implemented by a control-agent component running on a remote host for receiving and processing the commands from a mobile device and for transmitting video stream and some metadata about remote applications to the mobile device.

Claims

1. A system for intercepting move and resize events on an application window generated on a mobile device, the system comprising:

a mobile device in communication with a remote host running a remote application;

a Remote Access client running on the mobile device for representing a remote application window on a mobile device screen;

at least one proxy server-based broker for connecting the mobile device to a remote host;

at least one control-agent implemented on the remote host;

a manager server connected between the mobile device and the host for validating the mobile device user to the remote host and for selecting the broker closest to the remote host,

wherein;

the Remote Access client detects user actions on a remote application window displayed on a mobile device screen and provides coordinates of user touches on the mobile device screen to the control-agent;

the control-agent makes the query to a host OS for obtaining an element identifier and an application identifier of a first touch;

the control-agent obtains a list of restricted elements for the remote application window;

the control-agent finds an element in the list and blocks user actions after the first touch, if the list shows a restricted element of the remote application window; and

the control-agent forwards all user actions to the remote application, if the list shows a non-restricted element,

wherein the control-agent determines if the element is restricted by checking the list of the restricted elements.

2. The system of claim 1, wherein the mobile device and the remote host are connected through the proxy server-based broker over

a proxy broker connection.

3. The system of claim 1, wherein the control-agent determines areas of the remote application window that are restricted for move and resize by using a local database of applications when the host OS does not return the element identifier.

4. The system of claim 3, wherein the control-agent intercepts a first user touch screen action on the restricted area of the remote application window.

5. The system of claim 3, wherein the control-agent blocks all subsequent user touch screen actions, if a first user touch screen action occurs on the restricted area according to the local database.

6. The system of claim 3, wherein the control-agent transfers all subsequent user touch screen actions, if a first user touch screen action occurs on the non-restricted area according to the local database.

7. The system of claim 1, wherein the control-agent determines areas of the remote application window that are restricted for move and resize by using template coordinates of applications when the host OS does not return the element identifier and the local database does not contain the application.

8. The system of claim 7, wherein the control-agent blocks subsequent user touch screen actions after a first click, if a first user touch screen action occurs on the restricted area, based on a comparison of the first touch coordinates with the template coordinates.

9. The system of claim 7, wherein the control-agent transfers subsequent user touch screen actions after the first click, if a first user touch screen action occurs on the non-restricted area based on a comparison of the first touch coordinates with the template coordinates.

10. The system of claim 1, wherein the remote host has a plurality of the control-agents corresponding to multiple connections between the remote host and the mobile device.

11. The system of claim 1, wherein the control-agent receives coordinates of a point where a mobile device user touches the screen and uses the coordinates to determine if the move and resize events need to be blocked.

12. The system of claim 1, further comprising a service daemon running on the remote host and connected to the manager server for listening for commands from the mobile device Remote Access application.

13. The system of claim 12, wherein the service daemon provides the commands to the control-agent module.

14. A computer-implemented method for intercepting move and resize events on an application window generated on a mobile device, the method comprising:

(a) connecting a mobile device to a remote host running a remote application through a proxy server-based broker closest to the remote host;

(b) starting a Remote Access application on the mobile device;

(c) capturing a remote application window on the remote host;

(d) launching a control-agent module on the remote host for intercepting and blocking move and resize events on the remote application window generated on the mobile device;

(e) detecting a first user touch screen action on a mobile device screen by the Remote Access application;

(f) providing coordinates of the first user touch screen action to the control-agent; and

(g) analyzing the coordinates, by the control-agent, and blocking the user action, if the coordinates indicate a restricted element of the remote application window, and ignoring the user action, if the coordinates indicate a non-restricted element,

wherein the control-agent determines if the element is restricted by checking the element against a restricted elements database.

15. The method of claim 14, wherein the control-agent requests an identification of an element of the remote application window affected by the first user touch screen action from a remote host OS.

16. The method of claim 14, wherein the control-agent blocks the user screen actions after the first user touch on the restricted element of the remote application window.

17. The method of claim 16, wherein the control-agent blocks subsequent user touch screen actions after the first touch, if the first user touch screen action occurs on the restricted area.

18. The method of claim 14, wherein the control-agent allows all subsequent user touch screen actions, if the first user touch screen action occurs on the non-restricted element or area.

19. A system for intercepting move and resize events on an application window generated on a mobile device, the system comprising:

a processor;

a memory coupled to the processor;

a computer program logic stored in the memory and executed on the processor, the computer program logic for executing the steps (a)-(g) of claim 14.