Method for interception and blocking of mouse move and resize events on mobile device

• US 9,535,567 B1
• Filed: 12/21/2015
• Issued: 01/03/2017
• Est. Priority Date: 10/10/2013
• Status: Active Grant

• Current Assignee: Parallels Holdings Limited (HNA Technology Co. Ltd.)
• Original Assignee: Parallels International GmbH (Corel Holdings LP)
• Inventors: Bagrinovskiy, Kirill, Protassov, Stanislav S., Beloussov, Serguei M., Dobrovolskiy, Nikolay N.
• Primary Examiner(s): Nguyen, Kevin
• Application Number:
  US14/976,174
• Time in Patent Office: 379 Days
• Field of Search: 715/733, 715/744, 715/767, 715/788, 715/738, 715/762, 715/740, 715/765
• US Class Current: 1/1
• CPC Class Codes: G06F 21/629 to features or functions of an application
• CPC Class Codes: G06F 21/74 operating in dual or compartmented mode, i.e. at least one secure mode
• CPC Class Codes: G06F 2221/2105 Dual mode as a secondary aspect
• CPC Class Codes: G06F 3/033 Pointing devices displaced or positioned by the user , e.g. mice, trackballs, pens or joysticks; Accessories therefor digitisers characterised by the transducing means G06F3/041
• CPC Class Codes: G06F 3/038 Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
• CPC Class Codes: G06F 3/048 Interaction techniques based on graphical user interfaces [GUI]
• CPC Class Codes: G06F 3/0481 based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
• CPC Class Codes: G06F 3/04812 Interaction techniques based on cursor appearance or behaviour, e.g. being affected by the presence of displayed objects
• CPC Class Codes: G06F 3/04817 using icons graphical or visual programming using iconic symbols G06F8/34
• CPC Class Codes: G06F 3/04845 for image manipulation, e.g. dragging, rotation, expansion or change of colour
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06F 3/0489 using dedicated keyboard keys or combinations thereof
• CPC Class Codes: G06F 3/14 Digital output to display device ; Cooperation and interconnection of the display device with other functional units
• CPC Class Codes: G06F 3/1454 involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay
• CPC Class Codes: G06F 9/452 Remote windowing, e.g. X-Window System, desktop virtualisation protocols for virtual reality H04L67/131
• CPC Class Codes: G09G 2340/045 Zooming at least part of an image, i.e. enlarging it or shrinking it
• CPC Class Codes: G09G 2370/022 Centralised management of display operation, e.g. in a server instead of locally
• CPC Class Codes: H04L 41/22 comprising specially adapted graphical user interfaces [GUI]
• CPC Class Codes: H04L 67/025 for remote control or remote monitoring of applications
• CPC Class Codes: H04L 67/04 : specially adapted for terminals or networks with limited capabilities; specially adapted for terminal portability
• CPC Class Codes: H04L 67/08 : specially adapted for terminal emulation, e.g. Telnet
• CPC Class Codes: H04L 67/56 : Provisioning of proxy services store-and-forward switching systems in data switching networks H04L12/54
• CPC Class Codes: H04L 67/562 : Brokering proxy services
• CPC Class Codes: H04N 21/00 : Selective content distribution, e.g. interactive television or video on demand [VOD] real-time bi-directional transmission of motion video data H04N7/14 ; broadcast or conference over packet switching networks H04L12/18
• CPC Class Codes: H04W 4/00 : Services specially adapted for wireless communication networks; Facilities therefor
• CPC Class Codes: H04W 88/02 : Terminal devices

Abstract

A method and computer program product for intercepting and blocking the mouse move and resize events on mobile devices transmitting remote application. The remote access client installed on the mobile device send the coordinates of user'"'"'s touches to remote computer. The remote access agent, running on a remote host, blocks the consequences of user finger (or stylus) actions performed on a captured window of the remote application. The method defines the areas and elements of a captured remote application window that are not affected by the move/resize commands emulated by a mobile device user. This functionality is implemented by a control-agent component running on a remote host for receiving and processing the commands from a mobile device and for transmitting video stream and some metadata about remote applications to the mobile device.

Claims

1. A system for intercepting events on an application window generated on a mobile device, the system comprising:

a mobile device in communication with a remote host running a remote application;

a Remote Access component on the mobile device for representing a remote application window on a mobile device screen;

at least one proxy broker for connecting the mobile device to the remote host;

at least one control-agent on the remote host;

a manager server connected between the mobile device and the host for validating the mobile device user to the remote host and for selecting the broker closest to the remote host,

wherein;

the Remote Access component detects user touches on a remote application window displayed on a mobile device screen and provides coordinates of the user touches to the control-agent;

the control-agent obtains element identifiers and application identifiers of the user touches from a host OS;

the control-agent obtains a list of restricted elements for the remote application window; and

the control-agent compares the user touches to a list of restricted elements for the remote application window, and blocks corresponding user actions if the user action matches an element from the list, and forwards the user actions otherwise.

2. The system of claim 1, wherein the mobile device and the remote host are connected through the proxy broker over a proxy broker connection.

3. The system of claim 1, wherein the control-agent determines areas of the remote application window that are restricted for move and resize by using a local database of applications when the host OS does not return the element identifier.

4. The system of claim 3, wherein the control-agent intercepts a first user action on the restricted area of the remote application window.

5. The system of claim 3, wherein the control-agent blocks all subsequent user actions, if a first user action occurs on the restricted area according to the local database.

6. The system of claim 3, wherein the control-agent transfers all subsequent user touch screen actions, if a first user action occurs on the non-restricted area according to the local database.

7. The system of claim 1, wherein the control-agent determines areas of the remote application window that are restricted for move and resize by using template coordinates of applications when the host OS does not return the element identifier and the local database does not contain the application.

8. The system of claim 7, wherein the control-agent blocks subsequent user touch screen actions after a first tap, if the first tap occurs on the restricted area, based on a comparison of coordinates of the first tap with the template coordinates.

9. The system of claim 7, wherein the control-agent transfers subsequent user actions after a first tap, if the first tap occurs on the non-restricted area based on a comparison of coordinates of the first tap with the template coordinates.

10. The system of claim 1, wherein the remote host has a plurality of the control-agents corresponding to multiple connections between the remote host and the mobile device.

11. The system of claim 1, wherein the control-agent receives coordinates of a point where a mobile device user touches the screen and uses the coordinates to determine if the move and resize events need to be blocked.

12. The system of claim 1, further comprising a service daemon running on the remote host and connected to the manager server for listening for commands from the Remote Access component.

13. The system of claim 12, wherein the service daemon provides the commands to the control-agent.

14. The system of claim 1, wherein, after a first user action, the remote application is verified in a database on the remote host, and any subsequent user actions are delayed until the verification is completed, and, once the verification is completed, the user actions are filtered and blocked based on rules stored in the database.

15. The system of claim 14, wherein the verification is performed every time a remote application changes.

16. The system of claim 14, wherein database descriptions for verified remote applications are cached locally for a limited period of time for further verification.

17. The system of claim 14, wherein the remote application is running on the mobile device, all events generated by the mobile device are transmitted to the remote application without verification.

18. A computer-implemented method for intercepting events on an application window generated on a mobile device, the method comprising:

(a) connecting a mobile device to a remote host running a remote application through a proxy broker closest to the remote host;

(b) starting a Remote Access component on the mobile device;

(c) capturing a remote application window on the remote host;

(d) launching a control-agent on the remote host for intercepting and blocking events on the remote application window generated on the mobile device;

(e) detecting user touches on a mobile device screen by the Remote Access component;

(f) providing coordinates of the user touches to the control-agent; and

(g) blocking the user actions, if the coordinates indicate a restricted element of the remote application window, and executing the user action in the remote application otherwise,

wherein the control-agent determines if the element is restricted by checks a restricted elements database for the operations of step (g).

19. The method of claim 18, wherein the control-agent requests an identification of an element of the remote application window affected by the first user touch screen action from a remote host OS.

20. A system for intercepting events on an application window generated on a mobile device, the system comprising:

a processor;

a memory coupled to the processor;

a computer program logic stored in the memory and executed on the processor, the computer program logic for executing the steps (a)-(g) of claim 18.