Translation of touch input into local input based on a translation profile for an application

• US 9,632,693 B2
• Filed: 05/29/2012
• Issued: 04/25/2017
• Est. Priority Date: 05/29/2012
• Status: Active Grant

• Current Assignee: Hewlett-Packard Development Company, L.P. (HP Inc.)
• Original Assignee: Hewlett-Packard Development Company, L.P. (HP Inc.)
• Inventors: Nylund, Mark Edward, Lukasik, Derek, Walls, Jeffrey Joel
• Primary Examiner(s): CHOI, DAVID E
• Application Number:
  US14/384,249
• Publication Number:
  US 20150026586A1
• Time in Patent Office: 1,792 Days
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: H04L 67/025 for remote control or remote monitoring of applications

Abstract

Examples disclosed herein relate to translation of touch input into local input based on a translation profile for an application. Examples include translating touch input into local input based on a translation profile for an application in focus, if the translation profile is accessible. Examples further include providing the touch input to an operating system if no translation profile for the application in focus is accessible and the operating system is able to utilize touch input.

Claims

1. A non-transitory machine-readable storage medium encoded with instructions executable by a processor of a local computing device, the storage medium comprising instructions to:

provide, to a remote computing device with a network interface of the local computing device, remote display information useable to display at least a portion of a graphical user interface (GUI) of the local computing device;

receive, with the network interface, touch input identifying a touch event sensed with a touch-sensitive display at the remote computing device when displaying the at least a portion of the GUI;

determine an application in focus at the local computing device at the time of the touch event;

determine whether an application translation profile associated with the application in focus is accessible to the local computing device, wherein the application translation profile associated with the application in focus is one of a plurality of application translation profiles, each application translation profile in the plurality having a corresponding application;

in response to a determination that the application translation profile associated with the application in focus is accessible, translate at least the received touch input into local input useable by an operating system (OS) of the local computing device based on the application translation profile associated with the application in focus, wherein the application translation profile maps the touch input to a mouse or keyboard input that emulates the result of the touch input;

determine whether the OS is able to utilize touch input;

in response to a determination that no translation profile associated with the application in focus is accessible and a determination the OS is unable to utilize touch input, translate the received touch input into local input useable by the OS based on a general translation profile associated with the OS, wherein the plurality of application translation profiles have priority over the general translation profile; and

in response to the determination that no translation profile associated with the application in focus is accessible and a determination that the OS is able to utilize touch input, provide the received touch input to the OS without use of the plurality of application translation profiles and without use of the general translation profile.

2. The storage medium of claim 1, further comprising:

instructions to determine a device type of the remote computing device,

wherein the application translation profile associated with the application in focus is associated with the determined device type, and is one of a plurality of translation profiles associated with the application in focus, wherein each of the plurality of translation profiles associated with the application in focus is associated with a different device type.

3. The storage medium of claim 1, wherein:

the instructions to translate based on the application translation profile comprise;

instructions to identify a touch action of the application translation profile corresponding to at least the received touch input; and

instructions to provide to the OS the local input mapped to the identified touch action in the application translation profile associated with the application in focus; and

the local input includes information emulating output of at least one input device whose output is useable by the OS.

4. The storage medium of claim 3, wherein the local input includes information emulating a sequence of keystrokes output by a keyboard, the sequence defined to invoke a given function in the application in focus.

5. The storage medium of claim 3, wherein the identified touch action may include information identifying a sequence of touch input defining a touch gesture, the sequence of touch input including the received touch input.

6. A local computing device comprising:

a memory encoded with a set of executable instructions;

a processor to execute the instructions, wherein the instructions, when executed, cause the processor to;

provide, to a remote computing device, information useable to display at least a portion of a graphical user interface (GUI) of the local computing device;

receive touch input identifying a touch event sensed with a display of the remote computing device when displaying the at least a portion of the GUI;

translate, based on an application translation profile for an application in focus at the local computing device at the time of the touch event, a touch action including at least the received touch input into local input that an operating system (OS) of the local computing device is able to natively process if the first translation profile is accessible to the local computing device and maps the touch action to local input, wherein the translation profile maps the touch input to a mouse or keyboard input that emulates the result of the touch input, and wherein the application translation profile for the application in focus is one of a plurality of application translation profiles, each application translation profile in the plurality having a corresponding application;

translate, based on a general translation profile associated with the OS, at least the received touch input into local input the OS is able to natively process if the OS is not able to natively process touch input and no translation profile for the application in focus is accessible, wherein the plurality of application translation profiles have priority over the general translation profile; and

provide the touch input to the OS without use of the plurality of application translation profiles and without use of the general translation profile if no translation profile for the application in focus is accessible and the OS is able to natively process touch input.

7. The local computing device of claim 6, wherein the instructions, when executed, further cause the processor to:

receive touch input from both the remote computing device and at least one other remote computing device in the same format;

identify the application in focus at the time of the touch event in response to receiving the touch input from the remote computing device; and

determine that the application translation profile for the identified application in focus is accessible to the local computing device if the first translation profile is included among the plurality of application translation profiles, the plurality of application translation profiles stored at the local computing device.

8. The local computing device of claim 7, wherein:

the plurality of application translation profiles includes another translation profile for another application of the local computing device;

each of the plurality of application translation profiles includes a mapping of at least one touch action to local input; and

the application translation profile for the application in focus and the other application translation profile each map a given touch action to different local input.

9. The local computing device of claim 8, the instructions, when executed, further cause the processor to:

receive a translation profile alteration request specifying one of the plurality of application translation profiles; and

alter the specified translation profile in accordance with the received request.

10. The local computing device of claim 6, wherein the application translation profile for the application in focus includes a mapping of a given touch action to local input implementing a macro for the application associated with the first translation profile.

11. The local computing device of claim 8, the instructions, when executed, further cause the processor to:

provide, if the application translation profile for the application in focus is accessible to the local computing device and maps the touch action to command input, the command input to which the touch action is mapped in the application translation profile to the application in focus via an application command interface.

12. A method comprising:

providing, to a remote computing device with a network interface of the local computing device, remote display information useable to display at least a portion of a graphical user interface (GUI) of the local computing device;

receiving, with the network interface, touch input indicating a touch event sensed with a touch-sensitive display of the remote computing device when displaying the at least a portion of the GUI;

determining whether an application translation profile associated with an application in focus at the local computing device at the time of the touch event is accessible to the local computing device, wherein the translation profile maps the touch input to a mouse or keyboard input that emulates the result of the touch input, and wherein the application translation profile associated with the application in focus is one of a plurality of application translation profiles, each application translation profile in the plurality having a corresponding application;

translating at least the received touch input into local input the OS is able to natively process, based on the application translation profile if the application translation profile is accessible;

determining whether an operating system (OS) of a local computing device is able to natively process touch input;

generating, from at least the received touch input and a general translation profile associated with the OS, local input the OS is able to natively process if the OS is not able to natively process touch input and no translation profile for the application in focus is accessible to the local computing device, wherein the plurality of application translation profiles have priority over the general translation profile;

providing the touch input to the OS without use of the plurality of application translation profiles and without use of the general translation profile if no translation profile for the application in focus is accessible and the OS is able to natively process touch input.

13. The method of claim 12, further comprising:

receiving, with the network interface, other touch input indicating another touch event sensed with the touch-sensitive display when displaying the at least a portion of the GUI;

determining whether another translation profile associated with another application in focus at the local computing device at the time of the another touch event is accessible to the local computing device;

translating at least the received other touch input into other local input the OS is able to natively process, based on the other translation profile associated with the other application if the translation profile for the other application is accessible; and

providing the other touch input to the OS if no translation profile for the other application in focus is accessible and the OS is able to natively process touch input.