Display interaction based upon a distance of input

• US 10,133,474 B2
• Filed: 06/16/2016
• Issued: 11/20/2018
• Est. Priority Date: 06/16/2016
• Status: Active Grant

• Current Assignee: AirBNB Incorporated
• Original Assignee: International Business Machines Corporation
• Inventors: Jain, Mohit, Prakash, Ashok Pon Kumar Sree
• Primary Examiner(s): Haley, Joseph
• Application Number:
  US15/184,594
• Publication Number:
  US 20170364229A1
• Time in Patent Office: 887 Days
• Field of Search: None
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/04817 using icons graphical or visual programming using iconic symbols G06F8/34
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures

Abstract

One embodiment provides a method including utilizing at least one processor to execute computer code that performs the steps of: receiving, at a transmission device communicating with a display device, a first user input, wherein the first user input activates a mode, of the display device, allowing a user to control a graphical user interface on the display device; thereafter, detecting, at the transmission device, a second user input, wherein the second user input comprises instructions for a control action for manipulating the graphical user interface; identifying the distance between an input object providing the second user input and a surface of the transmission device; modifying, based upon the distance, an attribute of the control action; and providing instructions to the display device to perform the control action having the modified attribute. Other aspects are described and claimed.

Claims

1. A method, comprising:

utilizing at least one processor to execute computer code that performs the steps of;

receiving, at a transmission device separate from and communicating with a display device, a first user input corresponding event that activates predetermined interaction mode of the display device corresponding to the trigger event, allowing a user to control a graphical user interface on the display device via an interaction corresponding to the predetermined interaction mode, wherein different trigger events correspond to different interaction modes;

thereafter, detecting, at the transmission device, a second user input, wherein the second user input comprises instructions for a control action for manipulating the graphical user interface in a manner corresponding to the activated predetermined interaction mode;

identifying the location of the second user input with respect to the surface of the transmission device and identifying the distance between an input object providing the second user input and a surface of the transmission device, wherein the location of the second user input identifies an action of the interaction to be performed;

modifying, based upon the distance, an attribute of the identified action, wherein the modifying comprises modifying the attribute by an amount proportional to the identified distance; and

providing instructions to the display device to perform the control action according to the identified action having the modified attribute.

2. The method of claim 1, wherein the modifying comprises modifying the attribute by an amount directly proportional to the distance.

3. The method of claim 1, wherein the modifying comprises modifying the attribute by an amount indirectly proportional to the distance.

4. The method of claim 1, wherein the modifying comprises modifying speed of the control action.

5. The method of claim 1, wherein the modifying comprises modifying distance of movement associated with the control action.

6. The method of claim 1, wherein the modifying comprises modifying the size of an icon associated with the control action.

7. The method of claim 1, comprising pairing the transmission device with the display device.

8. The method of claim 1, comprising receiving a third user input, wherein the third user input deactivates the mode.

9. An apparatus, comprising:

at least one processor; and

a computer readable storage medium having computer readable program code embodied therewith and executable by the at least one processor, the computer readable program code comprising;

computer readable program code that receives, at a transmission device separate from and communicating with a display device, a first user input corresponding to a trigger event that activates predetermined interaction mode of the display device corresponding to the trigger event, allowing a user to control a graphical user interface on the display device via an interaction corresponding to the predetermined interaction mode, wherein different trigger events correspond to different interaction modes;

computer readable program code that thereafter, detects, at the transmission device, a second user input, wherein the second user input comprises instructions for a control action for manipulating the graphical user interface in a manner corresponding to the activated predetermined interaction mode;

computer readable program code that identifies the location of the second user input with respect to the surface of the transmission device and identifying the distance between an input object providing the second user input and a surface of the transmission device, wherein the location of the second user input identifies an action of the interaction to be performed;

computer readable program code that modifies, based upon the distance, an attribute of the identified action, wherein the modifying comprises modifying the attribute by an amount proportional to the identified distance; and

computer readable program code that provides instructions to the display device to perform the control action according to the identified action having the modified attribute.

10. A computer program product, comprising:

a computer readable storage medium having computer readable program code embodied therewith, the computer readable program code comprising;

computer readable program code that receives, at a transmission device separate from and communicating with a display device, a first user input corresponding to a trigger event that activates predetermined interaction mode of the display device corresponding to the trigger event, allowing a user to control a graphical user interface on the display device via an interaction corresponding to the predetermined interaction mode, wherein different trigger events correspond to different interaction modes;

computer readable program code that thereafter, detects, at the transmission device, a second user input, wherein the second user input comprises instructions for a control action for manipulating the graphical user interface in a manner corresponding to the activated predetermined interaction mode;

computer readable program code that identifies the location of the second user input with respect to the surface of the transmission device and identifying the distance between an input object providing the second user input and a surface of the transmission device, wherein the location of the second user input identifies an action of the interaction to be performed;

computer readable program code that modifies, based upon the distance, an attribute of the identified action, wherein the modifying comprises modifying the attribute by an amount proportional to the identified distance; and

computer readable program code that provides instructions to the display device to perform the control action according to the identified action having the modified attribute.

11. The computer program product of claim 10, wherein the code that modifies comprises modifying the attribute by an amount directly proportional to the distance.

12. The computer program product of claim 10, wherein the code that modifies comprises modifying the attribute by an amount indirectly proportional to the distance.

13. The computer program product of claim 10, wherein the code that modifies comprises modifying speed of the control action.

14. The computer program product of claim 10, wherein the code that modifies a characteristic comprises modifying distance of movement associated with the control action.

15. The computer program product of claim 10, wherein the code that modifies a characteristic comprises modifying the size of an icon associated with the control action.

16. The computer program product of claim 10, comprising code that pairs the transmission device with the display device.

17. The computer program product of claim 10, comprising code that receives a third user input, wherein the third user input deactivates the mode.

18. A method, comprising:

receiving, at an input device separate from and communicating with a display device, a first user input corresponding to a trigger event that activates a predetermined control mode of the display device corresponding to the trigger event, for controlling a graphical user interface on the display device via an interaction corresponding to the predetermined control mode, wherein different input types are mapped to different control modes;

receiving, at the input device, a second user input providing instructions for manipulating the graphical user interface in a manner corresponding to the activated predetermined control mode;

identifying the location of the second user input with respect to the surface of the input device and identifying the distance between an input object providing the second user input and a surface of the input device, wherein the location of the second user input identifies an action of the interaction to be performed;

scaling, at the input device, proportionally to the distance, an attribute of a response to the instructions; and

providing instructions to the display device to manipulate the graphical user interface according to identified action and the scaled response.