Replacement of physical buttons with virtual controls

• US 10,338,812 B2
• Filed: 01/10/2017
• Issued: 07/02/2019
• Est. Priority Date: 01/10/2017
• Status: Active Grant

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Adderly, Darryl M., Mannan, Rosanna S., Schultz, Kevin L.
• Primary Examiner(s): Simpson, Lixi C
• Application Number:
  US15/402,558
• Publication Number:
  US 20180196594A1
• Time in Patent Office: 903 Days
• CPC Class Codes: G06F 1/1692 the I/O peripheral being a secondary touch screen used as control interface, e.g. virtual buttons or sliders
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0416 Control or interface arrangements specially adapted for digitisers
• CPC Class Codes: G06F 3/044 by capacitive means
• CPC Class Codes: G06F 3/04847 Interaction techniques to control parameter settings, e.g. interaction with sliders or dials
• CPC Class Codes: G06F 3/04886 by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus

Abstract

In an approach for controlling a computing device without mechanical buttons the computer detects an interaction with a touch capacitive sensing surface on a computing device. The computer determines that the detected interaction includes at least three interactions including at least two different touch capacitive sensing surfaces. The computer determines a virtual control button to display based on the detected interaction. The computer displays the determined virtual control button to the user. The computer receives an interaction with the displayed virtual control button. The computer implements an action associated with the determined virtual control button based on the received interaction.

Claims

1. A method for controlling a computing device without mechanical buttons the method comprising:

detecting, by one or more computer processors, an interaction with a touch capacitive sensing surface on a computing device;

determining, by one or more computer processors, that the detected interaction includes at least three interactions including at least two different touch capacitive sensing surfaces, wherein the at least three interactions are based on a change in coordinates from a first geometric plane to a second geometric plane, the second geometric plane to a third geometric plane, and the second geometric plane to the first geometric plane;

determining, by one or more computer processors, a virtual control button to display based on the detected interaction;

displaying, by one or more computer processors, the determined virtual control button to the user;

receiving, by one or more computer processors, an interaction with the displayed virtual control button; and

implementing, by one or more computer processors, an action associated with the determined virtual control button based on the received interaction.

2. The method of claim 1, wherein the detected interaction is a single type of defined interaction selected from a group of types of defined interactions stored in memory that include:

a continuous motion that includes at least three touch capacitive sensing surfaces and a sequence of defined interactions that includes a series of separate interactions with at least three touch sensing capacitive surfaces wherein the series of separate interactions includes one or more of adjacent interactions and non-adjacent interactions.

3. The method of claim 1, wherein the detected interaction is a defined interaction that is a customized predefined interaction created by a user wherein the defined interaction links to a specific action that identifies a specific virtual control for operating an aspect of the computing device.

4. The method of claim 1, wherein the computing device includes touch capacitive sensing surfaces in place of mechanical buttons.

5. The method of claim 1, wherein determining that the detected interaction includes at least three interactions further comprises:

identifying, by one or more computer processors, a first interaction with a first touch capacitive surface of the computing device and coordinates of the first interaction;

detecting, by one or more computer processors, a change in the coordinates of the first interaction;

determining, by one or more computer processors, whether the change in coordinates of the first interaction are within the first touch capacitive sensing surface, wherein the change in the coordinates of the first interaction is based on determining whether the first interaction changes from the first geometric plane to the second geometric plane, wherein the coordinates of the first interaction are associated with a single set of coordinates;

responsive to determining the change in coordinates of the first interaction are not within the first touch capacitive sensing surface, identifying, by one or more computer processors, a second interaction with a second touch capacitive sensing surface of the computing device and coordinates of the second interaction;

detecting, by one or more computer processors, a change in the coordinates of the second interaction;

determining, by one or more computer processors, whether the change in coordinates of the second interaction are within the second touch capacitive sensing surface, wherein the change in the coordinates of the second interaction is based on determining whether the second interaction changes from one of the following;

the second geometric plane to the third geometric plane, and the second geometric plane to the first geometric plane; and

responsive to determining the change in coordinates of the second interaction are not within the second touch capacitive sensing surface, identifying, by one or more computer processors, a third interaction with a third capacitive surface of the computing device and coordinates of the third interaction.

6. The method of claim 1, wherein displaying the identified virtual control button further comprises:

determining, by one or more computer processors, that a time length of the detected interaction at least meets a defined time; and

displaying, by one or more computer processors, the virtual control button on the computing device in proximity to the detected interaction.

7. The method of claim 1, wherein identifying, the virtual control button based on the detected interaction further comprises:

comparing, by one or more computer processors, the detected interaction with defined interactions in memory;

identifying, by one or more computer processors, a match between the detected interaction and the defined interactions in memory based on the comparison; and

identifying, by one or more computer processors, the virtual control button based on the identified match.

8. A computer program product for controlling a computing device without mechanical buttons the computer program product comprising:

one or more computer readable storage devices and program instructions stored on the one or more computer readable storage devices, the program instructions comprising;

program instructions to detect an interaction with a touch capacitive sensing surface on a computing device;

program instructions to determine that the detected interaction includes at least three interactions including at least two different touch capacitive sensing surfaces, wherein the at least three interactions are based on a change in coordinates from a first geometric plane to a second geometric plane, the second geometric plane to a third geometric plane, and the second geometric plane to the first geometric plane;

program instructions to determine a virtual control button to display based on the detected interaction;

program instructions to display the determined virtual control button to the user;

program instructions to receive an interaction with the displayed virtual control button; and

program instructions to implement an action associated with the determined virtual control button based on the received interaction.

9. The computer program product of claim 8, wherein the detected interaction is a single type of defined interaction selected from a group of types of defined interactions stored in memory that include:

a continuous motion that includes at least three touch capacitive sensing surfaces and a sequence of defined interactions that includes a series of separate interactions with at least three touch sensing capacitive surfaces wherein the series of separate interactions includes one or more of adjacent interactions and non-adjacent interactions.

10. The computer program product of claim 8, wherein the detected interaction is a defined interaction that is a customized predefined interaction created by a user wherein the defined interaction links to a specific action that identifies a specific virtual control for operating an aspect of the computing device.

11. The computer program product of claim 8, wherein the computing device includes touch capacitive sensing surfaces in place of mechanical buttons.

12. The computer program product of claim 8, wherein to determine that the detected interaction includes at least three interactions further comprises program instructions, stored on the one or more computer readable storage devices, to:

identify a first interaction with a first touch capacitive surface of the computing device and coordinates of the first interaction;

detect a change in the coordinates of the first interaction;

determine whether the change in coordinates of the first interaction are within the first touch capacitive sensing surface, wherein the change in the coordinates of the first interaction is based on determining whether the first interaction changes from the first geometric plane to the second geometric plane, wherein the coordinates of the first interaction are associated with a single set of coordinates;

responsive to determining the change in coordinates of the first interaction are not within the first touch capacitive sensing surface, identify a second interaction with a second touch capacitive sensing surface of the computing device and coordinates of the second interaction;

detect a change in the coordinates of the second interaction;

determine whether the change in coordinates of the second interaction are within the second touch capacitive sensing surface, wherein the change in the coordinates of the second interaction is based on determining whether the second interaction changes from one of the following;

the second geometric plane to the third geometric plane, and the second geometric plane to the first geometric plane; and

responsive to determining the change in coordinates of the second interaction are not within the second touch capacitive sensing surface, identify a third interaction with a third capacitive surface of the computing device and coordinates of the third interaction.

13. The computer program product of claim 8, wherein to display the identified virtual control button further comprises program instructions, stored on the one or more computer readable storage devices, to:

determine that a time length of the detected interaction at least meets a defined time; and

display the virtual control button on the computing device in proximity to the detected interaction.

14. The computer program product of claim 8, wherein to identify the virtual control button based on the detected interaction further comprises program instructions, stored on the one or more computer readable storage devices, to:

compare the detected interaction with defined interactions in memory;

identify a match between the detected interaction and the defined interactions in memory based on the comparison; and

identify the virtual control button based on the identified match.

15. A computer system for controlling a computing device without mechanical buttons the computer system comprising:

one or more computer processors, one or more computer readable storage media, and program instructions stored on the computer readable storage media for execution by at least one of the one or more processors, the program instructions comprising;

program instructions to detect an interaction with a touch capacitive sensing surface on a computing device;

program instructions to determine that the detected interaction includes at least three interactions including at least two different touch capacitive sensing surfaces, wherein the at least three interactions are based on a change in coordinates from a first geometric plane to a second geometric plane, the second geometric plane to a third geometric plane, and the second geometric plane to the first geometric plane;

program instructions to determine a virtual control button to display based on the detected interaction;

program instructions to display the determined virtual control button to the user;

program instructions to receive an interaction with the displayed virtual control button; and

program instructions to implement an action associated with the determined virtual control button based on the received interaction.

16. The computer system of claim 15, wherein the detected interaction is a single type of defined interaction selected from a group of types of defined interactions stored in memory that include:

a continuous motion that includes at least three touch capacitive sensing surfaces and a sequence of defined interactions that includes a series of separate interactions with at least three touch sensing capacitive surfaces wherein the series of separate interactions includes one or more of adjacent interactions and non-adjacent interactions.

17. The computer system of claim 15, wherein the computing device includes touch capacitive sensing surfaces in place of mechanical buttons.

18. The computer system of claim 15, wherein to determine that the detected interaction includes at least three interactions further comprises program instructions, stored on the one or more computer readable storage media, to:

identify a first interaction with a first touch capacitive surface of the computing device and coordinates of the first interaction;

detect a change in the coordinates of the first interaction;

determine whether the change in coordinates of the first interaction are within the first touch capacitive sensing surface, wherein the change in the coordinates of the first interaction is based on determining whether the first interaction changes from the first geometric plane to the second geometric plane, wherein the coordinates of the first interaction are associated with a single set of coordinates;

responsive to determining the change in coordinates of the first interaction are not within the first touch capacitive sensing surface, identify a second interaction with a second touch capacitive sensing surface of the computing device and coordinates of the second interaction;

detect a change in the coordinates of the second interaction;

determine whether the change in coordinates of the second interaction are within the second touch capacitive sensing surface, wherein the change in the coordinates of the second interaction is based on determining whether the second interaction changes from one of the following;

the second geometric plane to the third geometric plane, and the second geometric plane to the first geometric plane; and

responsive to determining the change in coordinates of the second interaction are not within the second touch capacitive sensing surface, identify a third interaction with a third capacitive surface of the computing device and coordinates of the third interaction.

19. The computer system of claim 15, wherein to display the identified virtual control button further comprises program instructions, stored on the one or more computer readable storage media, to:

determine that a time length of the detected interaction at least meets a defined time; and

display the virtual control button on the computing device in proximity to the detected interaction.

20. The computer system of claim 15, wherein to identify the virtual control button based on the detected interaction further comprises program instructions, stored on the one or more computer readable storage media, to:

compare the detected interaction with defined interactions in memory;

identify a match between the detected interaction and the defined interactions in memory based on the comparison; and

identify the virtual control button based on the identified match.