Hover controlled user interface element

• US 10,120,568 B2
• Filed: 10/08/2015
• Issued: 11/06/2018
• Est. Priority Date: 09/16/2013
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Inventors: Dai, Lynn, Hwang, Dan, Hsu, Bo-June, Quan, Raymond, Badger, Eric, Rodriguez, Jose, Davis, Peter Gregory
• Primary Examiner(s): Titcomb, William
• Application Number:
  US14/878,153
• Publication Number:
  US 20160026385A1
• Time in Patent Office: 1,125 Days
• Field of Search: 715773
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06F 3/04886 by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
• CPC Class Codes: G06F 3/04897 Special input arrangements or commands for improving display capability

Abstract

Example apparatus and methods concern controlling a hover-sensitive input/output interface. One example apparatus includes a proximity detector that detects an object in a hover-space associated with the input/output interface. The apparatus produces characterization data concerning the object. The characterization data may be independent of where in the hover-space the object is located. The apparatus selectively controls the activation, display, and deactivation of user interface elements displayed by the apparatus on the input/output interface as a function of the characterization data and interface state. Selectively controlling the activation, display, and deactivation of the user interface elements includes allocating display space on the input/output interface to the user interface elements when they are needed for an operation on the apparatus and selectively reclaiming space on the input/output interface allocated to the user interface elements when they are not needed for an operation on the apparatus.

Claims

1. A method for controlling a user interface on a device having a hover-sensitive input/output interface, the method comprising:

identifying a state associated with a user interface element associated with the input/output interface, where the state depends, at least in part, on a user action performed using a virtual keyboard that is displayable on the input/output interface;

identifying a control action performed by an object in a hover-space associated with the input/output interface, where the hover-space comprises a three dimensional volume existing in an area accessible to the input/output interface; and

selectively configuring the user interface element as a function of the state and the control action.

2. The method of claim 1, comprising selectively displaying the user interface element on the input/output interface at a location that makes an insertion point associated with the user interface element visible during virtual typing performed using the virtual keyboard, where the location depends, at least in part, on the state.

3. The method of claim 1, where identifying the control action comprises identifying a gesture independent of the position of the virtual keyboard.

4. The method of claim 1, where identifying the control action comprises:

identifying the entry of a digit into the hover-space,

identifying the presence of a digit at a pre-determined location in the hover-space,

identifying the presence of a digit at a location in the hover-space related to the position of the virtual keyboard,

identifying a gesture that is related to the position of the virtual keyboard,

identifying the removal of a digit from the hover-space, or

identifying that a digit has moved less than a threshold amount in the hover-space over a threshold period of time.

5. The method of claim 1, where the control action is user configurable.

6. The method of claim 1, comprising selectively controlling the availability of the virtual keyboard on the input/output interface as a function of the control action,

where identifying the control action comprises:

receiving a signal from an active detection system provided by the device, or

receiving a signal from a passive detection system provided by the device.

7. The method of claim 1, comprising selectively controlling the availability of the virtual keyboard on the input/output interface as a function of the control action,

where controlling the availability of the virtual keyboard comprises:

making one hundred percent of the virtual keyboard visible on the input/output interface, and

making virtual keys associated with the virtual keyboard active for receiving a virtual keystroke.

8. The method of claim 7, where controlling the availability of the virtual keyboard comprises:

making less than one hundred percent of the virtual keyboard visible on the input/output interface, and

making virtual keys associated with the virtual keyboard inactive for receiving a virtual keystroke.

9. The method of claim 8, comprising:

splitting the virtual keyboard into at least two pieces;

positioning a first piece of the at least two pieces at a first position on the input/output interface, and

positioning a second piece of the at least two pieces at a second, different position on the input/output interface,

where less than one hundred percent of the first piece is visible on the input/output interface and where less than one hundred percent of the second piece is visible on the input/output interface.

10. The method of claim 8, comprising:

positioning a portion of the virtual keyboard within a threshold distance of an edge of the input/output interface.

11. The method of claim 7, where controlling the availability of the virtual keyboard comprises changing the opacity of the virtual keyboard.

12. The method of claim 1, comprising:

providing an indication that the virtual keyboard is about to be re-configured, the indication being a graphical indication, an audible indication, or a haptic indication.

13. The method of claim 1, comprising:

receiving an inbound message through an application programming interface (API) provided by a process running on the device, and

selectively reconfiguring how the availability of the virtual keyboard will be controlled as a function of the control action based on the inbound message.

14. The method of claim 13, comprising:

selectively providing an outbound message to the process through the API, where the outbound message concerns an action performed using the virtual keyboard or an action performed using the user interface element.

15. A computer-readable storage medium storing computer-executable instructions that when executed by a computer cause the computer to perform a method, the method comprising:

identifying a state associated with a user interface element associated with an input/output interface, where the state depends, at least in part, on a user action performed using a virtual keyboard that is displayable on the input/output interface;

identifying a user configurable control action performed by an object in a hover-space associated with the input/output interface, where the hover-space comprises a three dimensional volume existing in an area accessible to the input/output interface, where identifying the control action comprises;

receiving a signal from an active detection system provided by the device or from a passive detection system provided by the device, where the signal identifies a gesture independent of the position of the virtual keyboard, identifies the entry of a digit into the hover-space, identifies the presence of a digit at a pre-determined location in the hover-space, identifies the presence of a digit at a location in the hover-space related to the position of the virtual keyboard, identifies a gesture that is related to the position of the virtual keyboard, identifies the removal of a digit from the hover-space, or identifies that a digit has moved less than a threshold amount in the hover-space over a threshold period of time;

selectively configuring the user interface element as a function of the state and the control action;

selectively displaying the user interface element on the input/output interface at a location that makes an insertion point associated with the user interface element visible during virtual typing performed in the hover-space using the virtual keyboard, where the location depends, at least in part, on the state;

providing an indication that the virtual keyboard is about to be re-configured, the indication being a graphical indication, an audible indication, or a haptic indication;

receiving an inbound message through an application programming interface (API) provided by a process running on the device;

selectively reconfiguring how the availability of the virtual keyboard will be controlled as a function of the control action based on the inbound message, and

selectively providing an outbound message to the process through the API, where the outbound message concerns an action performed using the virtual keyboard or an action performed using the user interface element.

16. An apparatus, comprising:

a hover-sensitive input/output interface;

a proximity detector configured to detect an object in a hover-space comprising a three dimensional volume disposed in proximity to the input/output interface;

a first logic configured to produce characterization data concerning a control action by the object, where the characterization data is independent of where the object is located in the hover-space; and

a second logic configured to;

selectively control a first user interface element displayed by the apparatus on the input/output interface as a function of the characterization data and a state of the user interface element, where the state depends, at least in part, on a user action performed using a virtual keyboard that is deployable on the input/output interface, where selectively controlling the first user interface element includes;

allocating display space on the input/output interface to the first user interface element when the first user interface element is needed for an operation on the apparatus; and

selectively reclaiming space on the input/output interface allocated to the first user interface element when the first user interface element is not needed for an operation on the apparatus.

17. The apparatus of claim 16, where the characterization data describes a presence of the object, a direction of travel of the object, a velocity of travel of the object, an orientation of the object, a size of the object, or a gesture performed by the object.

18. The apparatus of claim 16, where controlling the first user interface element comprises:

displaying one hundred percent of the first user interface element on the input/output interface and activating the first user interface element to interact with the object;

displaying less than one hundred percent of the first interface element on the input/output interface and deactivating the first user interface element from interacting with the object;

dividing the first user interface element into at least two pieces, positioning a first piece of the at least two pieces at a first position on the input/output interface, and positioning a second piece of the at least two pieces at a second, different position on the input/output interface;

positioning a portion of the first user interface element within a threshold distance of an edge of the input/output interface, or

changing the transparency of the first user interface element.

19. The apparatus of claim 16, where the second logic is configured to control a second user interface element displayed by the apparatus on the input/output interface as a function of a state associated with the first user interface element and an action associated with the object and the first user interface element, where the second user interface element displays a result of an interaction between the object and the first user interface element, and

where the second logic is configured to control the first user interface element within a threshold amount of time of receiving access to the characterization data.

20. The apparatus of claim 19, comprising a third logic configured to reconfigure the first logic or the second logic based on a message received from a user or an application through a messaging interface.