Computing devices having dynamically configurable user input devices, and methods of operating the same

• US 10,474,358 B2
• Filed: 02/22/2017
• Issued: 11/12/2019
• Est. Priority Date: 02/29/2016
• Status: Active Grant

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google LLC (Alphabet Inc.)
• Inventors: Martin, Alberto, Roberts-Hoffman, Katie Leah, Kuscher, Alexander Friedrich, Goldsmith, Benjamin
• Primary Examiner(s): Phantana-angkool, David
• Application Number:
  US15/439,165
• Publication Number:
  US 20170249072A1
• Time in Patent Office: 993 Days
• Field of Search: 715760
• CPC Class Codes: G06F 1/1662 Details related to the integrated keyboard
• CPC Class Codes: G06F 1/1671 Special purpose buttons or auxiliary keyboards, e.g. retractable mini keypads, keypads or buttons that remain accessible at closed laptop G06F1/1666 takes precedence
• CPC Class Codes: G06F 1/1692 the I/O peripheral being a secondary touch screen used as control interface, e.g. virtual buttons or sliders
• CPC Class Codes: G06F 3/0238 Programmable keyboards key guide holders G06F3/0224
• CPC Class Codes: G06F 3/03547 Touch pads, in which fingers can move on a surface
• CPC Class Codes: G06F 3/04886 by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
• CPC Class Codes: G06F 3/0489 using dedicated keyboard keys or combinations thereof
• CPC Class Codes: G06F 40/171 by use of digital ink
• CPC Class Codes: G06F 40/221 Parsing markup language streams streaming G06F40/149
• CPC Class Codes: G06F 9/451 Execution arrangements for user interfaces

Abstract

A computing device may include one or more dynamically configurable user input devices. In one example, a triggering event, such as, for example, a user input at a user interface of the computing device, may be detected in connection with an application running on the computing device. In response to the detected triggering event, individual elements of the user interface, such as, for example, keys of a keyboard, may be configured, and/or re-configured, to correspond to the input received and/or the application running on the computing device.

Claims

1. A computer-implemented method, comprising:

detecting, by a processor of a computing device, a triggering event in an application executing on a computing device;

determining, by the processor, a configuration of a user interface of the computing device associated with the application in response to the detected triggering event; and

configuring electronic ink associated with at least a portion of the user interface of the computing device in response to the detected triggering event and the determined configuration, including at least one of;

changing an appearance of the portion of the user interface to provide a visual indication of the triggering event; and

changing a functionality associated with the portion of the user interface in response to the detected triggering event.

2. The method of claim 1, wherein the application is a web browsing application, and wherein the triggering event is a command present in a website, the method further comprising:

parsing the website to obtain key control information, the notification including the key control information; and

configuring the electronic ink according to the key control information.

3. The method of claim 2, wherein parsing the web site includes using a Java™

script to parse the website.

4. The method of claim 2, wherein configuring the electronic ink includes configuring an appearance of the user interface to correspond to an element of the web site.

5. The method of claim 1, wherein configuring the electronic ink includes configuring an appearance of the user interface so that the user interface is operable for the website to at least one of initiate payment for a purchase, log into an account, view an offer, access news, or select an emoticon.

6. The method of claim 1, wherein the triggering event is an activation of a modifier key of the user interface, and wherein configuring the electronic ink includes changing the appearance of the portion of the user interface to correspond to an effect of the modifier key on the portion of the user interface.

7. The method of claim 1, wherein the triggering event includes a notification of at least one of an incoming email, an incoming message, a detected error, an incoming alert, or an offer.

8. The method of claim 1, wherein changing the appearance of the portion of the user interface includes changing the appearance of the portion of the user interface to correspond to the changed functionality of the portion of the user interface.

9. The method of claim 1, wherein the user interface includes a keyboard, and wherein configuring the electronic ink includes configuring electronic ink associated with at least one key of the keyboard.

10. The method of claim 1, wherein the user interface includes a virtual keyboard, and wherein configuring the electronic ink includes configuring electronic ink associated with at least one virtual key of the virtual keyboard.

11. The method of claim 1, wherein the user interface occupies a region of a touch pad or track pad.

12. The method of claim 1, wherein the electronic ink is electrophoretic ink.

13. The method of claim 1, wherein changing at least one of the appearance or the functionality of the portion of the user interface includes reconfiguring the user interface from a first configuration to a second configuration that is different from the first configuration in response to the detected triggering event.

14. A computer-implemented method, comprising:

detecting, by a processor of a computing device, a touch input at a user interface of a computing device, the touch input corresponding to a triggering event;

determining, by the processor, a configuration of the user interface of the computing device in response to the detected triggering event; and

displaying, at the user interface, user interface elements corresponding to the determined configuration of the user interface in response to the detected triggering event and the determined configuration, including at least one of;

changing an appearance of at least a portion of the user interface to provide a visual indication of the triggering event; and

changing a functionality associated with the portion of the user interface in response to the detected triggering event.

15. The method of claim 14, wherein the user interface comprises a plurality of user interface elements, and wherein displaying user interface elements corresponding to the determined configuration of the user interface in response to the detected triggering event and the determined configuration includes:

re-configuring an appearance of a subset of user interface elements of the plurality of user interface elements of the user interface; and

displaying the re-configured subset of user interface elements at the user interface together with the remaining user interface elements of the plurality of user interface elements.

16. The method of claim 14, wherein the user interface comprises a plurality of user interface elements displayed at a first portion of the user interface, and wherein displaying user interface elements corresponding to the determined configuration of the user interface in response to the detected triggering event and the determined configuration includes:

displaying at least one new user interface element at a second portion of the user interface in response to the detected triggering event and the determined configuration, the second portion of the user interface being separate from the first portion of the user interface.

17. The method of claim 16, wherein the at least one new user interface element displayed at the second portion of the user interface occupies a portion of the user interface not previously occupied by the plurality of user interface elements.

18. The method of claim 14, wherein the user interface is a keyboard including a plurality of keys, and wherein

displaying, at the user interface, user interface elements corresponding to the determined configuration of the user interface in response to the detected triggering event and the determined configuration includes:

configuring electronic ink associated with at least one key of the plurality of keys to change an appearance of the at least one key.

19. The method of claim 18, wherein the changed appearance of the at least one key provides a visual indication of at least one of a changed functionality of the at least one key, additional functionality associated with the at least one key, or the triggering event.

20. The method of claim 14, wherein changing at least one of the appearance or the functionality of the portion of the user interface includes reconfiguring the user interface from a first configuration to a second configuration that is different from the first configuration in response to the detected triggering event.