Systems and methods for using entered text to access and process contextual information

• US 9,189,155 B2
• Filed: 11/21/2011
• Issued: 11/17/2015
• Est. Priority Date: 11/20/2010
• Status: Expired due to Fees

• Current Assignee: Cerence Operating Company (Cerence Inc.)
• Original Assignee: Nuance Communications, Inc. (Microsoft Corporation)
• Inventors: Kushler, Clifford A., Manning, Jane, McSherry, Mike, Sheedy, Aaron
• Primary Examiner(s): Spar, Ilana
• Assistant Examiner(s): Karki, Paras D
• Application Number:
  US13/301,732
• Publication Number:
  US 20120127083A1
• Time in Patent Office: 1,457 Days
• US Class Current: 1/1
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06F 3/04886 by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus

Abstract

A system and method for commanding a keyboard application based on a gesture received at a displayed keyboard is described. In some examples, the system receives a gesture, such as a shape-based or key-based gesture, identifies a command associated with the received gesture, and performs a function (e.g. changes mode of the keyboard, hides the keyboard, and so on), based on the identified command.

Claims

1. A keyboard system stored in memory of a mobile device, the keyboard system comprising:

a display component configured to present a virtual keyboard to a user via a touch-screen of the mobile device,

wherein the virtual keyboard is configured to receive text input;

a gesture component configured to receive a gesture via the virtual keyboard from a user of the mobile device,

wherein the gesture includes movement across the virtual keyboard that could be interpreted as text entry;

a context component configured to determine a context associated with the received gesture,

wherein the context is separate from the content of the received gesture;

an interpretive component configured to identify whether the received gesture input in the determined context is a command for the keyboard system or is text entry,

wherein the keyboard system is distinct from other applications stored in memory of the mobile device;

a text entry component configured to receive gesture input identified as text entry via the virtual keyboard and update text based on the received text entry; and

a command component configured to receive gesture input identified as a command for the keyboard system and to command the keyboard system to perform a function based on the received gesture,

wherein the commanded function is not the function of a key displayed on the virtual keyboard.

2. The keyboard system of claim 1, wherein the gesture component is configured to receive a shape-based gesture from the user via the touch-screen of the mobile device,

wherein the shape-based gesture is unassociated with specific keys of the keyboard;

and

wherein the command component is configured to command the keyboard system to change a mode of operation of the virtual keyboard based on the received shape-based gesture.

3. The keyboard system of claim 1, wherein the gesture component is configured to receive a shape-based gesture from the user via the touch-screen of the mobile device,

wherein the shape-based gesture is unassociated with specific keys of the keyboard;

and

wherein the command component is configured to modify a font of text entered via the virtual keyboard based on the received shape-based gesture.

4. The keyboard system of claim 1, wherein the gesture component is configured to receive a key-based gesture from the user via the touch-screen of the mobile device;

and

wherein the command component is configured to change a mode of operation of the virtual keyboard based on the received key-based gesture.

5. The keyboard system of claim 1, wherein the gesture component is configured to receive a key-based gesture from the user via the touch-screen of the mobile device;

and

wherein the command component is configured to modify a font of text entered via the virtual keyboard based on the received key-based gesture.

6. The keyboard system of claim 1, wherein the gesture component is configured to receive a user-defined gesture from the user via the touch-screen of the mobile device.

7. The keyboard system of claim 1, wherein the command component is configured to change one or more keys displayed by the virtual keyboard based on the received gesture.

8. The keyboard system of claim 1, wherein the command component is configured to hide the virtual keyboard based on the received gesture.

9. The keyboard system of claim 1, wherein the command component is configured to change a font of text displayed via the virtual keyboard based on the received gesture.

20. The keyboard system of claim 1, wherein the received gesture can be identified as a first command or a second command, and the interpretive component utilizes the determined context information to identify the received gesture as the first command.

21. The keyboard system of claim 1, wherein the commanded function can be performed in more than one way, and the interpretive component utilizes the determined context information to determine how to perform the commanded function.

10. A method performed by a mobile device for commanding a keyboard application, the method comprising:

receiving a gesture on a keyboard displayed by the keyboard application via a touch-screen of the mobile device,

wherein the displayed keyboard is configured to receive text input, and

wherein the gesture includes movement across the displayed keyboard that could be interpreted as text input;

identifying a context associated with the received gesture,

wherein the context is separate from the content of the received gesture;

determining whether the received gesture in the identified context comprises a command associated with a function to be performed by the keyboard application,

wherein the keyboard application is distinct from other applications of the mobile device;

wherein the function changes the display of the keyboard; and

wherein the function is not the function of a key on the keyboard;

when the received gesture input is determined not to comprise a command for the keyboard application, then;

accepting the received gesture input as text input for facilitating the entry of text; and

when the received gesture input is determined to comprise a command for the keyboard application, then;

intercepting the received gesture input, such that the gesture input is not accepted as text input; and

commanding the keyboard application to perform the function associated with the received command gesture.

11. The method of claim 10, wherein the received gesture is a path traced from a first key of the keyboard to a second key of the keyboard.

12. The method of claim 10, wherein the received gesture is a shape traced on or proximate to the keyboard displayed by the keyboard application, wherein the shape is unassociated with any keys of the keyboard.

13. The method of claim 10, wherein the received gesture is a shape traced on or proximate to the keyboard and an associated text entry field displayed by the keyboard application, wherein the shape is unassociated with any keys of the keyboard.

14. The method of claim 10, wherein commanding the keyboard application to perform a function associated with the received gesture includes commanding the keyboard application to perform an action that changes a mode of operation of the keyboard application.

15. The method of claim 10, wherein commanding the keyboard application to perform a function associated with the received gesture includes commanding the keyboard application to perform an action that changes one or more keys of the keyboard displayed by the keyboard application.

16. A non-transitory computer-readable medium whose contents, when executed by a mobile device, cause the mobile device to perform a method for commanding a keyboard application of the mobile device, the method comprising:

receiving an indication that a first letter key has been contacted by a user of the mobile device via a keyboard displayed by the keyboard application;

receiving an indication that a path has been traced by the user from the first letter key to a second letter key displayed by the keyboard application;

identifying a context associated with the traced path,

wherein the context is separate from the content of the traced path determining whether the traced path is associated with a command for performing an action within the keyboard application in the identified context, wherein the keyboard application is distinct from other applications of the mobile device; and

wherein the action is not the function of a key displayed on the keyboard or a function of facilitating the entry of text;

when the traced path is determined not to be associated with a command for the keyboard application, then;

accepting the traced path as text input; and

when the traced path is determined to be associated with a command for the keyboard application, then;

performing the action associated with the command within the keyboard application.

17. The non-transitory computer-readable medium of claim 16, wherein performing an action associated with the traced path within the keyboard application includes performing an action specific to an application currently running on the mobile device.

18. The non-transitory computer-readable medium of claim 16, wherein performing an action associated with the traced path within the keyboard application includes performing an action that changes a current mode of the keyboard application to an alternative mode of the keyboard application.

19. The non-transitory computer-readable medium of claim 16, wherein performing an action associated with the traced path within the keyboard application includes performing an action that modifies a font of text input by the user of the mobile device via the keyboard application.