User-centric soft keyboard predictive technologies

• US 9,613,015 B2
• Filed: 06/27/2014
• Issued: 04/04/2017
• Est. Priority Date: 02/12/2010
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Inventors: Badger, Eric Norman, Linerud, Drew Elliott, Almog, Itai, Paek, Timothy S., Sundararajan, Parthasarathy, Rudchenko, Dmytro, Gunawardana, Asela J.
• Primary Examiner(s): VINCENT, DAVID ROBERT
• Application Number:
  US14/318,260
• Publication Number:
  US 20140310213A1
• Time in Patent Office: 1,012 Days
• Field of Search: 706 12, 706 45
• CPC Class Codes: G06F 16/35 Clustering; Classification
• CPC Class Codes: G06F 3/0237 using prediction or retrieval techniques
• CPC Class Codes: G06F 3/048 Interaction techniques based on graphical user interfaces [GUI]
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06F 3/04886 by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
• CPC Class Codes: G06F 40/166 Editing, e.g. inserting or deleting
• CPC Class Codes: G06F 40/247 Thesauruses; Synonyms
• CPC Class Codes: G06F 40/274 Converting codes to words; Guess-ahead of partial word inputs
• CPC Class Codes: G06N 20/00 Machine learning

Abstract

An apparatus and method are disclosed for providing feedback and guidance to touch screen device users to improve text entry user experience and performance by generating input history data including character probabilities, word probabilities, and touch models. According to one embodiment, a method comprises receiving first input data, automatically learning user tendencies based on the first input data to generate input history data, receiving second input data, and generating auto-corrections or suggestion candidates for one or more words of the second input data based on the input history data. The user can then select one of the suggestion candidates to replace a selected word with the selected suggestion candidate.

Claims

1. A method, comprising:

receiving first input data associated with a mobile device, wherein the first input data comprises one or more words;

automatically learning user tendencies using the first input data to generate user-specific input history data indicating that at least one input word of the first input data was previously auto-corrected and that the auto-correction was undone;

receiving second input data from a touch screen keyboard;

analyzing the second input data and at least a portion of the user-specific input history data; and

based on the analyzing, providing one or more user-specific auto-corrections or suggestion candidates for the second input data to the touch screen keyboard.

2. The method of claim 1, wherein the user-specific auto-corrections comprise suppressing an auto-correction based on comparing a threshold value to a score generated by combining first data comprising a weighted probability based on one or more candidate sources with second data comprising a weighted edit distance based on one more edit distance penalty categories.

3. The method of claim 1, wherein:

the analyzing comprises combining a weighted probability for at least one of the words based on one or more candidate sources with a weighted edit distance based on one or more edit distance penalty categories; and

at least one of the one or more candidate sources is based on user-specific input history data.

4. The method of claim 1, wherein the receiving second input data further comprises resizing one or more target areas associated with one or more associated keys on the touch screen keyboard, wherein the resizing is based on one or more characters previously received in the second input data.

5. The method of claim 4, wherein the resizing is based at least in part on the user-specific input history data.

6. The method of claim 1, wherein:

the first input data and the second input data are received at a computing cloud from the mobile device;

the mobile device is at a location remote from the cloud;

the automatically learning user tendencies occurs in the cloud;

the analyzing further comprises combining input history data from two or more distinct users; and

the generated auto-corrections or suggestion candidates are provided from the cloud to the mobile device.

7. One or more computer-readable storage device or memory storing computer-readable instructions that when executed cause a computer to perform a method, the method comprising:

receiving first input data associated with a mobile device, wherein the first input data comprises one or more words, the first input data indicating that at least one of the words was previously auto-corrected and that the auto-correction was undone;

automatically learning user tendencies using the first input data to generate user-specific input history data;

receiving second input data from a touch screen keyboard, the receiving second data comprising resizing one or more target areas associated with one or more associated keys on the touch screen keyboard, the resizing being based on one or more characters previously received in the second input data;

analyzing the second input data and at least a portion of the user-specific input history data; and

based on the analyzing, providing one or more user-specific auto-corrections or suggestion candidates for the second input data to the touch screen keyboard.

9. The computer-readable storage device or memory of claim 7, wherein the user-specific auto-corrections comprise suppressing an auto-correction based on comparing a threshold value to a score generated by combining first data comprising a weighted probability based on one or more candidate sources with second data comprising a weighted edit distance based on one more edit distance penalty categories.

10. The computer-readable storage device or memory of claim 7, wherein the receiving second input data further comprises resizing one or more target areas associated with one or more associated keys on the touch screen keyboard, wherein the resizing is based on one or more characters previously received in the second input data.

11. The computer-readable storage device or memory of claim 7, wherein the first input data, the second input data, or the first input data and the second input data include data for an input scope of the mobile device.

12. The computer-readable storage device or memory of claim 7, wherein:

the first input data and the second input data are received at a computing cloud from the mobile device;

the mobile device is at a location remote from the cloud;

the automatically learning user tendencies occurs in the cloud;

the analyzing further comprises combining input history data from two or more distinct users; and

the generated auto-corrections or suggestion candidates are provided from the cloud to the mobile device.

8. One or more computer-readable storage device or memory storing computer-readable instructions that when executed cause a computer to perform a method, the method comprising:

using a touch screen keyboard coupled with a mobile device, receiving first user input data, the first user input data comprising one or more characters and data indicating an input scope of the mobile device;

using the text entry device touch screen keyboard, receiving a completion event;

after the receiving, automatically analyzing the first user input data and storing user-specific input history data based on the analyzing, wherein the stored user-specific input history data includes an indication;

using the touch screen keyboard, receiving second user input data;

determining a weighted probability determined from one or more candidate source data selected from a group including at least one or more of the following;

the user-specific input history data, the second user input data, dictionary probability data, user-specific touch model data, or generic touch model data;

determining a weighted edit distance determined by calculating one or more edit distances selected from a group of penalty categories including at least one or more of the following;

insertion, wildcard, deletion, transposition, non-fuzzy substitution, fuzzy substitution, case change, or accent;

automatically determining one or more suggestion candidates based on a score determined by combining the weighted probability and the weighted edit distance; and

displaying the suggestion candidates on the touch screen keyboard.

13. The computer-readable storage device or memory of claim 8, wherein the weighted probability is further determined based on proximity of zones to key boundaries associated with the characters of the first input data and/or the second input data.

14. The computer-readable storage device or memory of claim 8, wherein the weighted edit distance is further determined based on characters intended to be typed, but not actually received, in the second input data.

15. The computer-readable storage device or memory of claim 8, wherein the method further comprises performing auto correction to the first user input data and/or the second user input data based on a score determined by combining the weighted probability and the weighted edit distance.

16. The computer-readable storage device or memory of claim 8, wherein the weighted probability is further determined based on a predetermined probability of pressing one or more keys of the touch screen keyboard accidently.

17. The computer-readable storage device or memory of claim 8, wherein the first user input data include data collected from two or more different touch screen keyboard users, and wherein the weighted probability is determined based at least in part on running simulations that vary touch screen keyboard model parameters and then replay the first user input data using different hit target locations of the touch screen keyboard.