Entropy-guided text prediction using combined word and character n-gram language models
First Claim
1. A method for determining word prediction candidates to be displayed, the method comprising:
- at an electronic device;
receiving a first typed character from a user;
determining a first entropy of a first set of possible word completions based on first probabilities of the first set of possible word completions, wherein the first probabilities are based on the first typed character;
receiving a second typed character from the user;
determining a second entropy of a second set of possible word completions based on second probabilities of the second set of possible word completions, wherein the second probabilities are based on the first typed character and the second typed character;
determining a reduction in entropy from the first entropy to the second entropy, wherein determining the reduction in entropy comprises;
determining the reduction in entropy based on third probabilities of a third set of possible word completions, the third set of possible word completions comprising words in the first set of possible word completions other than words in the second set of possible word completions; and
in response to the reduction in entropy exceeding a threshold, causing a candidate word to be displayed from the second set of possible word completions.
1 Assignment
0 Petitions
Accused Products
Abstract
Systems and processes are disclosed for predicting words in a text entry environment. Candidate words and probabilities associated therewith can be determined by combining a word n-gram language model and a character m-gram language model. Based on entered text, candidate word probabilities from the word n-gram language model can be integrated with the corresponding candidate character probabilities from the character m-gram language model. A reduction in entropy can be determined from integrated candidate word probabilities before entry of the most recent character to integrated candidate word probabilities after entry of the most recent character. If the reduction in entropy exceeds a predetermined threshold, candidate words with high integrated probabilities can be displayed or otherwise made available to the user for selection. Otherwise, displaying candidate words can be deferred (e.g., pending receipt of an additional character from the user leading to reduced entropy in the candidate set).
3339 Citations
20 Claims
-
1. A method for determining word prediction candidates to be displayed, the method comprising:
at an electronic device; receiving a first typed character from a user; determining a first entropy of a first set of possible word completions based on first probabilities of the first set of possible word completions, wherein the first probabilities are based on the first typed character; receiving a second typed character from the user; determining a second entropy of a second set of possible word completions based on second probabilities of the second set of possible word completions, wherein the second probabilities are based on the first typed character and the second typed character; determining a reduction in entropy from the first entropy to the second entropy, wherein determining the reduction in entropy comprises; determining the reduction in entropy based on third probabilities of a third set of possible word completions, the third set of possible word completions comprising words in the first set of possible word completions other than words in the second set of possible word completions; and in response to the reduction in entropy exceeding a threshold, causing a candidate word to be displayed from the second set of possible word completions. - View Dependent Claims (2, 3, 4)
-
5. A method for determining word prediction candidates to be displayed, the method comprising:
at an electronic device; receiving a first typed character from a user; determining first probabilities of a first set of possible word completions based on the first typed character; receiving a second typed character from the user; determining second probabilities of a second set of possible word completions based on the first typed character and the second typed character; determining a reduction in entropy from the first probabilities of the first set to the second probabilities of the second set, wherein determining the reduction in entropy comprises; determining the reduction in entropy based on third probabilities of a third set of possible word completions, the third set of possible word completions comprising words in the first set of possible word completions other than words in the second set of possible word completions; and in response to the reduction in entropy exceeding a threshold, causing a candidate word to be displayed from the second set of possible word completions. - View Dependent Claims (6, 7, 8)
-
9. A non-transitory computer-readable storage medium comprising instructions for causing one or more processors to:
-
receive a first typed character from a user; determine a first entropy of a first set of possible word completions based on first probabilities of the first set of possible word completions, wherein the first probabilities are based on the first typed character; receive a second typed character from the user; determine a second entropy of a second set of possible word completions based on second probabilities of the second set of possible word completions, wherein the second probabilities are based on the first typed character and the second typed character; determine a reduction in entropy from the first entropy to the second entropy, wherein determining the reduction in entropy comprises; determining the reduction in entropy based on third probabilities of a third set of possible word completions, the third set of possible word completions comprising words in the first set of possible word completions other than words in the second set of possible word completions; and in response to the reduction in entropy exceeding a threshold, cause a candidate word to be displayed from the second set of possible word completions. - View Dependent Claims (10, 11)
-
-
12. A system comprising:
-
one or more processors; memory; one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for; receiving a first typed character from a user; determining a first entropy of a first set of possible word completions based on first probabilities of the first set of possible word completions, wherein the first probabilities are based on the first typed character; receiving a second typed character from the user; determining a second entropy of a second set of possible word completions based on second probabilities of the second set of possible word completions, wherein the second probabilities are based on the first typed character and the second typed character; determining a reduction in entropy from the first entropy to the second entropy, wherein determining the reduction in entropy comprises; determining the reduction in entropy based on third probabilities of a third set of possible word completions, the third set of possible word completions comprising words in the first set of possible word completions other than words in the second set of possible word completions; and in response to the reduction in entropy exceeding a threshold, causing a candidate word to be displayed from the second set of possible word completions. - View Dependent Claims (13, 14)
-
-
15. A non-transitory computer-readable storage medium comprising instructions for causing one or more processors to:
-
receive a first typed character from a user; determine first probabilities of a first set of possible word completions based on the first typed character; receive a second typed character from the user; determine second probabilities of a second set of possible word completions based on the first typed character and the second typed character; determine a reduction in entropy from the first probabilities of the first set to the second probabilities of the second set, wherein determining the reduction in entropy comprises; determining the reduction in entropy based on third probabilities of a third set of possible word completions, the third set of possible word completions comprising words in the first set of possible word completions other than words in the second set of possible word completions; and in response to the reduction in entropy exceeding a threshold, cause a candidate word to be displayed from the second set of possible word completions. - View Dependent Claims (16, 17)
-
-
18. A system comprising:
-
one or more processors; memory; one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs including instructions for; receiving a first typed character from a user; determining first probabilities of a first set of possible word completions based on the first typed character; receiving a second typed character from the user; determining second probabilities of a second set of possible word completions based on the first typed character and the second typed character; determining a reduction in entropy from the first probabilities of the first set to the second probabilities of the second set, wherein determining the reduction in entropy comprises; determining the reduction in entropy based on third probabilities of a third set of possible word completions, the third set of possible word completions comprising words in the first set of possible word completions other than words in the second set of possible word completions; and in response to the reduction in entropy exceeding a threshold, causing a candidate word to be displayed from the second set of possible word completions. - View Dependent Claims (19, 20)
-
Specification