Method for recognizing handwritten characters using shape and context analysis
First Claim
1. A method for handwriting translation including a deterministic finite automaton traversal subroutine, and a dynamic programming subroutine, comprising the steps of:
- deriving character proposals and corresponding probabilities from an input of digitized strokes and storing a pointer to the strokes not yet analyzed;
deriving a separate list of character proposals, probabilities, and new states from the deterministic finite automaton traversal subroutine;
merging the two character proposal lists into a single list of hypotheses, that are sorted by probability;
expanding each of those hypotheses in order from most to least probable;
deriving a new list of proposals from the strokes not yet analyzed with a shape matching subroutine and storing a pointer to the strokes still not yet analyzed;
deriving a new list of proposals from the DFA traverser using the state previously stored with the hypothesis being expanded; and
repeatedly expanding said hypotheses until a list of translations is produced.
4 Assignments
0 Petitions
Accused Products
Abstract
An improved pattern recognition system, using an improved method for merging low-level recognition information with auxiliary contextual information such as a Deterministic Finite Automaton (DFA). The system comprises a low-level shape recognizer for handwriting input, an English Language dictionary organized as a Trie (a special type of DFA), and software to merge the results of the two. An input of digitized handwriting strokes is translated into characters using the shape recognizer and the Trie in tandem, allowing the system to reject nonsense translations at the earliest possible stage of the process and without the overhead traversing the trie from the top with each translation.
76 Citations
13 Claims
-
1. A method for handwriting translation including a deterministic finite automaton traversal subroutine, and a dynamic programming subroutine, comprising the steps of:
-
deriving character proposals and corresponding probabilities from an input of digitized strokes and storing a pointer to the strokes not yet analyzed; deriving a separate list of character proposals, probabilities, and new states from the deterministic finite automaton traversal subroutine; merging the two character proposal lists into a single list of hypotheses, that are sorted by probability; expanding each of those hypotheses in order from most to least probable; deriving a new list of proposals from the strokes not yet analyzed with a shape matching subroutine and storing a pointer to the strokes still not yet analyzed; deriving a new list of proposals from the DFA traverser using the state previously stored with the hypothesis being expanded; and repeatedly expanding said hypotheses until a list of translations is produced. - View Dependent Claims (2, 3, 4)
-
-
5. A method for recognition of sequences of characters, including the steps of:
-
(1) storing a plurality of input strokes which are in a sequence; (2) generating a first set of recognition hypotheses for a first subset of said strokes, beginning at one end of the sequence of strokes, each hypothesis including;
(i) a hypothesized character, (ii) the number of strokes required to construct the hypothesized character, and (iii) a probability assigned to the hypothesized character;(3) comparing each hypothesized character with a predetermined database of character sequences; (4) for each hypothesized character which is found as a first character in the predetermined database of character sequences, generating a pointer which is correlated with that hypothesis and which points to that character'"'"'s position in the database; (5) for each character which is not found as a first character in the predetermined database of character sequences, assigning a lower probability to that character'"'"'s recognition hypothesis; (6) designating the recognition hypothesis having the highest probability as the current active hypothesis in the set of recognition hypotheses of which that recognition hypothesis is a member; (7) placing that set of recognition hypotheses as the first element on a stack of sets of recognition hypotheses; (8) from a plurality of strokes following the last stroke which is a part of the current active hypothesis from the set of recognition hypotheses at the top of the stack, generating a new set of new recognition hypotheses, each said new recognition hypothesis including;
(i) a hypothesized character, (ii) the number of strokes required to construct the hypothesized character, and (iii) a probability assigned to the hypothesized character;(9) replacing the probability assigned to each new recognition hypothesis with a value derived from the current value of the probability for the new recognition hypothesis and the value of the probability of the current active hypothesis from the set of recognition hypotheses at the top of the stack; (10) if the current active hypothesis from the set of recognition hypotheses at the top of the stack has an assigned pointer to the database, then for each new hypothesis which is found in the predetermined database of character sequences as a new character following the character corresponding to said current active hypothesis, generating a pointer which is correlated with that hypothesis and which points to the new character'"'"'s position in the database; (11) if the current active hypothesis from the set of the recognition hypotheses at the top of the stack does not have an assigned pointer to the database, then for each new hypothesis, reduce the probability of every recognition hypotheses in the new set by a predetermined factor; (12) designating the recognition hypothesis which is a member of the new set of recognition hypotheses and which has the highest probability in that set as the current active hypothesis in that set; (13) placing the new set of recognition hypotheses on top of the stack; (14) repeating steps 8 through 13, until no additional strokes are found in step 8 following the last stroke which is a part of the current active hypothesis from the set of recognition hypotheses at the top of the stack; (15) generating a first hypothesis string from the current active hypothesis of each set of recognition of hypotheses, in order from the bottom of the stack to the top; (16) generating a probability for the first hypothesis string, based upon the value of the probability for the current active hypothesis from the set of recognition hypotheses at the top of the stack; (17) storing the first hypothesis string as the best hypothesis string and storing its probability as the best probability, and proceeding to step 20; (18) generating a new hypothesis string from the current active hypothesis of each set of recognition of hypotheses, in order from the bottom of the stack to the top; (19) generating a probability for the new hypothesis string, based upon the value of the probability for the current active hypothesis from the set of recognition hypotheses at the top of the stack; (20) if the probability of the new hypothesis string is higher than the stored best probability, storing the new hypothesis string as the best probability string and storing its probability as the best probability; (21) if the set of recognition hypotheses at the top of the stack includes a subset of at least one other recognition hypothesis having a probability lower than the current active hypothesis, then designating the recognition hypothesis of said subset which has the highest probability value as the current active hypothesis and repeating steps 8-14 and 18-20; (22) removing the set of recognition hypotheses at the top of the stack, and if the stack is not empty as a result of such removal, proceeding to step 21, but if it is empty then proceeding to step 23; and (23) outputting the best stored string. - View Dependent Claims (6)
-
-
7. A method for generating a sequence of characters from a set of input strokes, including the steps of:
-
(1) generating at least one shape proposal corresponding to a first subset of the plurality of input strokers; (2) generating a probability for each of the shape proposals generated in step 1; (3) generating a plurality of hypothesis lists including the shape proposals; (4) maintaining a stack of hypothesis lists, with one hypothesis in each hypothesis list being designated as a current active hypothesis, the stack being ordered from a beginning of the plurality of input strokes to an end thereof, wherein each list of hypotheses is determined from the current active hypothesis in the list directly below it on the stack, and herein the current active hypothesis from the hypothesis list at the top of the stack utilizes all input strokes to be analyzed; (5) generating a string including the shape proposals corresponding to each of the current active hypotheses from the hypothesis lists on the stack, in order from bottom to top; (6) generating a probability for each such string form the probabilities of the individual shape proposals corresponding to the current active hypotheses which form the string, wherein the probability for each string which is not represented in a predetermined database is reduced in a predefined manner; (7) outputting a string as generated in step 5 having the highest probability as generated in step 6. - View Dependent Claims (8, 9, 10, 11, 12, 13)
-
Specification