Combined speech and handwriting recognition
First Claim
1. A method of word recognition comprising:
- receiving a handwritten representation of all or a part of a given sequence of one or more words to be recognized;
receiving a spoken representation of said sequence of one or more words;
performing handwriting recognition the handwritten representation and speech recognition upon the spoken representation and selecting one or more best scoring recognition candidates each comprised of a sequences of one or more words based on the scoring of recognition candidates against both the handwritten and spoken representations.
7 Assignments
0 Petitions
Accused Products
Abstract
The invention relates to the combination of speech recognition with handwriting and/or character recognition. This includes the innovation of selecting one or more best-scoring recognition candidates as a function of recognition of both handwritten and spoken representations of a sequence of one or more words to be recognized. It also includes the innovation of using character or handwriting recognition of one or more letters to alphabetically filter speech recognition of one or more words. It also includes the innovations of using speech recognition of one or more letter-identifying words to alphabetically filter handwriting recognition, and of using speech recognition to correct handwriting recognition of one or more words.
-
Citations
22 Claims
-
1. A method of word recognition comprising:
-
receiving a handwritten representation of all or a part of a given sequence of one or more words to be recognized;
receiving a spoken representation of said sequence of one or more words;
performing handwriting recognition the handwritten representation and speech recognition upon the spoken representation and selecting one or more best scoring recognition candidates each comprised of a sequences of one or more words based on the scoring of recognition candidates against both the handwritten and spoken representations.
-
-
2. A method of word recognition comprising:
-
receiving a spoken representation of a given sequence of one or more words to be recognized;
receiving a filtering input consisting of handwriting or character drawing input;
using handwriting or character recognition, respectively, to define a filter representing one or more sequences of characters selected by said recognition as most likely corresponding to said filtering input; and
using a combination of said filter and speech recognition performed on said spoken representation to select one or more recognition candidates, each consisting of a sequence of one or more words, selected as a function of the closeness of their match against the spoken representation and whether or not they match one of the one or more character sequences associated said filter. - View Dependent Claims (3, 4, 5, 6, 7, 8, 9, 10)
-
-
11. A method of word recognition comprising:
-
receiving a handwritten representation of a given sequence of one or more words to be recognized;
receiving a filtering input consisting one or more utterances representing a sequence of one or more letter identifying words;
using speech recognition to define a filter representing one or more sequences of characters selected by said recognition as most likely corresponding to said filtering input; and
using a combination of said filter and handwriting recognition performed on said handwritten representation to select one or more recognition candidates, each consisting of a sequence of one or more words, selected as a function of the closeness of their match against the handwritten representation and whether or not they match one of the one or more character sequences associated said filter. - View Dependent Claims (12, 13, 14, 15, 16, 17, 18, 19)
-
-
20. A method of word recognition comprising:
-
receiving a handwritten representation of a given sequence of one or more words to be recognized;
performing handwriting recognition upon said handwritten representation to produce one or more best scoring recognition candidates, each of which contains one or more words selected as having a likelihood of corresponding to the one or more words of said handwritten representation;
then receiving a spoken representation of a given sequence of one or more words to be recognized;
performing speech recognition upon said spoken representation to produce one or more best scoring recognition candidates, each of which contains one or more words selected as having a likelihood of corresponding to the one or more words of said spoken representation;
using information in one of said speech recognition'"'"'s best scoring candidates to correct the prior recognition of said handwritten representation. - View Dependent Claims (21, 22)
-
Specification