FACILITATING MULTIMODAL INTERACTION WITH GRAMMAR-BASED SPEECH APPLICATIONS
First Claim
1. One or more processor-accessible tangible media comprising processor-executable instructions for facilitating multimodal interaction, wherein the processor-executable instructions, when executed, direct a device to perform acts comprising:
- receiving a spoken utterance including two or more terms, the two or more terms not being recognized as a permissible phrase that is in-grammar for a grammar-based speech application;
recognizing one or more acceptable terms that are in-vocabulary from among the two or more terms of the spoken utterance;
searching an index using the one or more acceptable terms as query terms;
producing, from the searching of the index, at least one permissible phrase that is in-grammar and that includes the one or more acceptable terms;
the index comprising a searchable data structure that represents multiple possible grammar paths that are ascertainable based on acceptable values for each term position of the grammar-based speech application; and
presenting at least one permissible phrase to a user as at least one option that may be selected to conduct multimodal interaction with the device.
2 Assignments
0 Petitions
Accused Products
Abstract
Multimodal interaction with grammar-based speech applications may be facilitated with a device by presenting permissible phrases that are in-grammar based on acceptable terms that are in-vocabulary and that have been recognized from a spoken utterance. In an example embodiment, a spoken utterance having two or more terms is received. The two or more terms include one or more acceptable terms. An index is searched using the acceptable terms as query terms. From the searching of the index, permissible phrase(s) are produced that include the acceptable terms. The index is a searchable data structure that represents multiple possible grammar paths that are ascertainable based on acceptable values for each term position of a grammar-based speech application. The permissible phrase(s) are presented to a user as option(s) that may be selected to conduct multimodal interaction with the device.
-
Citations
20 Claims
-
1. One or more processor-accessible tangible media comprising processor-executable instructions for facilitating multimodal interaction, wherein the processor-executable instructions, when executed, direct a device to perform acts comprising:
-
receiving a spoken utterance including two or more terms, the two or more terms not being recognized as a permissible phrase that is in-grammar for a grammar-based speech application; recognizing one or more acceptable terms that are in-vocabulary from among the two or more terms of the spoken utterance; searching an index using the one or more acceptable terms as query terms; producing, from the searching of the index, at least one permissible phrase that is in-grammar and that includes the one or more acceptable terms;
the index comprising a searchable data structure that represents multiple possible grammar paths that are ascertainable based on acceptable values for each term position of the grammar-based speech application; andpresenting at least one permissible phrase to a user as at least one option that may be selected to conduct multimodal interaction with the device. - View Dependent Claims (2, 3, 4, 5)
-
-
6. A method that is implemented by a device to facilitate multimodal interaction, the method comprising acts of:
-
receiving a spoken utterance having two or more terms, the two or more terms including one or more acceptable terms; searching an index using the one or more acceptable terms as query terms; producing, from the searching of the index, at least one permissible phrase that includes the one or more acceptable terms;
the index comprising a searchable data structure that represents multiple possible grammar paths that are ascertainable based on acceptable values for each term position of a grammar-based speech application; andpresenting the at least one permissible phrase to a user as at least one option that may be selected to conduct multimodal interaction with the device. - View Dependent Claims (7, 8, 9, 10, 11, 12, 13, 14)
-
-
15. A device that is capable of facilitating multimodal interaction, the device comprising:
-
a speech processing component to receive a spoken utterance having two or more terms, the two or more terms including one or more acceptable terms; a grammar-based speech application including an index and a search unit;
the index comprising a searchable data structure that represents multiple possible grammar paths that are ascertainable based on acceptable values for each term position of the grammar-based speech application;
the search unit to search the index using the one or more acceptable terms as query terms and to produce at least one permissible phrase that includes the one or more acceptable terms; anda feedback component to present the at least one permissible phrase to a user as at least one option that may be selected to conduct multimodal interaction with the device. - View Dependent Claims (16, 17, 18, 19, 20)
-
Specification