INFERRING SWITCHING CONDITIONS FOR SWITCHING BETWEEN MODALITIES IN A SPEECH APPLICATION ENVIRONMENT EXTENDED FOR INTERACTIVE TEXT EXCHANGES
3 Assignments
0 Petitions
Accused Products
Abstract
The disclosed solution includes a method for dynamically switching modalities based upon inferred conditions in a dialogue session involving a speech application. The method establishes a dialogue session between a user and the speech application. During the dialogue session, the user interacts using an original modality and a second modality. The speech application interacts using a speech modality only. A set of conditions indicative of interaction problems using the original modality can be inferred. Responsive to the inferring step, the original modality can be changed to the second modality. A modality transition to the second modality can be transparent the speech application and can occur without interrupting the dialogue session. The original modality and the second modality can be different modalities; one including a text exchange modality and another including a speech modality.
-
Citations
37 Claims
-
1-20. -20. (canceled)
-
21. A method for allowing multimodal communication with a device executing a speech-enabled application during a communication session with a user, comprising:
-
with the device executing the speech-enabled application, at a first time during the communication session, receiving a first signal via a communication channel, the first signal corresponding to a voice input originating from a voice interface operated by the user during the communication session; processing the first signal with the speech-enabled application during the communication session with the user; with the device executing the speech-enabled application, at a second time during the communication session with the user, receiving a second signal via the communication channel, the second signal corresponding to a text input originating from a text interface operated by the user during the communication session; and processing the second signal with the voice-enabled application during the communication session with the user. - View Dependent Claims (22, 23, 24, 25, 26)
-
-
27. A system in which a user is able to engage in multiple modes of communication with a speech-enabled application, comprising:
-
a device configured to execute the speech-enabled application so as to engage in a communication session with a user; a voice interface operable by the user during the communication session; and a text interface operable by the user during the communication session; wherein the system is configured such that the device is able to receive, at a first time during the communication session, a first signal via a communication channel, the first signal corresponding to a voice input originating from the voice interface, and to process the first signal with the speech-enabled application during the communication session with the user; and wherein the system is further configured such that the device is able to receive, at a second time during the communication session with the user, a second signal via the communication channel, the second signal corresponding to a text input originating from the text interface operated by the user during the communication session, and to process the second signal with the voice-enabled application during the communication session with the user. - View Dependent Claims (28, 29, 30, 31, 32, 34, 35)
-
-
33. A system for allowing multimodal communication with a device executing a speech-enabled application during a communication session with a user, comprising:
-
means for, at a first time during the communication session, communicating a first signal corresponding to a voice input from a voice interface to an input of the device executing the speech application for processing thereby; and means for, at a second time during the communication session, communicating a second signal corresponding to a text input from a text interface to the input of the device executing the speech application for processing thereby. - View Dependent Claims (36, 37)
-
Specification