Providing expressive user interaction with a multimodal application
First Claim
1. A computer-implemented method of providing expressive user interaction with a multimodal application, the multimodal application operating in a multimodal browser on a multimodal device supporting multiple modes of user interaction including a voice mode and one or more non-voice modes, the multimodal application operatively coupled to a speech engine through a VoiceXML interpreter, the method comprising:
- receiving, by the multimodal browser, user input from a user through a particular mode of user interaction;
determining, by the multimodal browser, user output for the user in dependence upon the user input;
determining, by the multimodal browser, a style for the user output in dependence upon the user input, the style specifying expressive output characteristics for at least one other mode of user interaction; and
rendering, by the multimodal browser, the user output in dependence upon the style,wherein determining the style for the user output in dependence upon the user input comprises performing a determination distinct from determining the user output,wherein determining, by the multimodal browser, a style for the user output in dependence upon the user input comprises determining, by the multimodal browser, a style for the user output in dependence upon meaning of the user input.
2 Assignments
0 Petitions
Accused Products
Abstract
Methods, apparatus, and products are disclosed for providing expressive user interaction with a multimodal application, the multimodal application operating in a multimodal browser on a multimodal device supporting multiple modes of user interaction including a voice mode and one or more non-voice modes, the multimodal application operatively coupled to a speech engine through a VoiceXML interpreter, including: receiving, by the multimodal browser, user input from a user through a particular mode of user interaction; determining, by the multimodal browser, user output for the user in dependence upon the user input; determining, by the multimodal browser, a style for the user output in dependence upon the user input, the style specifying expressive output characteristics for at least one other mode of user interaction; and rendering, by the multimodal browser, the user output in dependence upon the style.
-
Citations
20 Claims
-
1. A computer-implemented method of providing expressive user interaction with a multimodal application, the multimodal application operating in a multimodal browser on a multimodal device supporting multiple modes of user interaction including a voice mode and one or more non-voice modes, the multimodal application operatively coupled to a speech engine through a VoiceXML interpreter, the method comprising:
-
receiving, by the multimodal browser, user input from a user through a particular mode of user interaction; determining, by the multimodal browser, user output for the user in dependence upon the user input; determining, by the multimodal browser, a style for the user output in dependence upon the user input, the style specifying expressive output characteristics for at least one other mode of user interaction; and rendering, by the multimodal browser, the user output in dependence upon the style, wherein determining the style for the user output in dependence upon the user input comprises performing a determination distinct from determining the user output, wherein determining, by the multimodal browser, a style for the user output in dependence upon the user input comprises determining, by the multimodal browser, a style for the user output in dependence upon meaning of the user input. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8)
-
-
9. Apparatus for providing expressive user interaction with a multimodal application, the multimodal application operating in a multimodal browser on a multimodal device supporting multiple modes of user interaction including a voice mode and one or more non-voice modes, the multimodal application operatively coupled to a speech engine through a VoiceXML interpreter, the apparatus comprising a computer processor and a computer memory operatively coupled to the computer processor, the computer memory having stored within it computer program instructions which, when executed by the computer processor, cause performance of a method comprising:
-
receiving, by the multimodal browser, user input from a user through a particular mode of user interaction; determining, by the multimodal browser, user output for the user in dependence upon the user input; determining, by the multimodal browser, a style for the user output in dependence upon the user input, the style specifying expressive output characteristics for at least one other mode of user interaction; and rendering, by the multimodal browser, the user output in dependence upon the style, wherein determining the style for the user output in dependence upon the user input comprises performing a determination distinct from determining the user output, wherein determining, by the multimodal browser, a style for the user output in dependence upon the user input comprises determining, by the multimodal browser, a style for the user output in dependence upon meaning of the user input. - View Dependent Claims (10, 11, 12, 13, 14)
-
-
15. A computer-recordable device storing computer program instructions for providing expressive user interaction with a multimodal application, the multimodal application operating in a multimodal browser on a multimodal device supporting multiple modes of user interaction including a voice mode and one or more non-voice modes, the multimodal application operatively coupled to a speech engine through a VoiceXML interpreter, wherein the computer program instructions, when executed, cause performance of a method comprising:
-
receiving, by the multimodal browser, user input from a user through a particular mode of user interaction; determining, by the multimodal browser, user output for the user in dependence upon the user input; determining, by the multimodal browser, a style for the user output in dependence upon the user input, the style specifying expressive output characteristics for at least one other mode of user interaction; and rendering, by the multimodal browser, the user output in dependence upon the style, wherein determining the style for the user output in dependence upon the user input comprises performing a determination distinct from determining the user output, wherein determining, by the multimodal browser, a style for the user output in dependence upon the user input comprises determining, by the multimodal browser, a style for the user output in dependence upon meaning of the user input. - View Dependent Claims (16, 17, 18, 19, 20)
-
Specification