ESTABLISHING A PREFERRED MODE OF INTERACTION BETWEEN A USER AND A MULTIMODAL APPLICATION

• US 20120151326A1
• Filed: 02/14/2012
• Published: 06/14/2012
• Est. Priority Date: 09/11/2006
• Status: Active Grant

• Current Assignee: Nuance Communications, Inc. (Microsoft Corporation)
• Original Assignee: Nuance Communications, Inc. (Microsoft Corporation)
• Inventors: Cross, Charles W. Jr., Pike, Hilary A.
• Granted Patent: US 8,494,858 B2
• Time in Patent Office: Days
• US Class Current: 715/234
• CPC Class Codes: G06F 3/0484 for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
• CPC Class Codes: G06F 3/16 Sound input; Sound output speech processing G10L
• CPC Class Codes: G06F 9/451 Execution arrangements for user interfaces
• CPC Class Codes: G10L 15/22 Procedures used during a speech recognition process, e.g. man-machine dialogue
• CPC Class Codes: H04M 3/42153 by subscriber
• CPC Class Codes: H04M 3/4936 Speech interaction details speech recognition per se G10L15/00
• CPC Class Codes: H04M 3/4938 comprising a voice browser which renders and interprets, e.g. VoiceXML
• CPC Class Codes: H04N 21/4126 The peripheral being portable, e.g. PDAs or mobile phones

Abstract

Establishing a preferred mode of interaction between a user and a multimodal application, including evaluating, by a multimodal application operating on a multimodal device supporting multiple modes of interaction including a voice mode and one or more non-voice modes, user modal preference, and dynamically configuring multimodal content of the multimodal application in dependence upon the evaluation of user modal preference.

Claims

1-20. -20. (canceled)

21. A method of establishing a preferred mode of interaction between a user and a multimodal application, the method comprising:

evaluating, with at least one processor of a multimodal device comprising a multimodal application supporting multiple modes of interaction including a voice mode and one or more non-voice modes, a user modal preference, wherein evaluating the user modal preference comprises identifying a mode of interaction used by the user in at least one previous interaction with at least one web page presented by the multimodal application and evaluating the user modal preference based, at least in part, on the identified mode of interaction; and

dynamically configuring, with the at least one processor, multimodal content of the multimodal application in dependence on the user modal preference.

22. The method of claim 21, wherein evaluating the user modal preference further comprises selecting the user modal preference as the identified mode of interaction.

23. The method of claim 21, wherein the multimodal application comprises a set of multimodal application markup documents organized in a sequence of presentation, and wherein dynamically configuring multimodal content of the multimodal application further comprises altering the sequence of presentation.

24. The method of claim 21, wherein the multimodal application comprises a plurality of static markup documents, wherein the plurality of static markup documents comprise documents having different proportions of support for voice mode and non-voice modes,

wherein dynamically configuring multimodal content of the multimodal application comprises selecting from among the plurality of static markup documents, in dependence upon the value of the user modal preference, a markup document for presentation to a user as part of the multimodal application.

25. The method of claim 21, wherein the multimodal application specifies a dynamic server page capable of generating the static markup documents of the multimodal application that include varying proportions of support for voice mode and non-voice modes,

wherein dynamically configuring multimodal content of the multimodal application further comprises generating by the dynamic server page a static markup document for presentation to a user as part of the multimodal application, the static markup document characterized by proportions of support for voice and non-voice modes established by the dynamic server page in dependence upon the value of the user modal preference.

26. The method of claim 21, further comprising:

receiving a configuration value indicating the user modal preference; and

storing the configuration value;

wherein identifying a mode of interaction used by the user in at least one previous interaction with at least one web page presented by the multimodal application comprises retrieving the stored configuration value.

27. An apparatus for establishing a preferred mode of interaction between a user and a multimodal application, the apparatus comprising:

at least one computer processor; and

at least one computer memory operatively coupled to the at least one computer processor, the at least one computer memory storing computer program instructions, that when executed by the at least one computer processor perform a method comprising;

evaluating, by a multimodal application operating on a multimodal device supporting multiple modes of interaction including a voice mode and one or more non-voice modes, a user modal preference, wherein evaluating the user modal preference comprises identifying a mode of interaction used by the user in at least one previous interaction with at least one web page presented by the multimodal application and evaluating the user modal preference based, at least in part, on the identified mode of interaction; and

dynamically configuring with the at least one computer processor, multimodal content of the multimodal application in dependence on the user modal preference.

28. The apparatus of claim 27, wherein evaluating the user modal preference method further comprises selecting the user modal preference as the identified mode of interaction.

29. The apparatus of claim 27, wherein the multimodal application comprises a set of multimodal application markup documents organized in a sequence of presentation, and wherein dynamically configuring multimodal content of the multimodal application further comprises altering the sequence of presentation.

30. The apparatus of claim 27, wherein the multimodal application comprises a plurality of static markup documents, wherein the plurality of static markup documents comprise documents having different proportions of support for voice mode and non-voice modes,

wherein dynamically configuring multimodal content of the multimodal application comprises selecting from among the plurality of static markup documents, in dependence upon the value of the user modal preference, a markup document for presentation to a user as part of the multimodal application.

31. The apparatus of claim 27, wherein the multimodal application specifies a dynamic server page capable of generating static markup documents of the multimodal application that include varying proportions of support for voice mode and non-voice modes;

wherein dynamically configuring multimodal content of the multimodal application further comprises generating by the dynamic server page a static markup document for presentation to a user as part of the multimodal application, the static markup document characterized by proportions of support for voice and non-voice modes established by the dynamic server page in dependence upon the value of the user modal preference.

32. The apparatus of claim 27, wherein the method further comprises:

receiving a configuration value indicating the user modal preference; and

storing the configuration value;

wherein identifying a mode of interaction used by the user in at least one previous interaction with at least one web page presented by the multimodal application comprises retrieving the stored configuration value.

33. A non-transitory computer-readable medium encoded with computer program instructions that, when executed by a computer, perform a method of establishing a preferred mode of interaction between a user and a multimodal application, the method comprising:

evaluating, by the multimodal application operating on a multimodal device supporting multiple modes of interaction including a voice mode and one or more non-voice modes, a user modal preference, wherein evaluating the user modal preference comprises identifying a mode of interaction used by the user in at least one previous interaction with at least one web page presented by the multimodal application and evaluating the user modal preference based, at least in part, on the identified mode of interaction; and

dynamically configuring multimodal content of the multimodal application in dependence on the user modal preference.

34. The computer-readable medium of claim 33, wherein the multimodal application comprises a plurality of static markup documents, wherein the plurality of static markup documents comprises documents having different proportions of support for voice mode and non-voice modes,

wherein dynamically configuring multimodal content of the multimodal application further comprises selecting among the plurality of static markup documents, in dependence upon the value of the user modal preference, a markup document for presentation to a user as part of the multimodal application.

35. The computer-readable medium of claim 33, wherein the multimodal application specifies a dynamic server page capable of generating static markup documents of the multimodal application that include varying proportions of support for voice mode and non-voice modes;

wherein dynamically configuring multimodal content of the multimodal application further comprises generating by the dynamic server page a static markup document for presentation to a user as part of the multimodal application, the static markup document characterized by proportions of support for voice and non-voice modes established by the dynamic server page in dependence upon the value of the user modal preference.

36. The computer-readable medium of claim 33, wherein the method further comprises selecting the user modal preference as the identified mode of interaction.

37. The computer-readable medium of claim 33 wherein the multimodal application comprises a set of multimodal application markup documents organized in a sequence of presentation, and wherein dynamically configuring multimodal content of the multimodal application further comprises altering the sequence of presentation.

38. The computer-readable medium of claim 33, wherein the method further comprises:

receiving a configuration value indicating the user modal preference; and

storing the configuration value;

wherein identifying a mode of interaction used by the user in at least one previous interaction with at least one web page presented by the multimodal application comprises retrieving the stored configuration value.