System and method of context-sensitive help for multi-modal dialog systems
First Claim
1. In a multi-modal dialog system, a method of presenting a multi-modal help dialog move to a user, comprising:
- analyzing a current dialog state with the user, including a visual context, to determine whether presenting a multi-modal help dialog move to the user is appropriate;
if the multi-modal dialog system determines that it is appropriate to present a multi-modal help dialog move;
presenting the multi-modal help dialog move having an audio portion and a graphical portion that utilize the visual context of the current dialog state with the user.
14 Assignments
0 Petitions
Accused Products
Abstract
A method of presenting a multi-modal help dialog move to a user in a multi-modal dialog system is disclosed. The method comprises presenting an audio portion of the multi-modal help dialog move that explains available ways of user inquiry and presenting a corresponding graphical action performed on a user interface associated with the audio portion. The multi-modal help dialog move is context-sensitive and uses current display information and dialog contextual information to present a multi-modal help move that is currently related to the user. A user request or a problematic dialog detection module may trigger the multi-modal help move.
24 Citations
21 Claims
-
1. In a multi-modal dialog system, a method of presenting a multi-modal help dialog move to a user, comprising:
-
analyzing a current dialog state with the user, including a visual context, to determine whether presenting a multi-modal help dialog move to the user is appropriate; if the multi-modal dialog system determines that it is appropriate to present a multi-modal help dialog move; presenting the multi-modal help dialog move having an audio portion and a graphical portion that utilize the visual context of the current dialog state with the user. - View Dependent Claims (2, 3, 4)
-
-
5. In a multi-modal dialog system, a method of presenting a multi-modal help dialog move to a user, comprising:
upon a user request or triggered by a problematic dialog situation detector, presenting the multi-modal help dialog move having an audio portion and a graphical portion that utilize a visual context of the current dialog state with the user, wherein the multi-modal help dialog move provides information to the user regarding how to interact with the system in a multi-modal fashion. - View Dependent Claims (6, 7)
-
8. In a multi-modal dialog system using a map display having an entity of interest thereon, a method of presenting a multi-modal help dialog move to a user, comprising:
when an entity of interest is currently being displayed to the user; presenting a multi-modal help dialog move having an audio portion and a graphical portion, the audio portion stating a plurality of types of information available to the user associated with the entity of interest, and the graphical portion corresponding to the audio portion. - View Dependent Claims (9, 10)
-
11. A method of assisting a user to interact with a system having a multi-modal interface, the method comprising:
-
analyzing a multi-modal dialog for problematic situations; and upon determining that help is needed, presenting to the user a multi-modal dialog help move having an audio portion and a graphical portion, the multi-modal dialog help move audibly explaining the user available multi-modal actions the user can take to obtain information while providing corresponding graphics demonstrating the kind of graphic input the user can make to obtain the information. - View Dependent Claims (12, 13)
-
-
14. In a multi-modal dialog system using a map display having a plurality of entities of interest thereon, a method of presenting a multi-modal help dialog move to a user, comprising:
-
selecting an entity of interest from the plurality of entities of interest currently displayed to the user; and presenting a multi-modal help dialog move having an audio portion and a graphical portion, the audio portion stating a plurality of types of information available to the user associated with the selected entity of interest, and the graphical portion being associated with the audio portion.
-
-
15. A computing device that provide a multi-modal interface for a user, the computing device comprising:
-
a module configured to analyze a current dialog state with the user, including a visual context, to determine whether presenting a multi-modal help dialog move to the user is appropriate; and a module configured to present a multi-modal dialog move having an audio potion and a graphical portion that utilize the visual context of the current dialog state with the user if the module configured to analyze the current dialog state determines it is appropriate. - View Dependent Claims (16, 17, 18)
-
-
19. A computing device having a multi-modal interface, the computing device comprising:
-
module configured to analyze a multi-modal dialog for problematic situations and a module configured, upon determining that help is needed, to present the user a multi-modal dialog help move having an audio portion and a graphical portion, the multi-modal dialog help move audibly explaining the user available multi-modal actions the user can take to obtain information while providing corresponding graphics demonstrating the kind of graphic input the user can make to obtain the information. - View Dependent Claims (20, 21)
-
Specification