Context-sensitive interface widgets for multi-modal dialog systems
First Claim
1. In a multi-modal dialog system, a method of providing widgets to a user, comprising, after first user input received in a combination of a first mode and a second mode in a map-based application, and where further user input will clarify the first user input during a multi-modal dialog:
- maintaining a current display screen context by only presenting additional data on a display in response to the first user input until further user input is received via interaction with the additional data that clarifies the further user input;
maintaining a current dialog context;
presenting speech to the user requesting the further user input to clarify the first user input; and
presenting the slider widget in a corner of the display screen to elicit the first user input as directed by the presented speech, wherein the further user input is received via the widget in a non-speech mode and provides distance range data that is shown on the display screen as the slider widget is adjusted by the further user input.
4 Assignments
0 Petitions
Accused Products
Abstract
A system and method of presenting widgets to a user during a multi-modal interactive dialog between a user and a computer is presented. The system controls the multi-modal dialog; and when user input would help to clarify or speed up the presentation of requested information, the system presents a temporary widget to the user to elicit the user input in this regard. The system presents the widget on a display screen at a position that will not interfere with the dialog. Various types of widgets are available, such as button widgets, sliders and confirmation widgets, depending on the type of information that the system requires.
108 Citations
20 Claims
-
1. In a multi-modal dialog system, a method of providing widgets to a user, comprising, after first user input received in a combination of a first mode and a second mode in a map-based application, and where further user input will clarify the first user input during a multi-modal dialog:
-
maintaining a current display screen context by only presenting additional data on a display in response to the first user input until further user input is received via interaction with the additional data that clarifies the further user input; maintaining a current dialog context; presenting speech to the user requesting the further user input to clarify the first user input; and presenting the slider widget in a corner of the display screen to elicit the first user input as directed by the presented speech, wherein the further user input is received via the widget in a non-speech mode and provides distance range data that is shown on the display screen as the slider widget is adjusted by the further user input. - View Dependent Claims (2, 3, 4, 5, 6)
-
-
7. A method of temporarily providing one of a plurality of widgets to a user in the course of a multi-modal dialog with a computer device in a map-based application, the method comprising:
-
after first user input received in a combination of a first mode and a second mode, determining whether further user input would be advantageous before the computer device presents information to the user; if further user input would be advantageous, selecting a widget from a plurality of widgets to yield a selected widget, the selected widget being associated with the further user input; maintaining a current display screen context by only presenting additional data on a display in response to the first user input until further user input is received via user interaction with the additional data that clarifies the further user input; maintaining a current dialog context; presenting speech to the user requesting the further user input to clarify the first user input; and presenting the selected widget in a corner of the display for receiving the further user input as directed by the presented speech, wherein the further user input is received in a non-speech mode and provides distance range data that is shown on the display screen as the selected widget is adjusted by the further user input. - View Dependent Claims (8, 9, 10)
-
-
11. A multi-modal dialog system presenting a map-based application comprising:
-
a multi-modal interface module that receives multi-modal input from a user received in a combination of a first mode and a second mode and provides multi-modal information to the user; a module that maintains a current dialog screen context by only presenting additional data on a display in response to the multimodal input until further user input is received via user interaction with the additional data that clarifies the multimodal input; and a widget control module that dynamically presents the slider widget on the display screen to facilitate a multi-modal dialog between the user and the multi-modal dialog system, the slider widget receiving further user input in a third mode, the further user input clarifying the first user input and providing distance range data that is shown on the display screen as the slider widget is adjusted by the further user input. - View Dependent Claims (12, 13, 14, 15, 16, 17, 18, 19, 20)
-
Specification