Methods and Systems for Authoring of Mixed-Initiative Multi-Modal Interactions and Related Browsing Mechanisms
First Claim
Patent Images
1. A conversational browser apparatus for providing access to an application by a user, the apparatus comprising:
- an interaction manager;
at least one modality based browser operatively coupled to the interaction manager, the modality based browser being a voice-based browser; and
a dialog manager operatively coupled to the interaction manager;
wherein interaction between the user, the interaction manager, the voice-based browser and the the dialog manager comprises;
(i) the interaction manager obtains the application from a server in response to a user request, and passes a representation of the application to the dialog manger;
(ii) the dialog manager determines at least one of a focus of the application and an intent of the user in accordance with the representation of the application, and informs the interaction manager of at least one of the focus of the application and the intent of the user; and
(iii) the interaction manager then designates a particular portion of the application for presentation to the user in accordance with the voice-based browser based on the determination of at least one of the focus of the application and the intent of the user, the portion comprising at least a prompt and an input field, wherein the prompt is presented to the user and the input field specifies user input receivable in response to the prompt for use in redetermining at least one of the focus of the application and the intent of the user.
0 Assignments
0 Petitions
Accused Products
Abstract
Application authoring techniques, and information browsing mechanisms associated therewith, which employ programming in association with mixed-initiative multi-modal interactions and natural language understanding for use in dialog systems. Also, a conversational browsing architecture is provided for use with these and other authoring techniques.
-
Citations
16 Claims
-
1. A conversational browser apparatus for providing access to an application by a user, the apparatus comprising:
-
an interaction manager;
at least one modality based browser operatively coupled to the interaction manager, the modality based browser being a voice-based browser; and
a dialog manager operatively coupled to the interaction manager;
wherein interaction between the user, the interaction manager, the voice-based browser and the the dialog manager comprises;
(i) the interaction manager obtains the application from a server in response to a user request, and passes a representation of the application to the dialog manger;
(ii) the dialog manager determines at least one of a focus of the application and an intent of the user in accordance with the representation of the application, and informs the interaction manager of at least one of the focus of the application and the intent of the user; and
(iii) the interaction manager then designates a particular portion of the application for presentation to the user in accordance with the voice-based browser based on the determination of at least one of the focus of the application and the intent of the user, the portion comprising at least a prompt and an input field, wherein the prompt is presented to the user and the input field specifies user input receivable in response to the prompt for use in redetermining at least one of the focus of the application and the intent of the user. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14)
-
-
15. A conversational browser apparatus for providing access to an application by a user, the apparatus comprising:
-
an interaction manager function;
at least one modality based browser function operatively coupled to the interaction manager function; and
a dialog manager function operatively coupled to the interaction manager function;
wherein interaction between the user, the interaction manager, the browser and the the dialog manager functions comprises;
(i) the interaction manager obtains the application from a server in response to a user request, the application representing interactions that the user may have with the application as a data model and one or more user interaction elements that populate an application state of the data model and that are bound thereto;
(ii) the dialog manager receives attribute value pairs generated from user input and processes the attribute value pairs to populate the data model and determine a next interaction focus; and
(iii) upon determination of the next interaction focus by the dialog manager, the application state and context are updated and an output is generated by the interaction manager and provided to the user for interaction via the browser.
-
-
16. A method of authoring an application accessible by a user in accordance with a conversational browser, the method comprising the steps of:
-
an interaction manager of the conversational browser obtaining the application from a server in response to a user request, the application representing interactions that the user may have with the application as a data model and one or more user interaction elements that populate an application state of the data model and that are bound thereto;
a dialog manager of the conversational browser receiving attribute value pairs generated from user input and processing the attribute value pairs to populate the data model and determine a next interaction focus; and
upon determination of the next interaction focus by the dialog manager, the application state and context being updated and an output being generated by the interaction manager and provided to the user for interaction via a browsing mechanism of the conversational browser.
-
Specification