Methods and systems for authoring of mixed-initiative multi-modal interactions and related browsing mechanisms
First Claim
Patent Images
1. A method of generating an application accessible by a user in accordance with a dialog system, the method comprising the steps of:
- representing interactions that the user may have with the dialog system as a data model and one or more user interaction elements that populate an application state of the data model and that are bound thereto, such that a dialog that the user has with the dialog system may be a mixed-initiative dialog;
wherein at least a portion of the one or more user interaction elements can be transformed or associated to one or more modality-specific renderings of the application which are presentable to the user and are one of selected and generated by a dialog manager algorithm.
1 Assignment
0 Petitions
Accused Products
Abstract
Application authoring techniques, and information browsing mechanisms associated therewith, which employ programming in association with mixed-initiative multi-modal interactions and natural language understanding for use in dialog systems. Also, a conversational browsing architecture is provided for use with these and other authoring techniques.
-
Citations
96 Claims
-
1. A method of generating an application accessible by a user in accordance with a dialog system, the method comprising the steps of:
-
representing interactions that the user may have with the dialog system as a data model and one or more user interaction elements that populate an application state of the data model and that are bound thereto, such that a dialog that the user has with the dialog system may be a mixed-initiative dialog;
wherein at least a portion of the one or more user interaction elements can be transformed or associated to one or more modality-specific renderings of the application which are presentable to the user and are one of selected and generated by a dialog manager algorithm. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36)
-
-
37. A dialog system for providing access to an application by a user, the dialog system comprising:
-
one or more processors operable to;
(i) obtain the application from an application server, the application representing interactions that the user may have with the dialog system as a data model and one or more user interaction elements that populate an application state of the data model and that are bound thereto, such that a dialog that the user has with the dialog system may be a mixed-initiative dialog; and
(ii) one of transforming and associating at least a portion of the one or more user interaction elements to one or more modality-specific renderings which are one of generated and selected by a dialog manager algorithm; and
memory, operatively coupled to the one or more processors, for storing at least a portion of results associated with at least one of the obtaining, transforming and associating operations.
-
-
38. A conversational browser apparatus for providing access to an application by a user, the apparatus comprising:
-
an interaction manager;
at least one modality based browser operatively coupled to the interaction manager, the modality based browser being a voice-based browser; and
a dialog manager operatively coupled to the interaction manager;
wherein interaction between the user, the interaction manager, the voice-based browser and the the dialog manager comprises;
(i) the interaction manager obtains the application from a server in response to a user request, and passes a representation of the application to the dialog manger;
(ii) the dialog manager determines at least one of a focus of the application and an intent of the user in accordance with the representation of the application, and informs the interaction manager of at least one of the focus of the application and the intent of the user; and
(iii) the interaction manager then designates a particular portion of the application for presentation to the user in accordance with the voice-based browser based on the determination of at least one of the focus of the application and the intent of the user, the portion comprising at least a prompt and an input field, wherein the prompt is presented to the user and the input field specifies user input receivable in response to the prompt for use in redetermining at least one of the focus of the application and the intent of the user. - View Dependent Claims (39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73)
-
-
74. A conversational browser apparatus for providing access to an application by a user, the apparatus comprising:
-
an interaction manager function;
at least one modality based browser function operatively coupled to the interaction manager function; and
a dialog manager function operatively coupled to the interaction manager function;
wherein interaction between the user, the interaction manager, the browser and the the dialog manager functions comprises;
(i) the interaction manager obtains the application from a server in response to a user request, the application representing interactions that the user may have with the application as a data model and one or more user interaction elements that populate an application state of the data model and that are bound thereto;
(ii) the dialog manager receives attribute value pairs generated from user input and processes the attribute value pairs to populate the data model and determine a next interaction focus; and
(iii) upon determination of the next interaction focus by the dialog manager, the application state and context are updated and an output is generated by the interaction manager and provided to the user for interaction via the browser. - View Dependent Claims (75, 76, 77, 78, 79, 80, 81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94)
-
-
95. A method of authoring an application accessible by a user in accordance with a conversational browser, the method comprising the steps of:
-
an interaction manager of the conversational browser obtaining the application from a server in response to a user request, the application representing interactions that the user may have with the application as a data model and one or more user interaction elements that populate an application state of the data model and that are bound thereto;
a dialog manager of the conversational browser receiving attribute value pairs generated from user input and processing the attribute value pairs to populate the data model and determine a next interaction focus; and
upon determination of the next interaction focus by the dialog manager, the application state and context being updated and an output being generated by the interaction manager and provided to the user for interaction via a browsing mechanism of the conversational browser.
-
-
96. An article of manufacture comprising a machine readable medium containing one or more programs which when executed implement the steps of:
-
representing interactions that the user may have with a dialog system as a data model and one or more user interaction elements that populate an application state of the data model and that are bound thereto, such that a dialog that the user has with the dialog system may be a mixed-initiative dialog;
wherein at least a portion of the one or more user interaction elements can be transformed or associated to one or more modality-specific renderings associated with the representation which are presentable to the user and are one of selected and generated by a dialog manager algorithm.
-
Specification