Method and system for intelligent prompt control in a multimodal software application
First Claim
1. A system for executing a multimodal software application, comprising:
- the multimodal software application, wherein said multimodal software application is configured to receive first data input from a first set of peripheral devices and output second data to a second set of peripheral devices;
a dialog engine in communication with the multimodal software application, wherein said dialog engine is configured to execute a workflow description received from the multimodal software application and provide the first data to the multimodal software application;
said dialog engine further configured to control outputting of a prompt from the workflow description based on an input state of the first set of peripheral devices; and
a respective interface component associated with each peripheral device within said first and second sets;
wherein each interface component is configured to provide the second data, if any, to the associated peripheral device and receive the first data, if any, from the associated peripheral device.
4 Assignments
0 Petitions
Accused Products
Abstract
Dialog manager and methods for integrating multi-modal data capture device inputs or speech recognition inputs with speech output capabilities. A work flow description is extracted from objects in a graphical user interface and a multi-modal user interface is defined. A dialog engine synchronizes the flow of information, in accordance with the work flow description, between input/output devices and an application. The prompts for inputting data, which are output via a plurality of peripheral devices, are controlled in an intelligent manner by the dialog engine based on the input state of the peripheral devices. Functionality such as barge-in, prompt-holdoff, priority prompts, and talk-ahead is provided.
-
Citations
25 Claims
-
1. A system for executing a multimodal software application, comprising:
-
the multimodal software application, wherein said multimodal software application is configured to receive first data input from a first set of peripheral devices and output second data to a second set of peripheral devices;
a dialog engine in communication with the multimodal software application, wherein said dialog engine is configured to execute a workflow description received from the multimodal software application and provide the first data to the multimodal software application;
said dialog engine further configured to control outputting of a prompt from the workflow description based on an input state of the first set of peripheral devices; and
a respective interface component associated with each peripheral device within said first and second sets;
wherein each interface component is configured to provide the second data, if any, to the associated peripheral device and receive the first data, if any, from the associated peripheral device. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8)
-
-
9. A method for executing a multimodal application, comprising the steps of:
-
executing a workflow description received from the multimodal application, said workflow description including a plurality of workflow objects;
outputting a prompt of a first workflow object via a plurality of peripheral devices, said prompt related to the multimodal application; and
controlling the outputting of the prompt according to an input state of the plurality of peripheral devices. - View Dependent Claims (10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21)
-
-
22. A computer-readable medium bearing instructions for executing a multimodal application, said instructions being arranged, upon execution thereof, to cause one or more processors to perform the steps of:
-
executing a workflow description received from the multimodal application, said workflow description including a plurality of workflow objects;
outputting a prompt of a first workflow object via a plurality of peripheral devices, said prompt related to a visual control of a GUI screen of the multimodal application; and
controlling the outputting of the prompt according to an input state of the plurality of peripheral devices. - View Dependent Claims (23, 24, 25)
-
Specification