Method and system for integrating multi-modal data capture device inputs with multi-modal output capabilities
First Claim
Patent Images
1. A system for executing a multimodal software application, comprising:
- the multimodal software application, wherein said multimodal software application is configured to receive first data input from a first set of peripheral devices and output second data to a second set of peripheral devices;
a dialog engine in communication with the multimodal software application, wherein said dialog engine is configured to execute a workflow description related to the multimodal software application and provide the first data to the multimodal software application; and
a respective interface component associated with each peripheral device within said first and second sets;
wherein each interface component is configured to provide the second data, if any, to the associated peripheral device and receive the first data, if any, from the associated peripheral device.
4 Assignments
0 Petitions
Accused Products
Abstract
A dialog engine includes methods for integrating multi-modal data capture device inputs with multimodal output capabilities in which a work flow description is extracted from objects in a graphical user interface and a multi-modal user interface is defined. The dialog engine synchronizes the flow of information, in accordance with the work flow description, between input/output devices and an application.
-
Citations
49 Claims
-
1. A system for executing a multimodal software application, comprising:
-
the multimodal software application, wherein said multimodal software application is configured to receive first data input from a first set of peripheral devices and output second data to a second set of peripheral devices;
a dialog engine in communication with the multimodal software application, wherein said dialog engine is configured to execute a workflow description related to the multimodal software application and provide the first data to the multimodal software application; and
a respective interface component associated with each peripheral device within said first and second sets;
wherein each interface component is configured to provide the second data, if any, to the associated peripheral device and receive the first data, if any, from the associated peripheral device. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15)
-
-
16. A system for executing a multimodal software application comprising:
-
a dialog engine in communication with a) the multimodal software application, b) a first set of peripheral devices for receiving first data, and c) a second set of peripheral devices for outputting second data; and
said dialog engine configured to execute a workflow description related to the multimodal software application, wherein executing the workflow description includes generating the second data from the workflow description and providing the first data to the multimodal software application. - View Dependent Claims (17, 18, 19, 20, 21, 22)
-
-
23. A method for developing multimodal software applications, said method comprises the steps of:
-
a) receiving a portion of code implementing a first visual control within a screen of a graphical user interface;
b) generating a corresponding dialog unit based on the portion of code; and
c) creating a link between the corresponding dialog unit and another dialog unit associated with a second visual control within the screen. - View Dependent Claims (24, 25, 26, 27, 28, 29, 30, 31, 32, 33)
-
-
34. A method for executing a multimodal software application having a graphical user interface with a screen, the method comprising the steps of:
-
receiving a workflow description corresponding to the screen, and executing the workflow description in synchronization with the graphical user interface. - View Dependent Claims (35, 36, 37, 38, 39, 40, 41)
-
-
42. A system for developing a multimodal application comprising:
-
a code extractor configured to analyze a portion of code implementing a visual control within a screen of a graphical user interface;
a dialog creator, in communication with the code extractor, configured to generate a workflow object based on the analysis of the portion of code; and
a linker configured to generate a link to another workflow object, said link being a portion of the workflow object. - View Dependent Claims (43, 44, 45, 46, 47)
-
-
48. A computer-readable medium bearing instructions for executing a multimodal software application having a graphical user interface with a screen, said instructions being arranged, upon execution thereof, to cause one or more processors to perform the steps of:
-
receiving a workflow description corresponding to the screen, and executing the workflow description in synchronization with the graphical user interface.
-
-
49. A computer-readable medium bearing instructions for developing multimodal software applications, said instructions being arranged, upon execution thereof, to cause one or more processors to perform the steps of:
-
receiving a portion of code implementing a first visual control within a screen of a graphical user interface;
generating a corresponding dialog unit based on the portion of code; and
creating a link between the corresponding dialog unit and another dialog unit associated with a second visual control within the screen.
-
Specification