System for Factoring Synchronization Strategies From Multimodal Programming Model Runtimes
First Claim
1. A factored multimodal interaction architecture for a distributed computing system, said distributed computing system including a plurality of client browsers and at least one multimodal application server that can interact with said clients by means of a plurality of interaction modalities, said architecture comprising:
- an interaction manager with a multimodal interface, wherein said interaction manager can receive a client request for a multimodal application in one interaction modality and transmit said client request in another modality; and
one or more pluggable synchronization modules, wherein each synchronization module implements one of the plurality of interaction modalities between one of the plurality of clients and the server so that a synchronization module for an interaction modality mediates communication between the client and the multimodal interface of the interaction manager.
0 Assignments
0 Petitions
Accused Products
Abstract
A factored multimodal interaction architecture for a distributed computing system is disclosed. The distributed computing system includes a plurality of clients and at least one application server that can interact with the clients via a plurality of interaction modalities. The factored architecture includes an interaction manager with a multimodal interface, wherein the interaction manager can receive a client request for a multimodal application in one interaction modality and transmit the client request in another modality, a browser adapter for each client browser, where each browser adapter includes the multimodal interface, and one or more pluggable synchronization modules. Each synchronization module implements one of the plurality of interaction modalities between one of the plurality of clients and the server such that the synchronization module for an interaction modality mediates communication between the multimodal interface of the client browser adapter and the multimodal interface of the interaction manager.
35 Citations
19 Claims
-
1. A factored multimodal interaction architecture for a distributed computing system, said distributed computing system including a plurality of client browsers and at least one multimodal application server that can interact with said clients by means of a plurality of interaction modalities, said architecture comprising:
-
an interaction manager with a multimodal interface, wherein said interaction manager can receive a client request for a multimodal application in one interaction modality and transmit said client request in another modality; and one or more pluggable synchronization modules, wherein each synchronization module implements one of the plurality of interaction modalities between one of the plurality of clients and the server so that a synchronization module for an interaction modality mediates communication between the client and the multimodal interface of the interaction manager. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10)
-
-
11. A factored multimodal interaction architecture for a distributed computing system, said distributed computing system including a plurality of clients and at least one application server that can interact with said clients by means of a plurality of interaction modalities, said architecture comprising:
-
a servlet filter that can intercept a client request for a multimodal application; an interaction manager with a multimodal interface, wherein said interaction manager can receive said client request for a multimodal application in one interaction modality and transmit said client request in another modality; a browser adapter for each client browser, each said browser adapter including the multimodal interface, wherein the multimodal interface of a client browser adapter and the multimodal interface of the interaction manager can communicate via a plurality of multimodal messages, and wherein each browser adapter includes a synchronization proxy for encoding said multimodal messages in an internet communication protocol; and one or more pluggable synchronization modules, wherein each synchronization module implements one of the plurality of interaction modalities between one of the plurality of clients and the server so that a synchronization module can receive events and send commands over an interaction modality channel between the multimodal interface of the client browser adapter and the multimodal interface of the interaction manager, wherein said servlet filter can pass a library of synchronization modules to the interaction manager, wherein the interaction manager can select and instantiate a synchronization module appropriate for the client request from the library of synchronization modules to implement an exchange of multimodal messages between the multimodal interface of the client browser adapter and the multimodal interface of the interaction manager. - View Dependent Claims (12, 13, 14, 15)
-
-
16. A factored multimodal interaction architecture for a distributed computing system, said distributed computing system including a plurality of clients and at least one application server that can interact with said clients by means of a plurality of interaction modalities, said architecture comprising:
-
a servlet filter that can intercept a client request for a multimodal application; an interaction manager with a multimodal interface, wherein said interaction manager can receive said client request for a multimodal application in one interaction modality and transmit said client request in another modality, said interaction manager being a state machine having an associated state, a loaded state, a ready state, and a not-associated state; a browser adapter for each client browser, each said browser adapter including the multimodal interface, wherein the multimodal interface of a client browser adapter and the multimodal interface of the interaction manager can communicate via a plurality of multimodal messages, and wherein each browser adapter includes a synchronization proxy for encoding said multimodal messages in an internet communication protocol, said client browser adapter being a state machine having an associated state, a loading state, a loaded state, and a ready state; one or more pluggable synchronization modules, wherein each synchronization module implements one of the plurality of interaction modalities between one of the plurality of clients and the server so that a synchronization module can receive events and send commands over an interaction modality channel between the multimodal interface of the client browser adapter and the multimodal interface of the interaction manager, each said synchronization module being a state machine having an instantiated state, a loaded state, a ready state, and a stale state; an event control interface, by which a client browser adapter or the interaction manager can register or remove an event listener, or dispatch an event to another client browser adapter or to the interaction manager; a command control interface by which a client browser adapter or the interaction manager can modify the state of another a client browser adapter by issuing a synchronization command; and an event listener interface that can provide an event handler to a client browser adapter or the interaction manager, wherein said servlet filter can pass a library of synchronization modules to the interaction manager, wherein the interaction manager can select and instantiate a synchronization module appropriate for the client request from the library of synchronization modules to implement an exchange of multimodal messages between the multimodal interface of the client browser adapter and the multimodal interface of the interaction manager. - View Dependent Claims (17, 18, 19)
-
Specification