Managing application interactions using distributed modality components
First Claim
Patent Images
1. A modality component server for managing distributed multimodal interactions comprising:
- a modality activator configured to dynamically activate at least one modality component responsive to an occurrence of an application event initiated by a multimodal application from a client device and connect said activated modality component to said client device, and to disconnect the activated modality component from the client device and deactivate the modality component upon completion of an interaction response; and
a multimodal engine including an inference engine, and a shared memory area for storing a set of activation conditions registered by each modality component, wherein the set of activation conditions defines how the modality component is activated, and how input and output between the modality component and the client device is started and stopped, wherein the modality component is activated whenever one of the set of activation conditions is detected, and wherein activation conditions are added or removed by an application module, said multimodal engine being configured to detect an interaction and to responsively initiate an interaction response by comparing activation conditions submitted by the multimodal application with the stored activation conditions in the shared memory area, wherein said interaction and said interaction response have been specified by a previously registered modality component.
2 Assignments
0 Petitions
Accused Products
Abstract
A method for managing multimodal interactions can include the step of registering a multitude of modality components with a modality component server, wherein each modality component handles an interface modality for an application. The modality component can be connected to a device. A user interaction can be conveyed from the device to the modality component for processing. Results from the user interaction can be placed on a shared memory are of the modality component server.
-
Citations
12 Claims
-
1. A modality component server for managing distributed multimodal interactions comprising:
-
a modality activator configured to dynamically activate at least one modality component responsive to an occurrence of an application event initiated by a multimodal application from a client device and connect said activated modality component to said client device, and to disconnect the activated modality component from the client device and deactivate the modality component upon completion of an interaction response; and a multimodal engine including an inference engine, and a shared memory area for storing a set of activation conditions registered by each modality component, wherein the set of activation conditions defines how the modality component is activated, and how input and output between the modality component and the client device is started and stopped, wherein the modality component is activated whenever one of the set of activation conditions is detected, and wherein activation conditions are added or removed by an application module, said multimodal engine being configured to detect an interaction and to responsively initiate an interaction response by comparing activation conditions submitted by the multimodal application with the stored activation conditions in the shared memory area, wherein said interaction and said interaction response have been specified by a previously registered modality component. - View Dependent Claims (2, 3, 4)
-
-
5. A machine-readable storage having stored thereon, a computer program having a plurality of code sections, said code sections executable by a machine for causing the machine to perform the steps of:
-
registering a plurality of distributed modality components with a modality component server, wherein each modality component handles an interface modality for an application, wherein each modality component places a set of activation conditions in a shared memory area of the modality component server, wherein the set of activation conditions defines how the modality component is activated, and how input and output between the modality component and a client device are started and stopped, wherein the modality component is activated whenever one of the set of activation conditions is detected, and wherein activation conditions are added or removed by an application module; initiating a multimodal application from a client device, the multimodal application submitting activation conditions for modality components it supports to a multimodal engine of the modality component server; matching the activation conditions submitted by the multimodal application with activation conditions stored in the shared memory area by an inference engine of the modality component server; activating a modality component by a modality activator of the modality component server when one of the set of activation conditions for said modality component is satisfied; connecting said activated modality component to said client device; conveying a user interaction from the client device to the activated modality component for processing; and disconnecting the activated modality component from the client device and deactivating the modality component by the modality activator upon completion of an interaction response. - View Dependent Claims (6, 7, 8, 9, 10)
-
-
11. A system for managing distributed multimodal interactions comprising:
-
a processor means for registering a plurality of modality components with a modality component server, wherein each modality component handles an interface modality for an application, wherein each modality component places a set of activation conditions in a shared memory area of the modality component server, wherein the set of activation conditions defines how the modality component is activated, and how input and output between the modality component and a client device are started and stopped, wherein the modality component is activated whenever one of the set of activation conditions is detected, and wherein activation conditions are added or removed by an application module; means for receiving activation conditions for modality components supported by a client device, the activation conditions being submitted by the client device; means for comparing the activation conditions submitted by the client device with the activation conditions stored in the shared memory area of the modality component server; means for activating a modality component when activation conditions for said modality component are satisfied; means for connecting said activated modality component to said client device; means for conveying a user interaction from the client device to the activated modality component for processing; and means for disconnecting the activated modality component from the client device and deactivating the modality component upon completion of an interaction response.
-
-
12. A system for managing distributed multimodal interactions comprising:
at least one computer system programmed to; register a plurality of modality components with a modality component server, wherein each modality component handles an interface modality for an application, wherein each modality component places a set of activation conditions in a shared memory area of the modality component server, wherein the set of activation conditions defines how the modality component is activated, and how input and output between the modality component and a client device are started and stopped, wherein the modality component is activated whenever one of the set of activation conditions is detected, and wherein activation conditions are added or removed by an application module; receive activation conditions for modality components supported by a client device, the activation conditions being submitted by the client device; compare the activation conditions submitted by the client device with the activation conditions stored in the shared memory area of the modality component server; activate a modality component when activation conditions for said modality component are satisfied; connect said activated modality component to said client device; convey a user interaction from the client device to the activated modality component for processing; and disconnect the activated modality component from the client device and deactivate the modality component upon completion of an interaction response.
Specification