Multi-modal synchronization
First Claim
1. A computer-implemented method of performing multi-modal synchronization, the method comprising:
- enabling, at a given point in time, a first-modality gateway and a second-modality gateway to output the same specific information from the same Uniform Resource Locator (URL) as both first-modality content and second-modality content, and to receive input to the output same specific information using either of the first-modality gateway and the second-modality gateway, further comprising;
opening a first-modality session via a first connection from a first-modality program on a client device to the first-modality gateway;
opening a second-modality session via a second connection from a second-modality program on the client device to the second-modality gateway on a server;
acquiring a unique identifier of the client device by the first-modality gateway and the second-modality gateway;
transmitting the unique identifier from the first-modality gateway to a synchronization handler;
creating a unique messaging channel on a third connection, based upon the unique identifier at the synchronization handler; and
subscribing the first-modality gateway and the second-modality program to the unique messaging channel at a synchronization handler based on the unique identifier; and
automatically determining a first-modality version of a resource if the input is received using the second-modality gateway, and a second-modality version of the resource if the input is received using the first-modality gateway.
3 Assignments
0 Petitions
Accused Products
Abstract
A system for synchronizing multiple modalities is described. A user may use multiple modalities, such as voice and browser, to interact with data on a network, such as the World Wide Web. All of the modalities may be synchronized so that all are updated when the user enters information in just one. A method of communicating between devices includes receiving a request for first-modality data that includes first content, and sending a message in response to receiving the request, the message including information allowing the request of second-modality data that includes second content overlapping the first content. Another method includes requesting first data for a first modality, the first data including first content, and automatically requesting second data for a second modality, wherein the second data includes second content that overlaps the first content.
-
Citations
28 Claims
-
1. A computer-implemented method of performing multi-modal synchronization, the method comprising:
-
enabling, at a given point in time, a first-modality gateway and a second-modality gateway to output the same specific information from the same Uniform Resource Locator (URL) as both first-modality content and second-modality content, and to receive input to the output same specific information using either of the first-modality gateway and the second-modality gateway, further comprising; opening a first-modality session via a first connection from a first-modality program on a client device to the first-modality gateway; opening a second-modality session via a second connection from a second-modality program on the client device to the second-modality gateway on a server; acquiring a unique identifier of the client device by the first-modality gateway and the second-modality gateway; transmitting the unique identifier from the first-modality gateway to a synchronization handler; creating a unique messaging channel on a third connection, based upon the unique identifier at the synchronization handler; and subscribing the first-modality gateway and the second-modality program to the unique messaging channel at a synchronization handler based on the unique identifier; and automatically determining a first-modality version of a resource if the input is received using the second-modality gateway, and a second-modality version of the resource if the input is received using the first-modality gateway. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13)
-
-
14. A computer-implemented method of performing multi-modal synchronization, the method comprising:
-
enabling, at a given point in time, a first-modality gateway and a second-modality gateway to output the same specific information from the same Uniform Resource Locator (URL) as both first-modality content and second-modality content, and to receive input to the output same specific information using either of the first-modality gateway and the second-modality gateway, further comprising; opening a first-modality session via a first connection from a first-modality program on a client device to the first-modality gateway; opening a second-modality session via a second connection from a second-modality program on the client device to the second-modality gateway on a server; acquiring a unique identifier of the client device by the first-modality gateway and the second-modality gateway; transmitting the unique identifier from the first-modality gateway to a synchronization handler; creating a unique messaging channel on a third connection, based upon the unique identifier at the synchronization handler; subscribing the first-modality gateway and the second-modality program to the unique messaging channel at the synchronization handler based on the unique identifier; associating the unique messaging channel with the second-modality session, at the server; transmitting the second-modality content from the sewer to the second-modality program via the second connection; publishing an indication of the second-modality content to the first-modality gateway on the unique messaging channel; and requesting the first-modality content corresponding to the second-modality content at the sewer from the first-modality gateway; and automatically determining a first-modality version of a resource if the input is received using the second-modality gateway, and a second-modality version of the resource if the input is received using the first-modality gateway. - View Dependent Claims (15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26)
-
-
27. A system for performing multi-modal synchronization, the system comprising:
-
a client device including a first-modality program and a second-modality program; a first-modality gateway configured to; open a first-modality session from the first-modality program via a first connection, acquire a unique identifier of the client device, and transmit the unique identifier; a server including a second-modality gateway configured to; open a second-modality session from the second-modality program to a second-modality gateway via a second connection; acquire the unique identifier of the client device at the second-modality gateway; and automatically determine a first-modality version of a resource if input is received using the second-modality gateway, and a second-modality version of the resource if the input is received using the first-modality gateway; and a synchronization handler configured to enable, at a given point in time, a first-modality gateway and a second-modality gateway to output the same specific information from the same Uniform Resource Locator as both first-modality content and second-modality content, and to receive the input to the output same specific information using either of the first-modality gateway and the second-modality gateway, by; receiving the unique identifier from the first-modality gateway, creating a unique messaging channel on a third connection, based upon the unique identifier handler, and subscribing the first-modality gateway and the second-modality program to the unique messaging channel based on the unique identifier.
-
-
28. A computer program product tangibly embodied in a machine-readable storage medium, the computer program product for performing multi-modal synchronization, where the computer program product comprises instructions that, when read by a machine, operate to cause a data processing apparatus to:
enable, at a given point in time, a first-modality gateway and a second-modality gateway to output the same specific information from the same Uniform Resource Locator (URL) as both first-modality content and second-modality content, and to receive input to the output same specific information using either of the first-modality gateway and the second-modality gateway, by; opening a first-modality session via a first connection from a first-modality program on a client device to the first-modality gateway; opening a second-modality session via a second connection from a second-modality program on the client device to the second-modality gateway on a server; acquiring a unique identifier of the client device by the first-modality gateway and the second-modality gateway; transmitting the unique identifier from the first-modality gateway to a synchronization handler; creating a unique messaging channel on a third connection, based upon the unique identifier at the synchronization handler; and subscribing the first-modality gateway and the second-modality program to the unique messaging channel at a synchronization handler based on the unique identifier; and
automatically determine a first-modality version of a resource if the input is received using the second-modality gateway, and a second-modality version of the resource if the input is received using the first-modality gateway.
Specification