Multi-modal communication using a session specific proxy server

• US 8,788,675 B2
• Filed: 09/22/2005
• Issued: 07/22/2014
• Est. Priority Date: 12/28/2001
• Status: Active Grant

• Current Assignee: Google Technology Holdings LLC (Alphabet Inc.)
• Original Assignee: Motorola Mobility LLC (Lenovo Group Ltd.)
• Inventors: Balasuriya, Senaka
• Primary Examiner(s): Kim, Hee Soo
• Application Number:
  US11/232,586
• Publication Number:
  US 20060020704A1
• Time in Patent Office: 3,225 Days
• Field of Search: 709/225, 709/228, 709/229, 709/227
• US Class Current: 709/227
• CPC Class Codes: G06F 16/957 Browsing optimisation, e.g. caching or content distillation
• CPC Class Codes: H04L 65/1045 Proxies, e.g. for session initiation protocol [SIP]
• CPC Class Codes: H04L 65/1046 Call controllers; Call servers
• CPC Class Codes: H04L 67/141 Setup of application sessions admission control or resource allocation in data switching networks H04L47/70

Abstract

A method and apparatus for multi-modal communication includes a controller (236) operably coupled to at least one multi-modal session proxy server (226). On a per multi-modal session basis, the controller (236) provides the multi-modal session proxy server (226) with a multi-modal proxy identifier (138). The multi-modal proxy identifier (138) is then provided to at least one browser with a per session multi-modal proxy evaluator (220) having a browser proxy identifier (140) wherein the browser proxy identifier (140) is evaluated in view of the multi-modal proxy identifier (138). The multi-modal session proxy server (226) then receives an information request (231) from the browser with per session multi-modal proxy evaluator (220) wherein the requested information is fetched from a content server (240). When the requested information is retrieved, a multi-modal synchronization coordinator (122) notifies the other browser with per session multi-modal proxy evaluator (232), via a multi-modal synchronization interface (234).

Claims

1. A system for multi-modal communication comprising:

a terminal that includes at least;

at least one graphical browser with a graphical browser per session multi-modal proxy evaluator that dynamically evaluates, on a per session basis, a stored graphical browser proxy identifier with a received per-session multi-modal proxy identifier from a network element as selected by the network element; and

at least one graphical browser multi-modal synchronization interface operably coupled to the at least one graphical browser.

2. The system of claim 1 wherein the terminal further comprises:

an audio subsystem comprising a microphone for receiving an audio input and a speaker for providing an audio output;

a terminal voice transfer interface operably coupled to the audio subsystem; and

a terminal session control for initiating a wireless terminal session.

3. The system of claim 2 further comprising:

a network element including;

at least one voice browser with a voice browser per session multi-modal proxy evaluator, wherein the at least one voice browser dynamically evaluates, on a per session basis a voice browser proxy identifier; and

at least one voice browser multi-modal synchronization interface operably coupled to the at least one voice browser.

4. The system of claim 3 wherein the network element includes:

a network session control for receiving initialization commands from the terminal session control;

a network voice transfer interface for transmitting and receiving encoded audio information from the terminal voice transfer interface; and

a speech engine operably coupled to the network voice transfer interface, wherein when a voice command is provided from the terminal voice transfer interface, the speech engine decodes the voice command for the voice browser.

5. The system of claim 3 wherein the network element includes a multi-modal synchronization coordinator coupled to the multi-modal voice browser multi-modal synchronization interface and to the graphical browser multi-modal synchronization interface;

and

a plurality of multi-modal session proxy servers operatively coupled to the multi-modal synchronization coordinator and to the graphical browser and voice browser.

6. The system of claim 4 wherein the network element further includes:

a controller; and

at least one multi-modal session proxy server having a proxy address operably coupled to the at least one voice browser and the at least one graphical browser, wherein the controller determines, on a per session basis, from among a plurality of multi-modal proxy servers, a multi-modal proxy identifier representing the proxy address of the multi-modal session proxy server and the multi-modal proxy identifier is provided to the at least one voice browser and the at least one graphical browser.

7. The system of claim 6 further comprising:

a multi-modal synchronization coordinator;

at least one information request provided by at least one of the at least one graphical browser and the at least one voice browser to the multi-modal session proxy server whereby the multi-modal session proxy server fetches requested information; and

wherein if the requested information is provided to the at least one voice browser, the at least one graphical browser is updated via the at least one graphical browser multi-modal synchronization interface through the multi-modal synchronization coordinator and if the requested information is provided to the at least one graphical browser, the at least one voice browser is updated via the at least one voice browser multi-modal synchronization interface through the multi-modal synchronization coordinator.

8. The system of claim 6 further comprising:

at least one content server operably coupled to the multi-modal session proxy server of the network element whereupon when an information request is provided to the multi-modal session proxy server, the multi-modal session proxy server retrieves the requested information from the at least one content server.

9. The system of claim 6 wherein the controller of the network element further comprises:

a load balancer operably coupled to the controller wherein the load balancer provides an indication of the available bandwidth of the at least one multi-modal proxy server to the controller such that the controller can determine, on a per session basis, the multi-modal session proxy identifier.

10. A method for multi-modal communication comprising:

receiving, by a terminal, a multi-modal proxy identifier corresponding to a per-session determined multi-modal session proxy server from a plurality of different multi-modal proxy servers, on a per session basis, for a graphical browser;

evaluating, by the terminal, on a per session basis, a current graphical browser proxy identifier in response to receiving the multi-modal proxy identifier;

receiving the multi-modal proxy identifier, on a per session basis, for a voice browser;

evaluating, on a per session basis, a current voice browser proxy identifier in response to receiving the multi-modal proxy identifier;

sending an information request from at least one of the graphical browser or voice browser via a multi-modal session proxy server identified by the multi-modal proxy identifier.

11. The method of claim 10 further comprising:

prior to receiving a multi-modal proxy identifier, initiating a multi-modal session between a terminal and a multi-modal network element and determining the multi-modal session proxy server from the plurality of different multi-modal session proxy servers, on a per session basis.

12. The method of claim 11 wherein the graphical browser is disposed on the terminal and the voice browser is disposed on the network element.

13. The method of claim 11 wherein determining the multi-modal session proxy server on a per-session basis comprises selecting the multi-modal proxy server from the plurality of multi-modal proxy servers, based on a bandwidth comparison.

14. The method of claim 12, prior to sending an information request, further comprising:

storing an updated graphical browser proxy identifier in a graphical browser memory location; and

storing an updated voice browser proxy identifier in a voice browser memory location.