Method and system for multi-modal communication

• US 20030217161A1
• Filed: 05/14/2002
• Published: 11/20/2003
• Est. Priority Date: 05/14/2002
• Status: Active Grant

• Current Assignee: Google Technology Holdings LLC (Alphabet Inc.)
• Original Assignee: Motorola Mobility LLC (Lenovo Group Ltd.)
• Inventors: Balasuriya, Senaka
• Granted Patent: US 8,601,096 B2
• Time in Patent Office: Days
• US Class Current: 709/229
• CPC Class Codes: G06F 3/038 Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
• CPC Class Codes: H04L 67/02 based on web technology, e.g. hypertext transfer protocol [HTTP]
• CPC Class Codes: H04L 67/53 using third party service providers
• CPC Class Codes: H04L 67/75 Indicating network or usage conditions on the user display
• CPC Class Codes: H04L 69/329 in the application layer [OSI layer 7]
• CPC Class Codes: H04L 9/40 Network security protocols
• CPC Class Codes: H04M 1/271 controlled by voice recognition
• CPC Class Codes: H04M 1/72445 for supporting Internet browser applications

Abstract

A method and system for multi-modal communication has a terminal (102) with at least one input component (108) and at least one output component (112) coupled to a gateway (104) having a dialog manager (114). The system and method further has a content server (106) coupled to the dialog manager (114) wherein the content server (106) provides the dialog manager (114) with an encoded control command. Moreover, at least one input component (108) and at least one output component (112) are coupled to a control unit (110). The dialog manager (114) decodes the encoded control command, producing and providing a decoded control command to the control unit (110). In response to the decoded control command, the control unit (110) modifies at least one of the input components (108) and/or at least one of the output components (112).

Claims

1. A method for multi-modal communication comprising:

receiving a control command from a content server;

decoding the control command; and

providing the control command to a control unit.

2. The method of claim 1 further comprising:

in response to the control command, modifying at least one of the following;

at least one input component and at least one output component.

3. The method of claim 2 wherein the step of modifying further comprises enabling or disabling at least one of the following:

at least one input component and at least one output component.

4. The method of claim 1 further comprising:

prior to receiving the control command, receiving an information fetch request for requested information and fetching the requested information from a content server, wherein the control command is encoded within the requested information.

12. The system of claim 1 I wherein the control command is encoded in a mark-up language.

5. A method for multi-modal communication comprising:

receiving an information fetch request for requested information;

accessing a content server to retrieve the requested information;

receiving a control command; and

providing the control command to a control unit.

6. The method of claim 5 wherein the control command is received from the content server as the control command is encoded within the requested information.

7. The method of claim 5 wherein the control command is received from a control server using a reference indicator encoded within the requested information.

8. The method of claim 5 further comprising:

in response to the control command, enabling an input encoder such that an input command is encoded in a first encoded scheme.

9. The method of claim 5 further comprising:

in response to the control command, disabling a speech detector/controller from detecting a barge-in voice command while an audio output is being provided to a speaker within an audio subsystem.

10. The method of claim 5 further comprising:

in response to the control command, disabling an output on a display of at least one keypad entry and enabling an output of non-recognition characters on the display wherein a non-recognition character corresponds to each of the keypad entries.

11. A system for multi-modal communication comprising:

at least dialog manager;

a content server operably coupled to the at least one dialog manager; and

a control unit operably coupled to the dialog manager wherein the dialog manager receives a control command from the content server, decodes the control command and provides the control command to the control unit.

13. The system of claim 11 further comprising:

at least one input component operably coupled to the control unit; and

at least one output component operably coupled to the control unit wherein the control unit, in response to the control command, does at least one of the following;

enables the at least one input component, enables the at least one output component, disables the at least one input component, and disables the at least one output component.

14. The system of claim 13 wherein the input component is at least one of the following:

a microphone disposed within an audio subsystem, a speech detector/controller, a speech recognition engine, a keypad, an input encoder, touchscreen, and a handwriting engine.

15. The system of claim 13 wherein the output component is at least one of the following:

a speaker disposed within the audio subsystem and a display.

16. A system for multi-modal communication comprising:

a terminal having at least one input component and at least one output component;

a gateway having a dialog manager operably coupled to the at least one input component and the at least one output component; and

a content server operably coupled to the dialog manager wherein the content server provides the dialog manager with a control command.

17. The system of claim 16 wherein the at least one input component and the at least one output component are operably coupled to a terminal control unit disposed within the terminal and the terminal control unit is operably coupled to a gateway control unit disposed within the gateway.

18. The system of claim 17 wherein the dialog manager decodes the encoded control command and thereupon provides the control command to the gateway control unit.

19. The system of claim 18 wherein the gateway control unit provides the terminal control unit the control command and the terminal session control unit, in response to the control command, does at least one of the following:

enables the at least one input component, enables the at least one output component, disables the at least one input component, and disables the at least one output component.

20. The system of claim 19 wherein the input component is at least one of the following:

a microphone disposed within an audio subsystem, a speech detector/controller, a speech recognition engine, a keypad, an input encoder, touchscreen, and a handwriting engine.

21. The system of claim 19 wherein the output component is at least one of the following:

a speaker disposed within the audio subsystem and a display.

22. A system for multi-modal communication comprising:

a terminal having at least one input component, at least one output component, and a dialog manager operably coupled to the at least one input component and the at least one output component; and

a content server operably coupled to the dialog manager, wherein the content server provides the dialog manager with a control command.

23. The system of claim 22 wherein the at least one input component, the at least one output component and the dialog manager are operably coupled to a control unit disposed within the terminal and wherein the dialog manager decodes the encoded control command to generate a decoded control command and provides the decoded control command to the control unit.

24. The system of claim 23 wherein the control unit, in response to the decoded control command, does at least one of the following:

enables the at least one input component, enables the at least one output component, disables the at least one input component, and disables the at least one output component.

25. The system of claim 24 wherein the input component is at least one of the following:

a microphone disposed within an audio subsystem, a speech detector/controller, a speech recognition engine, a keypad, an input encoder, touchscreen, and a handwriting engine and wherein the output component is at least one of the following;

a speaker disposed within the audio subsystem and a display.