Controlling user interfaces with voice commands from multiple languages

• US 20060136220A1
• Filed: 12/22/2004
• Published: 06/22/2006
• Est. Priority Date: 12/22/2004
• Status: Abandoned Application

• Current Assignee: SAP AG (SAP SE)
• Original Assignee: SAP AG (SAP SE)
• Inventors: Gurram, Rama, James, Frances
• Application Number:
  US11/017,889
• Publication Number:
  US 20060136220A1
• Time in Patent Office: Days
• US Class Current: 704/275
• CPC Class Codes: G10L 15/005 Language recognition
• CPC Class Codes: G10L 15/22 Procedures used during a speech recognition process, e.g. man-machine dialogue

Abstract

One or more internationalized voice user interfaces include a user interface and a voice extension module associated with the user interface. The voice extension module is configured to voice-enable the user interface and includes a speech recognition engine, a preprocessor, and an input handler. The preprocessor is configured to register with the speech recognition engine one or more voice commands for controlling the user interface. The one or more voice commands are representative of multiple languages. The input handler receives an initial voice command that is representative of one of the multiple languages and communicates with the preprocessor to control the user interface as indicated by the initial voice command. The initial voice command is one of the one or more voice commands registered with the speech recognition engine by the preprocessor.

Claims

1. An internationalized voice user interface comprising:

a user interface; and

a voice extension module associated with the user interface and configured to voice-enable the user interface, the voice extension module including;

a speech recognition engine;

a preprocessor configured to register with the speech recognition engine one or more voice commands for controlling the user interface, the one or more voice commands being representative of multiple languages; and

an input handler that receives an initial voice command that is representative of one of the multiple languages and communicates with the preprocessor to control the user interface as indicated by the initial voice command, the initial voice command being one of the one or more voice commands registered with the speech recognition engine by the preprocessor.

2. The internationalized voice user interface of claim 1 wherein the voice extension module further includes a language specific data store that includes information that identifies at least one voice command for controlling the user interface, the at least one voice command being representative of at least one of the multiple languages.

3. The internationalized voice user interface of claim 1 wherein the preprocessor identifies one of the multiple languages that will be used to provide voice commands for controlling the user interface and registers with the speech recognition engine one or more voice commands for controlling the user interface, the one or more voice commands being representative of the identified language.

4. The internationalized voice user interface of claim 3 wherein the preprocessor registers with the speech recognition engine only one or more voice commands that are representative of the identified language.

5. The internationalized voice user interface of claim 1 wherein the voice extension module further includes a speech application programming interface (API) that enables the preprocessor to register the voice commands with the speech recognition engine and that enables the speech recognition engine to communicate the initial voice command to the input handler.

6. The internationalized voice user interface of claim 1 wherein the preprocessor comprises:

a parser configured to parse the user interface to identify one or more user interface elements included in the user interface; and

a translator configured to register with the speech recognition engine one or more voice commands for controlling the one or more identified user interface elements, the one or more voice commands being representative of multiple languages.

7. The internationalized voice user interface of claim 1 wherein the user interface is at least one form a group including a hypertext markup language (HTML) document presented in a web browser, a standalone application, and a user interface for a web services application.

8. A voice extension module for internationalizing a voice-enabled user interface comprising:

a speech recognition engine;

a preprocessor configured to register with the speech recognition engine one or more voice commands for controlling a user interface, the one or more voice commands being representative of multiple languages; and

an input handler that receives an initial voice command that is representative of one of the multiple languages and communicates with the preprocessor to control the user interface as indicated by the initial voice command, the initial voice command being one of the one or more voice commands registered with the speech recognition engine by the preprocessor.

9. The voice extension module of claim 8 further comprising a language specific data store that includes information that identifies at least one voice command for controlling the user interface, the at least one voice command being representative of at least one of the multiple languages.

10. The voice extension module of claim 8 wherein the preprocessor identifies one of the multiple languages that will be used to provide voice commands for controlling the user interface and registers with the speech recognition engine one or more voice commands for controlling the user interface, the at least one voice command being representative of the identified language.

11. The voice extension module of claim 10 wherein the preprocessor is further configured to register with the speech recognition engine only voice commands that are representative of the identified language.

12. The voice extension module of claim 8 further comprising a speech application programming interface (API) that enables the preprocessor to register the voice commands with the speech recognition engine and that enables the speech recognition engine to communicate the initial voice command to the input handler.

13. The voice extension module of claim 8 wherein the preprocessor comprises:

a parser configured to parse the user interface to identify one or more user interface elements included in the user interface; and

a translator configured to register with the speech recognition engine one or more voice commands for controlling the one or more identified user interface elements, the one or more voice commands being representative of multiple languages.

14. A method for providing an internationalized voice user interface, the method comprising:

accessing information specifying a user interface;

registering with a speech recognition engine one or more voice commands for controlling the user interface to enable voice control of the user interface, the one or more voice commands being representative of multiple languages; and

controlling the user interface as indicated by an initial voice command that is representative of one of the multiple languages, the initial voice command being one of the one or more voice commands registered with the speech recognition engine.

15. The method of claim 14 wherein registering one or more voice commands comprises:

identifying one of the multiple languages that will be used to provide voice commands for controlling the user interface; and

registering with the speech recognition engine one or more voice commands that may be used to control the user interface, the one or more voice commands being representative of the identified one of the multiple languages.

16. The method of claim 15 wherein registering one or more voice commands that are representative of the identified one of the multiple languages comprises registering one or more voice commands that are representative of only the identified one of the multiple languages.

17. The method of claim 14 wherein registering one or more voice commands that may be used to control the user interface comprises:

parsing the information specifying the user interface to identify one or more user interface elements included in the user interface; and

registering one or more voice commands for controlling each of the one or more identified user interface elements.

18. The method of claim 14 wherein registering one or more voice commands that are representative of the multiple languages comprises:

registering one or more voice commands that are representative of one of the multiple languages based on the information specifying the user interface; and

registering one or more other voice commands that are representative of another of the multiple languages based on the one or more voice commands that are representative of the one of the multiple languages.

19. The method of claim 18 further comprising clarifying the initial voice command such that the initial voice command corresponds only to a manner in which the user interface is controlled in response to the initial voice command.

20. The method of claim 14 further comprising providing feedback that is representative of a language that is represented by the initial voice command.