Voice-controlled user interfaces

• US 20030156130A1
• Filed: 06/28/2002
• Published: 08/21/2003
• Est. Priority Date: 02/15/2002
• Status: Active Grant

• Current Assignee: SAP SE
• Original Assignee: SAP AG (SAP SE)
• Inventors: James, Frankie, Gurram, Rama, Swan, Richard, Roelands, Jeff
• Granted Patent: US 7,246,063 B2
• Time in Patent Office: Days
• US Class Current: 715/728
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: G10L 2015/228 of application context

Abstract

Method and systems to voice-enable a user interface using a voice extension module are provided. A voice extension module includes a preprocessor, a speech recognition engine, and an input handler. The voice extension module receives user interface information, such as, a hypertext markup language (HTML) document, and voice-enables the document so that a user may interact with any user interface elements using voice commands.

Claims

1. A method to voice-enable a user interface using a voice extension module comprising:

receiving user interface information;

parsing the user interface information to determine user interface elements; and

processing the user interface elements to enable voice control.

2. The method of claim 1 wherein the user interface information is a hypertext markup language (HTML) document.

3. The method of claim 2 wherein the HTML document includes JavaScript code.

4. The method of claim 1 wherein user interface data elements include one or more from the group consisting of:

a text field;

a selection list;

a scroll bar;

a slider;

a radio button;

a checkbox;

an icon; and

a button.

5. The method of claim 1 wherein processing the user interface elements includes:

for each user interface element, registering the user interface element with a speech recognition engine.

6. The method of claim 5 wherein registering the user interface element with a speech recognition engine includes registering the name of the user interface element.

7. The method of claim 5 wherein registering the user interface element with a speech recognition engine includes registering the type of the user interface element.

8. The method of claim 1 further comprising receiving input corresponding to the user interface elements.

9. The method of claim 8 wherein the user input is voice input recognized by a speech recognition engine.

10. The method of claim 8 wherein the input includes data obtained from one or more of the following devices:

a keyboard;

a mouse; and

a microphone.

11. A voice extension module for voice-enabling a user interface includes:

a speech recognition engine;

a preprocessor that receives user interface information and registers corresponding voice commands with the speech recognition engine; and

an input handler that receives and processes user interactions.

12. The voice extension module of claim 11 wherein the preprocessor comprises:

a parser to identify user interface elements; and

a translator to voice-enable the user interface elements.

13. The voice extension module of claim 12 wherein the user interface elements include one or more from the group consisting of:

a text field;

a selection list;

a scroll bar;

a slider;

a radio button;

a checkbox;

a icon; and

a button.

14. A system for voice-enabling user interfaces comprising:

a browser that generates a user interface corresponding to user interface information; and

a voice extension module associated with the browser and operable to voice-enable the user interface generated by the browser, the voice extension module including;

a speech recognition engine;

a preprocessor that receives the user interface information and registers corresponding voice commands with the speech recognition engine; and

an input handler that receives and processes user interactions.

15. The system of claim 14 wherein the browser is Internet Explorer.

16. The system of claim 14 further comprising an output device for presenting the user interface including one or more from the group consisting of:

a monitor;

a speaker; and

a liquid crystal display (LCD) panel.

17. The system of claim 14 wherein the user interface information is a hypertext markup language (HTML) document.

18. The system of claim 17 wherein the preprocessor comprises:

a parser to identify user interface elements; and

a translator to voice-enable the user interface elements.

19. The system of claim 18 wherein the user interface elements include one or more from the group consisting of:

a text field;

a selection list;

a scroll bar;

a slider;

a radio button;

a checkbox;

a icon; and

a button.

20. The system of claim 14 wherein the voice extension module is a component of the browser.