Voice interaction method for a computer graphical user interface

• US 6,499,015 B2
• Filed: 08/12/1999
• Issued: 12/24/2002
• Est. Priority Date: 08/12/1999
• Status: Expired due to Term

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Milenkovic, Maria, Loring, Keith P., Brooks, Brian S.
• Primary Examiner(s): CHAWAN, VIJAY B
• Application Number:
  US09/372,919
• Publication Number:
  US 20020169616A1
• Time in Patent Office: 1,230 Days
• Field of Search: 704/270, 704/275, 704/256, 704/260, 704/270.1, 704/231, 704/257
• US Class Current: 704/275
• CPC Class Codes: G06F 3/038 Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
• CPC Class Codes: G06F 3/16 Sound input; Sound output speech processing G10L

Abstract

The present invention enables a computer user to select a function represented via a graphical user interface by speaking command related to the function into audio processing circuitry. A voice recognition program interprets the spoken words to determine the function that is desired for execution. The user may use the cursor to identify an element on the graphical user interface display or speak the name of that element. The computer responds to the identification of the element by displaying a menu of the voice commands associated with that element.

Claims

1. A method for selecting functions from a graphical user interface of a computer, the method comprising the steps of:

selecting an activatable control element that is being presented by the graphical user interface on a monitor screen of the computer thereby producing an indication of the activatable control element, wherein the activatable control element can initiate associated functions;

responding to the indication by displaying a menu of voice commands which may be used to select the functions that can be initiated by the activatable control element;

receiving a first phrase spoken by the user;

applying voice recognition techniques to the first phrase to determine which one of the voice commands was spoken by the user; and

executing a function indicated by the one of the voice commands.

2. The method as recited in claim 1 wherein the step of selecting an activatable control element comprises determining a position of a cursor on the monitor screen;

and determining which activatable control element is located at that position.

3. The method as recited in claim 1 wherein the step of selecting an activatable control element comprises receiving a second phrase spoken by the user;

and applying voice recognition techniques to the second phrase to determine an activatable control element that is indicated by the second phrase.

4. A method for selecting functions from a graphical user interface of a computer, the method comprising the steps of:

determining a position of a cursor on the monitor screen and

determining which activatable control element of a graphical user interface is located at that position to produce an indication of that activatable control element, wherein the activatable control element can initiate associated functions;

responding to the indication by displaying a menu of voice commands which may be used to select the functions that can be initiated by the activatable control element;

receiving a first phrase spoken by the user;

applying voice recognition techniques to the first phrase to determine which one of the voice commands was spoken by the user; and

executing a function indicated by the one of the voice commands.

5. A method for selecting functions from a graphical user interface of a computer, the method comprising the steps of:

receiving a first phrase spoken by the user;

applying voice recognition techniques to the first phrase to determine an activatable control element that is indicated by the first phrase and produce an indication of that activatable control element, wherein the activatable control element can initiate associated functions;

responding to the indication by displaying a menu of voice commands which may be used to select the functions that can be initiated by the activatable control element;

receiving a first phrase spoken by the user;

applying voice recognition techniques to the first phrase to determine which one of the voice commands was spoken by the user; and

executing a function indicated by the one of the voice commands.