Method and apparatus for controlling a speech recognition function using a cursor control device

• US 5,386,494 A
• Filed: 06/21/1993
• Issued: 01/31/1995
• Est. Priority Date: 12/06/1991
• Status: Expired due to Term

• Current Assignee: Apple Inc.
• Original Assignee: Apple Computer Incorporated (Apple Inc.)
• Inventors: White, George M.
• Primary Examiner(s): MacDonald, Allen R.
• Assistant Examiner(s): HAFIZ, TARIQ R
• Application Number:
  US08/080,451
• Time in Patent Office: 589 Days
• Field of Search: 381/41-45, 395/2.4, 395/2.84, 395/2, 395/2.79, 395/2.44
• US Class Current: 704/270.1
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: G10L 15/22 Procedures used during a speech recognition process, e.g. man-machine dialogue

Abstract

A computer system having speech recognition functionality, a display screen, a microphone, and a mouse having pointer and voice buttons. The voice button located on the mouse is used to turn the microphone "on" and "off". The voice button in conjunction with the mouse are used to signal the computer to display the recognized spoken command. The pointer button located on the mouse is used to provide a standard "point and click" function so that a user can select text or object(s) on the display screen. The computer will apply recognized spoken commands only to the restricted selection. Voice icons are used to aid in the correction of any erroneous interpretation by the speech recognizer circuitry within the computer. A list of alternative commands are displayed in menu format associated with each icon so that the user can use the voice button and mouse to select the desired correct command. The computer then automatically corrects the erroneous interpretation. Each alternative has its own separate menu of synonyms and paraphrases to aid in locating and identifying the correct command.

Claims

1. A method for controlling a speech recognition function for a data processing system, the data processing system having a display, a speech recognition input device, and a cursor control device, the cursor control device having a first selector and a second selector separate from the first selector, the method comprising the steps of:

(a) displaying at least one object and a moveable cursor on the display;

(b) controlling the moveable cursor on the display in x and y directions simultaneously in response to user-manipulation of the cursor control device;

(c) selecting one of the at least one object displayed on the display in response to user-manipulation of the cursor control device and user-manipulation of the first selector of the cursor control device;

(d) activating the speech recognition function in response to engagement of the second selector of the cursor control device;

(e) inputting a spoken command for the data processing system by the speech recognition input device; and

(f) deactivating the speech recognition function in response to disengagement of the second selector of the cursor control device.

2. The method of claim 1, wherein the controlling step (b) includes the step of controlling the moveable cursor on the display in response to user-manipulation of the cursor control device that comprises one of a mouse, a joystick, a track-ball, or a touch tablet.

3. The method of claim 1, wherein the inputting step (e) includes the step of inputting the spoken command by the speech recognition input device that includes a microphone.

4. The method of claim 1, wherein the first selector includes a pointer button and the selecting step (c) includes the steps of:

(c)(i) selecting the one object in response to user-manipulation of the cursor control device in positioning the moveable cursor on the display and user-manipulation of the pointer button, and

(c)(ii) indicating on the display the selection of the one object.

5. The method of claim 1, wherein the second selector includes a voice button and the activating step (d) includes the step of activating the speech recognition function in response to depression of the voice button.

6. The method of claim 1, further comprising the step of:

(g) applying the spoken command inputted for the data processing system to only the selected one object.

7. The method of claim 6, wherein the selected one object has an associated list of speech commands and the applying step (g) includes the step of applying the spoken command to the selected one object if the spoken command is included in the associated list of speech commands.

8. The method of claim 1, further comprising the step of:

(g) changing the display of the moveable cursor on the display to indicate the speech recognition function is activated.

9. The method of claim 1, further comprising the step of:

(g) displaying on the display the spoken command inputted for the data processing system.

10. The method of claim 9, wherein the displaying step (g) includes the step of displaying on the display the spoken command in response to user-manipulation of the cursor control device.

11. The method of claim 9, further comprising the steps of:

(h) displaying on the display a list of alternative commands for the spoken command; and

(i) selecting either the spoken command or one of the commands in the list of alternative commands in response to user-manipulation of the cursor control device.

12. The method of claim 11, wherein the displaying step (h) includes the step of displaying the list of alternative commands as a menu and the selecting step (i) includes the step of selecting and displaying a synonym menu for one of the alternative commands.

13. A method for controlling a speech recognition function for a data processing system, the data processing system having a display, a speech recognition input device, and a cursor control device, the cursor control device having a selector, the method comprising the steps of:

(a) displaying at least one object and a moveable cursor on the display;

(b) controlling the moveable cursor on the display in x and y directions simultaneously in response to user-manipulation of the cursor control device;

(c) selecting one of the at least one object displayed on the display;

(d) activating the speech recognition function in response to engagement of the selector of the cursor control device;

(e) inputting a spoken command for the data processing system by the speech recognition input device;

(f) applying the spoken command inputted for the data processing system to only the selected one object; and

(g) deactivating the speech recognition function in response to disengagement of the selector of the cursor control device.

14. The method of claim 13, wherein the controlling step (b) includes the step of controlling the moveable cursor on the display in response to user-manipulation of the cursor control device that comprises one of a mouse, a joystick, a track-ball, or a touch tablet.

15. The method of claim 13, wherein the inputting step (e) includes the step of inputting the spoken command by the speech recognition input device includes a microphone.

16. The method of claim 13, wherein the selector includes a voice button and the activating step (d) includes the step of activating the speech recognition function in response to depression of the voice button.

17. The method of claim 13, wherein the selected one object has an associated list of speech commands and the applying step (f) includes the step of applying the spoken command to the selected object if the spoken command is included in the associated list of speech commands.

18. A method for controlling a speech recognition function for a data processing system, the data processing system having a display, a speech recognition input device, and a cursor control device, the cursor control device having a selector, the method comprising the steps of:

(a) displaying at least one object and a moveable cursor on the display;

(b) controlling the moveable cursor on the display in x and y directions simultaneously in response to user-manipulation of the cursor control device;

(c) selecting one of the at least one object displayed on the display;

(d) activating the speech recognition function in response to engagement of the selector of the cursor control device;

(e) inputting a spoken command for the data processing system by the speech recognition input device;

(f) displaying on the display the spoken command inputted for the data processing system;

(g) displaying on the display a list of alternative commands for the spoken command;

(h) selecting either the spoken command or one of the commands in the list of alternative commands in response to user-manipulation of the cursor control device; and

(i) deactivating the speech recognition function in response to disengagement of the selector of the cursor control device.

19. The method of claim 18, wherein the controlling step (b) includes the step of controlling the moveable cursor on the display in response to user-manipulation of the cursor control device that comprises one of a mouse, a joystick, a track-ball, or a touch tablet.

20. The method of claim 18, wherein the inputting step (e) includes the step of inputting the spoken command by the speech recognition input device that includes a microphone.

21. The method of claim 18, wherein the selector includes a voice button and the activating step (d) includes the step of activating the speech recognition function in response to depression of the voice button.

22. The method of claim 18, further comprising the step of:

(j) changing the display of the moveable cursor on the display to indicate the speech recognition function is activated.

23. The method of claim 18, wherein the displaying step (g) includes the step of displaying the list of alternative commands as a menu and the selecting step (h) includes the step of selecting and displaying a synonym menu for one of the alternative commands.

24. An apparatus for controlling a speech recognition function comprising:

(a) a data processing system having a speech recognition function and having a display, the data processing system for displaying at least one object and a moveable cursor on the display;

(b) a speech recognition input device coupled to the data processing system for inputting spoken commands for the data processing system; and

(c) a cursor control device coupled to the data processing system for controlling the moveable cursor displayed on the display in x and y directions simultaneously, the cursor control device including;

(i) a first selector for selecting one of the at least one object displayed on the display, and

(ii) a second selector separate from the first selector for activating and deactivating the speech recognition function of the data processing system.

25. The apparatus of claim 24, wherein the cursor control device comprises one of a mouse, a joystick, a track-ball, or a touch tablet.

26. The apparatus of claim 24, wherein the speech recognition input device includes a microphone.

27. The apparatus of claim 24, wherein the first selector includes a pointer button, the cursor control device is for selecting the one object in response to user-manipulation of the pointer button, and the data processing system is for indicating on the display the selection of the one object.

28. The apparatus of claim 24, Wherein the second selector includes a voice button and the data processing system activates the speech recognition function in response to depression of the voice button.

29. The apparatus of claim 24, wherein the data processing system applies the spoken command inputted for the data processing system to only the selected one object.

30. The apparatus of claim 29, wherein the selected one object has an associated list of speech commands and the data processing system applies the spoken command to the selected one object if the spoken command is included in the associated list of speech commands.

31. The apparatus of claim 24, wherein the data processing system changes the display of the moveable cursor on the display to indicate the speech recognition function is activated.

32. The apparatus of claim 24, wherein the data processing system displays on the display the spoken command inputted for the data processing system.

33. The apparatus of claim 32, wherein the data processing system displays on the display the spoken command in response to user-manipulation of the cursor control device.

34. The apparatus of claim 32, wherein the data processing system is for displaying on the display a list of alternative commands for the spoken command and the cursor control device is for selecting either the spoken command or one of the commands in the list of alternative commands.

35. The apparatus of claim 34, wherein the data processing system is for displaying the list of alternative commands as a menu and for displaying a synonym menu for one of the alternative commands in response to user-manipulation of the cursor control device.