SPEECH RECOGNITION USER INTERFACE

• US 20120089392A1
• Filed: 10/07/2010
• Published: 04/12/2012
• Est. Priority Date: 10/07/2010
• Status: Abandoned Application

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Larco, Vanessa, Vassigh, Ali M., Shen, Alan T., Klein, Christian, Soemo, Thomas M.
• Application Number:
  US12/900,004
• Publication Number:
  US 20120089392A1
• Time in Patent Office: Days
• US Class Current: 704/231
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: G10L 15/063 Training
• CPC Class Codes: G10L 15/22 Procedures used during a speech recognition process, e.g. man-machine dialogue
• CPC Class Codes: G10L 2015/227 of the speaker; Human-factor methodology

Abstract

Speech recognition techniques are disclosed herein. In one embodiment, a novice mode is available such that when the user is unfamiliar with the speech recognition system, a voice user interface (VUI) may be provided to guide them. The VUI may display one or more speech commands that are presently available. The VUI may also provide feedback to train the user. After the user becomes more familiar with speech recognition, the user may enter speech commands without the aid of the novice mode. In this “experienced mode,” the VUI need not be displayed. Therefore, the user interface is not cluttered.

Claims

1. A method of controlling an electronic device, comprising:

receiving a voice input that indicates speech recognition is requested;

determining whether the voice input is for a first mode or a second mode of speech recognition;

displaying a voice user interface on a display screen of the electronic device in response to determining that the voice input is for the first mode, the voice user interface shows one or more speech commands that are currently available;

providing speech recognition training through the voice user interface when in the first mode; and

controlling the electronic device based on a command in the voice input in response to determining that the voice input is for the second mode.

2. The method of claim 1, wherein the determining whether the voice input is for a first mode or a second mode of speech recognition includes:

recognizing a presently valid command in the voice input; and

determining that the voice input is for the second mode in response to recognizing the presently valid command.

3. The method of claim 1, wherein the providing speech recognition training through the voice user interface includes providing visual feedback while the user is speaking.

4. The method of claim 1, further comprising:

automatically determining that a user is done using speech recognition, the automatically determining is performed while in the first mode; and

removing the voice user interface from the display in response to the automatically determining.

5. The method of claim 1, wherein the voice input for the first mode includes a trigger word followed by a pause of a pre-determined length.

6. The method of claim 5, wherein the voice input for the second mode includes the trigger word followed by the command.

7. The method of claim 1, wherein the voice user interface includes a first region for global commands and a second region for local commands that are specific to an application being presently controlled by the voice input.

8. The method of claim 1, wherein the voice user interface is overlaid on a graphical user interface.

9. The method of claim 1, further comprising receiving a voice command while in the first mode.

10. A multimedia system, comprising:

a monitor for displaying multimedia content;

a microphone for capturing user sounds; and

a computer connected to the microphone and the monitor, the computer driving the monitor, the computer receives a voice input from the microphone;

the computer determines whether the voice input is for a novice mode or an experienced mode of speech recognition;

the computer displays a voice user interface on the monitor in response to determining that the voice input is for the novice mode, the voice user interface shows one or more speech commands that are available;

the computer provides speech recognition training feedback through the voice user interface when in the novice mode;

the computer recognizes a speech recognition command in the voice input if the voice input is for the experienced mode, the speech recognition command is not presented in the voice user interface at the time of the voice input; and

the computer controls the multimedia system based on the speech recognition command in the voice input in response to recognizing the speech recognition command in the voice input.

11. The multimedia system of claim 10, wherein the computer presents visual feedback in the voice user interface while the user is speaking as a part of providing the speech recognition training feedback.

12. The multimedia system of claim 10, wherein the computer:

automatically determines that a user is done using speech recognition, the automatically determining is performed while in the novice mode; and

remove the voice user interface from the display in response to the automatically determining.

13. The multimedia system of claim 10, wherein the computer recognizes a trigger word followed by a pause of a pre-determined length in the voice input as a condition of determining that the voice input is for the novice mode.

14. The multimedia system of claim 13, wherein the computer recognizes the trigger word followed by the command as a condition of determining that the voice input is for the experienced mode.

15. The multimedia system of claim 10, wherein the computer overlays the voice user interface on a graphical user interface.

16. A processor readable storage device having instructions stored thereon, the instructions for programming one or more processors to perform a method for controlling a multimedia system, the method comprising:

receiving a voice input when in a mode in which speech recognition is not currently being used to control the multimedia system;

recognizing a trigger voice signal in the voice input;

determining whether the trigger voice signal is followed by a presently valid speech command;

displaying a speech recognition user interface on a display screen of the multimedia system in response to determining that the trigger voice signal is not followed by any presently valid speech commands, the speech recognition user interface shows one or more speech commands that are presently available to control the multimedia system, the one or more speech commands include the presently valid speech command;

providing speech recognition training through the speech recognition user interface; and

controlling the multimedia system based on the presently valid speech command if it is determined that the trigger voice signal is followed by the presently valid speech command, the controlling the multimedia system if the trigger voice signal is followed by the presently valid speech command is performed without displaying the speech recognition user interface on the display screen.

17. The processor readable storage device of claim 16, wherein the providing speech recognition training through the speech recognition user interface includes providing real-time feedback based on audio input.

18. The processor readable storage device of claim 16, further comprising:

automatically determining that a user is done using speech recognition, the automatically determining is performed while displaying the speech recognition user interface; and

removing the speech recognition user interface from the display in response to the automatically determining.

19. The processor readable storage device of claim 16, wherein determining that the trigger voice signal is not followed by any presently valid speech commands includes determining that a pause of a pre-determined length follows the trigger voice signal.

20. The processor readable storage device of claim 19, further comprising:

receiving a first of the one or more presently valid speech commands;

determining a cost of acting on the first speech command, the cost includes low, medium, and high cost;

controlling the multimedia system in response to the first speech command without any confirmation from the user if the cost is low;

controlling the multimedia system in response to the first speech command with passive confirmation from the user if the cost is medium; and

controlling the multimedia system in response to the first speech command with active confirmation from the user if the cost is high.