Confirmation of speech commands for control of headset computers

• US 9,620,144 B2
• Filed: 12/27/2013
• Issued: 04/11/2017
• Est. Priority Date: 01/04/2013
• Status: Active Grant

• Current Assignee: Kopin Corporation
• Original Assignee: Kopin Corporation
• Inventors: Parkinson, Christopher, Jacobsen, Jeffrey J., Pombo, Stephen A., Ferguson, David B.
• Primary Examiner(s): He, Jialong
• Application Number:
  US14/142,280
• Publication Number:
  US 20140195247A1
• Time in Patent Office: 1,201 Days
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G06F 1/3215 Monitoring of peripheral devices
• CPC Class Codes: G06F 3/16 Sound input; Sound output speech processing G10L
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: G10L 15/22 Procedures used during a speech recognition process, e.g. man-machine dialogue
• CPC Class Codes: G10L 2015/225 Feedback of the input speech
• CPC Class Codes: G10L 21/06 Transformation of speech into a non-audible representation, e.g. speech visualisation or speech processing for tactile aids G10L15/26 takes precedence

Abstract

Presented are improvements for speech recognition systems used to control devices. Features include two-stage confirmation, two-stage limited speech recognition mode, and two-stage wake-up for speech driven applications and systems. A headset computer device includes such staged confirmation operation.

Claims

1. A method of speech control in a computer application, comprising:

given a headset computer having a microphone and a display, receiving a sound input via the microphone;

processing the sound input using a speech recognition engine coupled to the headset computer;

interpreting the sound input to be a command;

assessing a level of criticality of an action associated with the command;

determining that the assessed level of criticality meets or exceeds a threshold level of criticality; and

in response to the determination that the assessed level of criticality meets or exceeds the threshold level of criticality;

(i) displaying a first dialog box on the display,

(ii) receiving via the microphone a first confirmatory utterance corresponding to a prompt in the first dialog box,

(iii) displaying a second dialog box on the display in response to the receipt of the first confirmatory utterance, and

(iv) conditioning headset computer performance of the action on a user making a second confirmatory utterance corresponding to a prompt in the second dialog box, wherein the displaying of the second dialog box is configured to automatically time out and the command is cancelled if a second confirmatory utterance is not received within a defined time period.

2. The method of claim 1, wherein the displaying of the first dialog box is able to automatically time-out.

3. The method of claim 1, wherein the command is a command for the headset computer to disengage from a low power sleep mode.

4. The method of claim 1, wherein the command is a command for the headset computer to disengage from a limited speech recognition mode.

5. The method of claim 1, wherein the first confirmatory utterance and the second confirmatory utterance are different from each other.

6. A speech control apparatus comprising:

given a headset computer having a display and a microphone configured to receive a sound input;

a speech recognition engine configured to interpret the sound input and as part of that interpretation determine whether the sound input is a command, assess a level of criticality of an action associated with the command, and determine that the assessed level of criticality meets or exceeds a threshold level of criticality; and

a processor communicatively coupled to the speech recognition engine, and in response to the determination by the speech recognition engine that the assessed level of criticality meets or exceeds the threshold level of criticality, configured to;

(i) display a first dialog box on the display,

(ii) receive via the microphone a first confirmatory utterance corresponding to a prompt in the first dialog box;

(iii) display a second dialog box on the display in response to the receipt of the first confirmatory utterance, and

(iv) condition headset computer performance of the action on a user making a second confirmatory utterance corresponding to a prompt in the second dialog box, wherein the displaying of the second dialog box is configured to automatically time out and the command is cancelled if a second confirmatory utterance is not received within a defined time period.

7. The apparatus of claim 6, wherein the first dialog box is able to automatically time-out.

8. The apparatus of claim 6, wherein the command is a command for the headset computer to disengage from a low power sleep mode.

9. The apparatus of claim 6, wherein the command is a command for the headset computer to disengage from a limited speech recognition mode.

10. The apparatus of claim 6, wherein the first confirmatory utterance and the second confirmatory utterance are different from each other.

11. A headset computer comprising:

a display;

a microphone receiving sound input;

a speech recognition engine configured to interpret the sound input and as part of that interpretation determine whether the sound input is a command, assess a level of criticality of an action associated with the command, and determine that the assessed level of criticality meets or exceeds a threshold level of criticality; and

a processor communicatively coupled to the speech recognition engine, and in response to the determination by the speech recognition engine that the assessed level of criticality meets or exceeds the threshold level of criticality, configured to;

(i) display a first dialog box on the display,

(ii) receive via the microphone a first confirmatory utterance corresponding to a prompt in the first dialog box;

(iii) display a second dialog box on the display in response to the receipt of the first confirmatory utterance, and

(iv) condition headset computer performance of the action on a user making a second confirmatory utterance corresponding to a prompt in the second dialog box, wherein the displaying of the second dialog box is configured to automatically time out and the command is cancelled if a second confirmatory utterance is not received within a defined time period.