Automatic speech recognition (ASR) feedback for head mounted displays (HMD)

• US 10,402,162 B2
• Filed: 01/09/2019
• Issued: 09/03/2019
• Est. Priority Date: 11/15/2013
• Status: Active Grant

• Current Assignee: Kopin Corporation
• Original Assignee: Kopin Corporation
• Inventors: Parkinson, Christopher, Woodall, James
• Primary Examiner(s): Pham, Thierry L
• Application Number:
  US16/243,941
• Publication Number:
  US 20190146753A1
• Time in Patent Office: Days
• Field of Search: 704249
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: G10L 15/22 Procedures used during a speech recognition process, e.g. man-machine dialogue
• CPC Class Codes: G10L 17/22 Interactive procedures; Man-machine interfaces
• CPC Class Codes: G10L 2015/225 Feedback of the input speech

Abstract

Feedback mechanisms to the user of a Head Mounted Display (HMD) are provided. It is important to provide feedback to the user when speech is recognized as soon as possible after the user utters a voice command. The HMD displays and/or audibly renders an ASR acknowledgment in a manner that ensures the user that the HMD has received/understood his voiced command.

Claims

1. A method of acknowledging a voice command, comprising:

receiving, by a headset computer, a voice command;

interpreting, by the headset computer, the voice command; and

acknowledging, by the headset computer, the received voice command, in response to interpreting the voice command, by providing visual feedback to the user on a display such that the visual feedback is presented to the user on of (a) within 500 mS of when the voice command is interpreted and (b) within two cycles of a frame rate of the display of when the voice command is interpreted.

2. The method of claim 1, further including converting, using a microphone, an utterance corresponding to the voice command into an electrical signal.

3. The method of claim 1, wherein interpreting the voice command includes determining if the voice command is a member of a predetermined suite of voice commands.

4. The method of claim 1, wherein acknowledging the received voice command includes presenting an automatic speech recognition (ASR) notification clue.

5. The method of claim 4, wherein the ASR notification clue includes a visual clue.

6. The method of claim 5, wherein the visual clue is presented within 500 mS of when the utterance is interpreted.

7. The method of claim 5, wherein the visual clue is instantiated on a display within two cycles of the frame rate of the display.

8. The method of claim 5, wherein the visual clue remains on the display for a predetermined time after the visual clue is instantiated, and removed from the display after the predetermined time has elapsed.

9. The method of claim 4, wherein the ASR notification clue includes an audio clue.

10. The method of claim 9, wherein the audio clue is a chirp.

11. An apparatus for acknowledging a voice command, comprising:

a headset computer, including a processor, configured to;

receive a voice command;

interpret the voice command; and

acknowledge the received voice command, in response to interpreting the voice command by providing visual feedback to the user on a display such that the visual feedback is presented to the user on of (a) within 500 mS of when the voice command is interpreted and (b) within two cycles of a frame rate of the display of when the voice command is interpreted.

12. The apparatus of claim 11, wherein the headset computer is further configured to convert, using a microphone, an utterance corresponding to the voice command into an electrical signal.

13. The apparatus of claim 11, wherein the headset computer is further configured to determine if the voice command is a member of a predetermined suite of voice commands.

14. The apparatus of claim 11, the headset computer is further configured to present an automatic speech recognition (ASR) notification clue.

15. The apparatus of claim 14, wherein the ASR notification clue includes a visual clue.

16. The apparatus of claim 15, wherein the visual clue is presented within 500 mS of when the utterance is interpreted.

17. The apparatus of claim 15, wherein the visual clue is instantiated on a display within two cycles of the frame rate of the display.

18. The apparatus of claim 15, wherein the visual clue remains on the display for a predetermined time after the visual clue is instantiated, and removed from the display after the predetermined time has elapsed.

19. The apparatus of claim 14, wherein the ASR notification clue includes an audio clue.

20. The apparatus of claim 19, wherein the audio clue is a chirp.