Context sensitive overlays in voice controlled headset computer displays

• US 10,013,976 B2
• Filed: 03/13/2013
• Issued: 07/03/2018
• Est. Priority Date: 09/20/2010
• Status: Active Grant

• Current Assignee: Kopin Corporation
• Original Assignee: Kopin Corporation
• Inventors: Woodall, James, Parkinson, Christopher
• Primary Examiner(s): Hoang, Phi
• Application Number:
  US13/799,790
• Publication Number:
  US 20130231937A1
• Time in Patent Office: 1,938 Days
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/012 Head tracking input arrangements
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: G10L 15/22 Procedures used during a speech recognition process, e.g. man-machine dialogue

Abstract

In headset computers that leverage voice commands, often the user does not know what voice commands are available. In one embodiment, a method includes providing a user interface in a headset computer and, in response to user utterance of a cue toggle command, displaying at least one cue in the user interface. Each cue can correspond to a voice command associated with code to execute. In response to user utterance of the voice command, the method can also include executing the code associated with the voice command. The user can therefore ascertain what voice commands are available.

Claims

1. A method comprising:

providing a graphical user interface having a plurality of controls to a headset computer from a host device;

displaying the provided graphical user interface on a microdisplay of the headset computer;

in response to user utterance of a cue toggle command, displaying on the provided graphical user interface a semi-transparent overlay of a screen view and displaying a plurality of cues within the semi-transparent overlay, each cue associated with a corresponding one of the plurality of controls and located proximate to its corresponding one of the plurality of controls, each cue further providing a voice command associated with code to execute the associated one of the plurality of controls, the semi-transparent overlay generated at a local processor of the headset computer and fading away after a period of time via a timing mechanism employed to refresh the screen view, the cue toggle command available at all times; and

in response to user utterance of the voice command, executing the code associated with the voice command.

2. The method of claim 1, wherein displaying the cue includes displaying words that activate the voice command.

3. The method of claim 1, wherein displaying the cue includes displaying the cue in the graphical user interface providing the voice command associated with the control, the control displayed in the graphical user interface.

4. The method of claim 1, wherein displaying the cue includes displaying the cue in the graphical user interface providing the voice command associated with the control, the control hidden from the graphical user interface.

5. The method of claim 1, wherein displaying the cue includes displaying the cue in the graphical user interface providing the voice command associated with the control, the control being a global headset control.

6. The method of claim 1, wherein the cue is loaded from a control, the control indicating the cue and voice command.

7. The method of claim 1, wherein each of the plurality of cues is displayed in order of relevance.

8. A system for displaying a user interface in a headset computer, the system comprising:

a processor local to the headset computer; and

a memory with computer code instructions stored thereon, the processor and the memory, with the computer code instructions being configured to cause the system to;

receive a graphical user interface having a plurality of controls from a host device;

display, via a microdisplay of the headset computer, the provided graphical user interface;

in response to user utterance of a cue toggle command, displaying on the provided graphical user interface a semi-transparent overlay of a screen view and displaying a plurality of cues within the semi-transparent overlay, each cue associated with a corresponding one of the plurality of controls and located proximate to its corresponding one of the plurality of controls, each cue further providing to a voice command associated with code to execute the associated one of the plurality of controls, in the graphical user interface, the semi-transparent overlay generated at the local processor of the headset computer and configured to fade away after a period of time via a timing mechanism employed to refresh the screen view, the cue toggle command available at all times; and

in response to user utterance of the voice command, execute code associated with the voice command.

9. The system of claim 8, wherein displaying the semi-transparent overlay further displays words that activate the voice command.

10. The system of claim 8, wherein displaying the semi-transparent overlay further displays a cue includes displaying a cue in the graphical user interface providing a voice command associated with the control, the control displayed in the graphical user interface.

11. The system of claim 8, wherein displaying the semi-transparent overlay further displays the cue in the graphical user interface providing the voice command associated with the control, the control hidden from the graphical user interface.

12. The system of claim 8, wherein displaying the semi-transparent overlay further displays the cue in the graphical user interface providing the voice command associated with the control, the control being a global headset control.

13. The system of claim 8, wherein the cue is loaded from a control, the control indicating the cue and voice command.

14. The system of claim 8, wherein each of the plurality of cues is displayed in order of relevance.

15. A method of developing a graphical user interface in a headset computer, the method comprising:

embedding a voice command in a control for the graphical user interface, the voice command associated with the control;

providing the graphical user interface with the control to a headset computer from a host device; and

displaying a semi-transparent overlay on the graphical user interface, the semi-transparent overlay including a cue providing the voice command, the cue located proximate to its corresponding one of the plurality of controls, wherein the displaying of the semi-transparent overlay is responsive to a cue toggle command and generated at a local processor of the headset computer, the semi-transparent overlay fading away after a period of time via a timing mechanism employed to refresh the screen view, the cue toggle command available at all times.

16. The method of claim 15, wherein the cue includes words that activate the voice command.

17. The method of claim 15, wherein the cue provides the voice command associated with the control displayed in the graphical user interface.

18. The method of claim 15, wherein the cue provides the voice command associated with the control hidden from the graphical user interface.

19. The method of claim 15, wherein the cue provides the voice command associated with the control being a global headset control.

20. The method of claim 15, wherein the cue is loaded from a control, the control indicating the cue and voice command.