Head tracking based gesture control techniques for head mounted displays

• US 9,904,360 B2
• Filed: 11/13/2014
• Issued: 02/27/2018
• Est. Priority Date: 11/15/2013
• Status: Active Grant

• Current Assignee: Kopin Corporation
• Original Assignee: Kopin Corporation
• Inventors: Hennelly, Sean, Andrews, Nathan
• Primary Examiner(s): McLoone, Peter D
• Application Number:
  US14/540,974
• Publication Number:
  US 20150138074A1
• Time in Patent Office: 1,202 Days
• CPC Class Codes: G06F 1/163 Wearable computers, e.g. on a belt
• CPC Class Codes: G06F 3/012 Head tracking input arrangements
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/04812 Interaction techniques based on cursor appearance or behaviour, e.g. being affected by the presence of displayed objects
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/0486 Drag-and-drop

Abstract

A head gesture-based recognition system in Headset Computers (HSC) is disclosed. Notification dialogue boxes can be acknowledged by head nodding or ticking movement in the user interface. Question dialog boxes can be assured by head nods or head shakes in the user interface. Head swiping is also a recognizable form of user input through a head tracker of the HSC. Progress indicators and other visual display feedback are utilized.

Claims

1. A headset computer system, comprising:

a headworn display unit;

a digital processor coupled to the display unit; and

a head tracker operatively coupled to the display unit and processor, the processor configured to be responsive to a user head gesture detected by the head tracker, and to manipulate a pointer presented on the display unit, based on the detected user head gesture, to at least partially overlap a selected object, the selected object being one of a first object that corresponds to a first option and a second object that corresponds to a second option;

when the pointer overlaps the selected object;

(i) the selected object gradually fills over a period of time, and

(ii) a progress indicator is presented on the display in association with the selected object, and the progress indicator gradually fills over a period of time, such that when the progress indicator is completely filled, a command associated with the selected object is consummated.

2. The system of claim 1, wherein the user head gesture is one of a left traced check symbol and a right traced check symbol.

3. The system of claim 2, wherein the processor interprets the check symbol performed from left to right as having a first meaning, and the check symbol performed from right to left has having a second meaning.

4. The system of claim 2, wherein the display unit presents, to the user, a question dialog box having a first option and a second option, the processor interprets a first predefined user head gesture as a selection of the first option and the processor interprets a second predefined user head gesture as a selection of the second option.

5. The system of claim 4, wherein the first predefined user head gesture includes an additional gesture that commonly accompanies the first predefined head gesture, which the processor interprets as a part of the first predetermined head gesture.

6. The system of claim 5, wherein the additional gesture includes one of a head swipe to the left or a head swipe to the right.

7. The system of claim 4, wherein the head swipe to the left causes an indicator associated with the first option to transition from an empty state to a full state, and wherein the head swipe to the right causes an indicator associated with the second option to transition from an empty state to a full state.

8. The system of claim 1, wherein the period of time is selectable by a user of the headset computer system through a setup procedure of the headset computer system.

9. The system of claim 1, further including an automatic speech recognition (ASR) system configured to interpret utterances, wherein the processor combines the interpreted utterances with the detected gesture to produce a computer interface input.

10. A method of making selections on a headset computer system, comprising:

presenting, by a processor on a display unit, a first object that corresponds to a first option and a second object that corresponds to a second option;

detecting, with a head tracker operatively coupled to the display unit and processor, a head gesture performed by a wearer of the headset computer system;

manipulating a pointer presented on the display unit, based on the detected user head gesture, to at least partially overlap a selected object, the selected object being one of a first object that corresponds to a first option and a second object that corresponds to a second option; and

when the pointer overlaps the selected object;

(i) filling the selected object gradually over a period of time, and

(ii) presenting a progress indicator on the display in association with the selected object, and filling the progress indicator gradually over a period of time; and

(iii) consummating a command associated with the selected object when the progress indicator is completely filled.

11. The method of claim 10, wherein the head gesture is one of a left traced check symbol and a right traced check symbol.

12. The method of claim 11, further including interpreting the check symbol performed from left to right as having a first meaning, and a interpreting the check symbol performed from right to left as having a second meaning.

13. The method of claim 11, further including presenting, to the user, a question dialog box having a first option and a second option, interpreting a first head gesture as a selection of the first option and interpreting a second head gesture as a selection of the second option.

14. The method of claim 13, wherein the first head gesture includes an additional gesture that commonly accompanies the first head gesture, which the processor interprets as a part of the first head gesture.

15. The method of claim 14, wherein the additional gesture includes one of a head swipe to the left or a head swipe to the right.

16. The method of claim 10, further including adjusting the period of time based on an input provided by a user of the headset computer system through a setup procedure of the headset computer system.