SELECTING USER INTERFACE ELEMENTS VIA POSITION SIGNAL

• US 20140380230A1
• Filed: 06/25/2013
• Published: 12/25/2014
• Est. Priority Date: 06/25/2013
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Inventors: Venable, Morgan Kolya, Kerr, Bernard James, Thukral, Vaibhav, Nister, David
• Granted Patent: US 10,025,378 B2
• Time in Patent Office: Days
• US Class Current: 715/781
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/0486 Drag-and-drop

Abstract

Embodiments are disclosed herein that relate to selecting user interface elements via a periodically updated position signal. For example, one disclosed embodiment provides a method comprising displaying on a graphical user interface a representation of a user interface element and a representation of an interactive target. The method further comprises receiving an input of coordinates of the periodically updated position signal, and determining a selection of the user interface element if a motion interaction of the periodically updated position signal with the interactive target meets a predetermined motion condition

Claims

1. On a computing device, a method of receiving a selection of a user interface element displayed on a graphical user interface via a user input mechanism providing a periodically updated position signal, the method comprising:

displaying on the graphical user interface the user interface element;

displaying on the graphical user interface a representation of an interactive target;

receiving an input of coordinates of the periodically updated position signal; and

determining a selection of the user interface element in response to a motion interaction of the periodically updated position signal with the interactive target meeting a predetermined motion condition.

2. The method of claim 1, wherein the predetermined motion condition includes a sequential eye gaze gesture.

3. The method of claim 2, wherein the sequential eye gaze gesture includes a specific sequence of motion interactions between the periodically updated position signal and one or more interactive targets.

4. The method of claim 3, wherein the specific sequence of motion interactions includes one or more gaze dwells between eye gaze movements.

5. The method of claim 1, wherein the predetermined motion condition includes a pursuit eye gaze gesture based upon motion of the interactive target.

6. The method of claim 5, wherein the pursuit eye gaze gesture includes an eye movement gesture following the interactive target from an initial position to a destination position.

7. The method of claim 1, wherein the predetermined motion condition is one of two or more different motion conditions useable to select the user interface element.

8. The method of claim 1, wherein the periodically updated position signal captures eye gaze gestures.

9. The method of claim 1, wherein the periodically updated position signal captures user head movements.

10. The method of claim 1, wherein the predetermined motion condition comprises motion within a spatial tolerance threshold extending outside of the displayed area of the interactive target.

11. The method of claim 1, wherein the interactive target is displayed persistently on the graphical user interface.

12. The method of claim 1, wherein the interactive target is displayed in response to a user'"'"'s interaction with one or more user interface elements.

13. The method of claim 12, wherein the motion interaction between the displayed interactive target and the periodically updated position signal causes display of a second interactive target.

14. On a computing device, a method of receiving a selection via eye gaze gestures of content displayed on a graphical user interface, the method comprising:

displaying on the graphical user interface a representation of a user interface element;

displaying on the graphical user interface a representation of an interactive target for the user interface element;

receiving an input of coordinates corresponding to an eye gaze gesture;

detecting a motion interaction of the eye gaze gesture with the interactive target; and

determining a selection of the user interface element if the motion interaction meets a predetermined motion condition for eye gaze gestures.

15. The method of claim 14, wherein the predetermined motion condition includes a sequential saccadic gesture.

16. The method of claim 15, wherein the sequential saccadic gesture includes a specific sequence of motion interactions between the eye gaze gesture and one or more interactive targets.

17. The method of claim 14, wherein the predetermined motion condition includes a pursuit eye gaze gesture based upon motion of the interactive target.

18. A head-mounted display system configured to receive a selection of displayed content via eye gaze gestures;

the head-mounted display system comprising;

a near-eye display device;

an eye tracking input system;

a logic subsystem; and

a storage subsystem holding instructions executable by the logic subsystem to

display via the near-eye display device a representation of a user interface element,

display via the near-eye display device a representation of an interactive target for the user interface element,

receive an input of coordinates corresponding to an eye gaze gesture,

detect a motion interaction of the eye gaze gesture with the interactive target, and

select the user interface element if the motion interaction meets a predetermined motion condition for eye gaze gestures.

19. The head-mounted display system of claim 18, wherein the predetermined motion condition includes a sequential saccadic eye gaze gesture.

20. The head-mounted display system of claim 18, wherein the predetermined motion condition includes a pursuit eye gaze gesture based upon motion of the interactive target.