Delay warp gaze interaction

• US 9,619,020 B2
• Filed: 03/03/2014
• Issued: 04/11/2017
• Est. Priority Date: 03/01/2013
• Status: Active Grant

• Current Assignee: Tobii Technology AB
• Original Assignee: Tobii Technology AB
• Inventors: George-Svahn, Erland, Henderek, David Figgins, Lannsj, Rebecka, Skog, Mrten, Elvesj, John
• Primary Examiner(s): Haley, Joseph
• Assistant Examiner(s): Iluyomade, Ifedayo
• Application Number:
  US14/195,789
• Publication Number:
  US 20140247215A1
• Time in Patent Office: 1,135 Days
• Field of Search: None
• CPC Class Codes: G06F 3/012 Head tracking input arrangements
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06F 3/02 Input arrangements using manually operated switches, e.g. using keyboards or dials
• CPC Class Codes: G06F 3/0227 Cooperation and interconnection of the input arrangement with other functional units of a computer G06F3/023 - G06F3/037 take precedence
• CPC Class Codes: G06F 3/033 Pointing devices displaced or positioned by the user , e.g. mice, trackballs, pens or joysticks; Accessories therefor digitisers characterised by the transducing means G06F3/041
• CPC Class Codes: G06F 3/041 Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
• CPC Class Codes: G06F 3/0481 based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/04845 for image manipulation, e.g. dragging, rotation, expansion or change of colour
• CPC Class Codes: G06F 3/0485 Scrolling or panning

Abstract

A computer system can be controlled with non-contact inputs, such as eye-tracking devices. A visual indicator can be presented on a display to indicate the location where a computer function will take place (e.g., a common cursor). The visual indicator can be moved to a gaze target in response to continued detection of an action (e.g., touchpad touch) by a user for a predetermined period of time. A delay between the action and the movement of the visual indicator can allow a user time to “abort” movement of the visual indicator. Additionally, once the visual indicator has moved, the visual indicator can be controlled with additional precision as the user moves the gaze while continuing the action (e.g., continued holding of the touchpad).

Claims

1. A method of providing user input to a computer device, the method comprising:

detecting a user gaze relative to a display;

detecting a contact action from the user while a visual indicator is displayed at a first location of the display, the first location being different from a location of the user gaze,

wherein the contact action is associated with performing a computer input function, and

wherein the contact action comprises of at least one of;

physical contact with a contact-required input device or close proximity to the contact-required input device;

upon detection of the contact action, continuing to display the visual indicator at the first location while displaying a visual marker at the location of the user gaze;

detecting that the contact action is maintained for a predefined period of time, wherein during the predefined period of time performing the computer input function associated with the contact action is delayed and the visual indicator remains at the first location;

after the predefined time period and in response to detecting a cessation of the contact action during the predefined period of time, performing the computer input function associated with the contact action at the first location of the display; and

after the predefined time period and in response to detecting a continuation of the contact action after the predefined period of time, moving the visual indicator to the location of the user gaze.

2. The method of claim 1, wherein the contact action may be any of depressing a button or touching a touch-sensitive device.

3. The method of claim 1, wherein the predefined period of time is approximately 200 milliseconds (ms).

4. The method of claim 1, further comprising, after moving the visual indicator to the location of the user gaze, performing a second computer input function at the location of the visual indicator.

5. The method of claim 1, further comprising:

in response to detecting a further continuation of the contact action after moving the visual indicator to the location of the user gaze, moving the visual indicator at a slower rate and in a direction indicated by an additional user input until the further continuation of the contact action is no longer detected.

6. The method of claim 5, wherein the additional user input is the detected movement of the user'"'"'s gaze.

7. The method of claim 5, further comprising, after the contact action is no longer detected, performing a second computer input function at the location of the visual indicator.

8. A computing device, comprising:

at least one processor, a memory component, a display device, a gaze-detection device, and at least one additional user input device;

wherein the processor is programmed to;

detect a user gaze relative to a display;

detect a contact action from the user while a visual indicator is displayed at a first location of the display, the first location being different from a location of the user gaze;

wherein the contact action is associated with performing a computer input function, and wherein the contact action comprises of at least one;

of physical contact with a contact-required input device or dose proximity to the contact-required input device;

upon detection of the contact action, continuing to display the visual indicator at the first location while displaying a visual marker at the location of the user gaze;

detecting that the contact action is maintained for a predefined period of time, wherein during the predefined period of time and while the visual indicator is displayed at the first location, performing the computer input function associated with the contact action is delayed and the visual indicator remains at the first location;

after the predefined period of time and in response to detecting a cessation of the contact action during the predefined period of time, performing the computer input function associated with the contact action at the first location of the display; and

after the predefined period of time and in response to detecting a continuation of the contact action after the predefined period of time, moving the visual indicator to the location of the user gaze.

9. The computing device of claim 8, wherein the contact action may be any of depressing a button or touching a touch-sensitive device.

10. The computing device of claim 8, wherein the predefined period of time is approximately 200 milliseconds (ms).

11. The computing device of claim 8, further comprising, after moving the visual indicator to the location of the user gaze, performing a second computer input function at the location of the visual indicator.

12. The computing device of claim 8, further comprising:

in response to detecting a further continuation of the contact action after moving the visual indicator to the location of the user gaze, moving the visual indicator at a slower rate and in a direction indicated by an additional user input until the further continuation of the contact action is no longer detected.

13. The computing device of claim 12, wherein the additional user input is the detected movement of the user'"'"'s gaze.

14. The computing device of claim 12, further comprising, after the continuation of the contact action is no longer detected, performing a second computer input function at the location of the visual indicator.

15. A non-transitory computer-readable storage medium storing program instructions, wherein the program instructions, when executed by one or more computing devices, implement:

detecting a user gaze relative to a display;

detecting a contact action from the user while a visual indicator is displayed at a first location of the display, the first location being different from a location of the user gaze;

wherein the contact action is associated with performing a computer input function, and

wherein the contact action comprises of at least one of;

physical contact with a contact-required input device or close proximity to the contact-required input device;

upon detection of the contact action, continuing to display the visual indicator at the first location while displaying a visual marker at the location of the user gaze;

detecting that the contact action is maintained for a predefined period of time, wherein during the predefined period of time and while the visual indicator is displayed at the first location, performing the computer input function associated with the contact action is delayed and the visual indicator remains at the first location;

after the predefined time period and in response to detecting a cessation of the contact action during the predefined period of time, performing the computer input function associated with the contact action at the first location of the display; and

after the predefined time period and in response to detecting a continuation of the contact action after the predefined period of time, moving the visual indicator to the location of the user gaze.

16. The non-transitory computer-readable storage medium of claim 15, wherein the contact action may be any of depressing a button or touching a touch-sensitive device.

17. The non-transitory computer-readable storage medium of claim 15, wherein the predefined period of time is approximately 200 milliseconds (ms).

18. The non-transitory computer-readable storage medium of claim 15, further comprising, after moving the visual indicator to the location of the user gaze, performing a second computer input function at the location of the visual indicator.

19. The non-transitory computer-readable storage medium of claim 15, further comprising:

in response to detecting a further continuation of the contact action after moving the visual indicator to the location of the user gaze, moving the visual indicator at a slower rate and in a direction indicated by an additional user input until the further continuation of the contact action is no longer detected.

20. The non-transitory computer-readable storage medium of claim 19, wherein the additional user input is the detected movement of the user'"'"'s gaze.

21. The non-transitory computer-readable storage medium of claim 19, further comprising, after the further continuation of the contact action is no longer detected, performing a second computer input function at the location of the visual indicator.