Eye Tracker with Visual Feedback

• US 20090125849A1
• Filed: 10/19/2006
• Published: 05/14/2009
• Est. Priority Date: 10/28/2005
• Status: Active Grant

• Current Assignee: Tobii Technology AB
• Original Assignee: Tobii Technology AB
• Inventors: Bouvin, Johan, Runemo, Per
• Granted Patent: US 8,120,577 B2
• Time in Patent Office: Days
• US Class Current: 715/863
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06F 3/0481 based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
• CPC Class Codes: G06F 3/04812 Interaction techniques based on cursor appearance or behaviour, e.g. being affected by the presence of displayed objects

Abstract

The present invention relates to entry of control commands into a computer in response to eye-tracker detected movement sequences of a point of regard over a graphical display, which is associated with the computer. A processing module in the computer causes the display to present graphical feedback information in the form of a data-manipulating window, which visually confirms any entered control commands. The data-manipulating window is presented at a position relative to an active control object on the display, such that a center point of the window is located within a relatively small offset distance from a center point of the active control object. The window includes graphical information, which symbolizes and activity portion of the display presently being the object of an eye-tracker-controlled entry of control commands. Moreover the information in the window is repeatedly updated in response to the eye-tracker-controlled entry of control commands.

Claims

1. A system for controlling a computer apparatus associated with a graphical display, the computer apparatus being adapted to present a respective on-screen representation of at least one GUI-component on the display, the system comprising:

an eye-tracker system adapted to determine a user'"'"'s point of regard on the display and in response to movement sequences of the point of regard over the display enter control commands into the computer apparatus, the eye-tracker system comprising a processing module adapted to produce graphical feedback information for presentation on the display to visually confirm any entered control commands, wherein the processing module is adapted to;

investigate whether the movement sequence of the point of regard fulfills an activation criterion with respect to an activation zone for any of the at least one control command, and if such a criterion is found to be fulfilled; and

present a data-manipulating window at a position relative to an active control object on the display such that a center point of the window is located within a relatively small offset distance from a center point of the active control object, the window comprising graphical information which symbolizes an activity portion of the display presently being the object of an eye-tracker-controlled entry of control commands, the window being presented such that the activity portion and the window are simultaneously visible on the display, and

wherein the information in the data-manipulating window repeatedly updates in response to the eye-tracker-controlled entry of control commands.

2. The system according to claim 1, wherein the processing module is adapted to determine the active control object based on the movement sequence of the point of regard relative to the activation zone.

3. The system according to claim 2, wherein the movement sequence of the point of regard based on which the processing module is adapted to determine the active control object comprises a first saccade from the activation zone.

4. The system according to claim 1, wherein the at least one control command expresses at least one of:

a navigation direction for a cursor symbol with respect to the display, a rotation of at least one on-screen representation of at least one GUI-component on the display,

a color change of at least one on-screen representation of at least one GUI-component on the display, or

a texture modification of at least one on-screen representation of at least one GUI-component on the display.

5. The system according to claim 4, wherein the at least one control command expresses a navigation direction for a cursor symbol with respect to the display;

and

the processing module is adapted to;

discriminate a navigation direction from a first saccade relative-to the activation zone, and

move a cursor symbol over the display in agreement with the navigation direction.

6. The system according to claim 5, wherein the processing module is adapted to present a set of control objects on the display, each control object in the set being adapted to indicate a respective navigation direction for a cursor symbol relative to an information area.

7. The system according to claim 6, wherein the processing module is adapted to:

present the set of control objects on the display in such a manner that said set moves gradually across the display in agreement with the navigation direction, and

move the cursor over the display in agreement with the navigation direction.

8. The system according to claim 6, wherein the processing module is adapted to:

present the set of control objects at fixed positions on the display, and

move the cursor symbol over the display in agreement with the navigation direction.

9. The system according to claim 1, wherein the display presents an information area comprising editable symbols, and

wherein the processing module is adapted to:

determine at least one added symbol based on a movement sequence of the point of regard over a number of on-screen objects visually representing GUI-components of a software keyboard presented on the display, and

supplement the symbols in the information area with the at least one added symbol.

10. The system according to claim 1, wherein the display presents an information area comprising editable symbols, and

wherein the processing module is adapted to:

investigate whether the point of regard fulfills an activation criterion with respect to an active control object representing a deletion key, and

if such a criterion is found to be fulfilled, delete a sub-set of the symbols, the sub-set comprising at least one of the editable symbols.

11. The system according to claim 1, wherein the set of control objects comprises a single control object, and

wherein the processing module is adapted to:

determine a target location for a first saccade outside the activation zone,

present the single control object at the target position, the single control object including the data-manipulating window, and

move the cursor symbol over the display in agreement with a navigation direction expressed by the first saccade.

12. The system according to claim 1, wherein the processing module is adapted to:

investigate whether the point of regard fulfills a deactivation criterion with respect to the active control object, and

if such a criterion is found to be fulfilled deactivate the active control object.

13. A method of controlling a computer apparatus being associated with a graphical display, the computer apparatus being adapted to present a, respective on-screen representation of at least one GUI-component on the display, the method comprising:

determining a user'"'"'s point of regard on the display and-in response to movement sequences of the point of regard over the display;

receiving control commands entered into the computer apparatus;

producing graphical feedback information for presentation on the display to visually confirm any entered control commands;

investigating whether the movement sequence of the point of regard fulfills an activation criterion with respect to an activation zone for any of the at least one control command, and if such a criterion is found to be fulfilled;

presenting a data-manipulating window at a position relative to an active control object on the display such that a center point of the window is located within a relatively small offset distance from a center point of the active control object, the window comprising graphical information which symbolizes an activity portion of the display presently being the object of an eye-tracker-controlled entry of control commands, the window being presented such that the activity portion and the window are simultaneously visible on the display; and

updating repeatedly the information in the data-manipulating window in response to the eye-tracker-controlled entry of control commands.

14. The method according to claim 13, further comprising:

determining the active control object based on the movement sequence of the point of regard relative to the activation zone.

15. The method according to claim 14, wherein the movement sequence of the point of regards based on which the processing module is adapted to determine the active control object, comprises a first saccade from the activation zone.

16. The method according to claim 13, wherein the at least one control command further comprising:

expressing at least one of;

a navigation direction for a cursor symbol with respect to the display,

a rotation of at least one on-screen representation of at least one GUI-component on the display, a color change of, at least one on-screen representation of at least one GUI-component on the display, or

a texture modification of at least one on-screen representation of at least one GUI-component on the display.

17. The method according to claim 16, wherein the at least one control command expresses a navigation direction for a cursor symbol with respect to the display and the method further comprising:

discriminating a navigation direction from a first saccade relative to the activation zone, and moving a cursor symbol over the display in agreement with the navigation direction.

18. The method according to claim 17, further comprising:

presenting a set of control objects on the display, each control object in the set being adapted to indicate a respective navigation direction for a cursor symbol relative to an information area.

19. The method according to claim 18, further comprising:

presenting the set of control objects on the display in such a manner that said set moves gradually across the display in agreement with the navigation direction; and

moving the cursor over the display in agreement with the navigation direction.

20. The method according to claim 18, further comprising:

presenting the set of control objects at fixed positions on the display; and

moving the cursor symbol over the display in agreement with the navigation direction.

21. The method according to claim 13, wherein the display presents an information area comprising editable symbols, and the method further comprising:

determining at least one added symbol based on a movement sequence of the point of regard over a number of onscreen objects visually representing GUI-components of a software keyboard presented on the display; and

supplementing the symbols in the information area with the at least one added symbol.

22. The method according to claim 13, wherein the display presents an information area comprising editable symbols, and the method further comprising:

investigating whether the point of regard fulfills an activation criterion with respect to an active control object representing a deletion key, and if such a criterion is found to be fulfilled; and

deleting a sub-set of the symbols, the sub-set comprising at least one of the editable symbols.

23. The method according to claim 13, wherein the set of control objects comprising a single control object, and the method further comprising:

determining a target location for a first saccade outside the activation zone;

presenting the single control object at the target position, the single control object including the data-manipulating window; and

moving the cursor symbol over the display in agreement with a navigation direction expressed by the first saccade.

24. The method according to claim 13, further comprises:

investigating whether the point of regard fulfills a deactivation criterion with respect to the active control object, and if such a criterion is found to be fulfilled;

deactivating the active control object.

25. A computer program directly loadable into the internal memory of a computer, comprising software for controlling the process of claim 13 when said program is run on the computer.

26. A computer readable medium, having a program recorded thereon, where the program is to make a computer control the process of claim 13.