Arrangement, method and computer program for controlling a computer apparatus based on eye-tracking

• US 20070164990A1
• Filed: 05/24/2005
• Published: 07/19/2007
• Est. Priority Date: 06/18/2004
• Status: Active Grant

• Current Assignee: Tobii Technology AB
• Original Assignee: Tobii Technology AB
• Inventors: Skogo, Marten, Bjorklund, Christoffer, Eskilsson, Henrik, Jacobson, Magnus
• Granted Patent: US 8,185,845 B2
• Time in Patent Office: Days
• US Class Current: 345/156
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883

Abstract

A computer based eye-tracking solution is disclosed. A computer apparatus is associated with one or more graphical displays (GUI components) that may be manipulated based on user-generated commands. An event engine is adapted to receive an eye-tracking data signal that describes a user'"'"'s point of regard on the display. Based on the signal, the event engine is adapted to produce a set of non-cursor controlling event output signals, which influence the GUI-components. Each non-cursor controlling event output signal describes a particular aspect of the user'"'"'s ocular activity in respect of the display. Initially, the proposed event engine receives a control signal request from each of the GUI-components. The control signal request defines a sub-set of the set of non-cursor controlling event output signals which is required by the particular GUI-component. The event engine delivers non-cursor controlling event output signals to the GUI-components in accordance with each respective control signal request.

Claims

1. An arrangement for controlling a computer apparatus associated with a graphical display, the display presenting a representation of at least one GUI-component which is adapted to be manipulated based on user-generated commands, the arrangement comprising an event engine adapted to receive an eye-tracking data signal describing a user'"'"'s point of regard on the displays, and at least based on the eye-tracking data signal produce a set of non-cursor controlling event output signals influencing the at least one GUI-component, each non-cursor controlling event output signal describing a particular aspect of the user'"'"'s ocular activity in respect of the display, characterized in that the event engine is adapted to:

receive a control signal request from each of the at least one GUI-component, the control signal request defining a sub-set of the set of non-cursor controlling event output signals which is required by the GUI-component, and

deliver non-cursor controlling event output signals to the at least one GUI-component in accordance with each respective control signal request.

2. An arrangement according to claim 1, wherein the computer apparatus is adapted to:

receive a cursor control signal, and

control a graphical pointer on the display in response to the cursor control signal.

3. An arrangement according to claim 1, wherein at least one of the at least one GUI-component is adapted to generate at least one respective output control signal upon a user manipulation of the component.

4. An arrangement according to claim 1, wherein the event engine is adapted to produce at least a first signal of the non-cursor controlling event output signals based on a dynamic development of the eye-tracking data signal.

5. An arrangement according to claim 4, wherein the first signal represents a particular gaze pattern over the display.

6. An arrangement according to claim 5, wherein the at least one GUI-component is adapted to interpret the first signal as an estimated intention of the user, and trigger a user manipulation of the component in response to the estimated intention.

7. An arrangement according to claim 5, wherein the at least one GUI-component is adapted to interpret the first signal as an estimated attention level of the user, and trigger a user manipulation of the component in response to the estimated attention level.

8. An arrangement according to claim 5, wherein the at least one GUI-component is adapted to interpret the first signal as a state-of-mind parameter of the user, and trigger a user manipulation of the component in response to the state-of-mind parameter.

9. An arrangement according to claim 1, wherein the event engine is adapted to receive at least one auxiliary input signal and produce the set of non-cursor controlling event output signals on the further basis of the at least one auxiliary input signal.

10. An arrangement according to claim 1, wherein the at least one auxiliary input signal is originated from at least one of a button, a switch, a speech signal, a movement pattern of an input member, a gesture pattern, a facial expression and an EEG-signal.

11. A method of controlling a computer apparatus associated with graphical display, the display representing at least one GUI-component which is adapted to be manipulated based on user-generated commands, the method comprising:

receiving an eye-tracking data signal which describes a user'"'"'s point of regard on the display,

producing a set of non-cursor controlling event output signals at least based on the eye-tracking data signal, the set of non-cursor controlling event output signals influencing the at least one GUI-component, and each non-cursor controlling event output signal describing a particular aspect of the user'"'"'s ocular activity in respect of the display,

receiving a control signal request from each of the at least one GUI-component, the control signal request defining a sub-set of the set of non-cursor controlling event output signals which is required by the GUI-component, and

delivering non-cursor controlling event output signals to the at least one GUI-component in accordance with each respective control signal request.

12. A method according to claim 11 further comprising receiving a cursor control signal, and

controlling a graphical pointer on the display in response to the cursor control signal.

13. A method according to claim 11, wherein each GUI-component being adapted to generate at least one respective output control signal upon a user manipulation of the component.

14. A method according to claim 11, further comprising producing at least a first signal of the non-cursor controlling event output signals based on a dynamic development of the eye-tracking data signal.

15. A method according to claim 14, wherein the first signal representing a particular gaze pattern over the display.

16. A method according to claim 15, wherein the at least one GUI-component being adapted to interpret the first signal as an estimated intention of the user, and trigger a user manipulation of the component in response to the estimated intention.

17. A method according to claim 15, wherein at least one GUI-component being adapted to interpret the first signal as an estimated attention level of the user, and trigger a user manipulation of the component in response to the estimated attention level.

18. A method according to claim 15, wherein at least one GUI-component being adapted to interpret the first signal as a state-of-mind parameter of the users, and trigger a user manipulation of the component in response to the state-of-mind parameter.

19. A method according to claim 11, further comprising:

receiving at least one auxiliary input signal, and

producing the set of non-cursor controlling event output signals on the further basis of the at least one auxiliary input signal.

20. A method according to claim 11, wherein the at least one auxiliary input signal being originated from at least one of a button, a switch, a speech signal, a movement pattern of an input member, a gesture pattern, a facial expression and an EEG-signal.

21. A computer program directly loadable into the internal memory of a computer, comprising software for controlling the steps of claim 11 when said program is run on the computer.

22. A computer readable medium, having a program recorded thereon, where the program is to make a computer control the steps of claim 11.