ARRANGEMENT, METHOD AND COMPUTER PROGRAM FOR CONTROLLING A COMPUTER APPARATUS BASED ON EYE-TRACKING

• US 20130326431A1
• Filed: 08/06/2013
• Published: 12/05/2013
• Est. Priority Date: 06/18/2004
• Status: Active Grant

• Current Assignee: Tobii Technology AB
• Original Assignee: Tobii Technology AB
• Inventors: BJRKLUND, Christoffer, ESKILSSON, Henrik, JACOBSON, Magnus, SKOG, Mrten
• Granted Patent: US 10,203,758 B2
• Time in Patent Office: Days
• US Class Current: 715/863
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883

Abstract

A computer apparatus is associated with a graphical display presenting at least one GUI-component adapted to be manipulated based on user-generated commands. An event engine is adapted to receive an eye-tracking data signal that describes a user'"'"'s point of regard on the display. Based on the signal, the event engine produces a set of non-cursor controlling event output signals, which influence the at least one GUI-component. Each non-cursor controlling event output signal describes a particular aspect of the user'"'"'s ocular activity in respect of the display. Initially, the event engine receives a control signal request from each of the at least one GUI-component. The control signal request defines a sub-set of the set of non-cursor controlling event output signals which is required by the particular GUI-component. The event engine delivers non-cursor controlling event output signals to the at least one GUI-component in accordance with each respective control signal request.

Claims

1. An arrangement for controlling a computer apparatus associated with a graphical display, the graphical display displaying a representation of at least one GUI-component, the arrangement comprising:

an event engine configured to receive an eye-tracking data signal describing a user'"'"'s point of regard on the display, and configured to influence the representation of the at least one GUI-component at least based on the eye-tracking data signal,

wherein the event engine provides a non-cursor controlling event output signal indicating an estimated state-of-mind parameter of a user.

2. The arrangement according to claim 1, wherein the estimated state-of-mind parameter reflects whether the user is at least one of focused, concentrated, distracted, tired, unfocused or confused.

3. The arrangement according to claim 2, wherein a user manipulation of at least one GUI-component is triggered based on the estimated state-of-mind of the user.

4. The arrangement according to claim 3, wherein the number of and contents of items displayed on the graphical display is altered in response to the estimated state-of-mind of the user.

5. The arrangement according to claim 3, wherein items on the display that have not been observed by the user are highlighted.

6. A method for controlling a computer apparatus associated with a graphical display, the graphical display displaying a representation of at least one GUI-component, the method comprising:

receiving, by an event engine, an eye-tracking data signal describing a user'"'"'s point of regard on the display;

influencing, by the event engine, the representation of the at least one GUI-component at least based on the eye-tracking data signal; and

providing, by the event engine, a non-cursor controlling event output signal indicating an estimated state-of-mind parameter of a user.

7. The method according to claim 6, wherein the estimated state-of-mind parameter reflects whether the user is at least one of focused, concentrated, distracted, tired, unfocused or confused.

8. The method according to claim 7, further comprising triggering a user manipulation of the at least one GUI-component based on the estimated state-of-mind of the user.

9. The method according to claim 8, further comprising altering the number of and contents of items displayed on the graphical display in response to the estimated state-of-mind of the user.

10. The method according to claim 8, further comprising highlighting items on the display that have not been observed by the user.

11. A non-transitory computer readable medium containing a computer program product for controlling a computer apparatus associated with a graphical display, the graphical display displaying a representation of at least one GUI-component, the computer program product comprising computer-executable instructions for:

receiving, by an event engine, an eye-tracking data signal describing a user'"'"'s point of regard on the display;

influencing, by the event engine, the representation of the at least one GUI-component at least based on the eye-tracking data signal; and

providing, by the event engine, a non-cursor controlling event output signal indicating an estimated state-of-mind parameter of a user.

12. The non-transitory computer readable medium according to claim 11, wherein the estimated state-of-mind parameter reflects whether the user is at least one of focused, concentrated, distracted, tired, unfocused or confused.

13. The non-transitory computer readable medium according to claim 12, wherein the computer program product further comprises computer-executable instructions for triggering a user manipulation of the at least one GUI-component based on the estimated state-of-mind of the user.

14. The non-transitory computer readable medium according to claim 13, wherein the computer program product further comprises computer-executable instructions for altering the number of and contents of items displayed on the graphical display in response to the estimated state-of-mind of the user.

15. The non-transitory computer readable medium according to claim 13, wherein the computer program product further comprises computer-executable instructions for highlighting items on the display that have not been observed by the user.