Arrangement, method and computer program for controlling a computer apparatus based on eye-tracking

• US 9,996,159 B2
• Filed: 08/06/2013
• Issued: 06/12/2018
• Est. Priority Date: 06/18/2004
• Status: Active Grant

• Current Assignee: Tobii Technology AB
• Original Assignee: Tobii Technology AB
• Inventors: Bjrklund, Christoffer, Eskilsson, Henrik, Jacobson, Magnus, Skog, Mrten
• Primary Examiner(s): Long, Andrea
• Application Number:
  US13/960,361
• Publication Number:
  US 20130318457A1
• Time in Patent Office: 1,771 Days
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883

Abstract

A computer apparatus is associated with a graphical display presenting at least one GUI-component adapted to be manipulated based on user-generated commands. An event engine is adapted to receive an eye-tracking data signal that describes a user'"'"'s point of regard on the display. Based on the signal, the event engine produces a set of non-cursor controlling event output signals, which influence the at least one GUI-component. Each non-cursor controlling event output signal describes a particular aspect of the user'"'"'s ocular activity in respect of the display. Initially, the event engine receives a control signal request from each of the at least one GUI-component. The control signal request defines a sub-set of the set of non-cursor controlling event output signals which is required by the particular GUI-component. The event engine delivers non-cursor controlling event output signals to the at least one GUI-component in accordance with each respective control signal request.

Claims

1. An arrangement for controlling a computer apparatus associated with a graphical display, wherein the apparatus comprises a hardware implementation or a non-transitory computer-readable medium storing executable instructions and the display is configured to display a representation of a text input field, the arrangement comprising:

a plurality of applications, wherein;

each of the applications has a graphical user interface (GUI) component that the graphical display is configured to display, and

each of the applications uses a different subset of gaze-based output signals in association with controlling the GUI component of the application; and

an event engine configured to receive an eye-tracking data signal describing a user'"'"'s point of regard on the display, and configured to generate a set of gaze-based output signals based on the eye-tracking data signal, the set comprising the different subsets of gaze-based output signals, wherein upon receiving a request from an application that uses a GUI component presenting the text input field on the graphical display;

the event engine responds with a subset of the gaze-based output signals used by the application,

the subset of the gaze-based output signals is based on a determination that the user'"'"'s point of regard is within bounds of the text input field for a predetermined period of time, and

the subset of the gaze-based output signals influences the application to expand the text input field such that more information than was initially visible in the text input field is displayed.

2. The arrangement according to claim 1, wherein the display further displays a second representation of at least one of a button, icon, text field, text input field or menu.

3. The arrangement according to claim 2, wherein upon expansion of the text input field, the expanded text input field covers the second representation.

4. The arrangement according to claim 3, wherein the event engine receives the eye-tracking data from an eye-tracker.

5. The arrangement according to claim 4, wherein the event engine influences an application controlling display of the text input field and second representation.

6. A method for controlling a computer apparatus associated with a graphical display and with applications, the display displaying a representation of a text input field, the method comprising:

receiving, by an event engine, an eye-tracking data signal describing a user'"'"'s point of regard on the display, the event engine configured to generate a set of gaze-based output signals based on the eye-tracking data signal, the set comprising different subsets of gaze-based output signals, each of the different subsets corresponding to one of the applications, and

upon receiving, by the event, engine, a request from an application that uses a graphical user interface (GUI) component presenting the text input field on the graphical display;

responding, by the event engine, with a subset of the gaze-based output signals used by the application,

the subset of the gaze-based output signals being based on a determination that the user'"'"'s point of regard is within bounds of the representation of the text input field for a predetermined period of time, and

the subset of the gaze-output signals the influencing application to expand the text input field such that more information than was initially visible in the text input field is displayed.

7. The method according to claim 6, wherein the display further displays a second representation of a button, icon, text field, text input field or menu.

8. The method according to claim 7, further comprising covering the second representation upon expansion of the text input field.

9. The method according to claim 8, further comprising receiving, by the event engine, the eye-tracking data from an eye-tracker.

10. The method according to claim 9, further comprising influencing, by the event engine, an application controlling display of the text input field and second representation.

11. A non-transitory computer readable medium containing a computer program product for controlling a computer apparatus associated with a graphical display and with applications, the display displaying a representation of a text input field, the computer program product comprising computer-executable instructions for:

receiving, by an event engine, an eye-tracking data signal describing a user'"'"'s point of regard on the display, the event engine configured to generate a set of gaze-based output signals based on the eye-tracking data signal, the set comprising different subsets of gaze-based output signals, each of the different subsets corresponding to one of the applications, and

upon receiving, by the event, engine, a request from an application that uses a graphical user interface (GUI) component presenting the text input field on the graphical display;

responding, by the event engine, with a subset of the gaze-based output signals used by the application,

the subset of the gaze-based output signals being based on a determination that the user'"'"'s point of regard is within bounds of the representation of the text input field for a predetermined period of time, and

the subset of the gaze-output signals influencing application to expand the text input field such that more information than was initially visible in the text input field is displayed.

12. The non-transitory computer readable medium according to claim 11, wherein the display further displays a second representation of at least one of a button, icon, text field, text input field or menu.

13. The non-transitory computer readable medium according to claim 12, wherein upon expansion of the text input field, the expanded text input field covers the second representation.

14. The non-transitory computer readable medium according to claim 13, wherein the computer program product further comprises computer-executable instructions for comprising receiving, by the event engine, the eye-tracking data from an eye-tracker.

15. The non-transitory computer readable medium according to claim 14, wherein the computer program product further comprises computer-executable instructions for influencing, by the event engine, an application controlling display of the text input field.