Arrangement, method and computer program for controlling a computer apparatus based on eye-tracking

• US 10,025,389 B2
• Filed: 12/22/2011
• Issued: 07/17/2018
• Est. Priority Date: 06/18/2004
• Status: Active Grant

• Current Assignee: Tobii Technology AB
• Original Assignee: Tobii Technology AB
• Inventors: Bjorklund, Christoffer, Eskilsson, Henrik, Jacobson, Magnus, Skogo, Marten
• Primary Examiner(s): LONG, ANDREA NATAE
• Application Number:
  US13/335,502
• Publication Number:
  US 20120146895A1
• Time in Patent Office: 2,399 Days
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883

Abstract

A computer apparatus is associated with a graphical display presenting at least one GUI-component adapted to be manipulated based on user-generated commands. An event engine is adapted to receive an eye-tracking data signal that describes a user'"'"'s point of regard on the display. Based on the signal, the event engine produces a set of non-cursor controlling event output signals, which influence the at least one GUI-component. Each non-cursor controlling event output signal describes a particular aspect of the user'"'"'s ocular activity in respect of the display. Initially, the event engine receives a control signal request from each of the at least one GUI-component. The control signal request defines a sub-set of the set of non-cursor controlling event output signals which is required by the particular GUI-component. The event engine delivers non-cursor controlling event output signals to the at least one GUI-component in accordance with each respective control signal request.

Claims

1. An arrangement for controlling a computer apparatus associated with a graphical display, the arrangement comprising an event engine configured to receive an eye-tracking data signal describing a user'"'"'s point of regard on the display, wherein the event engine is configured to:

determine, in response to received first activation signal and based on the eye-tracking data signal, a direction and a length of the latest saccades registered in the eye-tracking data signal,

cause information on the display to scroll based on the direction of the latest saccades,

set a speed with which the information on the display is scrolled based on the length of the latest saccades, and

in response to a received second activation signal, cease causing the information on the display to scroll,

wherein the arrangement comprises a hardware implementation or a non-transitory computer-readable medium storing executable instructions.

2. The arrangement according to claim 1, wherein the first activation signal is a result of a key or button being pressed.

3. The arrangement according to claim 2, wherein the second activation signal is a result of a pressed key or button being released.

4. The arrangement according to claim 1, wherein a direction in which information on the display is scrolled is determined by the user'"'"'s point of regard being located within defined areas on the display.

5. The arrangement according to claim 4, wherein the speed further depends on a distance between the user'"'"'s point of regard and a defined position on the display.

6. The arrangement according to claim 1, wherein a speed with which information on the display is scrolled depends on a total amount of time during which said information has been scrolling.

7. The arrangement according to claim 2, wherein the second activation signal is a result of a key or button being pressed.

8. The arrangement according to claim 1, wherein the second activation signal is a result of a length of the latest saccades exceeding a particular value.

9. The arrangement according to claim 1, wherein the second activation signal is a result of the user'"'"'s point of regard moving towards a center of the information on the display.

10. A method for controlling a computer apparatus associated with a graphical display, comprising:

receiving an eye-tracking data signal describing a user'"'"'s point of regard on the display;

determine, in response to a received first activation signal and based on the eye-tracking data signal, a direction and a length of the latest saccades registered in the eye-tracking data signal;

causing information on the display to scroll 1 based on the direction of the latest saccades;

setting a speed with which the information on the display is scrolled based on the length of the latest saccades; and

in response to a received second activation signal, cease causing the information on the display to scroll.

11. The method according to claim 10, wherein the first activation signal is generated by pressing a key or button.

12. The method according to claim 11, wherein the second activation signal is generated by pressing a key or button.

13. The method according to claim 10, further comprising determining a direction, in which information on the display is scrolled, by the user'"'"'s point of regard being located within defined areas on the display.

14. The method according to claim 13, wherein the speed further depends on a distance between the user'"'"'s point of regard and a defined position on the display.

15. The method according to claim 10, wherein the speed further depends on a total amount of time during which said information has been scrolling.

16. The method according to claim 10, wherein the second activation signal is generated in response to a length of the latest saccades exceeding a particular value.

17. The method according to claim 10, wherein the second activation signal is generated in response to the user'"'"'s point of regard moving towards a center of the information on the display.