ARRANGEMENT, METHOD AND COMPUTER PROGRAM FOR CONTROLLING A COMPUTER APPARATUS BASED ON EYE-TRACKING

• US 20120146895A1
• Filed: 12/22/2011
• Published: 06/14/2012
• Est. Priority Date: 06/18/2004
• Status: Active Grant

• Current Assignee: Tobii Technology AB
• Original Assignee: Tobii Technology AB
• Inventors: Eskilsson, Henrik, Jacobson, Magnus, Bjrklund, Christoffer, Skog, Mrten
• Granted Patent: US 10,025,389 B2
• Time in Patent Office: Days
• US Class Current: 345/156
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883

Abstract

A computer apparatus is associated with a graphical display presenting at least one GUI-component adapted to be manipulated based on user-generated commands. An event engine is adapted to receive an eye-tracking data signal that describes a user'"'"'s point of regard on the display. Based on the signal, the event engine produces a set of non-cursor controlling event output signals, which influence the at least one GUI-component. Each non-cursor controlling event output signal describes a particular aspect of the user'"'"'s ocular activity in respect of the display. Initially, the event engine receives a control signal request from each of the at least one GUI-component. The control signal request defines a sub-set of the set of non-cursor controlling event output signals which is required by the particular GUI-component. The event engine delivers non-cursor controlling event output signals to the at least one GUI-component in accordance with each respective control signal request.

Claims

1. An arrangement for controlling a computer apparatus associated with a graphical display, the display presenting a representation of a plurality of GUI-components that are configured to be manipulated based on user-generated commands, the arrangement comprising a processing device for executing processes on the computer apparatus, and an event engine, wherein the processing device is configured to control operations of the event engine, wherein said event engine is configured to receive an eye-tracking data signal describing a user'"'"'s point of regard on the display, and at least based on the eye-tracking data signal, configured to produce a set of noncursor controlling event output signals influencing the GUI-components, each of the noncursor controlling event output signals describing a different aspect of the user'"'"'s ocular activity in respect of the display, wherein the event engine is configured to:

receive a respective control signal request from each of the GUI-components, each respective control signal request defining a sub-set of the set of non-cursor controlling event output signals which is required by a corresponding one of the GUI-components to operate as intended,

produce the set of non-cursor controlling event output signals which is actually requested by the respective control signal request from each of the GUI-components, and

deliver the set of non-cursor controlling event output signals to the GUI-components in accordance with each respective control signal request.

2. The arrangement according to claim 1, wherein the computer apparatus is configured to receive a cursor control signal, and control a graphical pointer on the display in response to the cursor control signal.

3. The arrangement according to claim 1, wherein at least one of the GUI-components is configured to generate at least one respective output control signal upon a user manipulation of the component.

4. The arrangement according to claim 1, wherein the event engine is configured to produce at least a first signal of the non-cursor controlling event output signals based on a dynamic development of the eye-tracking data signal.

5. The arrangement according to claim 4, wherein the first signal represents a particular gaze pattern over the display.

6. The arrangement according to claim 5, wherein at least one of the GUI-components is configured to interpret the first signal as an estimated intention of the user, and trigger a user manipulation of the component in response to the estimated intention.

7. The arrangement according to claim 5, wherein at least one of the GUI-components is configured to interpret the first signal as an estimated attention level of the user, and trigger a user manipulation of the component in response to the estimated attention level.

8. The arrangement according to claim 5, wherein at least one of the GUI-components is configured to interpret the first signal as a state-of-mind parameter of the user, and trigger a user manipulation of the component in response to the state-of-mind parameter.

9. The arrangement according to claim 1, wherein the event engine is configured to receive at least one auxiliary input signal and produce the set of non-cursor controlling event output signals on the further basis of the at least one auxiliary input signal.

10. The arrangement according to claim 1, wherein the at least one auxiliary input signal is originated from at least one of a button, a switch, a speech signal, a movement pattern of an input member, a gesture pattern, a facial expression and an EEG-signal.