Power management in an eye-tracking system

• US 10,313,587 B2
• Filed: 12/05/2017
• Issued: 06/04/2019
• Est. Priority Date: 10/27/2011
• Status: Active Grant

• Current Assignee: Tobii Technology AB
• Original Assignee: Tobii Technology AB
• Inventors: Eskilsson, Henrik, Skogo, Marten, Elvesjo, John, Blixt, Peter
• Primary Examiner(s): Zhou, Hong
• Application Number:
  US15/831,511
• Publication Number:
  US 20180103202A1
• Time in Patent Office: 546 Days
• CPC Class Codes: G02B 2027/0138 comprising image capture systems, e.g. camera
• CPC Class Codes: G02B 27/0172 characterised by optical features
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06V 40/18 Eye characteristics, e.g. of the iris
• CPC Class Codes: G09G 2330/021 Power management, e.g. power saving
• CPC Class Codes: G09G 2354/00 Aspects of interface with display user
• CPC Class Codes: H04N 23/667 Camera operation mode switching, e.g. between still and video, sport and normal or high- and low-resolution modes

Abstract

An imaging device adapted to provide eye-tracking data by imaging at least one eye of a viewer, wherein: the imaging device is switchable between at least an active mode and a ready mode; the imaging device is configured, in the active mode, to use active eye illumination, which enables tracking of a corneal reflection, and to provide eye tracking data which include eye position and eye orientation; and the imaging device is configured, in the ready mode, to reduce an illumination intensity from a value the illumination intensity has in the active mode.

Claims

1. An imaging device adapted to provide data measurements by imaging at least one eye of a viewer, wherein:

the data measurements describe one or more of eye position or eye orientation;

the imaging device is switchable between at least an active mode and a ready mode;

the imaging device is configured, in the active mode, to maintain a first result history of the data measurements based on data gathered based on first criteria, the first criteria including a first frame rate;

the imaging device is configured, in the ready mode, to maintain a second result history of the data measurements based on data gathered based on second criteria, the second criteria including a second frame rate that is lower than the first frame rate; and

upon switching to the active mode from the ready mode, the imaging device provides additional data based on a combination of the data measurements from the first result history and the data measurements from the second result history.

2. The imaging device of claim 1, wherein the first criteria further include one or more of:

data estimating camera-to-eye distance,

data indicating multiple distinct tracked eye features,

camera data having a resolution reduced by a relatively low binning ratio,

data received from multiple cameras, or

a particular eye position and a particular eye orientation.

3. The imaging device of claim 2, wherein the first criteria further include camera data having a full resolution.

4. The imaging device of claim 1, wherein the second criteria further include one or more of:

data indicating a single distinct tracked eye feature,

camera data having a resolution reduced by a relatively high binning ratio,

data received from a single camera, or

a particular eye position without a particular eye orientation.

5. The imaging device of claim 1, wherein the second result history includes data measurements based on partially processed data.

6. The imaging device of claim 1, wherein, in the ready mode, the data gathered based on the second criteria relates to an eye location in an image plane but not in world coordinates.

7. The imaging device of claim 1, wherein the imaging device is configured to activate, from a group of light sources:

in the active mode, multiple light sources from the group of light sources, and

in the ready mode, a single light source from the group of light sources.

8. The imaging device of claim 1, wherein the imaging device is configured to pre-process optical data by binning at a higher binning ratio in the ready mode than in the active mode.

9. The imaging device of claim 1, wherein the imaging device is switchable between the active mode, the ready mode and an idle mode, and wherein a switching time from the idle mode to the active mode is longer than a switching time from the ready mode to the active mode.

10. A personal computer system comprising:

the imaging device of claim 1;

a visual display; and

an input device for accepting eye-tracking control data and other input data.

11. The personal computer system of claim 10, wherein the input device includes:

at least one dedicated input device adapted to accept the eye-tracking control data only; and

at least one general-purpose input device adapted to accept the other input data.

12. The personal computer system of claim 11, wherein the imaging device operates in the active mode based on an input received from the dedicated input device.

13. The personal computer system of claim 12, wherein the imaging device changes operation to the active mode based on an interrupt triggered by the input received from the dedicated input device.

14. The personal computer system of claim 11, wherein the dedicated input device is a hardware touch-actuated input device, and the imaging device operates in an idle mode based on an input received from the hardware touch-actuated input device.

15. The personal computer system of claim 14, wherein:

the imaging device is selectively connected to a drive power; and

the imaging device changes operation to the idle mode based on the input received from the hardware touch-actuated input device disconnecting the imaging device from said drive power.

16. The personal computer system of claim 10, further comprising a viewer presence detector configured to provide at least one of:

a positive detection signal, wherein the imaging device switches into the ready mode from an idle mode based on the positive detection signal, or

a negative detection signal, wherein the imaging device switches into the idle mode from either the active mode or the ready mode based on the negative detection signal.

17. The personal computer system of claim 16, wherein:

the viewer presence detector is a proximity sensor at a push button and is arranged to sense proximity of a finger; and

the proximity sensor is configured to provide the positive detection signal causing the image device to switch into the ready mode from the idle mode.

18. A method in an imaging device adapted to provide data measurements by imaging at least one eye of a viewer,

wherein the data measurements describe one or more of eye position or eye orientation;

wherein said method comprises the steps of;

switching the imaging device between at least an active mode and a ready mode;

in the active mode, maintaining a first result history of the data measurements based on data gathered based on first criteria, the first criteria including a first frame rate; and

in the ready mode, maintaining a second result history of the data measurements based on data gathered based on second criteria, the second criteria including a second frame rate that is lower than the first frame rate; and

upon switching to the active mode from the ready mode, providing additional data based on a combination of the data measurements from the first result history and the data measurements from the second result history.

19. The method of claim 18, wherein the first criteria further include one or more of:

data estimating camera-to-eye distance,

data indicating multiple distinct tracked eye features,

camera data having a resolution reduced by a relatively low binning ratio,

data received from multiple cameras,

the imaging device being configured to use multiple light sources, or

a particular eye position and a particular eye orientation; and

wherein the second criteria further include one or more of;

data indicating a single distinct tracked eye feature,

camera data having a resolution reduced by a relatively high binning ratio,

data received from a single camera,

the imaging device being configured to use a single light source,

data measurements based on partially processed data, or

the particular eye position without the particular eye orientation.

20. A computer program product embodied in a non-transitory computer readable medium, the computer program product comprising computer-executable instructions for executing the method of claim 18.

21. A method in a personal computer system, the personal computer system comprising:

a visual display;

an imaging device adapted to provide data measurements by imaging at least one eye of a viewer of the visual display, wherein the data measurements describe one or more of eye position or eye orientation; and

an input device for accepting eye-tracking control data and other input data,

said method comprising the steps of;

switching the imaging device between at least an active mode and a ready mode;

in the active mode, maintaining a first result history of the data measurements based on data gathered based on first criteria, the first criteria including a first frame rate; and

in the ready mode, maintaining a second result history of the data measurements based on data gathered based on second criteria, the second criteria including a second frame rate that is lower than the first frame rate; and

upon switching to the active mode from the ready mode, providing additional data based on a combination of the data measurements from the first result history and the data measurements from the second result history.

22. The method of claim 21, wherein the first criteria further include one or more of:

data estimating camera-to-eye distance,

data indicating multiple distinct tracked eye features,

camera data having a resolution reduced by a relatively low binning ratio,

data received from multiple cameras, or

the imaging device being configured to use multiple light sources, or

a particular eye position and a particular eye orientation.

23. The method of claim 21, wherein the second criteria further include one or more of:

data indicating a single distinct tracked eye feature,

camera data having a resolution reduced by a relatively high binning ratio,

data received from a single camera,

the imaging device being configured to use a single light source, or

data measurements based on partially processed data, or

a particular eye position without a particular eye orientation.

24. A computer program product embodied in a non-transitory computer readable medium, the computer program product comprising computer-executable instructions of executing the method of claim 21.