Adaptive camera and illuminator eyetracker

• US 8,339,446 B2
• Filed: 04/01/2010
• Issued: 12/25/2012
• Est. Priority Date: 04/01/2009
• Status: Active Grant

• Current Assignee: Tobii Technology AB
• Original Assignee: Tobii Technology AB
• Inventors: Blixt, Peter, Hoglund, Anders, Troili, Gunnar, Elvesjö, John, Skogö, Mårten
• Primary Examiner(s): SHAW, PELING ANDREW
• Application Number:
  US12/752,258
• Publication Number:
  US 20100328444A1
• Time in Patent Office: 999 Days
• Field of Search: None
• US Class Current: 348/78
• CPC Class Codes: A61B 3/0008 provided with illuminating means A61B3/117 takes precedence; goniolenses used for laser treatment A61F9/009; illuminating means for optical instruments G02B27/00
• CPC Class Codes: A61B 3/0025 characterised by electronic signal processing, e.g. eye models
• CPC Class Codes: A61B 3/113 for determining or recording eye movement
• CPC Class Codes: A61B 3/14 Arrangements specially adapted for eye photography apparatus or arrangements for taking photographs per se G03B
• CPC Class Codes: A61B 3/145 by video means
• CPC Class Codes: G06V 40/19 Sensors therefor

Abstract

An eye tracker includes at least one illuminator for illuminating an eye, at least two cameras for imaging the eye, and a controller. The configuration of the reference illuminator(s) and cameras is such that, at least one camera is coaxial with a reference illuminator and at least one camera is non-coaxial with a reference illuminator. The controller is adapted to select one of the cameras to be active to maximize an image quality metric and avoid obscuring objects. The eye tracker is operable in a dual-camera mode to improve accuracy. A method and computer-program product for selecting a combination of an active reference illuminator from a number of reference illuminators, and an active camera from a plurality of cameras are provided.

Claims

1. An eye tracker comprising:

at least one illuminator for illuminating an eye;

at least two cameras for imaging the eye, with at least one camera being arranged coaxially with a reference illuminator and at least one camera being arranged non-coaxially with a reference illuminator; and

a controller adapted to repeatedly evaluate an image quality metric, which is based on at least one image quality factor, for images provided by each of the cameras and to select at least the camera which provides the highest image quality metric to be active.

2. The eye tracker according to claim 1, comprising at least two reference illuminators.

3. The eye tracker according to claim 2, wherein each camera is associated with a coaxial and substantially point-shaped illuminator of said at least two reference illuminators.

4. The eye tracker according to claim 2, wherein said controller is further adapted to repeatedly select a combination of one of the cameras and one of the reference illuminators to be active, on the basis of the highest image quality metric and a most centric location of a corneo-scleral reflection.

5. The eye tracker according to claim 1, operable in a dual-camera mode.

6. The eye tracker according to claim 5, wherein at least two cameras are separated by 70 mm or more.

7. The eye tracker according to claim 5, further adapted to determine a location of a first Purkinje reflection on the basis of two images acquired simultaneously by different cameras.

8. The eye tracker according to claim 2, further operable in an evaluation mode, wherein the controller activates at least two cameras while sequentially scanning the reference illuminators.

9. The eye tracker according to claim 1, wherein said at least one illuminator is adapted to emit infrared or near-infrared light.

10. The eye tracker according to claim 2, further adapted to determine a gaze direction of the eye based on locations of the corneo-scleral reflections of the reference illuminators.

11. The eye tracker according to claim 2, further comprising a processor adapted to:

define a mapping between a coordinate system in the object plane and a coordinate system in the plane of an eye image, based on locations in the eye image of corneo-scleral reflections of the illuminators; and

determine, based on the mapping, a gaze point of the eye in the object coordinate system,

wherein the mapping comprises an ellipsoidal reflection mapping and a perspective projection.

12. The eye tracker according to claim 1, wherein the at least one image quality factor, on which the image quality metric is based, includes at least one of the following:

number of detected pupils, gaze-detection noise, pupil contrast, gradient of pupil-iris boundary, presence of obstacles, and signal-to-noise ratio.

13. A method for selecting a combination of an active illuminator from a plurality of reference illuminators for illuminating an eye and an active camera from a plurality of cameras for imaging the eye, with at least one combination comprising an illuminator and a camera which are coaxial, and at least one combination comprising an illuminator and a camera which are non-coaxial, the method comprising the sequential steps of:

a) defining an image quality metric based on at least one image quality factor;

b) selecting an imaging mode based on values of the image quality metric for at least two eye images, at least one using a coaxial combination and at least one using a non-coaxial combination;

c) selecting an active camera based on values of the image quality metric for eye images acquired using combinations according to the selected imaging mode; and

d) selecting an active reference illuminator based on the centricity of a corneo-scleral reflection of each reference illuminator from said plurality of reference illuminators.

14. The method according to claim 13, further comprising the sequential steps of:

e) if the image quality factor is below a predetermined level, performing steps c) and d) and then, if the image quality factor is still below a predetermined level, further performing steps b) and c); and

f) performing step d).

15. The method according to claim 13, wherein the at least one image quality factor, on which the image quality metric is based, comprising at least one of the following:

number of detected pupils, gaze-detection noise, pupil contrast, gradient of pupil-iris boundary, presence of obstacles, and signal-to-noise ratio.

16. A computer-program product comprising computer-readable instructions which when executed on a general-purpose computer perform selection of a combination of an active illuminator from a plurality of reference illuminators for illuminating an eye and an active camera from a plurality of cameras for imaging the eye, with at least one combination comprising an illuminator and a camera which are coaxial, and at least one combination comprising an illuminator and a camera which are non-coaxial, the computer-readable instructions comprising:

a) defining an image quality metric based on at least one image quality factor;

b) selecting an imaging mode based on values of the image quality metric for at least two eye images, at least one using a coaxial combination and at least one using a non-coaxial combination;

c) selecting an active camera based on values of the image quality metric for eye images acquired using combinations according to the selected imaging mode; and

d) selecting an active reference illuminator based on the centricity of a corneo-scleral reflection of each reference illuminator from said plurality of reference illuminators.