System and method for tracking the point of gaze of an observer

• US 9,237,844 B2
• Filed: 03/15/2011
• Issued: 01/19/2016
• Est. Priority Date: 03/22/2010
• Status: Active Grant

• Current Assignee: Koninklijke Philips Electronics N.V. (Koninklijke Philips N.V.)
• Original Assignee: Koninklijke Philips N.V.
• Inventors: De Bruijn, Frederik Jan, Van Bree, Karl Catharina, Gritti, Tommaso
• Primary Examiner(s): YENKE, BRIAN P
• Application Number:
  US13/582,582
• Publication Number:
  US 20130002846A1
• Time in Patent Office: 1,771 Days
• Field of Search: 348/78, 348/159, 351/209, 351/210
• US Class Current: 1/1
• CPC Class Codes: A61B 3/113 for determining or recording eye movement
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06F 3/147 using display panels
• CPC Class Codes: G06V 40/193 Preprocessing; Feature extraction
• CPC Class Codes: G09G 2380/12 Avionics applications

Abstract

A system for tracking the point of gaze of an observer observing an object comprises a camera for recording an image of an eye of the observer, comprises a means for providing a luminous marker, and means for analyzing the image of the eye to determine the reflection of the marker on the eye and the centre of the pupil. The relative positions of the corneal reflection of the marker and the pupil centre are measured. The marker is repositioned, in dependence on the determined relative positions, to improve correspondence between the corneal reflection of the marker and the pupil center.

Claims

1. A system for tracking a point of gaze of an observer observing an object, wherein the system comprises:

a device for recording an image of an eye of the observer;

a light source configured to provide a luminous marker on or associated with the observed object, said marker being selectively movable within a field of view of the observer; and

a control unit comprising a first image analyzer configured to analyze the image recorded by the image recording device, said first image analyzer being configured to determine, from the image, a corneal reflection of the marker on the eye of the observer and a center of a pupil of the eye of the observer,

wherein the system for tracking further comprises;

said first image analyzer being configured to determine relative positions of the corneal reflection of the marker and the pupil center;

said control unit comprising a second analyzer configured to receive the determined relative positions of the corneal reflection of the marker and the pupil center, and configured to generate data for repositioning the marker in order to lessen a difference between the determined relative positions of the corneal reflection of the marker and the pupil, until the position of the corneal reflection of the marker and the position of the pupil substantially coincide; and

means for repositioning the marker in response to the repositioning data.

2. The system as claimed in claim 1, wherein the system further comprises a display device, and the position of the marker is related to the display device.

3. The system as claimed in claim 2, wherein the display device and the light source for providing the marker are integrated into a single device.

4. The system as claimed in claim 2, wherein the display device and the light source for providing the marker are separate devices.

5. The system as claimed in claim 4, wherein the light source for providing the marker comprises a transparent shield positioned in front of an image screen of the display device.

6. The system as claimed in claim 1, wherein the light source for providing the marker provides an infrared (IR) marker.

7. The system as claimed in claim 1, wherein the marker is shaped in a pattern.

8. The system as claimed in claim 1, wherein the light source for providing the marker and the repositioning means for repositioning the marker provide and reposition the marker in or on a transparent plate in front of a scene including the object.

9. The system as claimed in claim 8, wherein the transparent plate is a windshield of a vehicle.

10. The system as claimed in claim 8, wherein the transparent plate is a shop window.

11. The system as claimed in claim 3, wherein the light source for providing the marker provides the marker in an image displayed on a display screen of the display device.

12. The system as claimed in claim 11, wherein the marker is an IR marker.

13. The system as claimed in claim 11, wherein the system comprises a Liquid Crystal Display device having an infrared (IR) backlight and a visible light backlight.

14. The system as claimed in claim 1, wherein the light source for providing the marker comprise a transparent OLED screen for providing a marker.

15. The system as claimed in claim 1, wherein the system is arranged to track the gaze of more than one observer, said system providing a respective additional single marker for each additional observer.

16. A method for tracking the point of gaze of an observer observing an object, wherein the method comprises:

recording an image of an eye of the observer;

providing a luminous marker on or associated with the observed object, said marker being selectively movable within a field of view of the observer; and

analyzing the image recorded by the image recording device in order to determine, from the image, a corneal reflection of the marker and a center of a pupil of the eye of the observer, wherein the method further comprises;

determining relative positions of the corneal reflection of a marker and the pupil center;

generating data for repositioning the marker in order to lessen a difference between the determined relative positions of the corneal reflection of the marker and the pupil; and

repositioning the marker in response to the repositioning data.

17. The method as claimed in claim 16, wherein the marker is shaped in a pattern.

18. The method as claimed in claim 16, wherein the marker is provided in or on a transparent plate.