Visual display with illuminators for gaze tracking

• US 8,562,136 B2
• Filed: 05/07/2012
• Issued: 10/22/2013
• Est. Priority Date: 04/01/2009
• Status: Active Grant

• Current Assignee: Tobii Technology AB
• Original Assignee: Tobii Technology AB
• Inventors: Blixt, Peter, Hoglund, Anders, Rehnstrom, Bengt, Elvesj, John
• Primary Examiner(s): HASAN, MOHAMMED A
• Application Number:
  US13/465,245
• Publication Number:
  US 20120327101A1
• Time in Patent Office: 533 Days
• Field of Search: 351200-246
• US Class Current: 351/210
• CPC Class Codes: A61B 3/113 for determining or recording eye movement
• CPC Class Codes: G01S 17/46 Indirect determination of position data
• CPC Class Codes: G01S 17/66 Tracking systems using electromagnetic waves other than radio waves
• CPC Class Codes: G06F 3/01 Input arrangements or combined input and output arrangements for interaction between user and computer G06F3/16 takes precedence
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06V 40/19 Sensors therefor

Abstract

A visual display characterized by hidden reference illuminators is adapted to emit invisible light for generating corneo-scleral reflections on an eye watching a screen surface of the display. The tracking of such reflections and the pupil center provides input for gaze tracking. A method for equipping and an LCD with a reference illuminator are also provided. A system and method for determining a gaze point of an eye watching a visual display comprising reference illuminators are further provided. The determination of the gaze point may be based on an ellipsoidal cornea model.

Claims

1. A visual display comprising:

a screen surface;

a plurality of reference illuminators adjacent to and arranged beneath said screen surface and adapted to emit invisible light on an eye watching said screen surface;

said screen surface adapted to display graphical information based on said plurality of reference illuminators; and

a plurality of layers beneath said screen surface and essentially parallel therewith, wherein any layer being arranged between said plurality of reference illuminators and said screen surface is operable to be translucent.

2. The visual display according to claim 1, wherein said plurality of reference illuminators are adapted to emit infrared or near-infrared light.

3. The visual display according to claim 1, wherein a light cone of each reference illuminator is essentially normal to said screen surface and subtends a solid angle of at most π

steradians.

4. The visual display according to claim 1, wherein said plurality of reference illuminators is arranged in a two-dimensional array, with the array being parallel to said screen surface.

5. The visual display according to claim 1, wherein said visual display comprises an organic light-emitting diode display comprising a translucent anode layer, a conductive layer, an emissive layer and a translucent cathode layer, beneath which layers said plurality of reference illuminators are arranged.

6. The visual display according to claim 1, wherein said plurality of reference illuminators is adapted to illuminate an eye watching the visual display, with the eye being subject to gaze tracking.

7. A visual display comprising:

a screen surface;

a plurality of reference illuminators adjacent to and arranged beneath said screen surface and adapted to emit invisible light on an eye watching said screen surface;

said screen surface adapted to display graphical information based on said plurality of reference illuminators; and

a liquid crystal display comprising a light guide, which is optically coupled to an edge-mounted backlight illuminator, and a rear reflector layer, between which said plurality of reference illuminators is arranged.

8. The visual display according to claim 7, wherein said plurality of reference illuminators are adapted to emit infrared or near-infrared light.

9. The visual display according to claim 7, wherein a light cone of each reference illuminator is essentially normal to said screen surface and subtends a solid angle of at most π

steradians.

10. The visual display according to claim 7, wherein said plurality of reference illuminators is arranged in a two-dimensional array, with the array being parallel to said screen surface.

11. The visual display according to claim 7, further comprising a liquid crystal panel with variable transmittance, said visual display being alternately operable in:

a display mode, wherein at least one backlight illuminator is active; and

a reference mode, wherein said plurality of reference illuminators is active, all backlight illuminators for emitting visible light are inactive, and said liquid crystal panel has maximum transmittance.

12. The visual display according to claim 7, wherein said visual display comprises an organic light-emitting diode display comprising a translucent anode layer, a conductive layer, an emissive layer and a translucent cathode layer, beneath which layers said plurality of reference illuminators are arranged.

13. The visual display according to claim 7, wherein said plurality of reference illuminators is adapted to illuminate an eye watching the visual display, with the eye being subject to gaze tracking.

14. A visual display comprising:

a screen surface;

a plurality of reference illuminators adjacent to and arranged beneath said screen surface and adapted to emit invisible light on an eye watching said screen surface;

said screen surface adapted to display graphical information based on said plurality of reference illuminators; and

a liquid crystal display comprising a plurality of direct backlight illuminators, and wherein a subset of said plurality of backlight illuminators is at least one reference illuminator.

15. The visual display according to claim 14, wherein said plurality of reference illuminators are adapted to emit infrared or near-infrared light.

16. The visual display according to claim 14, wherein a light cone of each reference illuminator is essentially normal to said screen surface and subtends a solid angle of at most π

steradians.

17. The visual display according to claim 14, wherein said plurality of reference illuminators is arranged in a two-dimensional array, with the array being parallel to said screen surface.

18. The visual display according to claim 14, said visual display comprises a liquid crystal display comprising a plurality of direct backlight illuminators, and wherein a subset of said plurality of backlight illuminators is at least one reference illuminator.

19. The visual display according to claim 14, wherein said visual display comprises an organic light-emitting diode display comprising a translucent anode layer, a conductive layer, an emissive layer and a translucent cathode layer, beneath which layers said plurality of reference illuminators are arranged.

20. The visual display according to claim 14, wherein said plurality of reference illuminators is adapted to illuminate an eye watching the visual display, with the eye being subject to gaze tracking.