Eye-tracking enabled wearable devices

• US 10,467,470 B2
• Filed: 09/26/2016
• Issued: 11/05/2019
• Est. Priority Date: 09/24/2015
• Status: Active Grant

• Current Assignee: Tobii Technology AB
• Original Assignee: Tobii Technology AB
• Inventors: Gustafsson, Simon, Kingback, Anders, Blixt, Peter, Hainzl, Richard
• Primary Examiner(s): Chio, Tat C
• Application Number:
  US15/276,618
• Publication Number:
  US 20170090564A1
• Time in Patent Office: 1,135 Days
• CPC Class Codes: A61B 3/113 for determining or recording eye movement
• CPC Class Codes: G02B 2027/0138 comprising image capture systems, e.g. camera
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 2027/0187 slaved to motion of at least a part of the body of the user, e.g. head, eye
• CPC Class Codes: G02B 27/0093 with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G02B 27/0179 Display position adjusting means not related to the information to be displayed
• CPC Class Codes: G06F 2203/0381 Multimodal input, i.e. interface arrangements enabling the user to issue commands by simultaneous use of input devices of different nature, e.g. voice plus gesture on digitizer
• CPC Class Codes: G06F 3/012 Head tracking input arrangements
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06F 3/0304 Detection arrangements using opto-electronic means constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042
• CPC Class Codes: G06F 3/04815 Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
• CPC Class Codes: G06F 3/04845 for image manipulation, e.g. dragging, rotation, expansion or change of colour
• CPC Class Codes: G06F 3/0485 Scrolling or panning
• CPC Class Codes: G06V 40/19 Sensors therefor
• CPC Class Codes: G09G 2340/0464 Positioning
• CPC Class Codes: G09G 2354/00 Aspects of interface with display user
• CPC Class Codes: G09G 5/34 for rolling or scrolling

Abstract

A system for determining a gaze direction of a user in a wearable device is disclosed. The system may include a display device, a primary lens, an illuminator, and a plurality of imaging device. The primary lens may be disposed in front of the display device. The illuminator may be configured to illuminate an eye of a user. The plurality of imaging devices may be disposed on or in the primary lens to detect light reflected by the eye of the user.

Claims

1. A system for determining a gaze direction of a user in a wearable device, wherein the system comprises:

a display device;

a primary lens disposed in front of the display device;

an illuminator configured to illuminate an eye of a user, wherein the illuminator is disposed in the primary lens, and wherein the illuminator comprises a plurality of optical fibers;

wherein the optical fibers are deposited in grooves in a surface of the lens and are numerously distributed across a front side of the lens;

wherein any void in the grooves where the optical fibers are placed are filled with a substance to maintain a position of the optical fibers, and to minimize refraction therein; and

wherein the substance has a same, or similar, refraction index to the lens itself in order to minimize visible distortion of the lens to the user; and

an imaging device disposed in the primary lens to detect light reflected by the eye of the user.

2. The system for determining a gaze direction of a user in a wearable device of claim 1, wherein:

the imaging device is no larger than about 1 millimeter by about 1 millimeter by about 1 millimeter.

3. The system for determining a gaze direction of a user in a wearable device of claim 1, wherein:

the imaging device is disposed within a cavity in the primary lens.

4. The system for determining a gaze direction of a user in a wearable device of claim 3, wherein:

an additional substance having a substantially similar refraction index to the primary lens is disposed within the cavity so as to smooth a surface of the primary lens.

5. The system for determining a gaze direction of a user in a wearable device of claim 1, wherein the additional substance comprises:

a flow-able hardening substance.

6. The system for determining a gaze direction of a user in a wearable device of claim 1, wherein:

the imaging device comprises a sensor disposed on a flexible printed circuit; and

a width and a length of the flexible printed circuit is orientated orthogonally to a viewing surface of the primary lens.

7. The system for determining a gaze direction of a user in a wearable device of claim 1, wherein:

the illuminator is no larger than about 1 millimeter by about 1 millimeter by about 1 millimeter.

8. The system for determining a gaze direction of a user in a wearable device of claim 1, wherein:

the illuminator is disposed within a cavity in the primary lens.

9. The system for determining a gaze direction of a user in a wearable device of claim 8, wherein:

an additional substance having a substantially similar refraction index to the primary lens is disposed within the cavity so as to smooth a surface of the primary lens.

10. The system for determining a gaze direction of a user in a wearable device of claim 9, wherein the additional substance comprises:

a flow-able hardening substance.

11. The system for determining a gaze direction of a user in a wearable device of claim 1, wherein the system further comprises:

a reflector disposed in the cavity to reflect light from the optical fiber toward the user.

12. The system for determining a gaze direction of a user in a wearable device of claim 1, wherein the system further comprises:

a secondary lens at the surface of the primary lens to refract light from the optical fiber toward the user.

13. The system for determining a gaze direction of a user in a wearable device of claim 12, wherein the secondary lens comprises:

a flow-able hardening substance.

14. The system for determining a gaze direction of a user in a wearable device of claim 1, wherein:

the primary lens is configured to guide light from the illuminator toward the eye of the user.

15. The system for determining a gaze direction of a user in a wearable device of claim 1, wherein:

the primary lens comprises a light guide configured to guide light from the illuminator toward the eye of the user.

16. The system for determining a gaze direction of a user in a wearable device of claim 1, wherein:

the primary lens is configured to focus light toward the imaging device.

17. The system for determining a gaze direction of a user in a wearable device of claim 1, wherein the primary lens comprises:

a Fresnel lens.

18. The system for determining a gaze direction of a user in a wearable device of claim 1, further comprising a plurality of illumination sources, wherein the illumination sources are coupled to the end of the optical fibers at the edge, or away from, the lens.

19. A system for determining a gaze direction of a user in a wearable device, wherein the system comprises:

a display device;

a primary lens disposed in front of the display device;

an illuminator disposed on or in the primary lens configured to illuminate an eye of a user, wherein the illuminator comprises a plurality of optical fibers;

wherein the optical fibers are deposited in grooves in a surface of the lens and are numerously distributed across a front side of the lens;

wherein any void in the grooves where the optical fibers are placed are filled with a substance to maintain a position of the optical fibers, and to minimize refraction therein; and

wherein the substance has a same, or similar, refraction index to the lens itself in order to minimize visible distortion of the lens to the user; and

an imaging device disposed on or in the primary lens to detect light reflected by the eye of the user.

20. The system for determining a gaze direction of a user in a wearable device of claim 19, wherein:

the imaging device is disposed within a cavity in the primary lens.

21. The system for determining a gaze direction of a user in a wearable device of claim 19, wherein:

the primary lens is configured to guide light from the illuminator toward the eye of the user.

22. The system for determining a gaze direction of a user in a wearable device of claim 19, wherein:

the primary lens comprises a light guide configured to guide light from the illuminator toward the eye of the user.

23. A system for determining a gaze direction of a user in a wearable device, wherein the system comprises:

a display device;

a primary lens disposed in front of the display device;

an illuminator disposed on or in the primary lens configured to illuminate an eye of a user, wherein the illuminator comprises a plurality of optical fibers;

wherein the optical fibers are deposited in grooves in a surface of the lens and are numerously distributed across a front side of the lens;

wherein any void in the grooves where the optical fibers are placed are filled with a substance to maintain a position of the optical fibers, and to minimize refraction therein; and

wherein the substance has a same, or similar, refraction index to the lens itself in order to minimize visible distortion of the lens to the user; and

an imaging device.

24. The system for determining a gaze direction of a user in a wearable device of claim 23, wherein the imaging device comprises a profile sensor.

25. The system for determining a gaze direction of a user in a wearable device of claim 23, wherein:

the primary lens is configured to guide light from the illuminator toward the eye of the user.

26. The system for determining a gaze direction of a user in a wearable device of claim 23, wherein:

the primary lens comprises a light guide configured to guide light from the illuminator toward the eye of the user.

27. The system for determining a gaze direction of a user in a wearable device of claim 23, wherein:

the primary lens is configured to focus light toward the imaging device.

28. The system for determining a gaze direction of a user in a wearable device of claim 23, wherein the primary lens comprises:

a Fresnel lens.