WAVEGUIDE EYE TRACKING EMPLOYING SWITCHABLE DIFFRACTION GRATINGS

• US 20160085300A1
• Filed: 09/24/2014
• Published: 03/24/2016
• Est. Priority Date: 09/24/2014
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Inventors: Robbins, Steven, Nguyen, Ian A.
• Granted Patent: US 9,494,799 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: A61B 3/005 Constructional features of the display
• CPC Class Codes: A61B 3/113 for determining or recording eye movement
• CPC Class Codes: G02B 13/14 for use with infrared or ultraviolet radiation G02B13/008, G02B13/16 take precedence
• CPC Class Codes: G02B 2027/0138 comprising image capture systems, e.g. camera
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 2027/0178 Eyeglass type eyeglass details G02C
• CPC Class Codes: G02B 27/0093 with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking
• CPC Class Codes: G02B 27/0101 characterised by optical features G02B27/0172 takes precedence
• CPC Class Codes: G02B 27/0172 characterised by optical features
• CPC Class Codes: G02F 1/292 by controlled diffraction or phased-array beam steering controlled diffraction for optical switching G02F1/31
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: H04N 23/20 for generating image signals from infrared radiation only
• CPC Class Codes: H04N 23/673 based on contrast or high frequency components of image signals, e.g. hill climbing method
• CPC Class Codes: H04N 5/33 Transforming infrared radiation cameras or camera modules for generating image signals from infrared radiation H04N23/20; circuitry of SSIS for transforming infrared radiation into image signals H04N25/20

Abstract

A transparent waveguide, for use in tracking an eye illuminated by infrared light, includes an input-coupler and an output-coupler. The input-coupler includes a stack of electronically switchable diffractive gratings arranged parallel to one another, each of which has a respective lens power that causes each of the gratings in the stack to have a different focal length. Each grating, when turned on, couples received infrared light into the waveguide. A sensor images an eye in dependence on infrared light beams that exit the waveguide at the output-coupler. Images of an eye, obtained using the sensor, are analyzed to determine which one of the electronically switchable diffractive gratings, when turned on, provides a best focused image of the eye or portion thereof. The one of the electronically switchable diffractive gratings, which provides the best focused image of the eye, is used for imaging the eye during eye tracking.

Claims

1. An apparatus for use in tracking an eye that is illuminated by infrared light having an infrared wavelength, the apparatus comprising:

a waveguide that is transparent and includes an input-coupler and an output-coupler;

the input-coupler comprising a stack of two or more electronically switchable diffractive gratings arranged parallel to one another;

wherein each of the electronically switchable diffractive gratings has a respective lens power and a respective prismatic power;

wherein the lens power of each of the electronically switchable diffractive gratings differ from one another such that each of the electronically switchable diffractive gratings has a different focal length; and

wherein each of the electronically switchable diffractive gratings, when turned on, is adapted to receive infrared light having the infrared wavelength and couple the received infrared light into the waveguide.

2. The apparatus of claim 1, wherein:

each of the electronically switchable diffractive gratings includes a lower boundary and an upper boundary, the upper boundary being closer to the output-coupler than the lower boundary; and

each of the electronically switchable diffractive gratings has a k-vector angle at the lower boundary that is greater than a k-vector angle of the electronically switchable diffractive gratings at the upper boundary, with k-vector angles between the lower and upper boundaries gradually decreasing as distances decrease between grating planes of the electronically switchable diffractive gratings and the upper boundary.

3. The apparatus of claim 1, wherein when the input-coupler is positioned in front of an eye that is illuminated with the infrared light, at least portion of the infrared light reflected from the eye and received by the input-coupler is coupled into the waveguide at the input-coupler, propagates within the waveguide from the input-coupler to the output-coupler by way of total internal reflections, and exits the waveguide proximate the output-coupler.

4. The apparatus of claim 1, further comprising:

a sensor that images an eye in dependence on infrared light beams that exit the waveguide at the output-coupler;

an input-coupler controller that controls when each of the electronically switchable diffractive gratings is turned on, such that only one of the electronically switchable diffractive gratings is turned on at a time; and

an image analyzer that analyzes two or more images of an eye, obtained using the sensor, to determine which one of the electronically switchable diffractive gratings, when turned on, provides a best focused image of an eye or portion thereof.

5. The apparatus of claim 4, wherein:

the input-coupler controller causes the one of the electronically switchable diffractive gratings, which the image analysis module determines provides the best focused image of the eye, to be used for imaging the eye during eye tracking.

6. The apparatus of claim 5, further comprising:

a lens module between the output-coupler and the sensor;

wherein infrared light beams that exit the waveguide at the output-coupler pass through the lens module before being incident on the sensor.

7. The apparatus of claim 1, wherein:

the input-coupler comprising a second stack of two or more electronically switchable diffractive gratings arranged parallel to one another, the second stack being adjacent to the first stack, and the electronically switchable diffractive gratings in the second stack providing a field-of-view that differs from the field-of-view provided by the electronically switchable diffractive gratings in the first stack.

8. The apparatus of claim 7, further comprising:

a sensor that images an eye in dependence on infrared light beams that exit the waveguide at the output-coupler; and

an input-coupler control module that controls when each of the electronically switchable diffractive gratings in the first and second stacks is turned on, such that only one of the electronically switchable diffractive gratings is turned on at a time;

an image analysis module that analyzes images, obtained using the sensor, to determine which one of the electronically switchable diffractive gratings, when turned on, includes an eye within its field-of-view and provides a sharpest image of an eye or portion thereof.

9. The apparatus of claim 1, wherein each of the electronically switchable diffractive gratings has a grating period at its lower boundary that is less than the grating period at its upper boundary, with the grating period between the lower and upper boundaries gradually increasing.

10. The apparatus of claim 1, wherein each of the electronically switchable diffractive gratings comprises an electronically switchable Bragg grating (ESBG), an electronically switchable lithium niobate diffraction grating or an electronically switchable POLYCRIPS diffraction grating.

11. A method for use in tracking an eye, the method comprising:

illuminating an eye with infrared light while an input-coupler of a waveguide is generally axially aligned with the eye, the input-coupler comprising a stack of two or more electronically switchable diffractive gratings arranged parallel to one another, each of the electronically switchable diffractive gratings having a respective lens power and a respective prismatic power, the lens power of each of the electronically switchable diffractive gratings differing from one another such that each of the electronically switchable diffractive gratings has a different focal length;

selectively causing only one of the electronically switchable diffractive gratings of the input coupler to be turned on at a time, such that each of the electronically switchable diffractive gratings is individually turned on for a separate period of time;

separately imaging the eye, in dependence on infrared light beams that exit the waveguide at an output-coupler of the waveguide, while each of the electronically switchable diffractive gratings of the input coupler is separately turned on, to thereby obtain two or more images of the eye; and

analyzing the two or more images of the eye to determine which one of the electronically switchable diffractive gratings of the input-coupler, when turned on, provides a best focused image of the eye or portion thereof.

12. The method of claim 11, further comprising:

performing eye tracking using one or more images of the eye obtained while the electronically switchable diffractive grating of the input-coupler, that provides the best focused image of the eye or portion thereof, is turned on.

13. The method of claim 11, further comprising:

generating eye tracking data in dependence on infrared light beams that entered the waveguide while the electronically switchable diffractive grating of the input-coupler, that provides the best focused image of the eye or portion thereof, is turned on; and

controlling or modifying an aspect of an application based on the eye tracking data.

14. The method of claim 11, wherein the analyzing comprises:

determining a measure of at least one of resolution, contrast, or entropy of each of the two or more images to thereby determine a metric of focus for each of the two or more image;

determining which one of the two or more images has a greatest metric of focus; and

selecting the one of the electronically switchable diffractive gratings of the input-coupler that was used to obtain the image having the greatest metric of focus as the electronically switchable diffractive grating that provides the best focused image of the eye or portion thereof.

15. The method of claim 11, further comprising:

using gradually decreasing k-vector angles, between lower to upper boundaries of each of the electronically switchable diffractive gratings of input-coupler, to cause at least a majority of the infrared light that is coupled into the waveguide by the input-coupler to propagate through the waveguide to the output-coupler of the waveguide; and

using the output-coupler of the waveguide, causing the infrared light beams that have propagated from the input-coupler to the output-coupler to exit the waveguide.

16. An apparatus for use in tracking an eye that is illuminated by infrared light having an infrared wavelength, the apparatus comprising:

a waveguide that is transparent and includes an input-coupler and an output-coupler,

the input-coupler comprising two or more electronically switchable diffractive gratings arranged relative to one another such that the two or more electronically switchable diffractive gratings have different fields-of-view than one another, and

each of the electronically switchable diffractive gratings of the input-coupler, when turned on, adapted to receive infrared light having the infrared wavelength and couple the received infrared light into the waveguide;

an input-coupler controller that controls when each of the electronically switchable diffractive gratings is turned on, such that only one of the electronically switchable diffractive gratings is turned on at a time; and

a sensor that images an eye in dependence on infrared light beams that exit the waveguide at the output-coupler.

17. The apparatus of claim 16, wherein when the input-coupler is positioned in front of an eye that is illuminated with the infrared light, at least portion of the infrared light reflected from the eye and received by the input-coupler is coupled into the waveguide at the input-coupler, propagates within the waveguide from the input-coupler to the output-coupler by way of total internal reflections, and exits the waveguide proximate the output-coupler.

18. The apparatus of claim 16, further comprising:

an image analysis module that analyzes images, obtained using the sensor, to determine which one or more of the electronically switchable diffractive gratings, when turned on, includes an eye or portion thereof within its field-of-view.

19. The apparatus of claim 18, further comprising:

a processor that generates eye tracking data in dependence one or more images of the eye obtained using the sensor, and controls or modifies an aspect of an application based on the eye tracking data.

20. The apparatus of claim 16, wherein:

each of the electronically switchable diffractive gratings includes a lower boundary and an upper boundary, the upper boundary being closer to the output-coupler than the lower boundary; and

each of the electronically switchable diffractive gratings has a k-vector angle at the lower boundary that is greater than a k-vector angle of the electronically switchable diffractive gratings at the upper boundary, with k-vector angles between the lower and upper boundaries gradually decreasing as distances decrease between grating planes of the electronically switchable diffractive gratings and the upper boundary.