SYSTEMS AND METHODS OF LIGHT MODULATION IN EYE TRACKING DEVICES

• US 20150199559A1
• Filed: 01/09/2015
• Published: 07/16/2015
• Est. Priority Date: 01/10/2014
• Status: Active Grant

• Current Assignee: META Platforms Technologies LLC (Meta Platforms, Inc. (f/k/a Facebook, Inc.))
• Original Assignee: The Eye Tribe APS (Meta Platforms, Inc. (f/k/a Facebook, Inc.))
• Inventors: Sztuk, Sebastian, Tall, Martin Henrik, Lopez, Javier San Agustin
• Granted Patent: US 9,836,639 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06T 2207/10004 Still image; Photographic image
• CPC Class Codes: G06T 2207/30201 Face
• CPC Class Codes: G06T 7/70 Determining position or orientation of objects or cameras camera calibration G06T7/80
• CPC Class Codes: G06V 40/166 using acquisition arrangements
• CPC Class Codes: G06V 40/19 Sensors therefor
• CPC Class Codes: H04N 23/61 based on recognised objects
• CPC Class Codes: H04N 23/611 where the recognised objects include parts of the human body
• CPC Class Codes: H04N 23/651 for reducing power consumption by affecting camera operations, e.g. sleep mode, hibernation mode or power off of selective parts of the camera
• CPC Class Codes: H04N 23/6812 based on additional sensors, e.g. acceleration sensors
• CPC Class Codes: H04N 23/684 performed by controlling the image sensor readout, e.g. by controlling the integration time
• CPC Class Codes: H04N 23/73 by influencing the exposure time

Abstract

An image of a user'"'"'s eyes and face may be analyzed using computer-vision algorithms. A computing device may use the image to determine the location of the user'"'"'s eyes and estimate the direction in which the user is looking. The eye tracking technology may be used in a wide range of lighting conditions and with many different and varying light levels. When a user is near a light source, an automatic exposure feature in the camera may result in the user'"'"'s face and eyes appearing too dark in the image, possibly reducing the likelihood of face and eye detection. Adjusting attributes such as the camera exposure time and the intensity and illumination interval of the light sources based on motion and light levels may improve detection of a user'"'"'s features.

Claims

1. A method comprising:

capturing an image using a camera of an eye tracking device;

detecting a face region of the image, the face region depicting the face of a user;

based on at least a portion of the face region, measuring a parameter of the image;

based on the parameter of the image being outside of a target range, adjusting an attribute associated with the eye tracking device; and

determining, using the eye tracking device, gaze direction of the user after the attribute is adjusted.

2. The method of claim 1, wherein the measuring of the parameter of the image includes measuring a contrast of the image.

3. The method of claim 1, wherein the measuring of the parameter of the image includes measuring a brightness of the image.

4. The method of claim 1, wherein the measuring of the parameter of the image includes attempting to detect facial features of the user.

5. The method of claim 1, wherein the adjusting of the attribute includes determining a value for the attribute that places the parameter at the center of the target range.

6. The method of claim 1, wherein the attribute is a camera exposure time of the camera.

7. The method of claim 1, wherein the attribute is a camera gain of the camera.

8. The method of claim 1, wherein the attribute is a camera f-number of the camera.

9. The method of claim 1, wherein the attribute is a camera frame rate of the camera.

10. The method of claim 1, wherein the attribute is a light intensity of a light source of the eye tracking device.

11. A computing device comprising:

a camera module configured to capture an image;

an attribute adjustment module configured to;

detect a face region of the image, the face region depicting the face of a user;

based on at least a portion of the face region, measure a parameter of the image;

based on the parameter of the image being outside of a target range, adjusting an attribute associated with the camera module; and

an eye tracking module configured to determine gaze direction of the user after the attribute is adjusted.

12. The computing device of claim 11, further comprising a light source module configured to emit light while the image is captured.

13. The computing device of claim 11, wherein the measuring of the parameter of the image includes measuring a contrast of the image.

14. The computing device of claim 11, wherein the measuring of the parameter of the image includes measuring a brightness of the image.

15. The computing device of claim 11, wherein the measuring of the parameter of the image includes attempting to detect facial features of the user.

16. The computing device of claim 11, wherein the adjusting of the attribute includes determining a value for the attribute that places the parameter at the center of the target range.

17. The computing device of claim 11, wherein the attribute is a camera exposure time of the camera module.

18. The computing device of claim 11, wherein the attribute is a camera gain of the camera module.

19. The computing device of claim 11, wherein the attribute is a camera f-number of the camera module.

20. A machine-readable storage medium storing instructions which, when executed by one or more processors, cause the one or more processors to perform operations comprising:

capturing an image using a camera of an eye tracking device;

detecting a face region of the image, the face region depicting the face of a user;

based on at least a portion of the face region, measuring a parameter of the image;

based on the parameter of the image being outside of a target range, adjusting an attribute associated with the eye tracking device; and

determining, using the eye tracking device, gaze direction of the user after the attribute is adjusted.