PORTABLE EYE TRACKING DEVICE

• US 20170017299A1
• Filed: 09/27/2016
• Published: 01/19/2017
• Est. Priority Date: 09/03/2013
• Status: Active Grant

• Current Assignee: Tobii Technology AB
• Original Assignee: Tobii Technology AB
• Inventors: Biedert, Ralf, Thunstrm, Robin, Andersson, Jonas
• Granted Patent: US 10,310,597 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: A61B 3/113 for determining or recording eye movement
• CPC Class Codes: G02B 2027/0138 comprising image capture systems, e.g. camera
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 2027/0178 Eyeglass type eyeglass details G02C
• CPC Class Codes: G02B 2027/0187 slaved to motion of at least a part of the body of the user, e.g. head, eye
• CPC Class Codes: G02B 27/0093 with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G02B 27/0172 characterised by optical features
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06T 2207/10152 Varying illumination
• CPC Class Codes: G06T 2207/30201 Face
• CPC Class Codes: G06T 7/70 Determining position or orientation of objects or cameras camera calibration G06T7/80
• CPC Class Codes: G06T 7/74 involving reference images or patches
• CPC Class Codes: H04R 1/32 for obtaining desired directional characteristic only specially adapted for hearing aids H04R25/40
• CPC Class Codes: H04R 2201/40 Details of arrangements for obtaining desired directional characteristic by combining a number of identical transducers covered by H04R1/40 but not provided for in any of its subgroups

Abstract

A portable eye tracker device is disclosed which includes a frame, at least one optics holding member, a movement sensor, and a control unit. The frame may be a frame adapted for wearing by a user. The at least one optics holding member may include at least one illuminator configured to selectively illuminate at least a portion of at least one eye of the user, and at least one image sensor configured to capture image data representing images of at least a portion of at least one eye of the user. The movement sensor may be configured to detect movement of the frame. The control unit may be configured to control the at least one illuminator for the selective illumination of at least a portion of at least one eye of the user, receive the image data from the image sensors, and receive information from the movement sensor.

Claims

1. A method for calibrating a gaze detection system, wherein the method comprises:

displaying a virtual object in a virtual reality environment on a display of a wearable device worn by a user;

determining that the user is interacting with the virtual object;

determining a gaze direction of the user relative to the virtual object with an eye tracking device of the wearable device;

calibrating the eye tracking device based at least in part on the gaze direction.

2. The method for calibrating a gaze detection system of claim 1, wherein:

the method further comprises receiving an input; and

calibrating the eye tracking device occurs in response to the input.

3. The method for calibrating a gaze detection system of claim 2, wherein the input comprises:

an input from a hand held controller.

4. The method for calibrating a gaze detection system of claim 2, wherein the input comprises:

an interaction by the user with the virtual object that moves the virtual object closer to a particular portion of a virtual body of the user in the virtual reality environment.

5. The method for calibrating a gaze detection system of claim 2, wherein the input comprises:

the gaze direction remaining consistent for a predetermined amount of time.

6. The method for calibrating a gaze detection system of claim 1, wherein:

the virtual object comprises a salient feature; and

determining the gaze direction of the user relative to the virtual object comprises determining the gaze direction of the user relative to the salient feature.

7. The method for calibrating a gaze detection system of claim 1, wherein determining that the user is interacting with the virtual object comprises:

determining that the user has picked up the virtual object in the virtual reality environment.

8. The method for calibrating a gaze detection system of claim 1, wherein determining that the user is interacting with the virtual object comprises:

determining that the user has moved the virtual object in the virtual reality environment.

9. The method for calibrating a gaze detection system of claim 8, wherein the determining that the user has moved the virtual object comprises:

determining that the user has moved the virtual object closer to a particular portion of a virtual body of the user in the virtual reality environment.

10. A non-transitory machine-readable medium having instructions stored thereon for calibrating a gaze detection system, wherein the instructions are executable by at least one processor to at least:

display a virtual object in a virtual reality environment on a display of a wearable device worn by a user;

determine that the user is interacting with the virtual object;

determine a gaze direction of the user relative to the virtual object with an eye tracking device of the wearable device;

calibrate the eye tracking device based at least in part on the gaze direction.

11. The non-transitory machine-readable medium of claim 10, wherein the instructions are further executable to at least:

receive an input, wherein calibrating the eye tracking device occurs in response to the input.

12. The non-transitory machine-readable medium of claim 11, wherein the input comprises:

the gaze direction remaining consistent for a predetermined amount of time.

13. The non-transitory machine-readable medium of claim 10, wherein:

the virtual object comprises a salient feature; and

determining the gaze direction of the user relative to the virtual object comprises determining the gaze direction of the user relative to the salient feature.

14. The non-transitory machine-readable medium of claim 10, wherein determining that the user is interacting with the virtual object comprises:

determining that the user has picked up the virtual object in the virtual reality environment.

15. The non-transitory machine-readable medium of claim 10, wherein determining that the user is interacting with the virtual object comprises:

determining that the user has moved the virtual object in the virtual reality environment.

16. A system for determining a gaze direction of a user, wherein the system comprises:

a wearable device having a display and an eye tracking device;

one or more processors configured to at least;

display a virtual object in a virtual reality environment on the display;

determine that the user is interacting with the virtual object;

determine a gaze direction of the user relative to the virtual object with the eye tracking device;

calibrate the eye tracking device based at least in part on the gaze direction.

17. The system of claim 16, wherein the one or more processors are further configured to at least:

receive an input, wherein calibrating the eye tracking device occurs in response to the input.

18. The system of claim 16, wherein:

the virtual object comprises a salient feature; and

determining the gaze direction of the user relative to the virtual object comprises determining the gaze direction of the user relative to the salient feature.

19. The system of claim 16, wherein determining that the user is interacting with the virtual object comprises:

determining that the user has picked up the virtual object in the virtual reality environment.

20. The system of claim 16, wherein determining that the user is interacting with the virtual object comprises:

determining that the user has moved the virtual object in the virtual reality environment.