Eye tracking system with single point calibration
First Claim
1. A method comprising:
- obtaining cornea information for an eye of a user, the cornea information including a radius of a corneal sphere of the eye and location of a center of the corneal sphere;
capturing one or more reflections of a pupil of the eye of the user while the user is viewing content displayed on a head-mounted display (HMD);
determining a shape of the pupil based on the one or more captured pupil reflections;
identifying a three-dimensional plane parallel to the pupil, the three-dimensional plane identified based on the obtained cornea information and the identified pupil shape;
identifying a ray originating from the three-dimensional plane and perpendicular to a surface of the corneal sphere;
determining a pupillary axis for the pupil of the user based on the identified ray; and
performing an optical action based in part on the determined pupillary axis.
3 Assignments
0 Petitions
Accused Products
Abstract
A head mounted display (HMD) comprises an eye tracking system configured to perform a calibration process using an eye tracking system of the HMD that includes determining a pupillary axis and/or determining an angular offset between the pupillary axis and the eye'"'"'s true line of sight. The eye tracking system obtains an eye model captures images of the user'"'"'s pupil while the user is looking at a target or other content displayed on the HMD. In some embodiments, the calibration process is based on a single image of the user'"'"'s eye and is performed only once. For example, the process can be performed the first time the user uses the HMD, which stores the calibration data for the user in a memory for future use.
-
Citations
20 Claims
-
1. A method comprising:
-
obtaining cornea information for an eye of a user, the cornea information including a radius of a corneal sphere of the eye and location of a center of the corneal sphere; capturing one or more reflections of a pupil of the eye of the user while the user is viewing content displayed on a head-mounted display (HMD); determining a shape of the pupil based on the one or more captured pupil reflections; identifying a three-dimensional plane parallel to the pupil, the three-dimensional plane identified based on the obtained cornea information and the identified pupil shape; identifying a ray originating from the three-dimensional plane and perpendicular to a surface of the corneal sphere; determining a pupillary axis for the pupil of the user based on the identified ray; and performing an optical action based in part on the determined pupillary axis. - View Dependent Claims (2, 3, 4, 5, 6, 7)
-
-
8. A head mounted display (HMD) comprising:
an eye tracking system including; two or more illumination sources configured to illuminate an eye of a user, a detector configured to capture light reflected from at least one of a cornea or a pupil of the eye of the user as an image, and a control module configured to; obtain cornea information for an eye of a user, the cornea information including a radius of a corneal sphere of the eye and location of a center of the corneal sphere, illuminate the eye of the user with light from the two or more illumination sources, capture, at the detector, one or more reflections of the pupil of the eye of the user while the user is viewing content displayed by the HMD, determine a shape of the pupil based on the one or more captured pupil reflections; identify a three-dimensional plane parallel to the pupil, the three-dimensional plane identified based on the obtained cornea information and the identified pupil shape; identify a ray originating from the three-dimensional plane and perpendicular to a surface of the corneal sphere; determine a pupillary axis for the pupil of the user based on the identified ray; and perform an optical action based in part on the determined pupillary axis. - View Dependent Claims (9, 10, 11, 12, 13)
-
14. A head mounted display (HMD) comprising:
-
an electronic display configured to display images to the user; an optics block configured to magnify light received by the optics block from the electronic display; and an eye tracking system including; two or more illumination sources configured to illuminate an eye of a user, a detector configured to capture light reflected from at least one of a cornea or a pupil of the eye of the user as an image, and a control module configured to; obtain cornea information for an eye of a user, the cornea information including a radius of a corneal sphere of the eye and location of a center of the corneal sphere, illuminate the eye of the user with light from the two or more illumination sources, capture, at the detector, one or more reflections of the pupil of the eye of the user while the user is viewing content displayed by the HMD, determine a shape of the pupil based on the one or more captured pupil reflections; identify a three-dimensional plane parallel to the pupil, the three-dimensional plane identified based on the obtained cornea information and the identified pupil shape; identify a ray originating from the three-dimensional plane and perpendicular to a surface of the corneal sphere; determine a pupillary axis for the pupil of the user based on the identified ray; identify a foveal centralis region of the eye of the user; determine a second ray originating from the foveal centralis region of the eye and passing through the pupil corresponding to a true line of sight of the user; determine an angular offset between the determined pupillary axis for the pupil of the user and the true line of sight of the user; and perform an optical action based in part on the angular offset between the determined pupillary axis for the pupil of the user and the true line of sight of the user. - View Dependent Claims (15, 16, 17, 18, 19, 20)
-
Specification