Eyelid shape estimation
First Claim
Patent Images
1. A method for eye tracking, comprising:
- under control of a hardware processor;
generating an eye-box over an eye in an eye image for determining an eye pose of the eye in the eye image, wherein the eye pose comprises a direction toward which the eye is looking,wherein the eye-box has an upper edge and a lower edge,wherein the upper edge overlays a portion of an upper eyelid of the eye, andwherein the lower edge overlays a portion of a lower eyelid of the eye;
generating a plurality of radial lines extending from approximately the center of the eye-box to the upper edge or the lower edge;
determining candidate points on the plurality of radial lines using an edge detector;
determining parameters of a parabolic fit curve from a subset of the candidate points, wherein the parabolic fit curve is an estimation of an eyelid shape of the eye in the eye image;
determining a score of the parabolic fit curve is above a threshold score using the parameters of the parabolic fit curve;
determining that the parabolic fit curve is a preferred estimation of the eyelid shape of the eye in the eye image; and
determining the eye pose of the eye in the eye image using parameters of the preferred estimation of the eyelid shape; and
tracking the eye in the eye image using the eye pose of the eye in the eye image.
4 Assignments
0 Petitions
Accused Products
Abstract
Systems and methods for eyelid shape estimation are disclosed. In one aspect, after receiving an eye image of an eye (e.g., from an image capture device), an eye-box is generated over an iris of the eye in the eye image. A plurality of radial lines can be generated from approximately the center of the eye-box to an upper edge or a lower edge of the eye box. Candidate points can be determined to have local maximum derivatives along the plurality of radial lines. From the candidate points, an eyelid shape curve (e.g., for an upper eyelid or a lower eyelid) can be determined by fitting a curve (e.g., a parabola or a polynomial) to the candidate points or a subset of the candidate points.
-
Citations
18 Claims
-
1. A method for eye tracking, comprising:
under control of a hardware processor; generating an eye-box over an eye in an eye image for determining an eye pose of the eye in the eye image, wherein the eye pose comprises a direction toward which the eye is looking, wherein the eye-box has an upper edge and a lower edge, wherein the upper edge overlays a portion of an upper eyelid of the eye, and wherein the lower edge overlays a portion of a lower eyelid of the eye; generating a plurality of radial lines extending from approximately the center of the eye-box to the upper edge or the lower edge; determining candidate points on the plurality of radial lines using an edge detector; determining parameters of a parabolic fit curve from a subset of the candidate points, wherein the parabolic fit curve is an estimation of an eyelid shape of the eye in the eye image; determining a score of the parabolic fit curve is above a threshold score using the parameters of the parabolic fit curve; determining that the parabolic fit curve is a preferred estimation of the eyelid shape of the eye in the eye image; and determining the eye pose of the eye in the eye image using parameters of the preferred estimation of the eyelid shape; and tracking the eye in the eye image using the eye pose of the eye in the eye image. - View Dependent Claims (2, 3, 4, 5)
-
6. A head mounted display (HMD) system comprising:
-
an image capture device for tracking an eye pose of an eye of a wearer of the HMD system in an eye image of the eye of the wearer, wherein the eye pose comprises a direction toward which the eye is looking; non-transitory memory configured to store the eye image and an edge detector; a display for providing virtual image information to the wearer of the HMD system based on the eye pose of the wearer in the eye image; and a hardware processor in communication with the non-transitory memory, the hardware processor programmed to; receive the eye image from the image capture device; generate an eye-box around an iris of the eye, wherein a first edge of the eye-box is tangent to a limbic boundary of the eye; generate a plurality of lines extending to a second edge of the eye-box; determine candidate points on the plurality of lines in the eye image using the edge detector; determine parameters of an eyelid shape of the eye using a first subset of the candidate points; determine the eye pose of the eye using the parameters of the eyelid shape of the eye; determine the virtual image information to be provided to the wearer of the HMD using the eye pose of the eye; and cause the display to provide the virtual image information to the wearer of the HMD system. - View Dependent Claims (7, 8, 9, 10, 11, 12, 13, 14)
-
-
15. A method for eye tracking, the method comprising:
under control of a hardware processor; identifying a portion of an eye image comprising at least a portion of a pupil and an iris of an eye; generating a plurality of lines extending to an upper edge or a lower edge of the portion of the eye image; determining candidate points on the plurality of lines in the eye image using an edge detector; and determining parameters of an eyelid shape of the eye in the eye image using a subset of the candidate points comprising; determining a first functional form of the eyelid shape using a first subset of the candidate points; determining a second functional form of the eyelid shape using a second subset of the candidate points; determining a score of the first functional form of the eyelid shape; determining a score of the second functional form of the eyelid shape; and determining a preferred estimation of the eyelid shape is the first functional form of the eyelid shape if the score of the first functional form is greater than the score of the second functional form, and the second functional form of the eyelid shape otherwise; and determining an eye pose of the eye in the eye image using parameters of the preferred estimation of the eyelid shape, wherein the eye pose comprises a direction toward which the eye is looking; and tracking the eye in the eye image using the eye pose of the eye in the eye image. - View Dependent Claims (16, 17, 18)
Specification