Eye Gaze Tracking

• US 20150241967A1
• Filed: 02/25/2015
• Published: 08/27/2015
• Est. Priority Date: 02/25/2014
• Status: Active Grant

• Current Assignee: Jumio Inc.
• Original Assignee: EyeVerify, Inc. (Ant Group Co., Ltd.)
• Inventors: SARIPALLE, Sashi Kanth, DERAKHSHANI, Reza, GOTTEMUKKULA, Vikas
• Granted Patent: US 9,939,893 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06T 2207/30041 Eye; Retina; Ophthalmic
• CPC Class Codes: G06T 2207/30201 Face
• CPC Class Codes: G06T 7/246 using feature-based methods, e.g. the tracking of corners or segments
• CPC Class Codes: G06V 40/18 Eye characteristics, e.g. of the iris

Abstract

Methods and systems for eye gaze tracking are provided, in which a plurality of images of at least one eye are received and, for each image of the eye(s), a plurality of stable vascular points associated with a vasculature of the eye(s) are identified. Based on the identified stable vascular points in the received images of the eye(s), a gaze angle of the eye(s) is determined.

Claims

1. A computer-implemented method comprising:

receiving a plurality of images of at least one eye;

for each received image of the at least one eye, identifying a plurality of stable vascular points associated with a vasculature of the at least one eye; and

determining a gaze angle of the at least one eye based on the identified stable vascular points in the received images of the at least one eye.

2. The method of claim 1, further comprising:

extracting a plurality of feature descriptors around the identified stable vascular points; and

creating a plurality of templates based on the feature descriptors and identified stable vascular points.

3. The method of claim 2, wherein determining the gaze angle comprises matching one or more of the templates with one or more enrollment templates to determine the gaze angle.

4. The method of claim 1, further comprising identifying one or more stable peri-ocular anchor points based on one or more of the received images of the at least one eye.

5. The method of claim 4, wherein determining the gaze angle comprises:

tracking one or more of the identified stable vascular points over time; and

determining the gaze angle based on a displacement of one or more of the identified stable vascular points relative to one or more of the stable peri-ocular anchor points.

6. The method of claim 5, wherein a particular stable peri-ocular anchor point comprises a corner of the at least one eye.

7. The method of claim 5, wherein the identified stable vascular points comprises stable vascular points on a left eye and a right eye, and wherein the stable peri-ocular anchor points comprise stable peri-ocular anchor points relative to the left eye and the right eye.

8. The method of claim 1, further comprising:

enhancing a contrast of a white part of the at least one eye in a particular received image of the at least one eye; and

removing noise from a white part of the at least one eye in a particular received image of the at least one eye.

9. The method of claim 8, wherein the noise comprises an eyelash.

10. The method of claim 1, further comprising determining an approximate location of an iris of the at least one eye based on a particular received image of the at least one eye.

11. A system comprising:

one or more computers programmed to perform operations comprising;

receiving a plurality of images of at least one eye;

for each received image of the at least one eye, identifying a plurality of stable vascular points associated with a vasculature of the at least one eye; and

determining a gaze angle of the at least one eye based on the identified stable vascular points in the received images of the at least one eye.

12. The system of claim 11, wherein the operations further comprise:

extracting a plurality of feature descriptors around the identified stable vascular points; and

creating a plurality of templates based on the feature descriptors and identified stable vascular points.

13. The system of claim 12, wherein determining the gaze angle comprises matching one or more of the templates with one or more enrollment templates to determine the gaze angle.

14. The system of claim 11, wherein the operations further comprise identifying one or more stable peri-ocular anchor points based on one or more of the received images of the at least one eye.

15. The system of claim 14, wherein determining the gaze angle comprises:

tracking one or more of the identified stable vascular points over time; and

determining the gaze angle based on a displacement of one or more of the identified stable vascular points relative to one or more of the stable peri-ocular anchor points.

16. The system of claim 15, wherein a particular stable peri-ocular anchor point comprises a corner of the at least one eye.

17. The system of claim 15, wherein the identified stable vascular points comprises stable vascular points on a left eye and a right eye, and wherein the stable peri-ocular anchor points comprise stable peri-ocular anchor points relative to the left eye and the right eye.

18. The system of claim 11, wherein the operations further comprise:

enhancing a contrast of a white part of the at least one eye in a particular received image of the at least one eye; and

removing noise from a white part of the at least one eye in a particular received image of the at least one eye.

19. The system of claim 18, wherein the noise comprises an eyelash.

20. The system of claim 11, wherein the operations further comprise determining an approximate location of an iris of the at least one eye based on a particular received image of the at least one eye.