EYE TRACKING SYSTEM AND METHOD

• US 20090196460A1
• Filed: 01/21/2009
• Published: 08/06/2009
• Est. Priority Date: 01/17/2008
• Status: Abandoned Application

• Current Assignee: InvoTek, Inc.
• Original Assignee: InvoTek, Inc.
• Inventors: Baker, Allen W., Jakobs, Thomas
• Application Number:
  US12/357,280
• Publication Number:
  US 20090196460A1
• Time in Patent Office: Days
• US Class Current: 382/103
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06V 40/19 Sensors therefor

Abstract

An eye tracking system and method is provided giving persons with severe disabilities the ability to access a computer through eye movement. A system comprising a head tracking system, an eye tracking system, a display device, and a processor which calculates the gaze point of the user is provided. The eye tracking method comprises determining the location and orientation of the head, determining the location and orientation of the eye, calculating the location of the center of rotation of the eye, and calculating the gaze point of the eye. A method for inputting to an electronic device a character selected by a user through alternate means is provided, the method comprising placing a cursor near the character to be selected by said user, shifting the characters on a set of keys which are closest to the cursor, tracking the movement of the character to be selected with the cursor, and identifying the character to be selected by comparing the direction of movement of the cursor with the direction of movement of the characters of the set of keys which are closest to the cursor.

Claims

1. An eye tracking system which tracks a gaze point of a user, said system comprising:

a head tracking system which determines the location and orientation of the head of said user;

an eye tracking system which determines the location and orientation of an eye of said user;

a display device which presents a calibrating image to said user; and

a processor which calculates the location of the center of rotation of said eye and the location of the gaze point of said user based on the location and orientation of the head of said user, the location and orientation of the center of said eye, and the location of a plurality of calibration points presented within the calibrating image.

2. The eye tracking system of claim 1, wherein said head tracking system includes:

a head tracking apparatus having a plurality of markers coupled to the head of said user; and

an image capture device which captures image data of said markers of said head tracking apparatus from a plurality of points of view.

3. The eye tracking system of claim 2, wherein said processor calculates the location and orientation of the head of said user based on the image data captured by said image capture device;

wherein said markers of said head tracking apparatus are within the field of view of each point of view of said image capture device, and

wherein the fields of view of each point of view overlap in the area where said head tracking apparatus is positioned.

4. The eye tracking system of claim 1, wherein said an eye tracking system includes:

an eye tracking device having a marker that indicates the orientation of said eye; and

an image capture device which captures image data of said marker of said eye tracking device from a plurality of points of view.

5. The eye tracking system of claim 4, wherein said processor calculates the location and orientation of said eye based on the image data captured by said image capture device;

wherein said marker of said eye tracking device is within the field of view of each point of view of said image capture device, and

wherein the fields of view of each point of view overlap in the area where said eye tracking device is positioned.

6. The eye tracking system of claim 2, wherein said image capture device includes a plurality of cameras, said cameras being positioned at different positions relative to said calibrating image.

7. The eye tracking system of claim 4, wherein said image capture device includes a plurality of cameras, said cameras being positioned at different positions relative to said calibrating image.

8. The eye tracking system of claim 4, wherein said eye tracking device comprises a contact lens to which said marker is coupled.

15. The eye tracking method of claim 8, wherein calculating the location of the center of rotation of said eye further comprises:

presenting a calibrating image in front of said user;

viewing sequentially a plurality of highlighted locations on said image;

determining the location of said eye while said user is viewing each highlighted location;

calculating the equation of each line from each highlighted location through the orientation of said eye; and

calculating the location of the center of rotation based on the point of intersection of the lines.

22. The method of claim 16, further comprising:

tracking the gaze point of said user using the eye tracking system according to claim 1.

9. An eye tracking method for locating the gaze point of a user, said method comprising the steps of:

determining the location and orientation of the head of said user;

determining the location and orientation of an eye of said user;

presenting a calibrating image to said user, said calibrating image having calibration points;

calculating the location of the center of rotation of said eye; and

calculating the location of the gaze point of said eye based on the location and orientation of the head, the location and orientation of said eye, the location of the calibration points, and the location of the center of rotation of said eye.

10. The eye tracking method of claim 9, wherein determining the location and orientation of the head of said user further comprises coupling to the head of said user a head tracking apparatus having a plurality of retroreflective dots.

11. The eye tracking method of claim 10, wherein determining the location and orientation of the head of said user further comprises capturing image data of said retroreflective dots of said head tracking apparatus from a plurality of points of view with overlapping fields of view.

12. The eye tracking method of claim 9, wherein determining the location and orientation of said eye further comprises coupling to said eye an eye tracking device having a retroreflective dot.

13. The eye tracking method of claim 12, wherein determining the location and orientation of said eye further comprises capturing image data of said retroreflective dot coupled to said eye from a plurality of points of view with overlapping fields of view.

14. The eye tracking method of claim 13, wherein determining the location and orientation of said eye is based on the captured image data in relation to the determined location and orientation of the head of said user.

16. A method for inputting to an electronic device a character selected by a user controlling a cursor, said method comprising:

displaying an array of characters, said array of characters comprising keys having multiple characters displayed thereon;

placing the cursor near the character to be selected by said user;

shifting the characters on a set of keys which are closest to the cursor such that characters not at similar positions on adjacent keys move in different directions and characters on the same key move in different directions;

tracking the movement of the character to be selected with the cursor; and

identifying the character to be selected by comparing the direction of movement of the cursor with the direction of movement of the characters of said set of keys which are closest to the cursor.

17. The method of claim 16, wherein the cursor is controlled by the user through eye pointing and tracking the gaze point of said user.

18. The method of claim 16, wherein the cursor is controlled by the user through head pointing and tracking the head point of said user.

19. The method of claim 16, wherein shifting the characters on a set of keys which are closest to the cursor comprises rotating the characters of the keys about the center of their respective key.

20. The method of claim 16, further comprising:

highlighting the keys of said set of keys which are closest to the cursor.

21. The method of claim 16, further comprising:

shifting the characters on said set of keys back to their original position;

23. The method of claim 16, wherein tracking the gaze point of said user includes the method according to claim 9.